Dynamic Neural Networks Supporting Memory Retrieval

PubMed Central

St. Jacques, Peggy L.; Kragel, Philip A.; Rubin, David C.

2011-01-01

How do separate neural networks interact to support complex cognitive processes such as remembrance of the personal past? Autobiographical memory (AM) retrieval recruits a consistent pattern of activation that potentially comprises multiple neural networks. However, it is unclear how such large-scale neural networks interact and are modulated by properties of the memory retrieval process. In the present functional MRI (fMRI) study, we combined independent component analysis (ICA) and dynamic causal modeling (DCM) to understand the neural networks supporting AM retrieval. ICA revealed four task-related components consistent with the previous literature: 1) Medial Prefrontal Cortex (PFC) Network, associated with self-referential processes, 2) Medial Temporal Lobe (MTL) Network, associated with memory, 3) Frontoparietal Network, associated with strategic search, and 4) Cingulooperculum Network, associated with goal maintenance. DCM analysis revealed that the medial PFC network drove activation within the system, consistent with the importance of this network to AM retrieval. Additionally, memory accessibility and recollection uniquely altered connectivity between these neural networks. Recollection modulated the influence of the medial PFC on the MTL network during elaboration, suggesting that greater connectivity among subsystems of the default network supports greater re-experience. In contrast, memory accessibility modulated the influence of frontoparietal and MTL networks on the medial PFC network, suggesting that ease of retrieval involves greater fluency among the multiple networks contributing to AM. These results show the integration between neural networks supporting AM retrieval and the modulation of network connectivity by behavior. PMID:21550407

Space-Time Neural Networks

NASA Technical Reports Server (NTRS)

Villarreal, James A.; Shelton, Robert O.

1992-01-01

Concept of space-time neural network affords distributed temporal memory enabling such network to model complicated dynamical systems mathematically and to recognize temporally varying spatial patterns. Digital filters replace synaptic-connection weights of conventional back-error-propagation neural network.

Design of a MIMD neural network processor

NASA Astrophysics Data System (ADS)

Saeks, Richard E.; Priddy, Kevin L.; Pap, Robert M.; Stowell, S.

1994-03-01

The Accurate Automation Corporation (AAC) neural network processor (NNP) module is a fully programmable multiple instruction multiple data (MIMD) parallel processor optimized for the implementation of neural networks. The AAC NNP design fully exploits the intrinsic sparseness of neural network topologies. Moreover, by using a MIMD parallel processing architecture one can update multiple neurons in parallel with efficiency approaching 100 percent as the size of the network increases. Each AAC NNP module has 8 K neurons and 32 K interconnections and is capable of 140,000,000 connections per second with an eight processor array capable of over one billion connections per second.

Identification of the connections in biologically inspired neural networks

NASA Technical Reports Server (NTRS)

Demuth, H.; Leung, K.; Beale, M.; Hicklin, J.

1990-01-01

We developed an identification method to find the strength of the connections between neurons from their behavior in small biologically-inspired artificial neural networks. That is, given the network external inputs and the temporal firing pattern of the neurons, we can calculate a solution for the strengths of the connections between neurons and the initial neuron activations if a solution exists. The method determines directly if there is a solution to a particular neural network problem. No training of the network is required. It should be noted that this is a first pass at the solution of a difficult problem. The neuron and network models chosen are related to biology but do not contain all of its complexities, some of which we hope to add to the model in future work. A variety of new results have been obtained. First, the method has been tailored to produce connection weight matrix solutions for networks with important features of biological neural (bioneural) networks. Second, a computationally efficient method of finding a robust central solution has been developed. This later method also enables us to find the most consistent solution in the presence of noisy data. Prospects of applying our method to identify bioneural network connections are exciting because such connections are almost impossible to measure in the laboratory. Knowledge of such connections would facilitate an understanding of bioneural networks and would allow the construction of the electronic counterparts of bioneural networks on very large scale integrated (VLSI) circuits.

Structure-function relationships during segregated and integrated network states of human brain functional connectivity.

PubMed

Fukushima, Makoto; Betzel, Richard F; He, Ye; van den Heuvel, Martijn P; Zuo, Xi-Nian; Sporns, Olaf

2018-04-01

Structural white matter connections are thought to facilitate integration of neural information across functionally segregated systems. Recent studies have demonstrated that changes in the balance between segregation and integration in brain networks can be tracked by time-resolved functional connectivity derived from resting-state functional magnetic resonance imaging (rs-fMRI) data and that fluctuations between segregated and integrated network states are related to human behavior. However, how these network states relate to structural connectivity is largely unknown. To obtain a better understanding of structural substrates for these network states, we investigated how the relationship between structural connectivity, derived from diffusion tractography, and functional connectivity, as measured by rs-fMRI, changes with fluctuations between segregated and integrated states in the human brain. We found that the similarity of edge weights between structural and functional connectivity was greater in the integrated state, especially at edges connecting the default mode and the dorsal attention networks. We also demonstrated that the similarity of network partitions, evaluated between structural and functional connectivity, increased and the density of direct structural connections within modules in functional networks was elevated during the integrated state. These results suggest that, when functional connectivity exhibited an integrated network topology, structural connectivity and functional connectivity were more closely linked to each other and direct structural connections mediated a larger proportion of neural communication within functional modules. Our findings point out the possibility of significant contributions of structural connections to integrative neural processes underlying human behavior.

Synchronization and long-time memory in neural networks with inhibitory hubs and synaptic plasticity

NASA Astrophysics Data System (ADS)

Bertolotti, Elena; Burioni, Raffaella; di Volo, Matteo; Vezzani, Alessandro

2017-01-01

We investigate the dynamical role of inhibitory and highly connected nodes (hub) in synchronization and input processing of leaky-integrate-and-fire neural networks with short term synaptic plasticity. We take advantage of a heterogeneous mean-field approximation to encode the role of network structure and we tune the fraction of inhibitory neurons fI and their connectivity level to investigate the cooperation between hub features and inhibition. We show that, depending on fI, highly connected inhibitory nodes strongly drive the synchronization properties of the overall network through dynamical transitions from synchronous to asynchronous regimes. Furthermore, a metastable regime with long memory of external inputs emerges for a specific fraction of hub inhibitory neurons, underlining the role of inhibition and connectivity also for input processing in neural networks.

Linking structure and activity in nonlinear spiking networks

PubMed Central

Josić, Krešimir; Shea-Brown, Eric

2017-01-01

Recent experimental advances are producing an avalanche of data on both neural connectivity and neural activity. To take full advantage of these two emerging datasets we need a framework that links them, revealing how collective neural activity arises from the structure of neural connectivity and intrinsic neural dynamics. This problem of structure-driven activity has drawn major interest in computational neuroscience. Existing methods for relating activity and architecture in spiking networks rely on linearizing activity around a central operating point and thus fail to capture the nonlinear responses of individual neurons that are the hallmark of neural information processing. Here, we overcome this limitation and present a new relationship between connectivity and activity in networks of nonlinear spiking neurons by developing a diagrammatic fluctuation expansion based on statistical field theory. We explicitly show how recurrent network structure produces pairwise and higher-order correlated activity, and how nonlinearities impact the networks’ spiking activity. Our findings open new avenues to investigating how single-neuron nonlinearities—including those of different cell types—combine with connectivity to shape population activity and function. PMID:28644840

A hypercube compact neural network

DOE Office of Scientific and Technical Information (OSTI.GOV)

Rostykus, P.L.; Somani, A.K.

1988-09-01

A major problem facing implementation of neural networks is the connection problem. One popular tradeoff is to remove connections. Random disconnection severely degrades the capabilities. The hypercube based Compact Neural Network (CNN) has structured architecture combined with a rearrangement of the memory vectors gives a larger input space and better degradation than a cost equivalent network with more connections. The CNNs are based on a Hopfield network. The changes from the Hopfield net include states of -1 and +1 and when a node was evaluated to 0, it was not biased either positive or negative, instead it resumed its previousmore » state. L = PEs, N = memories and t/sub ij/s is the weights between i and j.« less

Electronic implementation of associative memory based on neural network models

NASA Technical Reports Server (NTRS)

Moopenn, A.; Lambe, John; Thakoor, A. P.

1987-01-01

An electronic embodiment of a neural network based associative memory in the form of a binary connection matrix is described. The nature of false memory errors, their effect on the information storage capacity of binary connection matrix memories, and a novel technique to eliminate such errors with the help of asymmetrical extra connections are discussed. The stability of the matrix memory system incorporating a unique local inhibition scheme is analyzed in terms of local minimization of an energy function. The memory's stability, dynamic behavior, and recall capability are investigated using a 32-'neuron' electronic neural network memory with a 1024-programmable binary connection matrix.

Application of the ANNA neural network chip to high-speed character recognition.

PubMed

Sackinger, E; Boser, B E; Bromley, J; Lecun, Y; Jackel, L D

1992-01-01

A neural network with 136000 connections for recognition of handwritten digits has been implemented using a mixed analog/digital neural network chip. The neural network chip is capable of processing 1000 characters/s. The recognition system has essentially the same rate (5%) as a simulation of the network with 32-b floating-point precision.

Development and function of human cerebral cortex neural networks from pluripotent stem cells in vitro

PubMed Central

Kirwan, Peter; Turner-Bridger, Benita; Peter, Manuel; Momoh, Ayiba; Arambepola, Devika; Robinson, Hugh P. C.; Livesey, Frederick J.

2015-01-01

A key aspect of nervous system development, including that of the cerebral cortex, is the formation of higher-order neural networks. Developing neural networks undergo several phases with distinct activity patterns in vivo, which are thought to prune and fine-tune network connectivity. We report here that human pluripotent stem cell (hPSC)-derived cerebral cortex neurons form large-scale networks that reflect those found in the developing cerebral cortex in vivo. Synchronised oscillatory networks develop in a highly stereotyped pattern over several weeks in culture. An initial phase of increasing frequency of oscillations is followed by a phase of decreasing frequency, before giving rise to non-synchronous, ordered activity patterns. hPSC-derived cortical neural networks are excitatory, driven by activation of AMPA- and NMDA-type glutamate receptors, and can undergo NMDA-receptor-mediated plasticity. Investigating single neuron connectivity within PSC-derived cultures, using rabies-based trans-synaptic tracing, we found two broad classes of neuronal connectivity: most neurons have small numbers (<10) of presynaptic inputs, whereas a small set of hub-like neurons have large numbers of synaptic connections (>40). These data demonstrate that the formation of hPSC-derived cortical networks mimics in vivo cortical network development and function, demonstrating the utility of in vitro systems for mechanistic studies of human forebrain neural network biology. PMID:26395144

Development and function of human cerebral cortex neural networks from pluripotent stem cells in vitro.

PubMed

Kirwan, Peter; Turner-Bridger, Benita; Peter, Manuel; Momoh, Ayiba; Arambepola, Devika; Robinson, Hugh P C; Livesey, Frederick J

2015-09-15

A key aspect of nervous system development, including that of the cerebral cortex, is the formation of higher-order neural networks. Developing neural networks undergo several phases with distinct activity patterns in vivo, which are thought to prune and fine-tune network connectivity. We report here that human pluripotent stem cell (hPSC)-derived cerebral cortex neurons form large-scale networks that reflect those found in the developing cerebral cortex in vivo. Synchronised oscillatory networks develop in a highly stereotyped pattern over several weeks in culture. An initial phase of increasing frequency of oscillations is followed by a phase of decreasing frequency, before giving rise to non-synchronous, ordered activity patterns. hPSC-derived cortical neural networks are excitatory, driven by activation of AMPA- and NMDA-type glutamate receptors, and can undergo NMDA-receptor-mediated plasticity. Investigating single neuron connectivity within PSC-derived cultures, using rabies-based trans-synaptic tracing, we found two broad classes of neuronal connectivity: most neurons have small numbers (<10) of presynaptic inputs, whereas a small set of hub-like neurons have large numbers of synaptic connections (>40). These data demonstrate that the formation of hPSC-derived cortical networks mimics in vivo cortical network development and function, demonstrating the utility of in vitro systems for mechanistic studies of human forebrain neural network biology. © 2015. Published by The Company of Biologists Ltd.

Reduced Synchronization Persistence in Neural Networks Derived from Atm-Deficient Mice

PubMed Central

Levine-Small, Noah; Yekutieli, Ziv; Aljadeff, Jonathan; Boccaletti, Stefano; Ben-Jacob, Eshel; Barzilai, Ari

2011-01-01

Many neurodegenerative diseases are characterized by malfunction of the DNA damage response. Therefore, it is important to understand the connection between system level neural network behavior and DNA. Neural networks drawn from genetically engineered animals, interfaced with micro-electrode arrays allowed us to unveil connections between networks’ system level activity properties and such genome instability. We discovered that Atm protein deficiency, which in humans leads to progressive motor impairment, leads to a reduced synchronization persistence compared to wild type synchronization, after chemically imposed DNA damage. Not only do these results suggest a role for DNA stability in neural network activity, they also establish an experimental paradigm for empirically determining the role a gene plays on the behavior of a neural network. PMID:21519382

Changes in the interaction of resting-state neural networks from adolescence to adulthood.

PubMed

Stevens, Michael C; Pearlson, Godfrey D; Calhoun, Vince D

2009-08-01

This study examined how the mutual interactions of functionally integrated neural networks during resting-state fMRI differed between adolescence and adulthood. Independent component analysis (ICA) was used to identify functionally connected neural networks in 100 healthy participants aged 12-30 years. Hemodynamic timecourses that represented integrated neural network activity were analyzed with tools that quantified system "causal density" estimates, which indexed the proportion of significant Granger causality relationships among system nodes. Mutual influences among networks decreased with age, likely reflecting stronger within-network connectivity and more efficient between-network influences with greater development. Supplemental tests showed that this normative age-related reduction in causal density was accompanied by fewer significant connections to and from each network, regional increases in the strength of functional integration within networks, and age-related reductions in the strength of numerous specific system interactions. The latter included paths between lateral prefrontal-parietal circuits and "default mode" networks. These results contribute to an emerging understanding that activity in widely distributed networks thought to underlie complex cognition influences activity in other networks. (c) 2009 Wiley-Liss, Inc.

Toward the Development of an Artificial Brain on a Micropatterned and Material-Regulated Biochip by Guiding and Promoting the Differentiation and Neurite Outgrowth of Neural Stem/Progenitor Cells.

PubMed

Liu, Yung-Chiang; Lee, I-Chi; Lei, Kin Fong

2018-02-14

An in vitro model mimicking the in vivo environment of the brain must be developed to study neural communication and regeneration and to obtain an understanding of cellular and molecular responses. In this work, a multilayered neural network was successfully constructed on a biochip by guiding and promoting neural stem/progenitor cell differentiation and network formation. The biochip consisted of 3 × 3 arrays of cultured wells connected with channels. Neurospheroids were cultured on polyelectrolyte multilayer (PEM) films in the culture wells. Neurite outgrowth and neural differentiation were guided and promoted by the micropatterns and the PEM films. After 5 days in culture, a 3 × 3 neural network was constructed on the biochip. The function and the connections of the network were evaluated by immunocytochemistry and impedance measurements. Neurons were generated and produced functional and recyclable synaptic vesicles. Moreover, the electrical connections of the neural network were confirmed by measuring the impedance across the neurospheroids. The current work facilitates the development of an artificial brain on a chip for investigations of electrical stimulations and recordings of multilayered neural communication and regeneration.

Generalized Adaptive Artificial Neural Networks

NASA Technical Reports Server (NTRS)

Tawel, Raoul

1993-01-01

Mathematical model of supervised learning by artificial neural network provides for simultaneous adjustments of both temperatures of neurons and synaptic weights, and includes feedback as well as feedforward synaptic connections. Extension of mathematical model described in "Adaptive Neurons For Artificial Neural Networks" (NPO-17803). Dynamics of neural network represented in new model by less-restrictive continuous formalism.

Neural-like growing networks

NASA Astrophysics Data System (ADS)

Yashchenko, Vitaliy A.

2000-03-01

On the basis of the analysis of scientific ideas reflecting the law in the structure and functioning the biological structures of a brain, and analysis and synthesis of knowledge, developed by various directions in Computer Science, also there were developed the bases of the theory of a new class neural-like growing networks, not having the analogue in world practice. In a base of neural-like growing networks the synthesis of knowledge developed by classical theories - semantic and neural of networks is. The first of them enable to form sense, as objects and connections between them in accordance with construction of the network. With thus each sense gets a separate a component of a network as top, connected to other tops. In common it quite corresponds to structure reflected in a brain, where each obvious concept is presented by certain structure and has designating symbol. Secondly, this network gets increased semantic clearness at the expense owing to formation not only connections between neural by elements, but also themselves of elements as such, i.e. here has a place not simply construction of a network by accommodation sense structures in environment neural of elements, and purely creation of most this environment, as of an equivalent of environment of memory. Thus neural-like growing networks are represented by the convenient apparatus for modeling of mechanisms of teleological thinking, as a fulfillment of certain psychophysiological of functions.

A neural network with modular hierarchical learning

NASA Technical Reports Server (NTRS)

Baldi, Pierre F. (Inventor); Toomarian, Nikzad (Inventor)

1994-01-01

This invention provides a new hierarchical approach for supervised neural learning of time dependent trajectories. The modular hierarchical methodology leads to architectures which are more structured than fully interconnected networks. The networks utilize a general feedforward flow of information and sparse recurrent connections to achieve dynamic effects. The advantages include the sparsity of units and connections, the modular organization. A further advantage is that the learning is much more circumscribed learning than in fully interconnected systems. The present invention is embodied by a neural network including a plurality of neural modules each having a pre-established performance capability wherein each neural module has an output outputting present results of the performance capability and an input for changing the present results of the performance capabilitiy. For pattern recognition applications, the performance capability may be an oscillation capability producing a repeating wave pattern as the present results. In the preferred embodiment, each of the plurality of neural modules includes a pre-established capability portion and a performance adjustment portion connected to control the pre-established capability portion.

Artificial neural networks as quantum associative memory

NASA Astrophysics Data System (ADS)

Hamilton, Kathleen; Schrock, Jonathan; Imam, Neena; Humble, Travis

We present results related to the recall accuracy and capacity of Hopfield networks implemented on commercially available quantum annealers. The use of Hopfield networks and artificial neural networks as content-addressable memories offer robust storage and retrieval of classical information, however, implementation of these models using currently available quantum annealers faces several challenges: the limits of precision when setting synaptic weights, the effects of spurious spin-glass states and minor embedding of densely connected graphs into fixed-connectivity hardware. We consider neural networks which are less than fully-connected, and also consider neural networks which contain multiple sparsely connected clusters. We discuss the effect of weak edge dilution on the accuracy of memory recall, and discuss how the multiple clique structure affects the storage capacity. Our work focuses on storage of patterns which can be embedded into physical hardware containing n < 1000 qubits. This work was supported by the United States Department of Defense and used resources of the Computational Research and Development Programs as Oak Ridge National Laboratory under Contract No. DE-AC0500OR22725 with the U. S. Department of Energy.

Unfolding the neutron spectrum of a NE213 scintillator using artificial neural networks.

PubMed

Sharghi Ido, A; Bonyadi, M R; Etaati, G R; Shahriari, M

2009-10-01

Artificial neural networks technology has been applied to unfold the neutron spectra from the pulse height distribution measured with NE213 liquid scintillator. Here, both the single and multi-layer perceptron neural network models have been implemented to unfold the neutron spectrum from an Am-Be neutron source. The activation function and the connectivity of the neurons have been investigated and the results have been analyzed in terms of the network's performance. The simulation results show that the neural network that utilizes the Satlins transfer function has the best performance. In addition, omitting the bias connection of the neurons improve the performance of the network. Also, the SCINFUL code is used for generating the response functions in the training phase of the process. Finally, the results of the neural network simulation have been compared with those of the FORIST unfolding code for both (241)Am-Be and (252)Cf neutron sources. The results of neural network are in good agreement with FORIST code.

Neural electrical activity and neural network growth.

PubMed

Gafarov, F M

2018-05-01

The development of central and peripheral neural system depends in part on the emergence of the correct functional connectivity in its input and output pathways. Now it is generally accepted that molecular factors guide neurons to establish a primary scaffold that undergoes activity-dependent refinement for building a fully functional circuit. However, a number of experimental results obtained recently shows that the neuronal electrical activity plays an important role in the establishing of initial interneuronal connections. Nevertheless, these processes are rather difficult to study experimentally, due to the absence of theoretical description and quantitative parameters for estimation of the neuronal activity influence on growth in neural networks. In this work we propose a general framework for a theoretical description of the activity-dependent neural network growth. The theoretical description incorporates a closed-loop growth model in which the neural activity can affect neurite outgrowth, which in turn can affect neural activity. We carried out the detailed quantitative analysis of spatiotemporal activity patterns and studied the relationship between individual cells and the network as a whole to explore the relationship between developing connectivity and activity patterns. The model, developed in this work will allow us to develop new experimental techniques for studying and quantifying the influence of the neuronal activity on growth processes in neural networks and may lead to a novel techniques for constructing large-scale neural networks by self-organization. Copyright © 2018 Elsevier Ltd. All rights reserved.

Ground states of partially connected binary neural networks

NASA Technical Reports Server (NTRS)

Baram, Yoram

1990-01-01

Neural networks defined by outer products of vectors over (-1, 0, 1) are considered. Patterns over (-1, 0, 1) define by their outer products partially connected neural networks consisting of internally strongly connected, externally weakly connected subnetworks. Subpatterns over (-1, 1) define subnetworks, and their combinations that agree in the common bits define permissible words. It is shown that the permissible words are locally stable states of the network, provided that each of the subnetworks stores mutually orthogonal subwords, or, at most, two subwords. It is also shown that when each of the subnetworks stores two mutually orthogonal binary subwords at most, the permissible words, defined as the combinations of the subwords (one corresponding to each subnetwork), that agree in their common bits are the unique ground states of the associated energy function.

Analog hardware for learning neural networks

NASA Technical Reports Server (NTRS)

Eberhardt, Silvio P. (Inventor)

1991-01-01

This is a recurrent or feedforward analog neural network processor having a multi-level neuron array and a synaptic matrix for storing weighted analog values of synaptic connection strengths which is characterized by temporarily changing one connection strength at a time to determine its effect on system output relative to the desired target. That connection strength is then adjusted based on the effect, whereby the processor is taught the correct response to training examples connection by connection.

Resting State fMRI Functional Connectivity-Based Classification Using a Convolutional Neural Network Architecture

PubMed Central

Meszlényi, Regina J.; Buza, Krisztian; Vidnyánszky, Zoltán

2017-01-01

Machine learning techniques have become increasingly popular in the field of resting state fMRI (functional magnetic resonance imaging) network based classification. However, the application of convolutional networks has been proposed only very recently and has remained largely unexplored. In this paper we describe a convolutional neural network architecture for functional connectome classification called connectome-convolutional neural network (CCNN). Our results on simulated datasets and a publicly available dataset for amnestic mild cognitive impairment classification demonstrate that our CCNN model can efficiently distinguish between subject groups. We also show that the connectome-convolutional network is capable to combine information from diverse functional connectivity metrics and that models using a combination of different connectivity descriptors are able to outperform classifiers using only one metric. From this flexibility follows that our proposed CCNN model can be easily adapted to a wide range of connectome based classification or regression tasks, by varying which connectivity descriptor combinations are used to train the network. PMID:29089883

Resting State fMRI Functional Connectivity-Based Classification Using a Convolutional Neural Network Architecture.

PubMed

Meszlényi, Regina J; Buza, Krisztian; Vidnyánszky, Zoltán

2017-01-01

Machine learning techniques have become increasingly popular in the field of resting state fMRI (functional magnetic resonance imaging) network based classification. However, the application of convolutional networks has been proposed only very recently and has remained largely unexplored. In this paper we describe a convolutional neural network architecture for functional connectome classification called connectome-convolutional neural network (CCNN). Our results on simulated datasets and a publicly available dataset for amnestic mild cognitive impairment classification demonstrate that our CCNN model can efficiently distinguish between subject groups. We also show that the connectome-convolutional network is capable to combine information from diverse functional connectivity metrics and that models using a combination of different connectivity descriptors are able to outperform classifiers using only one metric. From this flexibility follows that our proposed CCNN model can be easily adapted to a wide range of connectome based classification or regression tasks, by varying which connectivity descriptor combinations are used to train the network.

Neural Modularity Helps Organisms Evolve to Learn New Skills without Forgetting Old Skills

PubMed Central

Ellefsen, Kai Olav; Mouret, Jean-Baptiste; Clune, Jeff

2015-01-01

A long-standing goal in artificial intelligence is creating agents that can learn a variety of different skills for different problems. In the artificial intelligence subfield of neural networks, a barrier to that goal is that when agents learn a new skill they typically do so by losing previously acquired skills, a problem called catastrophic forgetting. That occurs because, to learn the new task, neural learning algorithms change connections that encode previously acquired skills. How networks are organized critically affects their learning dynamics. In this paper, we test whether catastrophic forgetting can be reduced by evolving modular neural networks. Modularity intuitively should reduce learning interference between tasks by separating functionality into physically distinct modules in which learning can be selectively turned on or off. Modularity can further improve learning by having a reinforcement learning module separate from sensory processing modules, allowing learning to happen only in response to a positive or negative reward. In this paper, learning takes place via neuromodulation, which allows agents to selectively change the rate of learning for each neural connection based on environmental stimuli (e.g. to alter learning in specific locations based on the task at hand). To produce modularity, we evolve neural networks with a cost for neural connections. We show that this connection cost technique causes modularity, confirming a previous result, and that such sparsely connected, modular networks have higher overall performance because they learn new skills faster while retaining old skills more and because they have a separate reinforcement learning module. Our results suggest (1) that encouraging modularity in neural networks may help us overcome the long-standing barrier of networks that cannot learn new skills without forgetting old ones, and (2) that one benefit of the modularity ubiquitous in the brains of natural animals might be to alleviate the problem of catastrophic forgetting. PMID:25837826

Neural modularity helps organisms evolve to learn new skills without forgetting old skills.

PubMed

Ellefsen, Kai Olav; Mouret, Jean-Baptiste; Clune, Jeff

2015-04-01

A long-standing goal in artificial intelligence is creating agents that can learn a variety of different skills for different problems. In the artificial intelligence subfield of neural networks, a barrier to that goal is that when agents learn a new skill they typically do so by losing previously acquired skills, a problem called catastrophic forgetting. That occurs because, to learn the new task, neural learning algorithms change connections that encode previously acquired skills. How networks are organized critically affects their learning dynamics. In this paper, we test whether catastrophic forgetting can be reduced by evolving modular neural networks. Modularity intuitively should reduce learning interference between tasks by separating functionality into physically distinct modules in which learning can be selectively turned on or off. Modularity can further improve learning by having a reinforcement learning module separate from sensory processing modules, allowing learning to happen only in response to a positive or negative reward. In this paper, learning takes place via neuromodulation, which allows agents to selectively change the rate of learning for each neural connection based on environmental stimuli (e.g. to alter learning in specific locations based on the task at hand). To produce modularity, we evolve neural networks with a cost for neural connections. We show that this connection cost technique causes modularity, confirming a previous result, and that such sparsely connected, modular networks have higher overall performance because they learn new skills faster while retaining old skills more and because they have a separate reinforcement learning module. Our results suggest (1) that encouraging modularity in neural networks may help us overcome the long-standing barrier of networks that cannot learn new skills without forgetting old ones, and (2) that one benefit of the modularity ubiquitous in the brains of natural animals might be to alleviate the problem of catastrophic forgetting.

Efficiently modeling neural networks on massively parallel computers

NASA Technical Reports Server (NTRS)

Farber, Robert M.

1993-01-01

Neural networks are a very useful tool for analyzing and modeling complex real world systems. Applying neural network simulations to real world problems generally involves large amounts of data and massive amounts of computation. To efficiently handle the computational requirements of large problems, we have implemented at Los Alamos a highly efficient neural network compiler for serial computers, vector computers, vector parallel computers, and fine grain SIMD computers such as the CM-2 connection machine. This paper describes the mapping used by the compiler to implement feed-forward backpropagation neural networks for a SIMD (Single Instruction Multiple Data) architecture parallel computer. Thinking Machines Corporation has benchmarked our code at 1.3 billion interconnects per second (approximately 3 gigaflops) on a 64,000 processor CM-2 connection machine (Singer 1990). This mapping is applicable to other SIMD computers and can be implemented on MIMD computers such as the CM-5 connection machine. Our mapping has virtually no communications overhead with the exception of the communications required for a global summation across the processors (which has a sub-linear runtime growth on the order of O(log(number of processors)). We can efficiently model very large neural networks which have many neurons and interconnects and our mapping can extend to arbitrarily large networks (within memory limitations) by merging the memory space of separate processors with fast adjacent processor interprocessor communications. This paper will consider the simulation of only feed forward neural network although this method is extendable to recurrent networks.

Multiple Resting-State Networks Are Associated With Tremors and Cognitive Features in Essential Tremor.

PubMed

Fang, Weidong; Chen, Huiyue; Wang, Hansheng; Zhang, Han; Liu, Mengqi; Puneet, Munankami; Lv, Fajin; Cheng, Oumei; Wang, Xuefeng; Lu, Xiurong; Luo, Tianyou

2015-12-01

The heterogeneous clinical features of essential tremor indicate that the dysfunctions of this syndrome are not confined to motor networks, but extend to nonmotor networks. Currently, these neural network dysfunctions in essential tremor remain unclear. In this study, independent component analysis of resting-state functional MRI was used to study these neural network mechanisms. Thirty-five essential tremor patients and 35 matched healthy controls with clinical and neuropsychological tests were included, and eight resting-state networks were identified. After considering the structure and head-motion factors and testing the reliability of the selected resting-state networks, we assessed the functional connectivity changes within or between resting-state networks. Finally, image-behavior correlation analysis was performed. Compared to healthy controls, essential tremor patients displayed increased functional connectivity in the sensorimotor and salience networks and decreased functional connectivity in the cerebellum network. Additionally, increased functional network connectivity was observed between anterior and posterior default mode networks, and a decreased functional network connectivity was noted between the cerebellum network and the sensorimotor and posterior default mode networks. Importantly, the functional connectivity changes within and between these resting-state networks were correlated with the tremor severity and total cognitive scores of essential tremor patients. The findings of this study provide the first evidence that functional connectivity changes within and between multiple resting-state networks are associated with tremors and cognitive features of essential tremor, and this work demonstrates a potential approach for identifying the underlying neural network mechanisms of this syndrome. © 2015 International Parkinson and Movement Disorder Society.

Functional neural networks underlying response inhibition in adolescents and adults.

PubMed

Stevens, Michael C; Kiehl, Kent A; Pearlson, Godfrey D; Calhoun, Vince D

2007-07-19

This study provides the first description of neural network dynamics associated with response inhibition in healthy adolescents and adults. Functional and effective connectivity analyses of whole brain hemodynamic activity elicited during performance of a Go/No-Go task were used to identify functionally integrated neural networks and characterize their causal interactions. Three response inhibition circuits formed a hierarchical, inter-dependent system wherein thalamic modulation of input to premotor cortex by fronto-striatal regions led to response suppression. Adolescents differed from adults in the degree of network engagement, regional fronto-striatal-thalamic connectivity, and network dynamics. We identify and characterize several age-related differences in the function of neural circuits that are associated with behavioral performance changes across adolescent development.

Functional neural networks underlying response inhibition in adolescents and adults

PubMed Central

Stevens, Michael C.; Kiehl, Kent A.; Pearlson, Godfrey D.; Calhoun, Vince D.

2008-01-01

This study provides the first description of neural network dynamics associated with response inhibition in healthy adolescents and adults. Functional and effective connectivity analyses of whole brain hemodynamic activity elicited during performance of a Go/No-Go task were used to identify functionally-integrated neural networks and characterize their causal interactions. Three response inhibition circuits formed a hierarchical, inter-dependent system wherein thalamic modulation of input to premotor cortex by frontostriatal regions led to response suppression. Adolescents differed from adults in the degree of network engagement, regional fronto-striatal-thalamic connectivity, and network dynamics. We identify and characterize several age-related differences in the function of neural circuits that are associated with behavioral performance changes across adolescent development. PMID:17467816

Artificial Neural Network with Regular Graph for Maximum Air Temperature Forecasting:. the Effect of Decrease in Nodes Degree on Learning

NASA Astrophysics Data System (ADS)

Ghaderi, A. H.; Darooneh, A. H.

The behavior of nonlinear systems can be analyzed by artificial neural networks. Air temperature change is one example of the nonlinear systems. In this work, a new neural network method is proposed for forecasting maximum air temperature in two cities. In this method, the regular graph concept is used to construct some partially connected neural networks that have regular structures. The learning results of fully connected ANN and networks with proposed method are compared. In some case, the proposed method has the better result than conventional ANN. After specifying the best network, the effect of input pattern numbers on the prediction is studied and the results show that the increase of input patterns has a direct effect on the prediction accuracy.

Network complexity as a measure of information processing across resting-state networks: evidence from the Human Connectome Project

PubMed Central

McDonough, Ian M.; Nashiro, Kaoru

2014-01-01

An emerging field of research focused on fluctuations in brain signals has provided evidence that the complexity of those signals, as measured by entropy, conveys important information about network dynamics (e.g., local and distributed processing). While much research has focused on how neural complexity differs in populations with different age groups or clinical disorders, substantially less research has focused on the basic understanding of neural complexity in populations with young and healthy brain states. The present study used resting-state fMRI data from the Human Connectome Project (Van Essen et al., 2013) to test the extent that neural complexity in the BOLD signal, as measured by multiscale entropy (1) would differ from random noise, (2) would differ between four major resting-state networks previously associated with higher-order cognition, and (3) would be associated with the strength and extent of functional connectivity—a complementary method of estimating information processing. We found that complexity in the BOLD signal exhibited different patterns of complexity from white, pink, and red noise and that neural complexity was differentially expressed between resting-state networks, including the default mode, cingulo-opercular, left and right frontoparietal networks. Lastly, neural complexity across all networks was negatively associated with functional connectivity at fine scales, but was positively associated with functional connectivity at coarse scales. The present study is the first to characterize neural complexity in BOLD signals at a high temporal resolution and across different networks and might help clarify the inconsistencies between neural complexity and functional connectivity, thus informing the mechanisms underlying neural complexity. PMID:24959130

Modeling fluctuations in default-mode brain network using a spiking neural network.

PubMed

Yamanishi, Teruya; Liu, Jian-Qin; Nishimura, Haruhiko

2012-08-01

Recently, numerous attempts have been made to understand the dynamic behavior of complex brain systems using neural network models. The fluctuations in blood-oxygen-level-dependent (BOLD) brain signals at less than 0.1 Hz have been observed by functional magnetic resonance imaging (fMRI) for subjects in a resting state. This phenomenon is referred to as a "default-mode brain network." In this study, we model the default-mode brain network by functionally connecting neural communities composed of spiking neurons in a complex network. Through computational simulations of the model, including transmission delays and complex connectivity, the network dynamics of the neural system and its behavior are discussed. The results show that the power spectrum of the modeled fluctuations in the neuron firing patterns is consistent with the default-mode brain network's BOLD signals when transmission delays, a characteristic property of the brain, have finite values in a given range.

Toward Rigorous Parameterization of Underconstrained Neural Network Models Through Interactive Visualization and Steering of Connectivity Generation

PubMed Central

Nowke, Christian; Diaz-Pier, Sandra; Weyers, Benjamin; Hentschel, Bernd; Morrison, Abigail; Kuhlen, Torsten W.; Peyser, Alexander

2018-01-01

Simulation models in many scientific fields can have non-unique solutions or unique solutions which can be difficult to find. Moreover, in evolving systems, unique final state solutions can be reached by multiple different trajectories. Neuroscience is no exception. Often, neural network models are subject to parameter fitting to obtain desirable output comparable to experimental data. Parameter fitting without sufficient constraints and a systematic exploration of the possible solution space can lead to conclusions valid only around local minima or around non-minima. To address this issue, we have developed an interactive tool for visualizing and steering parameters in neural network simulation models. In this work, we focus particularly on connectivity generation, since finding suitable connectivity configurations for neural network models constitutes a complex parameter search scenario. The development of the tool has been guided by several use cases—the tool allows researchers to steer the parameters of the connectivity generation during the simulation, thus quickly growing networks composed of multiple populations with a targeted mean activity. The flexibility of the software allows scientists to explore other connectivity and neuron variables apart from the ones presented as use cases. With this tool, we enable an interactive exploration of parameter spaces and a better understanding of neural network models and grapple with the crucial problem of non-unique network solutions and trajectories. In addition, we observe a reduction in turn around times for the assessment of these models, due to interactive visualization while the simulation is computed. PMID:29937723

A Novel Robot System Integrating Biological and Mechanical Intelligence Based on Dissociated Neural Network-Controlled Closed-Loop Environment.

PubMed

Li, Yongcheng; Sun, Rong; Wang, Yuechao; Li, Hongyi; Zheng, Xiongfei

2016-01-01

We propose the architecture of a novel robot system merging biological and artificial intelligence based on a neural controller connected to an external agent. We initially built a framework that connected the dissociated neural network to a mobile robot system to implement a realistic vehicle. The mobile robot system characterized by a camera and two-wheeled robot was designed to execute the target-searching task. We modified a software architecture and developed a home-made stimulation generator to build a bi-directional connection between the biological and the artificial components via simple binomial coding/decoding schemes. In this paper, we utilized a specific hierarchical dissociated neural network for the first time as the neural controller. Based on our work, neural cultures were successfully employed to control an artificial agent resulting in high performance. Surprisingly, under the tetanus stimulus training, the robot performed better and better with the increasement of training cycle because of the short-term plasticity of neural network (a kind of reinforced learning). Comparing to the work previously reported, we adopted an effective experimental proposal (i.e. increasing the training cycle) to make sure of the occurrence of the short-term plasticity, and preliminarily demonstrated that the improvement of the robot's performance could be caused independently by the plasticity development of dissociated neural network. This new framework may provide some possible solutions for the learning abilities of intelligent robots by the engineering application of the plasticity processing of neural networks, also for the development of theoretical inspiration for the next generation neuro-prostheses on the basis of the bi-directional exchange of information within the hierarchical neural networks.

A Novel Robot System Integrating Biological and Mechanical Intelligence Based on Dissociated Neural Network-Controlled Closed-Loop Environment

PubMed Central

Wang, Yuechao; Li, Hongyi; Zheng, Xiongfei

2016-01-01

We propose the architecture of a novel robot system merging biological and artificial intelligence based on a neural controller connected to an external agent. We initially built a framework that connected the dissociated neural network to a mobile robot system to implement a realistic vehicle. The mobile robot system characterized by a camera and two-wheeled robot was designed to execute the target-searching task. We modified a software architecture and developed a home-made stimulation generator to build a bi-directional connection between the biological and the artificial components via simple binomial coding/decoding schemes. In this paper, we utilized a specific hierarchical dissociated neural network for the first time as the neural controller. Based on our work, neural cultures were successfully employed to control an artificial agent resulting in high performance. Surprisingly, under the tetanus stimulus training, the robot performed better and better with the increasement of training cycle because of the short-term plasticity of neural network (a kind of reinforced learning). Comparing to the work previously reported, we adopted an effective experimental proposal (i.e. increasing the training cycle) to make sure of the occurrence of the short-term plasticity, and preliminarily demonstrated that the improvement of the robot’s performance could be caused independently by the plasticity development of dissociated neural network. This new framework may provide some possible solutions for the learning abilities of intelligent robots by the engineering application of the plasticity processing of neural networks, also for the development of theoretical inspiration for the next generation neuro-prostheses on the basis of the bi-directional exchange of information within the hierarchical neural networks. PMID:27806074

Neural Network Development Tool (NETS)

NASA Technical Reports Server (NTRS)

Baffes, Paul T.

1990-01-01

Artificial neural networks formed from hundreds or thousands of simulated neurons, connected in manner similar to that in human brain. Such network models learning behavior. Using NETS involves translating problem to be solved into input/output pairs, designing network configuration, and training network. Written in C.

Lateral Information Processing by Spiking Neurons: A Theoretical Model of the Neural Correlate of Consciousness

PubMed Central

Ebner, Marc; Hameroff, Stuart

2011-01-01

Cognitive brain functions, for example, sensory perception, motor control and learning, are understood as computation by axonal-dendritic chemical synapses in networks of integrate-and-fire neurons. Cognitive brain functions may occur either consciously or nonconsciously (on “autopilot”). Conscious cognition is marked by gamma synchrony EEG, mediated largely by dendritic-dendritic gap junctions, sideways connections in input/integration layers. Gap-junction-connected neurons define a sub-network within a larger neural network. A theoretical model (the “conscious pilot”) suggests that as gap junctions open and close, a gamma-synchronized subnetwork, or zone moves through the brain as an executive agent, converting nonconscious “auto-pilot” cognition to consciousness, and enhancing computation by coherent processing and collective integration. In this study we implemented sideways “gap junctions” in a single-layer artificial neural network to perform figure/ground separation. The set of neurons connected through gap junctions form a reconfigurable resistive grid or sub-network zone. In the model, outgoing spikes are temporally integrated and spatially averaged using the fixed resistive grid set up by neurons of similar function which are connected through gap-junctions. This spatial average, essentially a feedback signal from the neuron's output, determines whether particular gap junctions between neurons will open or close. Neurons connected through open gap junctions synchronize their output spikes. We have tested our gap-junction-defined sub-network in a one-layer neural network on artificial retinal inputs using real-world images. Our system is able to perform figure/ground separation where the laterally connected sub-network of neurons represents a perceived object. Even though we only show results for visual stimuli, our approach should generalize to other modalities. The system demonstrates a moving sub-network zone of synchrony, within which the contents of perception are represented and contained. This mobile zone can be viewed as a model of the neural correlate of consciousness in the brain. PMID:22046178

Lateral information processing by spiking neurons: a theoretical model of the neural correlate of consciousness.

PubMed

Ebner, Marc; Hameroff, Stuart

2011-01-01

Cognitive brain functions, for example, sensory perception, motor control and learning, are understood as computation by axonal-dendritic chemical synapses in networks of integrate-and-fire neurons. Cognitive brain functions may occur either consciously or nonconsciously (on "autopilot"). Conscious cognition is marked by gamma synchrony EEG, mediated largely by dendritic-dendritic gap junctions, sideways connections in input/integration layers. Gap-junction-connected neurons define a sub-network within a larger neural network. A theoretical model (the "conscious pilot") suggests that as gap junctions open and close, a gamma-synchronized subnetwork, or zone moves through the brain as an executive agent, converting nonconscious "auto-pilot" cognition to consciousness, and enhancing computation by coherent processing and collective integration. In this study we implemented sideways "gap junctions" in a single-layer artificial neural network to perform figure/ground separation. The set of neurons connected through gap junctions form a reconfigurable resistive grid or sub-network zone. In the model, outgoing spikes are temporally integrated and spatially averaged using the fixed resistive grid set up by neurons of similar function which are connected through gap-junctions. This spatial average, essentially a feedback signal from the neuron's output, determines whether particular gap junctions between neurons will open or close. Neurons connected through open gap junctions synchronize their output spikes. We have tested our gap-junction-defined sub-network in a one-layer neural network on artificial retinal inputs using real-world images. Our system is able to perform figure/ground separation where the laterally connected sub-network of neurons represents a perceived object. Even though we only show results for visual stimuli, our approach should generalize to other modalities. The system demonstrates a moving sub-network zone of synchrony, within which the contents of perception are represented and contained. This mobile zone can be viewed as a model of the neural correlate of consciousness in the brain.

Adaptive Neurons For Artificial Neural Networks

NASA Technical Reports Server (NTRS)

Tawel, Raoul

1990-01-01

Training time decreases dramatically. In improved mathematical model of neural-network processor, temperature of neurons (in addition to connection strengths, also called weights, of synapses) varied during supervised-learning phase of operation according to mathematical formalism and not heuristic rule. Evidence that biological neural networks also process information at neuronal level.

Synchronization and Inter-Layer Interactions of Noise-Driven Neural Networks

PubMed Central

Yuniati, Anis; Mai, Te-Lun; Chen, Chi-Ming

2017-01-01

In this study, we used the Hodgkin-Huxley (HH) model of neurons to investigate the phase diagram of a developing single-layer neural network and that of a network consisting of two weakly coupled neural layers. These networks are noise driven and learn through the spike-timing-dependent plasticity (STDP) or the inverse STDP rules. We described how these networks transited from a non-synchronous background activity state (BAS) to a synchronous firing state (SFS) by varying the network connectivity and the learning efficacy. In particular, we studied the interaction between a SFS layer and a BAS layer, and investigated how synchronous firing dynamics was induced in the BAS layer. We further investigated the effect of the inter-layer interaction on a BAS to SFS repair mechanism by considering three types of neuron positioning (random, grid, and lognormal distributions) and two types of inter-layer connections (random and preferential connections). Among these scenarios, we concluded that the repair mechanism has the largest effect for a network with the lognormal neuron positioning and the preferential inter-layer connections. PMID:28197088

Synchronization and Inter-Layer Interactions of Noise-Driven Neural Networks.

PubMed

Yuniati, Anis; Mai, Te-Lun; Chen, Chi-Ming

2017-01-01

In this study, we used the Hodgkin-Huxley (HH) model of neurons to investigate the phase diagram of a developing single-layer neural network and that of a network consisting of two weakly coupled neural layers. These networks are noise driven and learn through the spike-timing-dependent plasticity (STDP) or the inverse STDP rules. We described how these networks transited from a non-synchronous background activity state (BAS) to a synchronous firing state (SFS) by varying the network connectivity and the learning efficacy. In particular, we studied the interaction between a SFS layer and a BAS layer, and investigated how synchronous firing dynamics was induced in the BAS layer. We further investigated the effect of the inter-layer interaction on a BAS to SFS repair mechanism by considering three types of neuron positioning (random, grid, and lognormal distributions) and two types of inter-layer connections (random and preferential connections). Among these scenarios, we concluded that the repair mechanism has the largest effect for a network with the lognormal neuron positioning and the preferential inter-layer connections.

Machine Learning and Quantum Mechanics

NASA Astrophysics Data System (ADS)

Chapline, George

The author has previously pointed out some similarities between selforganizing neural networks and quantum mechanics. These types of neural networks were originally conceived of as away of emulating the cognitive capabilities of the human brain. Recently extensions of these networks, collectively referred to as deep learning networks, have strengthened the connection between self-organizing neural networks and human cognitive capabilities. In this note we consider whether hardware quantum devices might be useful for emulating neural networks with human-like cognitive capabilities, or alternatively whether implementations of deep learning neural networks using conventional computers might lead to better algorithms for solving the many body Schrodinger equation.

Recurrent Convolutional Neural Networks: A Better Model of Biological Object Recognition.

PubMed

Spoerer, Courtney J; McClure, Patrick; Kriegeskorte, Nikolaus

2017-01-01

Feedforward neural networks provide the dominant model of how the brain performs visual object recognition. However, these networks lack the lateral and feedback connections, and the resulting recurrent neuronal dynamics, of the ventral visual pathway in the human and non-human primate brain. Here we investigate recurrent convolutional neural networks with bottom-up (B), lateral (L), and top-down (T) connections. Combining these types of connections yields four architectures (B, BT, BL, and BLT), which we systematically test and compare. We hypothesized that recurrent dynamics might improve recognition performance in the challenging scenario of partial occlusion. We introduce two novel occluded object recognition tasks to test the efficacy of the models, digit clutter (where multiple target digits occlude one another) and digit debris (where target digits are occluded by digit fragments). We find that recurrent neural networks outperform feedforward control models (approximately matched in parametric complexity) at recognizing objects, both in the absence of occlusion and in all occlusion conditions. Recurrent networks were also found to be more robust to the inclusion of additive Gaussian noise. Recurrent neural networks are better in two respects: (1) they are more neurobiologically realistic than their feedforward counterparts; (2) they are better in terms of their ability to recognize objects, especially under challenging conditions. This work shows that computer vision can benefit from using recurrent convolutional architectures and suggests that the ubiquitous recurrent connections in biological brains are essential for task performance.

Neural Connectivity Evidence for a Categorical-Dimensional Hybrid Model of Autism Spectrum Disorder.

PubMed

Elton, Amanda; Di Martino, Adriana; Hazlett, Heather Cody; Gao, Wei

2016-07-15

Autism spectrum disorder (ASD) encompasses a complex manifestation of symptoms that include deficits in social interaction and repetitive or stereotyped interests and behaviors. In keeping with the increasing recognition of the dimensional characteristics of ASD symptoms and the categorical nature of a diagnosis, we sought to delineate the neural mechanisms of ASD symptoms based on the functional connectivity of four known neural networks (i.e., default mode network, dorsal attention network, salience network, and executive control network). We leveraged an open data resource (Autism Brain Imaging Data Exchange) providing resting-state functional magnetic resonance imaging data sets from 90 boys with ASD and 95 typically developing boys. This data set also included the Social Responsiveness Scale as a dimensional measure of ASD traits. Seed-based functional connectivity was paired with linear regression to identify functional connectivity abnormalities associated with categorical effects of ASD diagnosis, dimensional effects of ASD-like behaviors, and their interaction. Our results revealed the existence of dimensional mechanisms of ASD uniquely affecting each network based on the presence of connectivity-behavioral relationships; these were independent of diagnostic category. However, we also found evidence of categorical differences (i.e., diagnostic group differences) in connectivity strength for each network as well as categorical differences in connectivity-behavioral relationships (i.e., diagnosis-by-behavior interactions), supporting the coexistence of categorical mechanisms of ASD. Our findings support a hybrid model for ASD characterization that includes a combination of categorical and dimensional brain mechanisms and provide a novel understanding of the neural underpinnings of ASD. Copyright © 2016 Society of Biological Psychiatry. Published by Elsevier Inc. All rights reserved.

Neural-Network Simulator

NASA Technical Reports Server (NTRS)

Mitchell, Paul H.

1991-01-01

F77NNS (FORTRAN 77 Neural Network Simulator) computer program simulates popular back-error-propagation neural network. Designed to take advantage of vectorization when used on computers having this capability, also used on any computer equipped with ANSI-77 FORTRAN Compiler. Problems involving matching of patterns or mathematical modeling of systems fit class of problems F77NNS designed to solve. Program has restart capability so neural network solved in stages suitable to user's resources and desires. Enables user to customize patterns of connections between layers of network. Size of neural network F77NNS applied to limited only by amount of random-access memory available to user.

Spatiotemporal Dynamics and Reliable Computations in Recurrent Spiking Neural Networks

NASA Astrophysics Data System (ADS)

Pyle, Ryan; Rosenbaum, Robert

2017-01-01

Randomly connected networks of excitatory and inhibitory spiking neurons provide a parsimonious model of neural variability, but are notoriously unreliable for performing computations. We show that this difficulty is overcome by incorporating the well-documented dependence of connection probability on distance. Spatially extended spiking networks exhibit symmetry-breaking bifurcations and generate spatiotemporal patterns that can be trained to perform dynamical computations under a reservoir computing framework.

Ontology Mapping Neural Network: An Approach to Learning and Inferring Correspondences among Ontologies

ERIC Educational Resources Information Center

Peng, Yefei

2010-01-01

An ontology mapping neural network (OMNN) is proposed in order to learn and infer correspondences among ontologies. It extends the Identical Elements Neural Network (IENN)'s ability to represent and map complex relationships. The learning dynamics of simultaneous (interlaced) training of similar tasks interact at the shared connections of the…

Effect of dilution in asymmetric recurrent neural networks.

PubMed

Folli, Viola; Gosti, Giorgio; Leonetti, Marco; Ruocco, Giancarlo

2018-04-16

We study with numerical simulation the possible limit behaviors of synchronous discrete-time deterministic recurrent neural networks composed of N binary neurons as a function of a network's level of dilution and asymmetry. The network dilution measures the fraction of neuron couples that are connected, and the network asymmetry measures to what extent the underlying connectivity matrix is asymmetric. For each given neural network, we study the dynamical evolution of all the different initial conditions, thus characterizing the full dynamical landscape without imposing any learning rule. Because of the deterministic dynamics, each trajectory converges to an attractor, that can be either a fixed point or a limit cycle. These attractors form the set of all the possible limit behaviors of the neural network. For each network we then determine the convergence times, the limit cycles' length, the number of attractors, and the sizes of the attractors' basin. We show that there are two network structures that maximize the number of possible limit behaviors. The first optimal network structure is fully-connected and symmetric. On the contrary, the second optimal network structure is highly sparse and asymmetric. The latter optimal is similar to what observed in different biological neuronal circuits. These observations lead us to hypothesize that independently from any given learning model, an efficient and effective biologic network that stores a number of limit behaviors close to its maximum capacity tends to develop a connectivity structure similar to one of the optimal networks we found. Copyright © 2018 The Author(s). Published by Elsevier Ltd.. All rights reserved.

DANoC: An Efficient Algorithm and Hardware Codesign of Deep Neural Networks on Chip.

PubMed

Zhou, Xichuan; Li, Shengli; Tang, Fang; Hu, Shengdong; Lin, Zhi; Zhang, Lei

2017-07-18

Deep neural networks (NNs) are the state-of-the-art models for understanding the content of images and videos. However, implementing deep NNs in embedded systems is a challenging task, e.g., a typical deep belief network could exhaust gigabytes of memory and result in bandwidth and computational bottlenecks. To address this challenge, this paper presents an algorithm and hardware codesign for efficient deep neural computation. A hardware-oriented deep learning algorithm, named the deep adaptive network, is proposed to explore the sparsity of neural connections. By adaptively removing the majority of neural connections and robustly representing the reserved connections using binary integers, the proposed algorithm could save up to 99.9% memory utility and computational resources without undermining classification accuracy. An efficient sparse-mapping-memory-based hardware architecture is proposed to fully take advantage of the algorithmic optimization. Different from traditional Von Neumann architecture, the deep-adaptive network on chip (DANoC) brings communication and computation in close proximity to avoid power-hungry parameter transfers between on-board memory and on-chip computational units. Experiments over different image classification benchmarks show that the DANoC system achieves competitively high accuracy and efficiency comparing with the state-of-the-art approaches.

Learning in stochastic neural networks for constraint satisfaction problems

NASA Technical Reports Server (NTRS)

Johnston, Mark D.; Adorf, Hans-Martin

1989-01-01

Researchers describe a newly-developed artificial neural network algorithm for solving constraint satisfaction problems (CSPs) which includes a learning component that can significantly improve the performance of the network from run to run. The network, referred to as the Guarded Discrete Stochastic (GDS) network, is based on the discrete Hopfield network but differs from it primarily in that auxiliary networks (guards) are asymmetrically coupled to the main network to enforce certain types of constraints. Although the presence of asymmetric connections implies that the network may not converge, it was found that, for certain classes of problems, the network often quickly converges to find satisfactory solutions when they exist. The network can run efficiently on serial machines and can find solutions to very large problems (e.g., N-queens for N as large as 1024). One advantage of the network architecture is that network connection strengths need not be instantiated when the network is established: they are needed only when a participating neural element transitions from off to on. They have exploited this feature to devise a learning algorithm, based on consistency techniques for discrete CSPs, that updates the network biases and connection strengths and thus improves the network performance.

Chaotic simulated annealing by a neural network with a variable delay: design and application.

PubMed

Chen, Shyan-Shiou

2011-10-01

In this paper, we have three goals: the first is to delineate the advantages of a variably delayed system, the second is to find a more intuitive Lyapunov function for a delayed neural network, and the third is to design a delayed neural network for a quadratic cost function. For delayed neural networks, most researchers construct a Lyapunov function based on the linear matrix inequality (LMI) approach. However, that approach is not intuitive. We provide a alternative candidate Lyapunov function for a delayed neural network. On the other hand, if we are first given a quadratic cost function, we can construct a delayed neural network by suitably dividing the second-order term into two parts: a self-feedback connection weight and a delayed connection weight. To demonstrate the advantage of a variably delayed neural network, we propose a transiently chaotic neural network with variable delay and show numerically that the model should possess a better searching ability than Chen-Aihara's model, Wang's model, and Zhao's model. We discuss both the chaotic and the convergent phases. During the chaotic phase, we simply present bifurcation diagrams for a single neuron with a constant delay and with a variable delay. We show that the variably delayed model possesses the stochastic property and chaotic wandering. During the convergent phase, we not only provide a novel Lyapunov function for neural networks with a delay (the Lyapunov function is independent of the LMI approach) but also establish a correlation between the Lyapunov function for a delayed neural network and an objective function for the traveling salesman problem. © 2011 IEEE

Spatiotemporal discrimination in neural networks with short-term synaptic plasticity

NASA Astrophysics Data System (ADS)

Shlaer, Benjamin; Miller, Paul

2015-03-01

Cells in recurrently connected neural networks exhibit bistability, which allows for stimulus information to persist in a circuit even after stimulus offset, i.e. short-term memory. However, such a system does not have enough hysteresis to encode temporal information about the stimuli. The biophysically described phenomenon of synaptic depression decreases synaptic transmission strengths due to increased presynaptic activity. This short-term reduction in synaptic strengths can destabilize attractor states in excitatory recurrent neural networks, causing the network to move along stimulus dependent dynamical trajectories. Such a network can successfully separate amplitudes and durations of stimuli from the number of successive stimuli. Stimulus number, duration and intensity encoding in randomly connected attractor networks with synaptic depression. Front. Comput. Neurosci. 7:59., and so provides a strong candidate network for the encoding of spatiotemporal information. Here we explicitly demonstrate the capability of a recurrent neural network with short-term synaptic depression to discriminate between the temporal sequences in which spatial stimuli are presented.

Multiprocessor Neural Network in Healthcare.

PubMed

Godó, Zoltán Attila; Kiss, Gábor; Kocsis, Dénes

2015-01-01

A possible way of creating a multiprocessor artificial neural network is by the use of microcontrollers. The RISC processors' high performance and the large number of I/O ports mean they are greatly suitable for creating such a system. During our research, we wanted to see if it is possible to efficiently create interaction between the artifical neural network and the natural nervous system. To achieve as much analogy to the living nervous system as possible, we created a frequency-modulated analog connection between the units. Our system is connected to the living nervous system through 128 microelectrodes. Two-way communication is provided through A/D transformation, which is even capable of testing psychopharmacons. The microcontroller-based analog artificial neural network can play a great role in medical singal processing, such as ECG, EEG etc.

Structure-function clustering in multiplex brain networks

NASA Astrophysics Data System (ADS)

Crofts, J. J.; Forrester, M.; O'Dea, R. D.

2016-10-01

A key question in neuroscience is to understand how a rich functional repertoire of brain activity arises within relatively static networks of structurally connected neural populations: elucidating the subtle interactions between evoked “functional connectivity” and the underlying “structural connectivity” has the potential to address this. These structural-functional networks (and neural networks more generally) are more naturally described using a multilayer or multiplex network approach, in favour of standard single-layer network analyses that are more typically applied to such systems. In this letter, we address such issues by exploring important structure-function relations in the Macaque cortical network by modelling it as a duplex network that comprises an anatomical layer, describing the known (macro-scale) network topology of the Macaque monkey, and a functional layer derived from simulated neural activity. We investigate and characterize correlations between structural and functional layers, as system parameters controlling simulated neural activity are varied, by employing recently described multiplex network measures. Moreover, we propose a novel measure of multiplex structure-function clustering which allows us to investigate the emergence of functional connections that are distinct from the underlying cortical structure, and to highlight the dependence of multiplex structure on the neural dynamical regime.

Black Holes as Brains: Neural Networks with Area Law Entropy

NASA Astrophysics Data System (ADS)

Dvali, Gia

2018-04-01

Motivated by the potential similarities between the underlying mechanisms of the enhanced memory storage capacity in black holes and in brain networks, we construct an artificial quantum neural network based on gravity-like synaptic connections and a symmetry structure that allows to describe the network in terms of geometry of a d-dimensional space. We show that the network possesses a critical state in which the gapless neurons emerge that appear to inhabit a (d-1)-dimensional surface, with their number given by the surface area. In the excitations of these neurons, the network can store and retrieve an exponentially large number of patterns within an arbitrarily narrow energy gap. The corresponding micro-state entropy of the brain network exhibits an area law. The neural network can be described in terms of a quantum field, via identifying the different neurons with the different momentum modes of the field, while identifying the synaptic connections among the neurons with the interactions among the corresponding momentum modes. Such a mapping allows to attribute a well-defined sense of geometry to an intrinsically non-local system, such as the neural network, and vice versa, it allows to represent the quantum field model as a neural network.

Understanding the role of speech production in reading: Evidence for a print-to-speech neural network using graphical analysis.

PubMed

Cummine, Jacqueline; Cribben, Ivor; Luu, Connie; Kim, Esther; Bahktiari, Reyhaneh; Georgiou, George; Boliek, Carol A

2016-05-01

The neural circuitry associated with language processing is complex and dynamic. Graphical models are useful for studying complex neural networks as this method provides information about unique connectivity between regions within the context of the entire network of interest. Here, the authors explored the neural networks during covert reading to determine the role of feedforward and feedback loops in covert speech production. Brain activity of skilled adult readers was assessed in real word and pseudoword reading tasks with functional MRI (fMRI). The authors provide evidence for activity coherence in the feedforward system (inferior frontal gyrus-supplementary motor area) during real word reading and in the feedback system (supramarginal gyrus-precentral gyrus) during pseudoword reading. Graphical models provided evidence of an extensive, highly connected, neural network when individuals read real words that relied on coordination of the feedforward system. In contrast, when individuals read pseudowords the authors found a limited/restricted network that relied on coordination of the feedback system. Together, these results underscore the importance of considering multiple pathways and articulatory loops during language tasks and provide evidence for a print-to-speech neural network. (PsycINFO Database Record (c) 2016 APA, all rights reserved).

Information-geometric measures as robust estimators of connection strengths and external inputs.

PubMed

Tatsuno, Masami; Fellous, Jean-Marc; Amari, Shun-Ichi

2009-08-01

Information geometry has been suggested to provide a powerful tool for analyzing multineuronal spike trains. Among several advantages of this approach, a significant property is the close link between information-geometric measures and neural network architectures. Previous modeling studies established that the first- and second-order information-geometric measures corresponded to the number of external inputs and the connection strengths of the network, respectively. This relationship was, however, limited to a symmetrically connected network, and the number of neurons used in the parameter estimation of the log-linear model needed to be known. Recently, simulation studies of biophysical model neurons have suggested that information geometry can estimate the relative change of connection strengths and external inputs even with asymmetric connections. Inspired by these studies, we analytically investigated the link between the information-geometric measures and the neural network structure with asymmetrically connected networks of N neurons. We focused on the information-geometric measures of orders one and two, which can be derived from the two-neuron log-linear model, because unlike higher-order measures, they can be easily estimated experimentally. Considering the equilibrium state of a network of binary model neurons that obey stochastic dynamics, we analytically showed that the corrected first- and second-order information-geometric measures provided robust and consistent approximation of the external inputs and connection strengths, respectively. These results suggest that information-geometric measures provide useful insights into the neural network architecture and that they will contribute to the study of system-level neuroscience.

An optimally evolved connective ratio of neural networks that maximizes the occurrence of synchronized bursting behavior

PubMed Central

2012-01-01

Background Synchronized bursting activity (SBA) is a remarkable dynamical behavior in both ex vivo and in vivo neural networks. Investigations of the underlying structural characteristics associated with SBA are crucial to understanding the system-level regulatory mechanism of neural network behaviors. Results In this study, artificial pulsed neural networks were established using spike response models to capture fundamental dynamics of large scale ex vivo cortical networks. Network simulations with synaptic parameter perturbations showed the following two findings. (i) In a network with an excitatory ratio (ER) of 80-90%, its connective ratio (CR) was within a range of 10-30% when the occurrence of SBA reached the highest expectation. This result was consistent with the experimental observation in ex vivo neuronal networks, which were reported to possess a matured inhibitory synaptic ratio of 10-20% and a CR of 10-30%. (ii) No SBA occurred when a network does not contain any all-positive-interaction feedback loop (APFL) motif. In a neural network containing APFLs, the number of APFLs presented an optimal range corresponding to the maximal occurrence of SBA, which was very similar to the optimal CR. Conclusions In a neural network, the evolutionarily selected CR (10-30%) optimizes the occurrence of SBA, and APFL serves a pivotal network motif required to maximize the occurrence of SBA. PMID:22462685

Functional connectivity mapping of regions associated with self- and other-processing.

PubMed

Murray, Ryan J; Debbané, Martin; Fox, Peter T; Bzdok, Danilo; Eickhoff, Simon B

2015-04-01

Neuroscience literature increasingly suggests a conceptual self composed of interacting neural regions, rather than independent local activations, yet such claims have yet to be investigated. We, thus, combined task-dependent meta-analytic connectivity modeling (MACM) with task-independent resting-state (RS) connectivity analysis to delineate the neural network of the self, across both states. Given psychological evidence implicating the self's interdependence on social information, we also delineated the neural network underlying conceptual other-processing. To elucidate the relation between the self-/other-networks and their function, we mined the MACM metadata to generate a cognitive-behavioral profile for an empirically identified region specific to conceptual self, the pregenual anterior cingulate (pACC), and conceptual other, posterior cingulate/precuneus (PCC/PC). Mining of 7,200 published, task-dependent, neuroimaging studies, using healthy human subjects, yielded 193 studies activating the self-related seed and were conjoined with RS connectivity analysis to delineate a differentiated self-network composed of the pACC (seed) and anterior insula, relative to other functional connectivity. Additionally, 106 studies activating the other-related seed were conjoined with RS connectivity analysis to delineate a differentiated other-network of PCC/PC (seed) and angular gyrus/temporoparietal junction, relative to self-functional connectivity. The self-network seed related to emotional conflict resolution and motivational processing, whereas the other-network seed related to socially oriented processing and contextual information integration. Notably, our findings revealed shared RS connectivity between ensuing self-/other-networks within the ventromedial prefrontal cortex and medial orbitofrontal cortex, suggesting self-updating via integration of self-relevant social information. We, therefore, present initial neurobiological evidence corroborating the increasing claims of an intricate self-network, the architecture of which may promote social value processing. © 2014 Wiley Periodicals, Inc.

Causal interactions in resting-state networks predict perceived loneliness.

PubMed

Tian, Yin; Yang, Li; Chen, Sifan; Guo, Daqing; Ding, Zechao; Tam, Kin Yip; Yao, Dezhong

2017-01-01

Loneliness is broadly described as a negative emotional response resulting from the differences between the actual and desired social relations of an individual, which is related to the neural responses in connection with social and emotional stimuli. Prior research has discovered that some neural regions play a role in loneliness. However, little is known about the differences among individuals in loneliness and the relationship of those differences to differences in neural networks. The current study aimed to investigate individual differences in perceived loneliness related to the causal interactions between resting-state networks (RSNs), including the dorsal attentional network (DAN), the ventral attentional network (VAN), the affective network (AfN) and the visual network (VN). Using conditional granger causal analysis of resting-state fMRI data, we revealed that the weaker causal flow from DAN to VAN is related to higher loneliness scores, and the decreased causal flow from AfN to VN is also related to higher loneliness scores. Our results clearly support the hypothesis that there is a connection between loneliness and neural networks. It is envisaged that neural network features could play a key role in characterizing the loneliness of an individual.

Causal interactions in resting-state networks predict perceived loneliness

PubMed Central

Yang, Li; Chen, Sifan; Guo, Daqing; Ding, Zechao; Tam, Kin Yip; Yao, Dezhong

2017-01-01

Loneliness is broadly described as a negative emotional response resulting from the differences between the actual and desired social relations of an individual, which is related to the neural responses in connection with social and emotional stimuli. Prior research has discovered that some neural regions play a role in loneliness. However, little is known about the differences among individuals in loneliness and the relationship of those differences to differences in neural networks. The current study aimed to investigate individual differences in perceived loneliness related to the causal interactions between resting-state networks (RSNs), including the dorsal attentional network (DAN), the ventral attentional network (VAN), the affective network (AfN) and the visual network (VN). Using conditional granger causal analysis of resting-state fMRI data, we revealed that the weaker causal flow from DAN to VAN is related to higher loneliness scores, and the decreased causal flow from AfN to VN is also related to higher loneliness scores. Our results clearly support the hypothesis that there is a connection between loneliness and neural networks. It is envisaged that neural network features could play a key role in characterizing the loneliness of an individual. PMID:28545125

Neuromorphic device architectures with global connectivity through electrolyte gating

NASA Astrophysics Data System (ADS)

Gkoupidenis, Paschalis; Koutsouras, Dimitrios A.; Malliaras, George G.

2017-05-01

Information processing in the brain takes place in a network of neurons that are connected with each other by an immense number of synapses. At the same time, neurons are immersed in a common electrochemical environment, and global parameters such as concentrations of various hormones regulate the overall network function. This computational paradigm of global regulation, also known as homeoplasticity, has important implications in the overall behaviour of large neural ensembles and is barely addressed in neuromorphic device architectures. Here, we demonstrate the global control of an array of organic devices based on poly(3,4ethylenedioxythiophene):poly(styrene sulf) that are immersed in an electrolyte, a behaviour that resembles homeoplasticity phenomena of the neural environment. We use this effect to produce behaviour that is reminiscent of the coupling between local activity and global oscillations in the biological neural networks. We further show that the electrolyte establishes complex connections between individual devices, and leverage these connections to implement coincidence detection. These results demonstrate that electrolyte gating offers significant advantages for the realization of networks of neuromorphic devices of higher complexity and with minimal hardwired connectivity.

Consciousness, cognition and brain networks: New perspectives.

PubMed

Aldana, E M; Valverde, J L; Fábregas, N

2016-10-01

A detailed analysis of the literature on consciousness and cognition mechanisms based on the neural networks theory is presented. The immune and inflammatory response to the anesthetic-surgical procedure induces modulation of neuronal plasticity by influencing higher cognitive functions. Anesthetic drugs can cause unconsciousness, producing a functional disruption of cortical and thalamic cortical integration complex. The external and internal perceptions are processed through an intricate network of neural connections, involving the higher nervous activity centers, especially the cerebral cortex. This requires an integrated model, formed by neural networks and their interactions with highly specialized regions, through large-scale networks, which are distributed throughout the brain collecting information flow of these perceptions. Functional and effective connectivity between large-scale networks, are essential for consciousness, unconsciousness and cognition. It is what is called the "human connectome" or map neural networks. Copyright © 2014 Sociedad Española de Anestesiología, Reanimación y Terapéutica del Dolor. Publicado por Elsevier España, S.L.U. All rights reserved.

Long-Term Memory Stabilized by Noise-Induced Rehearsal

PubMed Central

Wei, Yi

2014-01-01

Cortical networks can maintain memories for decades despite the short lifetime of synaptic strengths. Can a neural network store long-lasting memories in unstable synapses? Here, we study the effects of ongoing spike-timing-dependent plasticity (STDP) on the stability of memory patterns stored in synapses of an attractor neural network. We show that certain classes of STDP rules can stabilize all stored memory patterns despite a short lifetime of synapses. In our model, unstructured neural noise, after passing through the recurrent network connections, carries the imprint of all memory patterns in temporal correlations. STDP, combined with these correlations, leads to reinforcement of all stored patterns, even those that are never explicitly visited. Our findings may provide the functional reason for irregular spiking displayed by cortical neurons and justify models of system memory consolidation. Therefore, we propose that irregular neural activity is the feature that helps cortical networks maintain stable connections. PMID:25411507

Neural activity, neural connectivity, and the processing of emotionally valenced information in older adults: links with life satisfaction.

PubMed

Waldinger, Robert J; Kensinger, Elizabeth A; Schulz, Marc S

2011-09-01

This study examines whether differences in late-life well-being are linked to how older adults encode emotionally valenced information. Using fMRI with 39 older adults varying in life satisfaction, we examined how viewing positive and negative images would affect activation and connectivity of an emotion-processing network. Participants engaged most regions within this network more robustly for positive than for negative images, but within the PFC this effect was moderated by life satisfaction, with individuals higher in satisfaction showing lower levels of activity during the processing of positive images. Participants high in satisfaction showed stronger correlations among network regions-particularly between the amygdala and other emotion processing regions-when viewing positive, as compared with negative, images. Participants low in satisfaction showed no valence effect. Findings suggest that late-life satisfaction is linked with how emotion-processing regions are engaged and connected during processing of valenced information. This first demonstration of a link between neural recruitment and late-life well-being suggests that differences in neural network activation and connectivity may account for the preferential encoding of positive information seen in some older adults.

Neural Activity, Neural Connectivity, and the Processing of Emotionally-Valenced Information in Older Adults: Links with Life Satisfaction

PubMed Central

Waldinger, Robert J.; Kensinger, Elizabeth A.; Schulz, Marc S.

2013-01-01

This study examines whether differences in late-life well-being are linked to how older adults encode emotionally-valenced information. Using fMRI with 39 older adults varying in life satisfaction, we examined how viewing positive and negative images affected activation and connectivity of an emotion-processing network. Participants engaged most regions within this network more robustly for positive than for negative images, but within the PFC this effect was moderated by life satisfaction, with individuals higher in satisfaction showing lower levels of activity during the processing of positive images. Participants high in satisfaction showed stronger correlations among network regions – particularly between the amygdala and other emotion processing regions – when viewing positive as compared to negative images. Participants low in satisfaction showed no valence effect. Findings suggest that late-life satisfaction is linked with how emotion-processing regions are engaged and connected during processing of valenced information. This first demonstration of a link between neural recruitment and late-life well-being suggests that differences in neural network activation and connectivity may account for the preferential encoding of positive information seen in some older adults. PMID:21590504

Salience Network Connectivity Modulates Skin Conductance Responses in Predicting Arousal Experience

PubMed Central

Xia, Chenjie; Touroutoglou, Alexandra; Quigley, Karen S.; Barrett, Lisa Feldman; Dickerson, Bradford C.

2017-01-01

Individual differences in arousal experience have been linked to differences in resting-state salience network connectivity strength. In this study, we investigated how adding task-related skin conductance responses (SCR), a measure of sympathetic autonomic nervous system activity, can predict additional variance in arousal experience. Thirty-nine young adults rated their subjective experience of arousal to emotionally evocative images while SCRs were measured. They also underwent a separate resting-state fMRI scan. Greater SCR reactivity (an increased number of task-related SCRs) to emotional images and stronger intrinsic salience network connectivity independently predicted more intense experiences of arousal. Salience network connectivity further moderated the effect of SCR reactivity: In individuals with weak salience network connectivity, SCR reactivity more significantly predicted arousal experience, whereas in those with strong salience network connectivity, SCR reactivity played little role in predicting arousal experience. This interaction illustrates the degeneracy in neural mechanisms driving individual differences in arousal experience and highlights the intricate interplay between connectivity in central visceromotor neural circuitry and peripherally expressed autonomic responses in shaping arousal experience. PMID:27991182

Computational modeling of spiking neural network with learning rules from STDP and intrinsic plasticity

NASA Astrophysics Data System (ADS)

Li, Xiumin; Wang, Wei; Xue, Fangzheng; Song, Yongduan

2018-02-01

Recently there has been continuously increasing interest in building up computational models of spiking neural networks (SNN), such as the Liquid State Machine (LSM). The biologically inspired self-organized neural networks with neural plasticity can enhance the capability of computational performance, with the characteristic features of dynamical memory and recurrent connection cycles which distinguish them from the more widely used feedforward neural networks. Despite a variety of computational models for brain-like learning and information processing have been proposed, the modeling of self-organized neural networks with multi-neural plasticity is still an important open challenge. The main difficulties lie in the interplay among different forms of neural plasticity rules and understanding how structures and dynamics of neural networks shape the computational performance. In this paper, we propose a novel approach to develop the models of LSM with a biologically inspired self-organizing network based on two neural plasticity learning rules. The connectivity among excitatory neurons is adapted by spike-timing-dependent plasticity (STDP) learning; meanwhile, the degrees of neuronal excitability are regulated to maintain a moderate average activity level by another learning rule: intrinsic plasticity (IP). Our study shows that LSM with STDP+IP performs better than LSM with a random SNN or SNN obtained by STDP alone. The noticeable improvement with the proposed method is due to the better reflected competition among different neurons in the developed SNN model, as well as the more effectively encoded and processed relevant dynamic information with its learning and self-organizing mechanism. This result gives insights to the optimization of computational models of spiking neural networks with neural plasticity.

Proceedings of the Second Joint Technology Workshop on Neural Networks and Fuzzy Logic, volume 2

NASA Technical Reports Server (NTRS)

Lea, Robert N. (Editor); Villarreal, James A. (Editor)

1991-01-01

Documented here are papers presented at the Neural Networks and Fuzzy Logic Workshop sponsored by NASA and the University of Texas, Houston. Topics addressed included adaptive systems, learning algorithms, network architectures, vision, robotics, neurobiological connections, speech recognition and synthesis, fuzzy set theory and application, control and dynamics processing, space applications, fuzzy logic and neural network computers, approximate reasoning, and multiobject decision making.

Efficient self-organizing multilayer neural network for nonlinear system modeling.

PubMed

Han, Hong-Gui; Wang, Li-Dan; Qiao, Jun-Fei

2013-07-01

It has been shown extensively that the dynamic behaviors of a neural system are strongly influenced by the network architecture and learning process. To establish an artificial neural network (ANN) with self-organizing architecture and suitable learning algorithm for nonlinear system modeling, an automatic axon-neural network (AANN) is investigated in the following respects. First, the network architecture is constructed automatically to change both the number of hidden neurons and topologies of the neural network during the training process. The approach introduced in adaptive connecting-and-pruning algorithm (ACP) is a type of mixed mode operation, which is equivalent to pruning or adding the connecting of the neurons, as well as inserting some required neurons directly. Secondly, the weights are adjusted, using a feedforward computation (FC) to obtain the information for the gradient during learning computation. Unlike most of the previous studies, AANN is able to self-organize the architecture and weights, and to improve the network performances. Also, the proposed AANN has been tested on a number of benchmark problems, ranging from nonlinear function approximating to nonlinear systems modeling. The experimental results show that AANN can have better performances than that of some existing neural networks. Crown Copyright © 2013. Published by Elsevier Ltd. All rights reserved.

IR wireless cluster synapses of HYDRA very large neural networks

NASA Astrophysics Data System (ADS)

Jannson, Tomasz; Forrester, Thomas

2008-04-01

RF/IR wireless (virtual) synapses are critical components of HYDRA (Hyper-Distributed Robotic Autonomy) neural networks, already discussed in two earlier papers. The HYDRA network has the potential to be very large, up to 10 11-neurons and 10 18-synapses, based on already established technologies (cellular RF telephony and IR-wireless LANs). It is organized into almost fully connected IR-wireless clusters. The HYDRA neurons and synapses are very flexible, simple, and low-cost. They can be modified into a broad variety of biologically-inspired brain-like computing capabilities. In this third paper, we focus on neural hardware in general, and on IR-wireless synapses in particular. Such synapses, based on LED/LD-connections, dominate the HYDRA neural cluster.

Markov models for fMRI correlation structure: Is brain functional connectivity small world, or decomposable into networks?

PubMed

Varoquaux, G; Gramfort, A; Poline, J B; Thirion, B

2012-01-01

Correlations in the signal observed via functional Magnetic Resonance Imaging (fMRI), are expected to reveal the interactions in the underlying neural populations through hemodynamic response. In particular, they highlight distributed set of mutually correlated regions that correspond to brain networks related to different cognitive functions. Yet graph-theoretical studies of neural connections give a different picture: that of a highly integrated system with small-world properties: local clustering but with short pathways across the complete structure. We examine the conditional independence properties of the fMRI signal, i.e. its Markov structure, to find realistic assumptions on the connectivity structure that are required to explain the observed functional connectivity. In particular we seek a decomposition of the Markov structure into segregated functional networks using decomposable graphs: a set of strongly-connected and partially overlapping cliques. We introduce a new method to efficiently extract such cliques on a large, strongly-connected graph. We compare methods learning different graph structures from functional connectivity by testing the goodness of fit of the model they learn on new data. We find that summarizing the structure as strongly-connected networks can give a good description only for very large and overlapping networks. These results highlight that Markov models are good tools to identify the structure of brain connectivity from fMRI signals, but for this purpose they must reflect the small-world properties of the underlying neural systems. Copyright © 2012 Elsevier Ltd. All rights reserved.

Anisotropic connectivity implements motion-based prediction in a spiking neural network.

PubMed

Kaplan, Bernhard A; Lansner, Anders; Masson, Guillaume S; Perrinet, Laurent U

2013-01-01

Predictive coding hypothesizes that the brain explicitly infers upcoming sensory input to establish a coherent representation of the world. Although it is becoming generally accepted, it is not clear on which level spiking neural networks may implement predictive coding and what function their connectivity may have. We present a network model of conductance-based integrate-and-fire neurons inspired by the architecture of retinotopic cortical areas that assumes predictive coding is implemented through network connectivity, namely in the connection delays and in selectiveness for the tuning properties of source and target cells. We show that the applied connection pattern leads to motion-based prediction in an experiment tracking a moving dot. In contrast to our proposed model, a network with random or isotropic connectivity fails to predict the path when the moving dot disappears. Furthermore, we show that a simple linear decoding approach is sufficient to transform neuronal spiking activity into a probabilistic estimate for reading out the target trajectory.

Feature Extraction Using an Unsupervised Neural Network

DTIC Science & Technology

1991-05-03

with this neural netowrk is given and its connection to exploratory projection pursuit methods is established. DD I 2 P JA d 73 EDITIONj Of I NOV 6s...IS OBSOLETE $IN 0102- LF- 014- 6601 SECURITY CLASSIFICATION OF THIS PAGE (When Daoes Enlered) Feature Extraction using an Unsupervised Neural Network

ChainMail based neural dynamics modeling of soft tissue deformation for surgical simulation.

PubMed

Zhang, Jinao; Zhong, Yongmin; Smith, Julian; Gu, Chengfan

2017-07-20

Realistic and real-time modeling and simulation of soft tissue deformation is a fundamental research issue in the field of surgical simulation. In this paper, a novel cellular neural network approach is presented for modeling and simulation of soft tissue deformation by combining neural dynamics of cellular neural network with ChainMail mechanism. The proposed method formulates the problem of elastic deformation into cellular neural network activities to avoid the complex computation of elasticity. The local position adjustments of ChainMail are incorporated into the cellular neural network as the local connectivity of cells, through which the dynamic behaviors of soft tissue deformation are transformed into the neural dynamics of cellular neural network. Experiments demonstrate that the proposed neural network approach is capable of modeling the soft tissues' nonlinear deformation and typical mechanical behaviors. The proposed method not only improves ChainMail's linear deformation with the nonlinear characteristics of neural dynamics but also enables the cellular neural network to follow the principle of continuum mechanics to simulate soft tissue deformation.

Organization of Anti-Phase Synchronization Pattern in Neural Networks: What are the Key Factors?

PubMed Central

Li, Dong; Zhou, Changsong

2011-01-01

Anti-phase oscillation has been widely observed in cortical neural network. Elucidating the mechanism underlying the organization of anti-phase pattern is of significance for better understanding more complicated pattern formations in brain networks. In dynamical systems theory, the organization of anti-phase oscillation pattern has usually been considered to relate to time delay in coupling. This is consistent to conduction delays in real neural networks in the brain due to finite propagation velocity of action potentials. However, other structural factors in cortical neural network, such as modular organization (connection density) and the coupling types (excitatory or inhibitory), could also play an important role. In this work, we investigate the anti-phase oscillation pattern organized on a two-module network of either neuronal cell model or neural mass model, and analyze the impact of the conduction delay times, the connection densities, and coupling types. Our results show that delay times and coupling types can play key roles in this organization. The connection densities may have an influence on the stability if an anti-phase pattern exists due to the other factors. Furthermore, we show that anti-phase synchronization of slow oscillations can be achieved with small delay times if there is interaction between slow and fast oscillations. These results are significant for further understanding more realistic spatiotemporal dynamics of cortico-cortical communications. PMID:22232576

The Energy Coding of a Structural Neural Network Based on the Hodgkin-Huxley Model.

PubMed

Zhu, Zhenyu; Wang, Rubin; Zhu, Fengyun

2018-01-01

Based on the Hodgkin-Huxley model, the present study established a fully connected structural neural network to simulate the neural activity and energy consumption of the network by neural energy coding theory. The numerical simulation result showed that the periodicity of the network energy distribution was positively correlated to the number of neurons and coupling strength, but negatively correlated to signal transmitting delay. Moreover, a relationship was established between the energy distribution feature and the synchronous oscillation of the neural network, which showed that when the proportion of negative energy in power consumption curve was high, the synchronous oscillation of the neural network was apparent. In addition, comparison with the simulation result of structural neural network based on the Wang-Zhang biophysical model of neurons showed that both models were essentially consistent.

Constraint satisfaction adaptive neural network and heuristics combined approaches for generalized job-shop scheduling.

PubMed

Yang, S; Wang, D

2000-01-01

This paper presents a constraint satisfaction adaptive neural network, together with several heuristics, to solve the generalized job-shop scheduling problem, one of NP-complete constraint satisfaction problems. The proposed neural network can be easily constructed and can adaptively adjust its weights of connections and biases of units based on the sequence and resource constraints of the job-shop scheduling problem during its processing. Several heuristics that can be combined with the neural network are also presented. In the combined approaches, the neural network is used to obtain feasible solutions, the heuristic algorithms are used to improve the performance of the neural network and the quality of the obtained solutions. Simulations have shown that the proposed neural network and its combined approaches are efficient with respect to the quality of solutions and the solving speed.

Ground-state coding in partially connected neural networks

NASA Technical Reports Server (NTRS)

Baram, Yoram

1989-01-01

Patterns over (-1,0,1) define, by their outer products, partially connected neural networks, consisting of internally strongly connected, externally weakly connected subnetworks. The connectivity patterns may have highly organized structures, such as lattices and fractal trees or nests. Subpatterns over (-1,1) define the subcodes stored in the subnetwork, that agree in their common bits. It is first shown that the code words are locally stable stares of the network, provided that each of the subcodes consists of mutually orthogonal words or of, at most, two words. Then it is shown that if each of the subcodes consists of two orthogonal words, the code words are the unique ground states (absolute minima) of the Hamiltonian associated with the network. The regions of attraction associated with the code words are shown to grow with the number of subnetworks sharing each of the neurons. Depending on the particular network architecture, the code sizes of partially connected networks can be vastly greater than those of fully connected ones and their error correction capabilities can be significantly greater than those of the disconnected subnetworks. The codes associated with lattice-structured and hierarchical networks are discussed in some detail.

Functional Connectivity with Distinct Neural Networks Tracks Fluctuations in Gain/Loss Framing Susceptibility

PubMed Central

Smith, David V.; Sip, Kamila E.; Delgado, Mauricio R.

2016-01-01

Multiple large-scale neural networks orchestrate a wide range of cognitive processes. For example, interoceptive processes related to self-referential thinking have been linked to the default-mode network (DMN); whereas exteroceptive processes related to cognitive control have been linked to the executive-control network (ECN). Although the DMN and ECN have been postulated to exert opposing effects on cognition, it remains unclear how connectivity with these spatially overlapping networks contribute to fluctuations in behavior. While previous work has suggested the medial prefrontal cortex (MPFC) is involved in behavioral change following feedback, these observations could be linked to interoceptive processes tied to DMN or exteroceptive processes tied to ECN because MPFC is positioned in both networks. To address this problem, we employed independent component analysis combined with dual-regression functional connectivity analysis. Participants made a series of financial decisions framed as monetary gains or losses. In some sessions, participants received feedback from a peer observing their choices; in other sessions, feedback was not provided. Following feedback, framing susceptibility—indexed as the increase in gambling behavior in loss frames compared to gain frames—was heightened in some participants and diminished in others. We examined whether these individual differences were linked to differences in connectivity by contrasting sessions containing feedback against those that did not contain feedback. We found two key results. As framing susceptibility increased, the MPFC increased connectivity with DMN; in contrast, temporal-parietal junction decreased connectivity with the ECN. Our results highlight how functional connectivity patterns with distinct neural networks contribute to idiosyncratic behavioral changes. PMID:25858445

Functional connectivity with distinct neural networks tracks fluctuations in gain/loss framing susceptibility.

PubMed

Smith, David V; Sip, Kamila E; Delgado, Mauricio R

2015-07-01

Multiple large-scale neural networks orchestrate a wide range of cognitive processes. For example, interoceptive processes related to self-referential thinking have been linked to the default-mode network (DMN); whereas exteroceptive processes related to cognitive control have been linked to the executive-control network (ECN). Although the DMN and ECN have been postulated to exert opposing effects on cognition, it remains unclear how connectivity with these spatially overlapping networks contribute to fluctuations in behavior. While previous work has suggested the medial-prefrontal cortex (MPFC) is involved in behavioral change following feedback, these observations could be linked to interoceptive processes tied to DMN or exteroceptive processes tied to ECN because MPFC is positioned in both networks. To address this problem, we employed independent component analysis combined with dual-regression functional connectivity analysis. Participants made a series of financial decisions framed as monetary gains or losses. In some sessions, participants received feedback from a peer observing their choices; in other sessions, feedback was not provided. Following feedback, framing susceptibility-indexed as the increase in gambling behavior in loss frames compared to gain frames-was heightened in some participants and diminished in others. We examined whether these individual differences were linked to differences in connectivity by contrasting sessions containing feedback against those that did not contain feedback. We found two key results. As framing susceptibility increased, the MPFC increased connectivity with DMN; in contrast, temporal-parietal junction decreased connectivity with the ECN. Our results highlight how functional connectivity patterns with distinct neural networks contribute to idiosyncratic behavioral changes. © 2015 Wiley Periodicals, Inc.

Role of local network oscillations in resting-state functional connectivity.

PubMed

Cabral, Joana; Hugues, Etienne; Sporns, Olaf; Deco, Gustavo

2011-07-01

Spatio-temporally organized low-frequency fluctuations (<0.1 Hz), observed in BOLD fMRI signal during rest, suggest the existence of underlying network dynamics that emerge spontaneously from intrinsic brain processes. Furthermore, significant correlations between distinct anatomical regions-or functional connectivity (FC)-have led to the identification of several widely distributed resting-state networks (RSNs). This slow dynamics seems to be highly structured by anatomical connectivity but the mechanism behind it and its relationship with neural activity, particularly in the gamma frequency range, remains largely unknown. Indeed, direct measurements of neuronal activity have revealed similar large-scale correlations, particularly in slow power fluctuations of local field potential gamma frequency range oscillations. To address these questions, we investigated neural dynamics in a large-scale model of the human brain's neural activity. A key ingredient of the model was a structural brain network defined by empirically derived long-range brain connectivity together with the corresponding conduction delays. A neural population, assumed to spontaneously oscillate in the gamma frequency range, was placed at each network node. When these oscillatory units are integrated in the network, they behave as weakly coupled oscillators. The time-delayed interaction between nodes is described by the Kuramoto model of phase oscillators, a biologically-based model of coupled oscillatory systems. For a realistic setting of axonal conduction speed, we show that time-delayed network interaction leads to the emergence of slow neural activity fluctuations, whose patterns correlate significantly with the empirically measured FC. The best agreement of the simulated FC with the empirically measured FC is found for a set of parameters where subsets of nodes tend to synchronize although the network is not globally synchronized. Inside such clusters, the simulated BOLD signal between nodes is found to be correlated, instantiating the empirically observed RSNs. Between clusters, patterns of positive and negative correlations are observed, as described in experimental studies. These results are found to be robust with respect to a biologically plausible range of model parameters. In conclusion, our model suggests how resting-state neural activity can originate from the interplay between the local neural dynamics and the large-scale structure of the brain. Copyright © 2011 Elsevier Inc. All rights reserved.

Differential reward network functional connectivity in cannabis dependent and non-dependent users☆

PubMed Central

Filbey, Francesca M.; Dunlop, Joseph

2015-01-01

Background Emergent studies show that similar to other substances of abuse, cue-reactivity to cannabis is also associated with neural response in the brain’s reward pathway (Filbey et al., 2009). However, the inter-relatedness of brain regions during cue-reactivity in cannabis users remains unknown. Methods In this study, we conducted a series of investigations to determine functional connectivity during cue-reactivity in 71 cannabis users. First, we used psychophysiological interaction (PPI) analysis to examine coherent neural response to cannabis cues. Second, we evaluated whether these patterns of network functional connectivity differentiated dependent and non-dependent users. Finally, as an exploratory analysis, we determined the directionality of these connections via Granger connectivity analyses. Results PPI analyses showed reward network functional connectivity with the nucleus accumbens (NAc) seed region during cue exposure. Between-group contrasts found differential effects of dependence status. Dependent users (N = 31) had greater functional connectivity with amygdala and anterior cingulate gyrus (ACG) seeds while the non-dependent users (N = 24) had greater functional connectivity with the NAc, orbitofrontal cortex (OFC) and hippocampus seeds. Granger analyses showed that hippocampal and ACG activation preceded neural response in reward areas. Conclusions Both PPI and Granger analyses demonstrated strong functional coherence in reward regions during exposure to cannabis cues in current cannabis users. Functional connectivity (but not regional activation) in the reward network differentiated dependent from non-dependent cannabis users. Our findings suggest that repeated cannabis exposure causes observable changes in functional connectivity in the reward network and should be considered in intervention strategies. PMID:24838032

Neural-Network-Development Program

NASA Technical Reports Server (NTRS)

Phillips, Todd A.

1993-01-01

NETS, software tool for development and evaluation of neural networks, provides simulation of neural-network algorithms plus computing environment for development of such algorithms. Uses back-propagation learning method for all of networks it creates. Enables user to customize patterns of connections between layers of network. Also provides features for saving, during learning process, values of weights, providing more-precise control over learning process. Written in ANSI standard C language. Machine-independent version (MSC-21588) includes only code for command-line-interface version of NETS 3.0.

Computational Account of Spontaneous Activity as a Signature of Predictive Coding

PubMed Central

Koren, Veronika

2017-01-01

Spontaneous activity is commonly observed in a variety of cortical states. Experimental evidence suggested that neural assemblies undergo slow oscillations with Up ad Down states even when the network is isolated from the rest of the brain. Here we show that these spontaneous events can be generated by the recurrent connections within the network and understood as signatures of neural circuits that are correcting their internal representation. A noiseless spiking neural network can represent its input signals most accurately when excitatory and inhibitory currents are as strong and as tightly balanced as possible. However, in the presence of realistic neural noise and synaptic delays, this may result in prohibitively large spike counts. An optimal working regime can be found by considering terms that control firing rates in the objective function from which the network is derived and then minimizing simultaneously the coding error and the cost of neural activity. In biological terms, this is equivalent to tuning neural thresholds and after-spike hyperpolarization. In suboptimal working regimes, we observe spontaneous activity even in the absence of feed-forward inputs. In an all-to-all randomly connected network, the entire population is involved in Up states. In spatially organized networks with local connectivity, Up states spread through local connections between neurons of similar selectivity and take the form of a traveling wave. Up states are observed for a wide range of parameters and have similar statistical properties in both active and quiescent state. In the optimal working regime, Up states are vanishing, leaving place to asynchronous activity, suggesting that this working regime is a signature of maximally efficient coding. Although they result in a massive increase in the firing activity, the read-out of spontaneous Up states is in fact orthogonal to the stimulus representation, therefore interfering minimally with the network function. PMID:28114353

Intranasal oxytocin modulates neural functional connectivity during human social interaction.

PubMed

Rilling, James K; Chen, Xiangchuan; Chen, Xu; Haroon, Ebrahim

2018-02-10

Oxytocin (OT) modulates social behavior in primates and many other vertebrate species. Studies in non-primate animals have demonstrated that, in addition to influencing activity within individual brain areas, OT influences functional connectivity across networks of areas involved in social behavior. Previously, we used fMRI to image brain function in human subjects during a dyadic social interaction task following administration of either intranasal oxytocin (INOT) or placebo, and analyzed the data with a standard general linear model. Here, we conduct an extensive re-analysis of these data to explore how OT modulates functional connectivity across a neural network that animal studies implicate in social behavior. OT induced widespread increases in functional connectivity in response to positive social interactions among men and widespread decreases in functional connectivity in response to negative social interactions among women. Nucleus basalis of Meynert, an important regulator of selective attention and motivation with a particularly high density of OT receptors, had the largest number of OT-modulated connections. Regions known to receive mesolimbic dopamine projections such as the nucleus accumbens and lateral septum were also hubs for OT effects on functional connectivity. Our results suggest that the neural mechanism by which OT influences primate social cognition may include changes in patterns of activity across neural networks that regulate social behavior in other animals. © 2018 Wiley Periodicals, Inc.

Consolidation in older adults depends upon competition between resting-state networks

PubMed Central

Jacobs, Heidi I. L.; Dillen, Kim N. H.; Risius, Okka; Göreci, Yasemin; Onur, Oezguer A.; Fink, Gereon R.; Kukolja, Juraj

2015-01-01

Memory encoding and retrieval problems are inherent to aging. To date, however, the effect of aging upon the neural correlates of forming memory traces remains poorly understood. Resting-state fMRI connectivity can be used to investigate initial consolidation. We compared within and between network connectivity differences between healthy young and older participants before encoding, after encoding and before retrieval by means of resting-state fMRI. Alterations over time in the between-network connectivity analyses correlated with retrieval performance, whereas within-network connectivity did not: a higher level of negative coupling or competition between the default mode and the executive networks during the after encoding condition was associated with increased retrieval performance in the older adults, but not in the young group. Data suggest that the effective formation of memory traces depends on an age-dependent, dynamic reorganization of the interaction between multiple, large-scale functional networks. Our findings demonstrate that a cross-network based approach can further the understanding of the neural underpinnings of aging-associated memory decline. PMID:25620930

Neural-Network Quantum States, String-Bond States, and Chiral Topological States

NASA Astrophysics Data System (ADS)

Glasser, Ivan; Pancotti, Nicola; August, Moritz; Rodriguez, Ivan D.; Cirac, J. Ignacio

2018-01-01

Neural-network quantum states have recently been introduced as an Ansatz for describing the wave function of quantum many-body systems. We show that there are strong connections between neural-network quantum states in the form of restricted Boltzmann machines and some classes of tensor-network states in arbitrary dimensions. In particular, we demonstrate that short-range restricted Boltzmann machines are entangled plaquette states, while fully connected restricted Boltzmann machines are string-bond states with a nonlocal geometry and low bond dimension. These results shed light on the underlying architecture of restricted Boltzmann machines and their efficiency at representing many-body quantum states. String-bond states also provide a generic way of enhancing the power of neural-network quantum states and a natural generalization to systems with larger local Hilbert space. We compare the advantages and drawbacks of these different classes of states and present a method to combine them together. This allows us to benefit from both the entanglement structure of tensor networks and the efficiency of neural-network quantum states into a single Ansatz capable of targeting the wave function of strongly correlated systems. While it remains a challenge to describe states with chiral topological order using traditional tensor networks, we show that, because of their nonlocal geometry, neural-network quantum states and their string-bond-state extension can describe a lattice fractional quantum Hall state exactly. In addition, we provide numerical evidence that neural-network quantum states can approximate a chiral spin liquid with better accuracy than entangled plaquette states and local string-bond states. Our results demonstrate the efficiency of neural networks to describe complex quantum wave functions and pave the way towards the use of string-bond states as a tool in more traditional machine-learning applications.

Two distinct neural networks support the mapping of meaning to a novel word.

PubMed

Ye, Zheng; Mestres-Missé, Anna; Rodriguez-Fornells, Antoni; Münte, Thomas F

2011-07-01

Children can learn the meaning of a new word from context during normal reading or listening, without any explicit instruction. It is unclear how such meaning acquisition is supported and achieved in human brain. In this functional magnetic resonance imaging (fMRI) study we investigated neural networks supporting word learning with a functional connectivity approach. Participants were exposed to a new word presented in two successive sentences and needed to derive the meaning of the new word. We observed two neural networks involved in mapping the meaning to the new word. One network connected the left inferior frontal gyrus (LIFG) with the middle frontal gyrus (MFG), medial superior frontal gyrus, caudate nucleus, thalamus, and inferior parietal lobule. The other network connected the left middle temporal gyrus (LMTG) with the MFG, anterior and posterior cingulate cortex. The LIFG network showed stronger interregional interactions for new than real words, whereas the LMTG network showed similar connectivity patterns for new and real words. We proposed that these two networks support different functions during word learning. The LIFG network appears to select the most appropriate meaning from competing candidates and to map the selected meaning onto the new word. The LMTG network may be recruited to integrate the word into sentential context, regardless of whether the word is real or new. The LIFG and the LMTG networks share a common node, the MFG, suggesting that these two networks communicate in working memory. Copyright © 2010 Wiley-Liss, Inc.

Explicitly integrating parameter, input, and structure uncertainties into Bayesian Neural Networks for probabilistic hydrologic forecasting

DOE Office of Scientific and Technical Information (OSTI.GOV)

Zhang, Xuesong; Liang, Faming; Yu, Beibei

2011-11-09

Estimating uncertainty of hydrologic forecasting is valuable to water resources and other relevant decision making processes. Recently, Bayesian Neural Networks (BNNs) have been proved powerful tools for quantifying uncertainty of streamflow forecasting. In this study, we propose a Markov Chain Monte Carlo (MCMC) framework to incorporate the uncertainties associated with input, model structure, and parameter into BNNs. This framework allows the structure of the neural networks to change by removing or adding connections between neurons and enables scaling of input data by using rainfall multipliers. The results show that the new BNNs outperform the BNNs that only consider uncertainties associatedmore » with parameter and model structure. Critical evaluation of posterior distribution of neural network weights, number of effective connections, rainfall multipliers, and hyper-parameters show that the assumptions held in our BNNs are not well supported. Further understanding of characteristics of different uncertainty sources and including output error into the MCMC framework are expected to enhance the application of neural networks for uncertainty analysis of hydrologic forecasting.« less

Abnormal resting-state connectivity of motor and cognitive networks in early manifest Huntington's disease.

PubMed

Wolf, R C; Sambataro, F; Vasic, N; Depping, M S; Thomann, P A; Landwehrmeyer, G B; Süssmuth, S D; Orth, M

2014-11-01

Functional magnetic resonance imaging (fMRI) of multiple neural networks during the brain's 'resting state' could facilitate biomarker development in patients with Huntington's disease (HD) and may provide new insights into the relationship between neural dysfunction and clinical symptoms. To date, however, very few studies have examined the functional integrity of multiple resting state networks (RSNs) in manifest HD, and even less is known about whether concomitant brain atrophy affects neural activity in patients. Using MRI, we investigated brain structure and RSN function in patients with early HD (n = 20) and healthy controls (n = 20). For resting-state fMRI data a group-independent component analysis identified spatiotemporally distinct patterns of motor and prefrontal RSNs of interest. We used voxel-based morphometry to assess regional brain atrophy, and 'biological parametric mapping' analyses to investigate the impact of atrophy on neural activity. Compared with controls, patients showed connectivity changes within distinct neural systems including lateral prefrontal, supplementary motor, thalamic, cingulate, temporal and parietal regions. In patients, supplementary motor area and cingulate cortex connectivity indices were associated with measures of motor function, whereas lateral prefrontal connectivity was associated with cognition. This study provides evidence for aberrant connectivity of RSNs associated with motor function and cognition in early manifest HD when controlling for brain atrophy. This suggests clinically relevant changes of RSN activity in the presence of HD-associated cortical and subcortical structural abnormalities.

Neural network based speech synthesizer: A preliminary report

NASA Technical Reports Server (NTRS)

Villarreal, James A.; Mcintire, Gary

1987-01-01

A neural net based speech synthesis project is discussed. The novelty is that the reproduced speech was extracted from actual voice recordings. In essence, the neural network learns the timing, pitch fluctuations, connectivity between individual sounds, and speaking habits unique to that individual person. The parallel distributed processing network used for this project is the generalized backward propagation network which has been modified to also learn sequences of actions or states given in a particular plan.

[Measurement and performance analysis of functional neural network].

PubMed

Li, Shan; Liu, Xinyu; Chen, Yan; Wan, Hong

2018-04-01

The measurement of network is one of the important researches in resolving neuronal population information processing mechanism using complex network theory. For the quantitative measurement problem of functional neural network, the relation between the measure indexes, i.e. the clustering coefficient, the global efficiency, the characteristic path length and the transitivity, and the network topology was analyzed. Then, the spike-based functional neural network was established and the simulation results showed that the measured network could represent the original neural connections among neurons. On the basis of the former work, the coding of functional neural network in nidopallium caudolaterale (NCL) about pigeon's motion behaviors was studied. We found that the NCL functional neural network effectively encoded the motion behaviors of the pigeon, and there were significant differences in four indexes among the left-turning, the forward and the right-turning. Overall, the establishment method of spike-based functional neural network is available and it is an effective tool to parse the brain information processing mechanism.

Long-term memory stabilized by noise-induced rehearsal.

PubMed

Wei, Yi; Koulakov, Alexei A

2014-11-19

Cortical networks can maintain memories for decades despite the short lifetime of synaptic strengths. Can a neural network store long-lasting memories in unstable synapses? Here, we study the effects of ongoing spike-timing-dependent plasticity (STDP) on the stability of memory patterns stored in synapses of an attractor neural network. We show that certain classes of STDP rules can stabilize all stored memory patterns despite a short lifetime of synapses. In our model, unstructured neural noise, after passing through the recurrent network connections, carries the imprint of all memory patterns in temporal correlations. STDP, combined with these correlations, leads to reinforcement of all stored patterns, even those that are never explicitly visited. Our findings may provide the functional reason for irregular spiking displayed by cortical neurons and justify models of system memory consolidation. Therefore, we propose that irregular neural activity is the feature that helps cortical networks maintain stable connections. Copyright © 2014 the authors 0270-6474/14/3415804-12$15.00/0.

The Laplacian spectrum of neural networks

PubMed Central

de Lange, Siemon C.; de Reus, Marcel A.; van den Heuvel, Martijn P.

2014-01-01

The brain is a complex network of neural interactions, both at the microscopic and macroscopic level. Graph theory is well suited to examine the global network architecture of these neural networks. Many popular graph metrics, however, encode average properties of individual network elements. Complementing these “conventional” graph metrics, the eigenvalue spectrum of the normalized Laplacian describes a network's structure directly at a systems level, without referring to individual nodes or connections. In this paper, the Laplacian spectra of the macroscopic anatomical neuronal networks of the macaque and cat, and the microscopic network of the Caenorhabditis elegans were examined. Consistent with conventional graph metrics, analysis of the Laplacian spectra revealed an integrative community structure in neural brain networks. Extending previous findings of overlap of network attributes across species, similarity of the Laplacian spectra across the cat, macaque and C. elegans neural networks suggests a certain level of consistency in the overall architecture of the anatomical neural networks of these species. Our results further suggest a specific network class for neural networks, distinct from conceptual small-world and scale-free models as well as several empirical networks. PMID:24454286

Self-organization of synchronous activity propagation in neuronal networks driven by local excitation

PubMed Central

Bayati, Mehdi; Valizadeh, Alireza; Abbassian, Abdolhossein; Cheng, Sen

2015-01-01

Many experimental and theoretical studies have suggested that the reliable propagation of synchronous neural activity is crucial for neural information processing. The propagation of synchronous firing activity in so-called synfire chains has been studied extensively in feed-forward networks of spiking neurons. However, it remains unclear how such neural activity could emerge in recurrent neuronal networks through synaptic plasticity. In this study, we investigate whether local excitation, i.e., neurons that fire at a higher frequency than the other, spontaneously active neurons in the network, can shape a network to allow for synchronous activity propagation. We use two-dimensional, locally connected and heterogeneous neuronal networks with spike-timing dependent plasticity (STDP). We find that, in our model, local excitation drives profound network changes within seconds. In the emergent network, neural activity propagates synchronously through the network. This activity originates from the site of the local excitation and propagates through the network. The synchronous activity propagation persists, even when the local excitation is removed, since it derives from the synaptic weight matrix. Importantly, once this connectivity is established it remains stable even in the presence of spontaneous activity. Our results suggest that synfire-chain-like activity can emerge in a relatively simple way in realistic neural networks by locally exciting the desired origin of the neuronal sequence. PMID:26089794

GaAs Optoelectronic Integrated-Circuit Neurons

NASA Technical Reports Server (NTRS)

Lin, Steven H.; Kim, Jae H.; Psaltis, Demetri

1992-01-01

Monolithic GaAs optoelectronic integrated circuits developed for use as artificial neurons. Neural-network computer contains planar arrays of optoelectronic neurons, and variable synaptic connections between neurons effected by diffraction of light from volume hologram in photorefractive material. Basic principles of neural-network computers explained more fully in "Optoelectronic Integrated Circuits For Neural Networks" (NPO-17652). In present circuits, devices replaced by metal/semiconductor field effect transistors (MESFET's), which consume less power.

Muscle networks: Connectivity analysis of EMG activity during postural control

NASA Astrophysics Data System (ADS)

Boonstra, Tjeerd W.; Danna-Dos-Santos, Alessander; Xie, Hong-Bo; Roerdink, Melvyn; Stins, John F.; Breakspear, Michael

2015-12-01

Understanding the mechanisms that reduce the many degrees of freedom in the musculoskeletal system remains an outstanding challenge. Muscle synergies reduce the dimensionality and hence simplify the control problem. How this is achieved is not yet known. Here we use network theory to assess the coordination between multiple muscles and to elucidate the neural implementation of muscle synergies. We performed connectivity analysis of surface EMG from ten leg muscles to extract the muscle networks while human participants were standing upright in four different conditions. We observed widespread connectivity between muscles at multiple distinct frequency bands. The network topology differed significantly between frequencies and between conditions. These findings demonstrate how muscle networks can be used to investigate the neural circuitry of motor coordination. The presence of disparate muscle networks across frequencies suggests that the neuromuscular system is organized into a multiplex network allowing for parallel and hierarchical control structures.

Qualitative and quantitative estimation of comprehensive synaptic connectivity in short- and long-term cultured rat hippocampal neurons with new analytical methods inspired by Scatchard and Hill plots

DOE Office of Scientific and Technical Information (OSTI.GOV)

Tanamoto, Ryo; Shindo, Yutaka; Niwano, Mariko

2016-03-18

To investigate comprehensive synaptic connectivity, we examined Ca{sup 2+} responses with quantitative electric current stimulation by indium-tin-oxide (ITO) glass electrode with transparent and high electro-conductivity. The number of neurons with Ca{sup 2+} responses was low during the application of stepwise increase of electric current in short-term cultured neurons (less than 17 days in-vitro (DIV)). The neurons cultured over 17 DIV showed two-type responses: S-shaped (sigmoid) and monotonous saturated responses, and Scatchard plots well illustrated the difference of these two responses. Furthermore, sigmoid like neural network responses over 17 DIV were altered to the monotonous saturated ones by the application ofmore » the mixture of AP5 and CNQX, specific blockers of NMDA and AMPA receptors, respectively. This alternation was also characterized by the change of Hill coefficients. These findings indicate that the neural network with sigmoid-like responses has strong synergetic or cooperative synaptic connectivity via excitatory glutamate synapses. - Highlights: • We succeed to evaluate the maturation of neural network by Scathard and Hill Plots. • Long-term cultured neurons showed two-type responses: sigmoid and monotonous. • The sigmoid-like increase indicates the cooperatevity of neural networks. • Excitatory glutamate synapses cause the cooperatevity of neural networks.« less

Synchronization transition in neuronal networks composed of chaotic or non-chaotic oscillators.

PubMed

Xu, Kesheng; Maidana, Jean Paul; Castro, Samy; Orio, Patricio

2018-05-30

Chaotic dynamics has been shown in the dynamics of neurons and neural networks, in experimental data and numerical simulations. Theoretical studies have proposed an underlying role of chaos in neural systems. Nevertheless, whether chaotic neural oscillators make a significant contribution to network behaviour and whether the dynamical richness of neural networks is sensitive to the dynamics of isolated neurons, still remain open questions. We investigated synchronization transitions in heterogeneous neural networks of neurons connected by electrical coupling in a small world topology. The nodes in our model are oscillatory neurons that - when isolated - can exhibit either chaotic or non-chaotic behaviour, depending on conductance parameters. We found that the heterogeneity of firing rates and firing patterns make a greater contribution than chaos to the steepness of the synchronization transition curve. We also show that chaotic dynamics of the isolated neurons do not always make a visible difference in the transition to full synchrony. Moreover, macroscopic chaos is observed regardless of the dynamics nature of the neurons. However, performing a Functional Connectivity Dynamics analysis, we show that chaotic nodes can promote what is known as multi-stable behaviour, where the network dynamically switches between a number of different semi-synchronized, metastable states.

Successful Reconstruction of a Physiological Circuit with Known Connectivity from Spiking Activity Alone

PubMed Central

Gerhard, Felipe; Kispersky, Tilman; Gutierrez, Gabrielle J.; Marder, Eve; Kramer, Mark; Eden, Uri

2013-01-01

Identifying the structure and dynamics of synaptic interactions between neurons is the first step to understanding neural network dynamics. The presence of synaptic connections is traditionally inferred through the use of targeted stimulation and paired recordings or by post-hoc histology. More recently, causal network inference algorithms have been proposed to deduce connectivity directly from electrophysiological signals, such as extracellularly recorded spiking activity. Usually, these algorithms have not been validated on a neurophysiological data set for which the actual circuitry is known. Recent work has shown that traditional network inference algorithms based on linear models typically fail to identify the correct coupling of a small central pattern generating circuit in the stomatogastric ganglion of the crab Cancer borealis. In this work, we show that point process models of observed spike trains can guide inference of relative connectivity estimates that match the known physiological connectivity of the central pattern generator up to a choice of threshold. We elucidate the necessary steps to derive faithful connectivity estimates from a model that incorporates the spike train nature of the data. We then apply the model to measure changes in the effective connectivity pattern in response to two pharmacological interventions, which affect both intrinsic neural dynamics and synaptic transmission. Our results provide the first successful application of a network inference algorithm to a circuit for which the actual physiological synapses between neurons are known. The point process methodology presented here generalizes well to larger networks and can describe the statistics of neural populations. In general we show that advanced statistical models allow for the characterization of effective network structure, deciphering underlying network dynamics and estimating information-processing capabilities. PMID:23874181

A Change in the Ion Selectivity of Ligand-Gated Ion Channels Provides a Mechanism to Switch Behavior.

PubMed

Pirri, Jennifer K; Rayes, Diego; Alkema, Mark J

2015-01-01

Behavioral output of neural networks depends on a delicate balance between excitatory and inhibitory synaptic connections. However, it is not known whether network formation and stability is constrained by the sign of synaptic connections between neurons within the network. Here we show that switching the sign of a synapse within a neural circuit can reverse the behavioral output. The inhibitory tyramine-gated chloride channel, LGC-55, induces head relaxation and inhibits forward locomotion during the Caenorhabditis elegans escape response. We switched the ion selectivity of an inhibitory LGC-55 anion channel to an excitatory LGC-55 cation channel. The engineered cation channel is properly trafficked in the native neural circuit and results in behavioral responses that are opposite to those produced by activation of the LGC-55 anion channel. Our findings indicate that switches in ion selectivity of ligand-gated ion channels (LGICs) do not affect network connectivity or stability and may provide an evolutionary and a synthetic mechanism to change behavior.

Neuronal avalanches of a self-organized neural network with active-neuron-dominant structure.

PubMed

Li, Xiumin; Small, Michael

2012-06-01

Neuronal avalanche is a spontaneous neuronal activity which obeys a power-law distribution of population event sizes with an exponent of -3/2. It has been observed in the superficial layers of cortex both in vivo and in vitro. In this paper, we analyze the information transmission of a novel self-organized neural network with active-neuron-dominant structure. Neuronal avalanches can be observed in this network with appropriate input intensity. We find that the process of network learning via spike-timing dependent plasticity dramatically increases the complexity of network structure, which is finally self-organized to be active-neuron-dominant connectivity. Both the entropy of activity patterns and the complexity of their resulting post-synaptic inputs are maximized when the network dynamics are propagated as neuronal avalanches. This emergent topology is beneficial for information transmission with high efficiency and also could be responsible for the large information capacity of this network compared with alternative archetypal networks with different neural connectivity.

Proceedings of the Second Joint Technology Workshop on Neural Networks and Fuzzy Logic, volume 1

NASA Technical Reports Server (NTRS)

Lea, Robert N. (Editor); Villarreal, James (Editor)

1991-01-01

Documented here are papers presented at the Neural Networks and Fuzzy Logic Workshop sponsored by NASA and the University of Houston, Clear Lake. The workshop was held April 11 to 13 at the Johnson Space Flight Center. Technical topics addressed included adaptive systems, learning algorithms, network architectures, vision, robotics, neurobiological connections, speech recognition and synthesis, fuzzy set theory and application, control and dynamics processing, space applications, fuzzy logic and neural network computers, approximate reasoning, and multiobject decision making.

Implementation of pulse-coupled neural networks in a CNAPS environment.

PubMed

Kinser, J M; Lindblad, T

1999-01-01

Pulse coupled neural networks (PCNN's) are biologically inspired algorithms very well suited for image/signal preprocessing. While several analog implementations are proposed we suggest a digital implementation in an existing environment, the connected network of adapted processors system (CNAPS). The reason for this is two fold. First, CNAPS is a commercially available chip which has been used for several neural-network implementations. Second, the PCNN is, in almost all applications, a very efficient component of a system requiring subsequent and additional processing. This may include gating, Fourier transforms, neural classifiers, data mining, etc, with or without feedback to the PCNN.

Modification of a neuronal network direction using stepwise photo-thermal etching of an agarose architecture.

PubMed

Suzuki, Ikurou; Sugio, Yoshihiro; Moriguchi, Hiroyuki; Jimbo, Yasuhiko; Yasuda, Kenji

2004-07-01

Control over spatial distribution of individual neurons and the pattern of neural network provides an important tool for studying information processing pathways during neural network formation. Moreover, the knowledge of the direction of synaptic connections between cells in each neural network can provide detailed information on the relationship between the forward and feedback signaling. We have developed a method for topographical control of the direction of synaptic connections within a living neuronal network using a new type of individual-cell-based on-chip cell-cultivation system with an agarose microchamber array (AMCA). The advantages of this system include the possibility to control positions and number of cultured cells as well as flexible control of the direction of elongation of axons through stepwise melting of narrow grooves. Such micrometer-order microchannels are obtained by photo-thermal etching of agarose where a portion of the gel is melted with a 1064-nm infrared laser beam. Using this system, we created neural network from individual Rat hippocampal cells. We were able to control elongation of individual axons during cultivation (from cells contained within the AMCA) by non-destructive stepwise photo-thermal etching. We have demonstrated the potential of our on-chip AMCA cell cultivation system for the controlled development of individual cell-based neural networks.

Neural networks for vertical microcode compaction

NASA Astrophysics Data System (ADS)

Chu, Pong P.

1992-09-01

Neural networks provide an alternative way to solve complex optimization problems. Instead of performing a program of instructions sequentially as in a traditional computer, neural network model explores many competing hypotheses simultaneously using its massively parallel net. The paper shows how to use the neural network approach to perform vertical micro-code compaction for a micro-programmed control unit. The compaction procedure includes two basic steps. The first step determines the compatibility classes and the second step selects a minimal subset to cover the control signals. Since the selection process is an NP- complete problem, to find an optimal solution is impractical. In this study, we employ a customized neural network to obtain the minimal subset. We first formalize this problem, and then define an `energy function' and map it to a two-layer fully connected neural network. The modified network has two types of neurons and can always obtain a valid solution.

Chimera states in brain networks: Empirical neural vs. modular fractal connectivity

NASA Astrophysics Data System (ADS)

Chouzouris, Teresa; Omelchenko, Iryna; Zakharova, Anna; Hlinka, Jaroslav; Jiruska, Premysl; Schöll, Eckehard

2018-04-01

Complex spatiotemporal patterns, called chimera states, consist of coexisting coherent and incoherent domains and can be observed in networks of coupled oscillators. The interplay of synchrony and asynchrony in complex brain networks is an important aspect in studies of both the brain function and disease. We analyse the collective dynamics of FitzHugh-Nagumo neurons in complex networks motivated by its potential application to epileptology and epilepsy surgery. We compare two topologies: an empirical structural neural connectivity derived from diffusion-weighted magnetic resonance imaging and a mathematically constructed network with modular fractal connectivity. We analyse the properties of chimeras and partially synchronized states and obtain regions of their stability in the parameter planes. Furthermore, we qualitatively simulate the dynamics of epileptic seizures and study the influence of the removal of nodes on the network synchronizability, which can be useful for applications to epileptic surgery.

Joint multiple fully connected convolutional neural network with extreme learning machine for hepatocellular carcinoma nuclei grading.

PubMed

Li, Siqi; Jiang, Huiyan; Pang, Wenbo

2017-05-01

Accurate cell grading of cancerous tissue pathological image is of great importance in medical diagnosis and treatment. This paper proposes a joint multiple fully connected convolutional neural network with extreme learning machine (MFC-CNN-ELM) architecture for hepatocellular carcinoma (HCC) nuclei grading. First, in preprocessing stage, each grayscale image patch with the fixed size is obtained using center-proliferation segmentation (CPS) method and the corresponding labels are marked under the guidance of three pathologists. Next, a multiple fully connected convolutional neural network (MFC-CNN) is designed to extract the multi-form feature vectors of each input image automatically, which considers multi-scale contextual information of deep layer maps sufficiently. After that, a convolutional neural network extreme learning machine (CNN-ELM) model is proposed to grade HCC nuclei. Finally, a back propagation (BP) algorithm, which contains a new up-sample method, is utilized to train MFC-CNN-ELM architecture. The experiment comparison results demonstrate that our proposed MFC-CNN-ELM has superior performance compared with related works for HCC nuclei grading. Meanwhile, external validation using ICPR 2014 HEp-2 cell dataset shows the good generalization of our MFC-CNN-ELM architecture. Copyright © 2017 Elsevier Ltd. All rights reserved.

A new optimized GA-RBF neural network algorithm.

PubMed

Jia, Weikuan; Zhao, Dean; Shen, Tian; Su, Chunyang; Hu, Chanli; Zhao, Yuyan

2014-01-01

When confronting the complex problems, radial basis function (RBF) neural network has the advantages of adaptive and self-learning ability, but it is difficult to determine the number of hidden layer neurons, and the weights learning ability from hidden layer to the output layer is low; these deficiencies easily lead to decreasing learning ability and recognition precision. Aiming at this problem, we propose a new optimized RBF neural network algorithm based on genetic algorithm (GA-RBF algorithm), which uses genetic algorithm to optimize the weights and structure of RBF neural network; it chooses new ways of hybrid encoding and optimizing simultaneously. Using the binary encoding encodes the number of the hidden layer's neurons and using real encoding encodes the connection weights. Hidden layer neurons number and connection weights are optimized simultaneously in the new algorithm. However, the connection weights optimization is not complete; we need to use least mean square (LMS) algorithm for further leaning, and finally get a new algorithm model. Using two UCI standard data sets to test the new algorithm, the results show that the new algorithm improves the operating efficiency in dealing with complex problems and also improves the recognition precision, which proves that the new algorithm is valid.

Trade-off between Multiple Constraints Enables Simultaneous Formation of Modules and Hubs in Neural Systems

PubMed Central

Chen, Yuhan; Wang, Shengjun; Hilgetag, Claus C.; Zhou, Changsong

2013-01-01

The formation of the complex network architecture of neural systems is subject to multiple structural and functional constraints. Two obvious but apparently contradictory constraints are low wiring cost and high processing efficiency, characterized by short overall wiring length and a small average number of processing steps, respectively. Growing evidence shows that neural networks are results from a trade-off between physical cost and functional value of the topology. However, the relationship between these competing constraints and complex topology is not well understood quantitatively. We explored this relationship systematically by reconstructing two known neural networks, Macaque cortical connectivity and C. elegans neuronal connections, from combinatory optimization of wiring cost and processing efficiency constraints, using a control parameter , and comparing the reconstructed networks to the real networks. We found that in both neural systems, the reconstructed networks derived from the two constraints can reveal some important relations between the spatial layout of nodes and the topological connectivity, and match several properties of the real networks. The reconstructed and real networks had a similar modular organization in a broad range of , resulting from spatial clustering of network nodes. Hubs emerged due to the competition of the two constraints, and their positions were close to, and partly coincided, with the real hubs in a range of values. The degree of nodes was correlated with the density of nodes in their spatial neighborhood in both reconstructed and real networks. Generally, the rebuilt network matched a significant portion of real links, especially short-distant ones. These findings provide clear evidence to support the hypothesis of trade-off between multiple constraints on brain networks. The two constraints of wiring cost and processing efficiency, however, cannot explain all salient features in the real networks. The discrepancy suggests that there are further relevant factors that are not yet captured here. PMID:23505352

Elements of an algorithm for optimizing a parameter-structural neural network

NASA Astrophysics Data System (ADS)

Mrówczyńska, Maria

2016-06-01

The field of processing information provided by measurement results is one of the most important components of geodetic technologies. The dynamic development of this field improves classic algorithms for numerical calculations in the aspect of analytical solutions that are difficult to achieve. Algorithms based on artificial intelligence in the form of artificial neural networks, including the topology of connections between neurons have become an important instrument connected to the problem of processing and modelling processes. This concept results from the integration of neural networks and parameter optimization methods and makes it possible to avoid the necessity to arbitrarily define the structure of a network. This kind of extension of the training process is exemplified by the algorithm called the Group Method of Data Handling (GMDH), which belongs to the class of evolutionary algorithms. The article presents a GMDH type network, used for modelling deformations of the geometrical axis of a steel chimney during its operation.

Mutual connectivity analysis (MCA) using generalized radial basis function neural networks for nonlinear functional connectivity network recovery in resting-state functional MRI

NASA Astrophysics Data System (ADS)

D'Souza, Adora M.; Abidin, Anas Zainul; Nagarajan, Mahesh B.; Wismüller, Axel

2016-03-01

We investigate the applicability of a computational framework, called mutual connectivity analysis (MCA), for directed functional connectivity analysis in both synthetic and resting-state functional MRI data. This framework comprises of first evaluating non-linear cross-predictability between every pair of time series prior to recovering the underlying network structure using community detection algorithms. We obtain the non-linear cross-prediction score between time series using Generalized Radial Basis Functions (GRBF) neural networks. These cross-prediction scores characterize the underlying functionally connected networks within the resting brain, which can be extracted using non-metric clustering approaches, such as the Louvain method. We first test our approach on synthetic models with known directional influence and network structure. Our method is able to capture the directional relationships between time series (with an area under the ROC curve = 0.92 +/- 0.037) as well as the underlying network structure (Rand index = 0.87 +/- 0.063) with high accuracy. Furthermore, we test this method for network recovery on resting-state fMRI data, where results are compared to the motor cortex network recovered from a motor stimulation sequence, resulting in a strong agreement between the two (Dice coefficient = 0.45). We conclude that our MCA approach is effective in analyzing non-linear directed functional connectivity and in revealing underlying functional network structure in complex systems.

Mutual Connectivity Analysis (MCA) Using Generalized Radial Basis Function Neural Networks for Nonlinear Functional Connectivity Network Recovery in Resting-State Functional MRI.

PubMed

DSouza, Adora M; Abidin, Anas Zainul; Nagarajan, Mahesh B; Wismüller, Axel

2016-03-29

We investigate the applicability of a computational framework, called mutual connectivity analysis (MCA), for directed functional connectivity analysis in both synthetic and resting-state functional MRI data. This framework comprises of first evaluating non-linear cross-predictability between every pair of time series prior to recovering the underlying network structure using community detection algorithms. We obtain the non-linear cross-prediction score between time series using Generalized Radial Basis Functions (GRBF) neural networks. These cross-prediction scores characterize the underlying functionally connected networks within the resting brain, which can be extracted using non-metric clustering approaches, such as the Louvain method. We first test our approach on synthetic models with known directional influence and network structure. Our method is able to capture the directional relationships between time series (with an area under the ROC curve = 0.92 ± 0.037) as well as the underlying network structure (Rand index = 0.87 ± 0.063) with high accuracy. Furthermore, we test this method for network recovery on resting-state fMRI data, where results are compared to the motor cortex network recovered from a motor stimulation sequence, resulting in a strong agreement between the two (Dice coefficient = 0.45). We conclude that our MCA approach is effective in analyzing non-linear directed functional connectivity and in revealing underlying functional network structure in complex systems.

Dynamic neural network models of the premotoneuronal circuitry controlling wrist movements in primates.

PubMed

Maier, M A; Shupe, L E; Fetz, E E

2005-10-01

Dynamic recurrent neural networks were derived to simulate neuronal populations generating bidirectional wrist movements in the monkey. The models incorporate anatomical connections of cortical and rubral neurons, muscle afferents, segmental interneurons and motoneurons; they also incorporate the response profiles of four populations of neurons observed in behaving monkeys. The networks were derived by gradient descent algorithms to generate the eight characteristic patterns of motor unit activations observed during alternating flexion-extension wrist movements. The resulting model generated the appropriate input-output transforms and developed connection strengths resembling those in physiological pathways. We found that this network could be further trained to simulate additional tasks, such as experimentally observed reflex responses to limb perturbations that stretched or shortened the active muscles, and scaling of response amplitudes in proportion to inputs. In the final comprehensive network, motor units are driven by the combined activity of cortical, rubral, spinal and afferent units during step tracking and perturbations. The model displayed many emergent properties corresponding to physiological characteristics. The resulting neural network provides a working model of premotoneuronal circuitry and elucidates the neural mechanisms controlling motoneuron activity. It also predicts several features to be experimentally tested, for example the consequences of eliminating inhibitory connections in cortex and red nucleus. It also reveals that co-contraction can be achieved by simultaneous activation of the flexor and extensor circuits without invoking features specific to co-contraction.

Hybrid discrete-time neural networks.

PubMed

Cao, Hongjun; Ibarz, Borja

2010-11-13

Hybrid dynamical systems combine evolution equations with state transitions. When the evolution equations are discrete-time (also called map-based), the result is a hybrid discrete-time system. A class of biological neural network models that has recently received some attention falls within this category: map-based neuron models connected by means of fast threshold modulation (FTM). FTM is a connection scheme that aims to mimic the switching dynamics of a neuron subject to synaptic inputs. The dynamic equations of the neuron adopt different forms according to the state (either firing or not firing) and type (excitatory or inhibitory) of their presynaptic neighbours. Therefore, the mathematical model of one such network is a combination of discrete-time evolution equations with transitions between states, constituting a hybrid discrete-time (map-based) neural network. In this paper, we review previous work within the context of these models, exemplifying useful techniques to analyse them. Typical map-based neuron models are low-dimensional and amenable to phase-plane analysis. In bursting models, fast-slow decomposition can be used to reduce dimensionality further, so that the dynamics of a pair of connected neurons can be easily understood. We also discuss a model that includes electrical synapses in addition to chemical synapses with FTM. Furthermore, we describe how master stability functions can predict the stability of synchronized states in these networks. The main results are extended to larger map-based neural networks.

Neural Network Modeling of UH-60A Pilot Vibration

NASA Technical Reports Server (NTRS)

Kottapalli, Sesi

2003-01-01

Full-scale flight-test pilot floor vibration is modeled using neural networks and full-scale wind tunnel test data for low speed level flight conditions. Neural network connections between the wind tunnel test data and the tlxee flight test pilot vibration components (vertical, lateral, and longitudinal) are studied. Two full-scale UH-60A Black Hawk databases are used. The first database is the NASMArmy UH-60A Airloads Program flight test database. The second database is the UH-60A rotor-only wind tunnel database that was acquired in the NASA Ames SO- by 120- Foot Wind Tunnel with the Large Rotor Test Apparatus (LRTA). Using neural networks, the flight-test pilot vibration is modeled using the wind tunnel rotating system hub accelerations, and separately, using the hub loads. The results show that the wind tunnel rotating system hub accelerations and the operating parameters can represent the flight test pilot vibration. The six components of the wind tunnel N/rev balance-system hub loads and the operating parameters can also represent the flight test pilot vibration. The present neural network connections can significandy increase the value of wind tunnel testing.

The role of symmetry in neural networks and their Laplacian spectra.

PubMed

de Lange, Siemon C; van den Heuvel, Martijn P; de Reus, Marcel A

2016-11-01

Human and animal nervous systems constitute complexly wired networks that form the infrastructure for neural processing and integration of information. The organization of these neural networks can be analyzed using the so-called Laplacian spectrum, providing a mathematical tool to produce systems-level network fingerprints. In this article, we examine a characteristic central peak in the spectrum of neural networks, including anatomical brain network maps of the mouse, cat and macaque, as well as anatomical and functional network maps of human brain connectivity. We link the occurrence of this central peak to the level of symmetry in neural networks, an intriguing aspect of network organization resulting from network elements that exhibit similar wiring patterns. Specifically, we propose a measure to capture the global level of symmetry of a network and show that, for both empirical networks and network models, the height of the main peak in the Laplacian spectrum is strongly related to node symmetry in the underlying network. Moreover, examination of spectra of duplication-based model networks shows that neural spectra are best approximated using a trade-off between duplication and diversification. Taken together, our results facilitate a better understanding of neural network spectra and the importance of symmetry in neural networks. Copyright © 2016 Elsevier Inc. All rights reserved.

Intrinsic connectivity of neural networks in the awake rabbit.

PubMed

Schroeder, Matthew P; Weiss, Craig; Procissi, Daniel; Disterhoft, John F; Wang, Lei

2016-04-01

The way in which the brain is functionally connected into different networks has emerged as an important research topic in order to understand normal neural processing and signaling. Since some experimental manipulations are difficult or unethical to perform in humans, animal models are better suited to investigate this topic. Rabbits are a species that can undergo MRI scanning in an awake and conscious state with minimal preparation and habituation. In this study, we characterized the intrinsic functional networks of the resting New Zealand White rabbit brain using BOLD fMRI data. Group independent component analysis revealed seven networks similar to those previously found in humans, non-human primates and/or rodents including the hippocampus, default mode, cerebellum, thalamus, and visual, somatosensory, and parietal cortices. For the first time, the intrinsic functional networks of the resting rabbit brain have been elucidated demonstrating the rabbit's applicability as a translational animal model. Without the confounding effects of anesthetics or sedatives, future experiments may employ rabbits to understand changes in neural connectivity and brain functioning as a result of experimental manipulation (e.g., temporary or permanent network disruption, learning-related changes, and drug administration). Copyright © 2016 Elsevier Inc. All rights reserved.

The evolution of cost-efficiency in neural networks during recovery from traumatic brain injury.

PubMed

Roy, Arnab; Bernier, Rachel A; Wang, Jianli; Benson, Monica; French, Jerry J; Good, David C; Hillary, Frank G

2017-01-01

A somewhat perplexing finding in the systems neuroscience has been the observation that physical injury to neural systems may result in enhanced functional connectivity (i.e., hyperconnectivity) relative to the typical network response. The consequences of local or global enhancement of functional connectivity remain uncertain and this is particularly true for the overall metabolic cost of the network. We examine the hyperconnectivity hypothesis in a sample of 14 individuals with TBI with data collected at approximately 3, 6, and 12 months following moderate and severe TBI. As anticipated, individuals with TBI showed increased network strength and cost early after injury, but by one-year post injury hyperconnectivity was more circumscribed to frontal DMN and temporal-parietal attentional control regions. Cost in these subregions was a significant predictor of cognitive performance. Cost-efficiency analysis in the Power 264 data parcellation suggested that at 6 months post injury the network requires higher cost connections to achieve high efficiency as compared to the network 12 months post injury. These results demonstrate that networks self-organize to re-establish connectivity while balancing cost-efficiency trade-offs.

The evolution of cost-efficiency in neural networks during recovery from traumatic brain injury

PubMed Central

Roy, Arnab; Bernier, Rachel A.; Wang, Jianli; Benson, Monica; French, Jerry J.; Good, David C.; Hillary, Frank G.

2017-01-01

A somewhat perplexing finding in the systems neuroscience has been the observation that physical injury to neural systems may result in enhanced functional connectivity (i.e., hyperconnectivity) relative to the typical network response. The consequences of local or global enhancement of functional connectivity remain uncertain and this is particularly true for the overall metabolic cost of the network. We examine the hyperconnectivity hypothesis in a sample of 14 individuals with TBI with data collected at approximately 3, 6, and 12 months following moderate and severe TBI. As anticipated, individuals with TBI showed increased network strength and cost early after injury, but by one-year post injury hyperconnectivity was more circumscribed to frontal DMN and temporal-parietal attentional control regions. Cost in these subregions was a significant predictor of cognitive performance. Cost-efficiency analysis in the Power 264 data parcellation suggested that at 6 months post injury the network requires higher cost connections to achieve high efficiency as compared to the network 12 months post injury. These results demonstrate that networks self-organize to re-establish connectivity while balancing cost-efficiency trade-offs. PMID:28422992

Single-hidden-layer feed-forward quantum neural network based on Grover learning.

PubMed

Liu, Cheng-Yi; Chen, Chein; Chang, Ching-Ter; Shih, Lun-Min

2013-09-01

In this paper, a novel single-hidden-layer feed-forward quantum neural network model is proposed based on some concepts and principles in the quantum theory. By combining the quantum mechanism with the feed-forward neural network, we defined quantum hidden neurons and connected quantum weights, and used them as the fundamental information processing unit in a single-hidden-layer feed-forward neural network. The quantum neurons make a wide range of nonlinear functions serve as the activation functions in the hidden layer of the network, and the Grover searching algorithm outstands the optimal parameter setting iteratively and thus makes very efficient neural network learning possible. The quantum neuron and weights, along with a Grover searching algorithm based learning, result in a novel and efficient neural network characteristic of reduced network, high efficient training and prospect application in future. Some simulations are taken to investigate the performance of the proposed quantum network and the result show that it can achieve accurate learning. Copyright © 2013 Elsevier Ltd. All rights reserved.

Dynamic facial expressions evoke distinct activation in the face perception network: a connectivity analysis study.

PubMed

Foley, Elaine; Rippon, Gina; Thai, Ngoc Jade; Longe, Olivia; Senior, Carl

2012-02-01

Very little is known about the neural structures involved in the perception of realistic dynamic facial expressions. In the present study, a unique set of naturalistic dynamic facial emotional expressions was created. Through fMRI and connectivity analysis, a dynamic face perception network was identified, which is demonstrated to extend Haxby et al.'s [Haxby, J. V., Hoffman, E. A., & Gobbini, M. I. The distributed human neural system for face perception. Trends in Cognitive Science, 4, 223-233, 2000] distributed neural system for face perception. This network includes early visual regions, such as the inferior occipital gyrus, which is identified as insensitive to motion or affect but sensitive to the visual stimulus, the STS, identified as specifically sensitive to motion, and the amygdala, recruited to process affect. Measures of effective connectivity between these regions revealed that dynamic facial stimuli were associated with specific increases in connectivity between early visual regions, such as the inferior occipital gyrus and the STS, along with coupling between the STS and the amygdala, as well as the inferior frontal gyrus. These findings support the presence of a distributed network of cortical regions that mediate the perception of different dynamic facial expressions.

A loop-based neural architecture for structured behavior encoding and decoding.

PubMed

Gisiger, Thomas; Boukadoum, Mounir

2018-02-01

We present a new type of artificial neural network that generalizes on anatomical and dynamical aspects of the mammal brain. Its main novelty lies in its topological structure which is built as an array of interacting elementary motifs shaped like loops. These loops come in various types and can implement functions such as gating, inhibitory or executive control, or encoding of task elements to name a few. Each loop features two sets of neurons and a control region, linked together by non-recurrent projections. The two neural sets do the bulk of the loop's computations while the control unit specifies the timing and the conditions under which the computations implemented by the loop are to be performed. By functionally linking many such loops together, a neural network is obtained that may perform complex cognitive computations. To demonstrate the potential offered by such a system, we present two neural network simulations. The first illustrates the structure and dynamics of a single loop implementing a simple gating mechanism. The second simulation shows how connecting four loops in series can produce neural activity patterns that are sufficient to pass a simplified delayed-response task. We also show that this network reproduces electrophysiological measurements gathered in various regions of the brain of monkeys performing similar tasks. We also demonstrate connections between this type of neural network and recurrent or long short-term memory network models, and suggest ways to generalize them for future artificial intelligence research. Copyright © 2017 Elsevier Ltd. All rights reserved.

Homeostatic Scaling of Excitability in Recurrent Neural Networks

PubMed Central

Remme, Michiel W. H.; Wadman, Wytse J.

2012-01-01

Neurons adjust their intrinsic excitability when experiencing a persistent change in synaptic drive. This process can prevent neural activity from moving into either a quiescent state or a saturated state in the face of ongoing plasticity, and is thought to promote stability of the network in which neurons reside. However, most neurons are embedded in recurrent networks, which require a delicate balance between excitation and inhibition to maintain network stability. This balance could be disrupted when neurons independently adjust their intrinsic excitability. Here, we study the functioning of activity-dependent homeostatic scaling of intrinsic excitability (HSE) in a recurrent neural network. Using both simulations of a recurrent network consisting of excitatory and inhibitory neurons that implement HSE, and a mean-field description of adapting excitatory and inhibitory populations, we show that the stability of such adapting networks critically depends on the relationship between the adaptation time scales of both neuron populations. In a stable adapting network, HSE can keep all neurons functioning within their dynamic range, while the network is undergoing several (patho)physiologically relevant types of plasticity, such as persistent changes in external drive, changes in connection strengths, or the loss of inhibitory cells from the network. However, HSE cannot prevent the unstable network dynamics that result when, due to such plasticity, recurrent excitation in the network becomes too strong compared to feedback inhibition. This suggests that keeping a neural network in a stable and functional state requires the coordination of distinct homeostatic mechanisms that operate not only by adjusting neural excitability, but also by controlling network connectivity. PMID:22570604

Functional connectivity of hippocampal and prefrontal networks during episodic and spatial memory based on real-world environments.

PubMed

Robin, Jessica; Hirshhorn, Marnie; Rosenbaum, R Shayna; Winocur, Gordon; Moscovitch, Morris; Grady, Cheryl L

2015-01-01

Several recent studies have compared episodic and spatial memory in neuroimaging paradigms in order to understand better the contribution of the hippocampus to each of these tasks. In the present study, we build on previous findings showing common neural activation in default network areas during episodic and spatial memory tasks based on familiar, real-world environments (Hirshhorn et al. (2012) Neuropsychologia 50:3094-3106). Following previous demonstrations of the presence of functionally connected sub-networks within the default network, we performed seed-based functional connectivity analyses to determine how, depending on the task, the hippocampus and prefrontal cortex differentially couple with one another and with distinct whole-brain networks. We found evidence for a medial prefrontal-parietal network and a medial temporal lobe network, which were functionally connected to the prefrontal and hippocampal seeds, respectively, regardless of the nature of the memory task. However, these two networks were functionally connected with one another during the episodic memory task, but not during spatial memory tasks. Replicating previous reports of fractionation of the default network into stable sub-networks, this study also shows how these sub-networks may flexibly couple and uncouple with one another based on task demands. These findings support the hypothesis that episodic memory and spatial memory share a common medial temporal lobe-based neural substrate, with episodic memory recruiting additional prefrontal sub-networks. © 2014 Wiley Periodicals, Inc.

Neural connections foster social connections: a diffusion-weighted imaging study of social networks

PubMed Central

Hampton, William H.; Unger, Ashley; Von Der Heide, Rebecca J.

2016-01-01

Although we know the transition from childhood to adulthood is marked by important social and neural development, little is known about how social network size might affect neurocognitive development or vice versa. Neuroimaging research has identified several brain regions, such as the amygdala, as key to this affiliative behavior. However, white matter connectivity among these regions, and its behavioral correlates, remain unclear. Here we tested two hypotheses: that an amygdalocentric structural white matter network governs social affiliative behavior and that this network changes during adolescence and young adulthood. We measured social network size behaviorally, and white matter microstructure using probabilistic diffusion tensor imaging in a sample of neurologically normal adolescents and young adults. Our results suggest amygdala white matter microstructure is key to understanding individual differences in social network size, with connectivity to other social brain regions such as the orbitofrontal cortex and anterior temporal lobe predicting much variation. In addition, participant age correlated with both network size and white matter variation in this network. These findings suggest the transition to adulthood may constitute a critical period for the optimization of structural brain networks underlying affiliative behavior. PMID:26755769

Rule extraction from minimal neural networks for credit card screening.

PubMed

Setiono, Rudy; Baesens, Bart; Mues, Christophe

2011-08-01

While feedforward neural networks have been widely accepted as effective tools for solving classification problems, the issue of finding the best network architecture remains unresolved, particularly so in real-world problem settings. We address this issue in the context of credit card screening, where it is important to not only find a neural network with good predictive performance but also one that facilitates a clear explanation of how it produces its predictions. We show that minimal neural networks with as few as one hidden unit provide good predictive accuracy, while having the added advantage of making it easier to generate concise and comprehensible classification rules for the user. To further reduce model size, a novel approach is suggested in which network connections from the input units to this hidden unit are removed by a very straightaway pruning procedure. In terms of predictive accuracy, both the minimized neural networks and the rule sets generated from them are shown to compare favorably with other neural network based classifiers. The rules generated from the minimized neural networks are concise and thus easier to validate in a real-life setting.

Reconstruction of magnetic configurations in W7-X using artificial neural networks

NASA Astrophysics Data System (ADS)

Böckenhoff, Daniel; Blatzheim, Marko; Hölbe, Hauke; Niemann, Holger; Pisano, Fabio; Labahn, Roger; Pedersen, Thomas Sunn; The W7-X Team

2018-05-01

It is demonstrated that artificial neural networks can be used to accurately and efficiently predict details of the magnetic topology at the plasma edge of the Wendelstein 7-X stellarator, based on simulated as well as measured heat load patterns onto plasma-facing components observed with infrared cameras. The connection between heat load patterns and the magnetic topology is a challenging regression problem, but one that suits artificial neural networks well. The use of a neural network makes it feasible to analyze and control the plasma exhaust in real-time, an important goal for Wendelstein 7-X, and for magnetic confinement fusion research in general.

A neural-network-based model for the dynamic simulation of the tire/suspension system while traversing road irregularities.

PubMed

Guarneri, Paolo; Rocca, Gianpiero; Gobbi, Massimiliano

2008-09-01

This paper deals with the simulation of the tire/suspension dynamics by using recurrent neural networks (RNNs). RNNs are derived from the multilayer feedforward neural networks, by adding feedback connections between output and input layers. The optimal network architecture derives from a parametric analysis based on the optimal tradeoff between network accuracy and size. The neural network can be trained with experimental data obtained in the laboratory from simulated road profiles (cleats). The results obtained from the neural network demonstrate good agreement with the experimental results over a wide range of operation conditions. The NN model can be effectively applied as a part of vehicle system model to accurately predict elastic bushings and tire dynamics behavior. Although the neural network model, as a black-box model, does not provide a good insight of the physical behavior of the tire/suspension system, it is a useful tool for assessing vehicle ride and noise, vibration, harshness (NVH) performance due to its good computational efficiency and accuracy.

The C. elegans Connectome Consists of Homogenous Circuits with Defined Functional Roles

PubMed Central

Azulay, Aharon; Zaslaver, Alon

2016-01-01

A major goal of systems neuroscience is to decipher the structure-function relationship in neural networks. Here we study network functionality in light of the common-neighbor-rule (CNR) in which a pair of neurons is more likely to be connected the more common neighbors it shares. Focusing on the fully-mapped neural network of C. elegans worms, we establish that the CNR is an emerging property in this connectome. Moreover, sets of common neighbors form homogenous structures that appear in defined layers of the network. Simulations of signal propagation reveal their potential functional roles: signal amplification and short-term memory at the sensory/inter-neuron layer, and synchronized activity at the motoneuron layer supporting coordinated movement. A coarse-grained view of the neural network based on homogenous connected sets alone reveals a simple modular network architecture that is intuitive to understand. These findings provide a novel framework for analyzing larger, more complex, connectomes once these become available. PMID:27606684

Learning Universal Computations with Spikes

PubMed Central

Thalmeier, Dominik; Uhlmann, Marvin; Kappen, Hilbert J.; Memmesheimer, Raoul-Martin

2016-01-01

Providing the neurobiological basis of information processing in higher animals, spiking neural networks must be able to learn a variety of complicated computations, including the generation of appropriate, possibly delayed reactions to inputs and the self-sustained generation of complex activity patterns, e.g. for locomotion. Many such computations require previous building of intrinsic world models. Here we show how spiking neural networks may solve these different tasks. Firstly, we derive constraints under which classes of spiking neural networks lend themselves to substrates of powerful general purpose computing. The networks contain dendritic or synaptic nonlinearities and have a constrained connectivity. We then combine such networks with learning rules for outputs or recurrent connections. We show that this allows to learn even difficult benchmark tasks such as the self-sustained generation of desired low-dimensional chaotic dynamics or memory-dependent computations. Furthermore, we show how spiking networks can build models of external world systems and use the acquired knowledge to control them. PMID:27309381

The brainstem reticular formation is a small-world, not scale-free, network

PubMed Central

Humphries, M.D; Gurney, K; Prescott, T.J

2005-01-01

Recently, it has been demonstrated that several complex systems may have simple graph-theoretic characterizations as so-called ‘small-world’ and ‘scale-free’ networks. These networks have also been applied to the gross neural connectivity between primate cortical areas and the nervous system of Caenorhabditis elegans. Here, we extend this work to a specific neural circuit of the vertebrate brain—the medial reticular formation (RF) of the brainstem—and, in doing so, we have made three key contributions. First, this work constitutes the first model (and quantitative review) of this important brain structure for over three decades. Second, we have developed the first graph-theoretic analysis of vertebrate brain connectivity at the neural network level. Third, we propose simple metrics to quantitatively assess the extent to which the networks studied are small-world or scale-free. We conclude that the medial RF is configured to create small-world (implying coherent rapid-processing capabilities), but not scale-free, type networks under assumptions which are amenable to quantitative measurement. PMID:16615219

Constructive autoassociative neural network for facial recognition.

PubMed

Fernandes, Bruno J T; Cavalcanti, George D C; Ren, Tsang I

2014-01-01

Autoassociative artificial neural networks have been used in many different computer vision applications. However, it is difficult to define the most suitable neural network architecture because this definition is based on previous knowledge and depends on the problem domain. To address this problem, we propose a constructive autoassociative neural network called CANet (Constructive Autoassociative Neural Network). CANet integrates the concepts of receptive fields and autoassociative memory in a dynamic architecture that changes the configuration of the receptive fields by adding new neurons in the hidden layer, while a pruning algorithm removes neurons from the output layer. Neurons in the CANet output layer present lateral inhibitory connections that improve the recognition rate. Experiments in face recognition and facial expression recognition show that the CANet outperforms other methods presented in the literature.

Mindfulness and dynamic functional neural connectivity in children and adolescents.

PubMed

Marusak, Hilary A; Elrahal, Farrah; Peters, Craig A; Kundu, Prantik; Lombardo, Michael V; Calhoun, Vince D; Goldberg, Elimelech K; Cohen, Cindy; Taub, Jeffrey W; Rabinak, Christine A

2018-01-15

Interventions that promote mindfulness consistently show salutary effects on cognition and emotional wellbeing in adults, and more recently, in children and adolescents. However, we lack understanding of the neurobiological mechanisms underlying mindfulness in youth that should allow for more judicious application of these interventions in clinical and educational settings. Using multi-echo multi-band fMRI, we examined dynamic (i.e., time-varying) and conventional static resting-state connectivity between core neurocognitive networks (i.e., salience/emotion, default mode, central executive) in 42 children and adolescents (ages 6-17). We found that trait mindfulness in youth relates to dynamic but not static resting-state connectivity. Specifically, more mindful youth transitioned more between brain states over the course of the scan, spent overall less time in a certain connectivity state, and showed a state-specific reduction in connectivity between salience/emotion and central executive networks. The number of state transitions mediated the link between higher mindfulness and lower anxiety, providing new insights into potential neural mechanisms underlying benefits of mindfulness on psychological health in youth. Our results provide new evidence that mindfulness in youth relates to functional neural dynamics and interactions between neurocognitive networks, over time. Copyright © 2017 Elsevier B.V. All rights reserved.

Pruning artificial neural networks using neural complexity measures.

PubMed

Jorgensen, Thomas D; Haynes, Barry P; Norlund, Charlotte C F

2008-10-01

This paper describes a new method for pruning artificial neural networks, using a measure of the neural complexity of the neural network. This measure is used to determine the connections that should be pruned. The measure computes the information-theoretic complexity of a neural network, which is similar to, yet different from previous research on pruning. The method proposed here shows how overly large and complex networks can be reduced in size, whilst retaining learnt behaviour and fitness. The technique proposed here helps to discover a network topology that matches the complexity of the problem it is meant to solve. This novel pruning technique is tested in a robot control domain, simulating a racecar. It is shown, that the proposed pruning method is a significant improvement over the most commonly used pruning method Magnitude Based Pruning. Furthermore, some of the pruned networks prove to be faster learners than the benchmark network that they originate from. This means that this pruning method can also help to unleash hidden potential in a network, because the learning time decreases substantially for a pruned a network, due to the reduction of dimensionality of the network.

An FPGA Implementation of a Polychronous Spiking Neural Network with Delay Adaptation.

PubMed

Wang, Runchun; Cohen, Gregory; Stiefel, Klaus M; Hamilton, Tara Julia; Tapson, Jonathan; van Schaik, André

2013-01-01

We present an FPGA implementation of a re-configurable, polychronous spiking neural network with a large capacity for spatial-temporal patterns. The proposed neural network generates delay paths de novo, so that only connections that actually appear in the training patterns will be created. This allows the proposed network to use all the axons (variables) to store information. Spike Timing Dependent Delay Plasticity is used to fine-tune and add dynamics to the network. We use a time multiplexing approach allowing us to achieve 4096 (4k) neurons and up to 1.15 million programmable delay axons on a Virtex 6 FPGA. Test results show that the proposed neural network is capable of successfully recalling more than 95% of all spikes for 96% of the stored patterns. The tests also show that the neural network is robust to noise from random input spikes.

Nested neural networks

NASA Technical Reports Server (NTRS)

Baram, Yoram

1988-01-01

Nested neural networks, consisting of small interconnected subnetworks, allow for the storage and retrieval of neural state patterns of different sizes. The subnetworks are naturally categorized by layers of corresponding to spatial frequencies in the pattern field. The storage capacity and the error correction capability of the subnetworks generally increase with the degree of connectivity between layers (the nesting degree). Storage of only few subpatterns in each subnetworks results in a vast storage capacity of patterns and subpatterns in the nested network, maintaining high stability and error correction capability.

Resting state neural networks for visual Chinese word processing in Chinese adults and children.

PubMed

Li, Ling; Liu, Jiangang; Chen, Feiyan; Feng, Lu; Li, Hong; Tian, Jie; Lee, Kang

2013-07-01

This study examined the resting state neural networks for visual Chinese word processing in Chinese children and adults. Both the functional connectivity (FC) and amplitude of low frequency fluctuation (ALFF) approaches were used to analyze the fMRI data collected when Chinese participants were not engaged in any specific explicit tasks. We correlated time series extracted from the visual word form area (VWFA) with those in other regions in the brain. We also performed ALFF analysis in the resting state FC networks. The FC results revealed that, regarding the functionally connected brain regions, there exist similar intrinsically organized resting state networks for visual Chinese word processing in adults and children, suggesting that such networks may already be functional after 3-4 years of informal exposure to reading plus 3-4 years formal schooling. The ALFF results revealed that children appear to recruit more neural resources than adults in generally reading-irrelevant brain regions. Differences between child and adult ALFF results suggest that children's intrinsic word processing network during the resting state, though similar in functional connectivity, is still undergoing development. Further exposure to visual words and experience with reading are needed for children to develop a mature intrinsic network for word processing. The developmental course of the intrinsically organized word processing network may parallel that of the explicit word processing network. Copyright © 2013 Elsevier Ltd. All rights reserved.

Machine Learning Technique to Find Quantum Many-Body Ground States of Bosons on a Lattice

NASA Astrophysics Data System (ADS)

Saito, Hiroki; Kato, Masaya

2018-01-01

We have developed a variational method to obtain many-body ground states of the Bose-Hubbard model using feedforward artificial neural networks. A fully connected network with a single hidden layer works better than a fully connected network with multiple hidden layers, and a multilayer convolutional network is more efficient than a fully connected network. AdaGrad and Adam are optimization methods that work well. Moreover, we show that many-body ground states with different numbers of particles can be generated by a single network.

Convergence analysis of stochastic hybrid bidirectional associative memory neural networks with delays

NASA Astrophysics Data System (ADS)

Wan, Li; Zhou, Qinghua

2007-10-01

The stability property of stochastic hybrid bidirectional associate memory (BAM) neural networks with discrete delays is considered. Without assuming the symmetry of synaptic connection weights and the monotonicity and differentiability of activation functions, the delay-independent sufficient conditions to guarantee the exponential stability of the equilibrium solution for such networks are given by using the nonnegative semimartingale convergence theorem.

A novel multi-model neuro-fuzzy-based MPPT for three-phase grid-connected photovoltaic system

DOE Office of Scientific and Technical Information (OSTI.GOV)

Chaouachi, Aymen; Kamel, Rashad M.; Nagasaka, Ken

This paper presents a novel methodology for Maximum Power Point Tracking (MPPT) of a grid-connected 20 kW photovoltaic (PV) system using neuro-fuzzy network. The proposed method predicts the reference PV voltage guarantying optimal power transfer between the PV generator and the main utility grid. The neuro-fuzzy network is composed of a fuzzy rule-based classifier and three multi-layered feed forwarded Artificial Neural Networks (ANN). Inputs of the network (irradiance and temperature) are classified before they are fed into the appropriated ANN for either training or estimation process while the output is the reference voltage. The main advantage of the proposed methodology,more » comparing to a conventional single neural network-based approach, is the distinct generalization ability regarding to the nonlinear and dynamic behavior of a PV generator. In fact, the neuro-fuzzy network is a neural network based multi-model machine learning that defines a set of local models emulating the complex and nonlinear behavior of a PV generator under a wide range of operating conditions. Simulation results under several rapid irradiance variations proved that the proposed MPPT method fulfilled the highest efficiency comparing to a conventional single neural network and the Perturb and Observe (P and O) algorithm dispositive. (author)« less

Does Artificial Neural Network Support Connectivism's Assumptions?

ERIC Educational Resources Information Center

AlDahdouh, Alaa A.

2017-01-01

Connectivism was presented as a learning theory for the digital age and connectivists claim that recent developments in Artificial Intelligence (AI) and, more specifically, Artificial Neural Network (ANN) support their assumptions of knowledge connectivity. Yet, very little has been done to investigate this brave allegation. Does the advancement…

Prediction of protein tertiary structure from sequences using a very large back-propagation neural network

DOE Office of Scientific and Technical Information (OSTI.GOV)

Liu, X.; Wilcox, G.L.

1993-12-31

We have implemented large scale back-propagation neural networks on a 544 node Connection Machine, CM-5, using the C language in MIMD mode. The program running on 512 processors performs backpropagation learning at 0.53 Gflops, which provides 76 million connection updates per second. We have applied the network to the prediction of protein tertiary structure from sequence information alone. A neural network with one hidden layer and 40 million connections is trained to learn the relationship between sequence and tertiary structure. The trained network yields predicted structures of some proteins on which it has not been trained given only their sequences.more » Presentation of the Fourier transform of the sequences accentuates periodicity in the sequence and yields good generalization with greatly increased training efficiency. Training simulations with a large, heterologous set of protein structures (111 proteins from CM-5 time) to solutions with under 2% RMS residual error within the training set (random responses give an RMS error of about 20%). Presentation of 15 sequences of related proteins in a testing set of 24 proteins yields predicted structures with less than 8% RMS residual error, indicating good apparent generalization.« less

Disrupted Topological Patterns of Large-Scale Network in Conduct Disorder

PubMed Central

Jiang, Yali; Liu, Weixiang; Ming, Qingsen; Gao, Yidian; Ma, Ren; Zhang, Xiaocui; Situ, Weijun; Wang, Xiang; Yao, Shuqiao; Huang, Bingsheng

2016-01-01

Regional abnormalities in brain structure and function, as well as disrupted connectivity, have been found repeatedly in adolescents with conduct disorder (CD). Yet, the large-scale brain topology associated with CD is not well characterized, and little is known about the systematic neural mechanisms of CD. We employed graphic theory to investigate systematically the structural connectivity derived from cortical thickness correlation in a group of patients with CD (N = 43) and healthy controls (HCs, N = 73). Nonparametric permutation tests were applied for between-group comparisons of graphical metrics. Compared with HCs, network measures including global/local efficiency and modularity all pointed to hypo-functioning in CD, despite of preserved small-world organization in both groups. The hubs distribution is only partially overlapped with each other. These results indicate that CD is accompanied by both impaired integration and segregation patterns of brain networks, and the distribution of highly connected neural network ‘hubs’ is also distinct between groups. Such misconfiguration extends our understanding regarding how structural neural network disruptions may underlie behavioral disturbances in adolescents with CD, and potentially, implicates an aberrant cytoarchitectonic profiles in the brain of CD patients. PMID:27841320

How synapses can enhance sensibility of a neural network

NASA Astrophysics Data System (ADS)

Protachevicz, P. R.; Borges, F. S.; Iarosz, K. C.; Caldas, I. L.; Baptista, M. S.; Viana, R. L.; Lameu, E. L.; Macau, E. E. N.; Batista, A. M.

2018-02-01

In this work, we study the dynamic range in a neural network modelled by cellular automaton. We consider deterministic and non-deterministic rules to simulate electrical and chemical synapses. Chemical synapses have an intrinsic time-delay and are susceptible to parameter variations guided by learning Hebbian rules of behaviour. The learning rules are related to neuroplasticity that describes change to the neural connections in the brain. Our results show that chemical synapses can abruptly enhance sensibility of the neural network, a manifestation that can become even more predominant if learning rules of evolution are applied to the chemical synapses.

Neural networks within multi-core optic fibers

PubMed Central

Cohen, Eyal; Malka, Dror; Shemer, Amir; Shahmoon, Asaf; Zalevsky, Zeev; London, Michael

2016-01-01

Hardware implementation of artificial neural networks facilitates real-time parallel processing of massive data sets. Optical neural networks offer low-volume 3D connectivity together with large bandwidth and minimal heat production in contrast to electronic implementation. Here, we present a conceptual design for in-fiber optical neural networks. Neurons and synapses are realized as individual silica cores in a multi-core fiber. Optical signals are transferred transversely between cores by means of optical coupling. Pump driven amplification in erbium-doped cores mimics synaptic interactions. We simulated three-layered feed-forward neural networks and explored their capabilities. Simulations suggest that networks can differentiate between given inputs depending on specific configurations of amplification; this implies classification and learning capabilities. Finally, we tested experimentally our basic neuronal elements using fibers, couplers, and amplifiers, and demonstrated that this configuration implements a neuron-like function. Therefore, devices similar to our proposed multi-core fiber could potentially serve as building blocks for future large-scale small-volume optical artificial neural networks. PMID:27383911

Neural networks within multi-core optic fibers.

PubMed

Cohen, Eyal; Malka, Dror; Shemer, Amir; Shahmoon, Asaf; Zalevsky, Zeev; London, Michael

2016-07-07

Hardware implementation of artificial neural networks facilitates real-time parallel processing of massive data sets. Optical neural networks offer low-volume 3D connectivity together with large bandwidth and minimal heat production in contrast to electronic implementation. Here, we present a conceptual design for in-fiber optical neural networks. Neurons and synapses are realized as individual silica cores in a multi-core fiber. Optical signals are transferred transversely between cores by means of optical coupling. Pump driven amplification in erbium-doped cores mimics synaptic interactions. We simulated three-layered feed-forward neural networks and explored their capabilities. Simulations suggest that networks can differentiate between given inputs depending on specific configurations of amplification; this implies classification and learning capabilities. Finally, we tested experimentally our basic neuronal elements using fibers, couplers, and amplifiers, and demonstrated that this configuration implements a neuron-like function. Therefore, devices similar to our proposed multi-core fiber could potentially serve as building blocks for future large-scale small-volume optical artificial neural networks.

Neural network connectivity differences in children who stutter

PubMed Central

Zhu, David C.

2013-01-01

Affecting 1% of the general population, stuttering impairs the normally effortless process of speech production, which requires precise coordination of sequential movement occurring among the articulatory, respiratory, and resonance systems, all within millisecond time scales. Those afflicted experience frequent disfluencies during ongoing speech, often leading to negative psychosocial consequences. The aetiology of stuttering remains unclear; compared to other neurodevelopmental disorders, few studies to date have examined the neural bases of childhood stuttering. Here we report, for the first time, results from functional (resting state functional magnetic resonance imaging) and structural connectivity analyses (probabilistic tractography) of multimodal neuroimaging data examining neural networks in children who stutter. We examined how synchronized brain activity occurring among brain areas associated with speech production, and white matter tracts that interconnect them, differ in young children who stutter (aged 3–9 years) compared with age-matched peers. Results showed that children who stutter have attenuated connectivity in neural networks that support timing of self-paced movement control. The results suggest that auditory-motor and basal ganglia-thalamocortical networks develop differently in stuttering children, which may in turn affect speech planning and execution processes needed to achieve fluent speech motor control. These results provide important initial evidence of neurological differences in the early phases of symptom onset in children who stutter. PMID:24131593

Rich club analysis in the Alzheimer's disease connectome reveals a relatively undisturbed structural core network

PubMed Central

Daianu, Madelaine; Jahanshad, Neda; Nir, Talia M.; Jack, Clifford R.; Weiner, Michael W.; Bernstein, Matthew; Thompson, Paul M.

2015-01-01

Diffusion imaging can assess the white matter connections within the brain, revealing how neural pathways break down in Alzheimer's disease (AD). We analyzed 3-Tesla whole-brain diffusion-weighted images from 202 participants scanned by the Alzheimer's Disease Neuroimaging Initiative – 50 healthy controls, 110 with mild cognitive impairment (MCI) and 42 AD patients. From whole-brain tractography, we reconstructed structural brain connectivity networks to map connections between cortical regions. We tested whether AD disrupts the ‘rich-club’ – a network property where high-degree network nodes are more interconnected than expected by chance. We calculated the rich-club properties at a range of degree thresholds, as well as other network topology measures including global degree, clustering coefficient, path length and efficiency. Network disruptions predominated in the low-degree regions of the connectome in patients, relative to controls. The other metrics also showed alterations, suggesting a distinctive pattern of disruption in AD, less pronounced in MCI, targeting global brain connectivity, and focusing on more remotely connected nodes rather than the central core of the network. AD involves severely reduced structural connectivity; our step-wise rich club coefficients analyze points to disruptions predominantly in the peripheral network components; other modalities of data are needed to know if this indicates impaired communication among non rich-club regions. The highly connected core was relatively preserved, offering new evidence on the neural basis of progressive risk for cognitive decline. PMID:26037224

A neural network construction method for surrogate modeling of physics-based analysis

NASA Astrophysics Data System (ADS)

Sung, Woong Je

In this thesis existing methodologies related to the developmental methods of neural networks have been surveyed and their approaches to network sizing and structuring are carefully observed. This literature review covers the constructive methods, the pruning methods, and the evolutionary methods and questions about the basic assumption intrinsic to the conventional neural network learning paradigm, which is primarily devoted to optimization of connection weights (or synaptic strengths) for the pre-determined connection structure of the network. The main research hypothesis governing this thesis is that, without breaking a prevailing dichotomy between weights and connectivity of the network during learning phase, the efficient design of a task-specific neural network is hard to achieve because, as long as connectivity and weights are searched by separate means, a structural optimization of the neural network requires either repetitive re-training procedures or computationally expensive topological meta-search cycles. The main contribution of this thesis is designing and testing a novel learning mechanism which efficiently learns not only weight parameters but also connection structure from a given training data set, and positioning this learning mechanism within the surrogate modeling practice. In this work, a simple and straightforward extension to the conventional error Back-Propagation (BP) algorithm has been formulated to enable a simultaneous learning for both connectivity and weights of the Generalized Multilayer Perceptron (GMLP) in supervised learning tasks. A particular objective is to achieve a task-specific network having reasonable generalization performance with a minimal training time. The dichotomy between architectural design and weight optimization is reconciled by a mechanism establishing a new connection for a neuron pair which has potentially higher error-gradient than one of the existing connections. Interpreting an instance of the absence of connection as a zero-weight connection, the potential contribution to training error reduction of any present or absent connection can readily be evaluated using the BP algorithm. Instead of being broken, the connections that contribute less remain frozen with constant weight values optimized to that point but they are excluded from further weight optimization until reselected. In this way, a selective weight optimization is executed only for the dynamically maintained pool of high gradient connections. By searching the rapidly changing weights and concentrating optimization resources on them, the learning process is accelerated without either a significant increase in computational cost or a need for re-training. This results in a more task-adapted network connection structure. Combined with another important criterion for the division of a neuron which adds a new computational unit to a network, a highly fitted network can be grown out of the minimal random structure. This particular learning strategy can belong to a more broad class of the variable connectivity learning scheme and the devised algorithm has been named Optimal Brain Growth (OBG). The OBG algorithm has been tested on two canonical problems; a regression analysis using the Complicated Interaction Regression Function and a classification of the Two-Spiral Problem. A comparative study with conventional Multilayer Perceptrons (MLPs) consisting of single- and double-hidden layers shows that OBG is less sensitive to random initial conditions and generalizes better with only a minimal increase in computational time. This partially proves that a variable connectivity learning scheme has great potential to enhance computational efficiency and reduce efforts to select proper network architecture. To investigate the applicability of the OBG to more practical surrogate modeling tasks, the geometry-to-pressure mapping of a particular class of airfoils in the transonic flow regime has been sought using both the conventional MLP networks with pre-defined architecture and the OBG-developed networks started from the same initial MLP networks. Considering wide variety in airfoil geometry and diversity of flow conditions distributed over a range of flow Mach numbers and angles of attack, the new method shows a great potential to capture fundamentally nonlinear flow phenomena especially related to the occurrence of shock waves on airfoil surfaces in transonic flow regime. (Abstract shortened by UMI.).

The Functional Neuroanatomy of Human Face Perception.

PubMed

Grill-Spector, Kalanit; Weiner, Kevin S; Kay, Kendrick; Gomez, Jesse

2017-09-15

Face perception is critical for normal social functioning and is mediated by a network of regions in the ventral visual stream. In this review, we describe recent neuroimaging findings regarding the macro- and microscopic anatomical features of the ventral face network, the characteristics of white matter connections, and basic computations performed by population receptive fields within face-selective regions composing this network. We emphasize the importance of the neural tissue properties and white matter connections of each region, as these anatomical properties may be tightly linked to the functional characteristics of the ventral face network. We end by considering how empirical investigations of the neural architecture of the face network may inform the development of computational models and shed light on how computations in the face network enable efficient face perception.

The neural circuit and synaptic dynamics underlying perceptual decision-making

NASA Astrophysics Data System (ADS)

Liu, Feng

2015-03-01

Decision-making with several choice options is central to cognition. To elucidate the neural mechanisms of multiple-choice motion discrimination, we built a continuous recurrent network model to represent a local circuit in the lateral intraparietal area (LIP). The network is composed of pyramidal cells and interneurons, which are directionally tuned. All neurons are reciprocally connected, and the synaptic connectivity strength is heterogeneous. Specifically, we assume two types of inhibitory connectivity to pyramidal cells: opposite-feature and similar-feature inhibition. The model accounted for both physiological and behavioral data from monkey experiments. The network is endowed with slow excitatory reverberation, which subserves the buildup and maintenance of persistent neural activity, and predominant feedback inhibition, which underlies the winner-take-all competition and attractor dynamics. The opposite-feature and opposite-feature inhibition have different effects on decision-making, and only their combination allows for a categorical choice among 12 alternatives. Together, our work highlights the importance of structured synaptic inhibition in multiple-choice decision-making processes.

Diminished neural network dynamics in amnestic mild cognitive impairment.

PubMed

Brenner, Einat K; Hampstead, Benjamin M; Grossner, Emily C; Bernier, Rachel A; Gilbert, Nicholas; Sathian, K; Hillary, Frank G

2018-05-05

Mild cognitive impairment (MCI) is widely regarded as an intermediate stage between typical aging and dementia, with nearly 50% of patients with amnestic MCI (aMCI) converting to Alzheimer's dementia (AD) within 30 months of follow-up (Fischer et al., 2007). The growing literature using resting-state functional magnetic resonance imaging reveals both increased and decreased connectivity in individuals with MCI and connectivity loss between the anterior and posterior components of the default mode network (DMN) throughout the course of the disease progression (Hillary et al., 2015; Sheline & Raichle, 2013; Tijms et al., 2013). In this paper, we use dynamic connectivity modeling and graph theory to identify unique brain "states," or temporal patterns of connectivity across distributed networks, to distinguish individuals with aMCI from healthy older adults (HOAs). We enrolled 44 individuals diagnosed with aMCI and 33 HOAs of comparable age and education. Our results indicated that individuals with aMCI spent significantly more time in one state in particular, whereas neural network analysis in the HOA sample revealed approximately equivalent representation across four distinct states. Among individuals with aMCI, spending a higher proportion of time in the dominant state relative to a state where participants exhibited high cost (a measure combining connectivity and distance), predicted better language performance and less perseveration. This is the first report to examine neural network dynamics in individuals with aMCI. Copyright © 2018 Elsevier B.V. All rights reserved.

Binary synaptic connections based on memory switching in a-Si:H for artificial neural networks

NASA Technical Reports Server (NTRS)

Thakoor, A. P.; Lamb, J. L.; Moopenn, A.; Khanna, S. K.

1987-01-01

A scheme for nonvolatile associative electronic memory storage with high information storage density is proposed which is based on neural network models and which uses a matrix of two-terminal passive interconnections (synapses). It is noted that the massive parallelism in the architecture would require the ON state of a synaptic connection to be unusually weak (highly resistive). Memory switching using a-Si:H along with ballast resistors patterned from amorphous Ge-metal alloys is investigated for a binary programmable read only memory matrix. The fabrication of a 1600 synapse test array of uniform connection strengths and a-Si:H switching elements is discussed.

Altered Synchronizations among Neural Networks in Geriatric Depression

PubMed Central

Wang, Lihong; Chou, Ying-Hui; Potter, Guy G.; Steffens, David C.

2015-01-01

Although major depression has been considered as a manifestation of discoordinated activity between affective and cognitive neural networks, only a few studies have examined the relationships among neural networks directly. Because of the known disconnection theory, geriatric depression could be a useful model in studying the interactions among different networks. In the present study, using independent component analysis to identify intrinsically connected neural networks, we investigated the alterations in synchronizations among neural networks in geriatric depression to better understand the underlying neural mechanisms. Resting-state fMRI data was collected from thirty-two patients with geriatric depression and thirty-two age-matched never-depressed controls. We compared the resting-state activities between the two groups in the default-mode, central executive, attention, salience, and affective networks as well as correlations among these networks. The depression group showed stronger activity than the controls in an affective network, specifically within the orbitofrontal region. However, unlike the never-depressed controls, geriatric depression group lacked synchronized/antisynchronized activity between the affective network and the other networks. Those depressed patients with lower executive function has greater synchronization between the salience network with the executive and affective networks. Our results demonstrate the effectiveness of the between-network analyses in examining neural models for geriatric depression. PMID:26180795

Altered Synchronizations among Neural Networks in Geriatric Depression.

PubMed

Wang, Lihong; Chou, Ying-Hui; Potter, Guy G; Steffens, David C

2015-01-01

Although major depression has been considered as a manifestation of discoordinated activity between affective and cognitive neural networks, only a few studies have examined the relationships among neural networks directly. Because of the known disconnection theory, geriatric depression could be a useful model in studying the interactions among different networks. In the present study, using independent component analysis to identify intrinsically connected neural networks, we investigated the alterations in synchronizations among neural networks in geriatric depression to better understand the underlying neural mechanisms. Resting-state fMRI data was collected from thirty-two patients with geriatric depression and thirty-two age-matched never-depressed controls. We compared the resting-state activities between the two groups in the default-mode, central executive, attention, salience, and affective networks as well as correlations among these networks. The depression group showed stronger activity than the controls in an affective network, specifically within the orbitofrontal region. However, unlike the never-depressed controls, geriatric depression group lacked synchronized/antisynchronized activity between the affective network and the other networks. Those depressed patients with lower executive function has greater synchronization between the salience network with the executive and affective networks. Our results demonstrate the effectiveness of the between-network analyses in examining neural models for geriatric depression.

Models of Innate Neural Attractors and Their Applications for Neural Information Processing

PubMed Central

Solovyeva, Ksenia P.; Karandashev, Iakov M.; Zhavoronkov, Alex; Dunin-Barkowski, Witali L.

2016-01-01

In this work we reveal and explore a new class of attractor neural networks, based on inborn connections provided by model molecular markers, the molecular marker based attractor neural networks (MMBANN). Each set of markers has a metric, which is used to make connections between neurons containing the markers. We have explored conditions for the existence of attractor states, critical relations between their parameters and the spectrum of single neuron models, which can implement the MMBANN. Besides, we describe functional models (perceptron and SOM), which obtain significant advantages over the traditional implementation of these models, while using MMBANN. In particular, a perceptron, based on MMBANN, gets specificity gain in orders of error probabilities values, MMBANN SOM obtains real neurophysiological meaning, the number of possible grandma cells increases 1000-fold with MMBANN. MMBANN have sets of attractor states, which can serve as finite grids for representation of variables in computations. These grids may show dimensions of d = 0, 1, 2,…. We work with static and dynamic attractor neural networks of the dimensions d = 0 and 1. We also argue that the number of dimensions which can be represented by attractors of activities of neural networks with the number of elements N = 104 does not exceed 8. PMID:26778977

Neural coding in graphs of bidirectional associative memories.

PubMed

Bouchain, A David; Palm, Günther

2012-01-24

In the last years we have developed large neural network models for the realization of complex cognitive tasks in a neural network architecture that resembles the network of the cerebral cortex. We have used networks of several cortical modules that contain two populations of neurons (one excitatory, one inhibitory). The excitatory populations in these so-called "cortical networks" are organized as a graph of Bidirectional Associative Memories (BAMs), where edges of the graph correspond to BAMs connecting two neural modules and nodes of the graph correspond to excitatory populations with associative feedback connections (and inhibitory interneurons). The neural code in each of these modules consists essentially of the firing pattern of the excitatory population, where mainly it is the subset of active neurons that codes the contents to be represented. The overall activity can be used to distinguish different properties of the patterns that are represented which we need to distinguish and control when performing complex tasks like language understanding with these cortical networks. The most important pattern properties or situations are: exactly fitting or matching input, incomplete information or partially matching pattern, superposition of several patterns, conflicting information, and new information that is to be learned. We show simple simulations of these situations in one area or module and discuss how to distinguish these situations based on the overall internal activation of the module. This article is part of a Special Issue entitled "Neural Coding". Copyright © 2011 Elsevier B.V. All rights reserved.

Tinnitus and hyperacusis involve hyperactivity and enhanced connectivity in auditory-limbic-arousal-cerebellar network

PubMed Central

Chen, Yu-Chen; Li, Xiaowei; Liu, Lijie; Wang, Jian; Lu, Chun-Qiang; Yang, Ming; Jiao, Yun; Zang, Feng-Chao; Radziwon, Kelly; Chen, Guang-Di; Sun, Wei; Krishnan Muthaiah, Vijaya Prakash; Salvi, Richard; Teng, Gao-Jun

2015-01-01

Hearing loss often triggers an inescapable buzz (tinnitus) and causes everyday sounds to become intolerably loud (hyperacusis), but exactly where and how this occurs in the brain is unknown. To identify the neural substrate for these debilitating disorders, we induced both tinnitus and hyperacusis with an ototoxic drug (salicylate) and used behavioral, electrophysiological, and functional magnetic resonance imaging (fMRI) techniques to identify the tinnitus–hyperacusis network. Salicylate depressed the neural output of the cochlea, but vigorously amplified sound-evoked neural responses in the amygdala, medial geniculate, and auditory cortex. Resting-state fMRI revealed hyperactivity in an auditory network composed of inferior colliculus, medial geniculate, and auditory cortex with side branches to cerebellum, amygdala, and reticular formation. Functional connectivity revealed enhanced coupling within the auditory network and segments of the auditory network and cerebellum, reticular formation, amygdala, and hippocampus. A testable model accounting for distress, arousal, and gating of tinnitus and hyperacusis is proposed. DOI: http://dx.doi.org/10.7554/eLife.06576.001 PMID:25962854

Decomposition of Rotor Hopfield Neural Networks Using Complex Numbers.

PubMed

Kobayashi, Masaki

2018-04-01

A complex-valued Hopfield neural network (CHNN) is a multistate model of a Hopfield neural network. It has the disadvantage of low noise tolerance. Meanwhile, a symmetric CHNN (SCHNN) is a modification of a CHNN that improves noise tolerance. Furthermore, a rotor Hopfield neural network (RHNN) is an extension of a CHNN. It has twice the storage capacity of CHNNs and SCHNNs, and much better noise tolerance than CHNNs, although it requires twice many connection parameters. In this brief, we investigate the relations between CHNN, SCHNN, and RHNN; an RHNN is uniquely decomposed into a CHNN and SCHNN. In addition, the Hebbian learning rule for RHNNs is decomposed into those for CHNNs and SCHNNs.

The Rich Get Richer: Brain Injury Elicits Hyperconnectivity in Core Subnetworks

PubMed Central

Hillary, Frank G.; Rajtmajer, Sarah M.; Roman, Cristina A.; Medaglia, John D.; Slocomb-Dluzen, Julia E.; Calhoun, Vincent D.; Good, David C.; Wylie, Glenn R.

2014-01-01

There remains much unknown about how large-scale neural networks accommodate neurological disruption, such as moderate and severe traumatic brain injury (TBI). A primary goal in this study was to examine the alterations in network topology occurring during the first year of recovery following TBI. To do so we examined 21 individuals with moderate and severe TBI at 3 and 6 months after resolution of posttraumatic amnesia and 15 age- and education-matched healthy adults using functional MRI and graph theoretical analyses. There were two central hypotheses in this study: 1) physical disruption results in increased functional connectivity, or hyperconnectivity, and 2) hyperconnectivity occurs in regions typically observed to be the most highly connected cortical hubs, or the “rich club”. The current findings generally support the hyperconnectivity hypothesis showing that during the first year of recovery after TBI, neural networks show increased connectivity, and this change is disproportionately represented in brain regions belonging to the brain's core subnetworks. The selective increases in connectivity observed here are consistent with the preferential attachment model underlying scale-free network development. This study is the largest of its kind and provides the unique opportunity to examine how neural systems adapt to significant neurological disruption during the first year after injury. PMID:25121760

The rich get richer: brain injury elicits hyperconnectivity in core subnetworks.

PubMed

Hillary, Frank G; Rajtmajer, Sarah M; Roman, Cristina A; Medaglia, John D; Slocomb-Dluzen, Julia E; Calhoun, Vincent D; Good, David C; Wylie, Glenn R

2014-01-01

There remains much unknown about how large-scale neural networks accommodate neurological disruption, such as moderate and severe traumatic brain injury (TBI). A primary goal in this study was to examine the alterations in network topology occurring during the first year of recovery following TBI. To do so we examined 21 individuals with moderate and severe TBI at 3 and 6 months after resolution of posttraumatic amnesia and 15 age- and education-matched healthy adults using functional MRI and graph theoretical analyses. There were two central hypotheses in this study: 1) physical disruption results in increased functional connectivity, or hyperconnectivity, and 2) hyperconnectivity occurs in regions typically observed to be the most highly connected cortical hubs, or the "rich club". The current findings generally support the hyperconnectivity hypothesis showing that during the first year of recovery after TBI, neural networks show increased connectivity, and this change is disproportionately represented in brain regions belonging to the brain's core subnetworks. The selective increases in connectivity observed here are consistent with the preferential attachment model underlying scale-free network development. This study is the largest of its kind and provides the unique opportunity to examine how neural systems adapt to significant neurological disruption during the first year after injury.

Superconducting Optoelectronic Circuits for Neuromorphic Computing

NASA Astrophysics Data System (ADS)

Shainline, Jeffrey M.; Buckley, Sonia M.; Mirin, Richard P.; Nam, Sae Woo

2017-03-01

Neural networks have proven effective for solving many difficult computational problems, yet implementing complex neural networks in software is computationally expensive. To explore the limits of information processing, it is necessary to implement new hardware platforms with large numbers of neurons, each with a large number of connections to other neurons. Here we propose a hybrid semiconductor-superconductor hardware platform for the implementation of neural networks and large-scale neuromorphic computing. The platform combines semiconducting few-photon light-emitting diodes with superconducting-nanowire single-photon detectors to behave as spiking neurons. These processing units are connected via a network of optical waveguides, and variable weights of connection can be implemented using several approaches. The use of light as a signaling mechanism overcomes fanout and parasitic constraints on electrical signals while simultaneously introducing physical degrees of freedom which can be employed for computation. The use of supercurrents achieves the low power density (1 mW /cm2 at 20-MHz firing rate) necessary to scale to systems with enormous entropy. Estimates comparing the proposed hardware platform to a human brain show that with the same number of neurons (1 011) and 700 independent connections per neuron, the hardware presented here may achieve an order of magnitude improvement in synaptic events per second per watt.

Proceedings of the Third International Workshop on Neural Networks and Fuzzy Logic, volume 2

NASA Technical Reports Server (NTRS)

Culbert, Christopher J. (Editor)

1993-01-01

Papers presented at the Neural Networks and Fuzzy Logic Workshop sponsored by the National Aeronautics and Space Administration and cosponsored by the University of Houston, Clear Lake, held 1-3 Jun. 1992 at the Lyndon B. Johnson Space Center in Houston, Texas are included. During the three days approximately 50 papers were presented. Technical topics addressed included adaptive systems; learning algorithms; network architectures; vision; robotics; neurobiological connections; speech recognition and synthesis; fuzzy set theory and application, control and dynamics processing; space applications; fuzzy logic and neural network computers; approximate reasoning; and multiobject decision making.

Plasticity of brain wave network interactions and evolution across physiologic states

PubMed Central

Liu, Kang K. L.; Bartsch, Ronny P.; Lin, Aijing; Mantegna, Rosario N.; Ivanov, Plamen Ch.

2015-01-01

Neural plasticity transcends a range of spatio-temporal scales and serves as the basis of various brain activities and physiologic functions. At the microscopic level, it enables the emergence of brain waves with complex temporal dynamics. At the macroscopic level, presence and dominance of specific brain waves is associated with important brain functions. The role of neural plasticity at different levels in generating distinct brain rhythms and how brain rhythms communicate with each other across brain areas to generate physiologic states and functions remains not understood. Here we perform an empirical exploration of neural plasticity at the level of brain wave network interactions representing dynamical communications within and between different brain areas in the frequency domain. We introduce the concept of time delay stability (TDS) to quantify coordinated bursts in the activity of brain waves, and we employ a system-wide Network Physiology integrative approach to probe the network of coordinated brain wave activations and its evolution across physiologic states. We find an association between network structure and physiologic states. We uncover a hierarchical reorganization in the brain wave networks in response to changes in physiologic state, indicating new aspects of neural plasticity at the integrated level. Globally, we find that the entire brain network undergoes a pronounced transition from low connectivity in Deep Sleep and REM to high connectivity in Light Sleep and Wake. In contrast, we find that locally, different brain areas exhibit different network dynamics of brain wave interactions to achieve differentiation in function during different sleep stages. Moreover, our analyses indicate that plasticity also emerges in frequency-specific networks, which represent interactions across brain locations mediated through a specific frequency band. Comparing frequency-specific networks within the same physiologic state we find very different degree of network connectivity and link strength, while at the same time each frequency-specific network is characterized by a different signature pattern of sleep-stage stratification, reflecting a remarkable flexibility in response to change in physiologic state. These new aspects of neural plasticity demonstrate that in addition to dominant brain waves, the network of brain wave interactions is a previously unrecognized hallmark of physiologic state and function. PMID:26578891

Speaker-dependent Multipitch Tracking Using Deep Neural Networks

DTIC Science & Technology

2015-01-01

connections through time. Studies have shown that RNNs are good at modeling sequential data like handwriting [12] and speech [26]. We plan to explore RNNs in...Schmidhuber, and S. Fernández, “Unconstrained on-line handwriting recognition with recurrent neural networks,” in Proceedings of NIPS, 2008, pp. 577–584. [13

Estimation of effective connectivity using multi-layer perceptron artificial neural network.

PubMed

Talebi, Nasibeh; Nasrabadi, Ali Motie; Mohammad-Rezazadeh, Iman

2018-02-01

Studies on interactions between brain regions estimate effective connectivity, (usually) based on the causality inferences made on the basis of temporal precedence. In this study, the causal relationship is modeled by a multi-layer perceptron feed-forward artificial neural network, because of the ANN's ability to generate appropriate input-output mapping and to learn from training examples without the need of detailed knowledge of the underlying system. At any time instant, the past samples of data are placed in the network input, and the subsequent values are predicted at its output. To estimate the strength of interactions, the measure of " Causality coefficient " is defined based on the network structure, the connecting weights and the parameters of hidden layer activation function. Simulation analysis demonstrates that the method, called "CREANN" (Causal Relationship Estimation by Artificial Neural Network), can estimate time-invariant and time-varying effective connectivity in terms of MVAR coefficients. The method shows robustness with respect to noise level of data. Furthermore, the estimations are not significantly influenced by the model order (considered time-lag), and the different initial conditions (initial random weights and parameters of the network). CREANN is also applied to EEG data collected during a memory recognition task. The results implicate that it can show changes in the information flow between brain regions, involving in the episodic memory retrieval process. These convincing results emphasize that CREANN can be used as an appropriate method to estimate the causal relationship among brain signals.

Establishing a Dynamic Self-Adaptation Learning Algorithm of the BP Neural Network and Its Applications

NASA Astrophysics Data System (ADS)

Li, Xiaofeng; Xiang, Suying; Zhu, Pengfei; Wu, Min

2015-12-01

In order to avoid the inherent deficiencies of the traditional BP neural network, such as slow convergence speed, that easily leading to local minima, poor generalization ability and difficulty in determining the network structure, the dynamic self-adaptive learning algorithm of the BP neural network is put forward to improve the function of the BP neural network. The new algorithm combines the merit of principal component analysis, particle swarm optimization, correlation analysis and self-adaptive model, hence can effectively solve the problems of selecting structural parameters, initial connection weights and thresholds and learning rates of the BP neural network. This new algorithm not only reduces the human intervention, optimizes the topological structures of BP neural networks and improves the network generalization ability, but also accelerates the convergence speed of a network, avoids trapping into local minima, and enhances network adaptation ability and prediction ability. The dynamic self-adaptive learning algorithm of the BP neural network is used to forecast the total retail sale of consumer goods of Sichuan Province, China. Empirical results indicate that the new algorithm is superior to the traditional BP network algorithm in predicting accuracy and time consumption, which shows the feasibility and effectiveness of the new algorithm.

Neural coordination can be enhanced by occasional interruption of normal firing patterns: a self-optimizing spiking neural network model.

PubMed

Woodward, Alexander; Froese, Tom; Ikegami, Takashi

2015-02-01

The state space of a conventional Hopfield network typically exhibits many different attractors of which only a small subset satisfies constraints between neurons in a globally optimal fashion. It has recently been demonstrated that combining Hebbian learning with occasional alterations of normal neural states avoids this problem by means of self-organized enlargement of the best basins of attraction. However, so far it is not clear to what extent this process of self-optimization is also operative in real brains. Here we demonstrate that it can be transferred to more biologically plausible neural networks by implementing a self-optimizing spiking neural network model. In addition, by using this spiking neural network to emulate a Hopfield network with Hebbian learning, we attempt to make a connection between rate-based and temporal coding based neural systems. Although further work is required to make this model more realistic, it already suggests that the efficacy of the self-optimizing process is independent from the simplifying assumptions of a conventional Hopfield network. We also discuss natural and cultural processes that could be responsible for occasional alteration of neural firing patterns in actual brains. Copyright © 2014 Elsevier Ltd. All rights reserved.

Feedforward, high density, programmable read only neural network based memory system

NASA Technical Reports Server (NTRS)

Daud, Taher; Moopenn, Alex; Lamb, James; Thakoor, Anil; Khanna, Satish

1988-01-01

Neural network-inspired, nonvolatile, programmable associative memory using thin-film technology is demonstrated. The details of the architecture, which uses programmable resistive connection matrices in synaptic arrays and current summing and thresholding amplifiers as neurons, are described. Several synapse configurations for a high-density array of a binary connection matrix are also described. Test circuits are evaluated for operational feasibility and to demonstrate the speed of the read operation. The results are discussed to highlight the potential for a read data rate exceeding 10 megabits/sec.

Effects of bursting dynamic features on the generation of multi-clustered structure of neural network with symmetric spike-timing-dependent plasticity learning rule.

PubMed

Liu, Hui; Song, Yongduan; Xue, Fangzheng; Li, Xiumin

2015-11-01

In this paper, the generation of multi-clustered structure of self-organized neural network with different neuronal firing patterns, i.e., bursting or spiking, has been investigated. The initially all-to-all-connected spiking neural network or bursting neural network can be self-organized into clustered structure through the symmetric spike-timing-dependent plasticity learning for both bursting and spiking neurons. However, the time consumption of this clustering procedure of the burst-based self-organized neural network (BSON) is much shorter than the spike-based self-organized neural network (SSON). Our results show that the BSON network has more obvious small-world properties, i.e., higher clustering coefficient and smaller shortest path length than the SSON network. Also, the results of larger structure entropy and activity entropy of the BSON network demonstrate that this network has higher topological complexity and dynamical diversity, which benefits for enhancing information transmission of neural circuits. Hence, we conclude that the burst firing can significantly enhance the efficiency of clustering procedure and the emergent clustered structure renders the whole network more synchronous and therefore more sensitive to weak input. This result is further confirmed from its improved performance on stochastic resonance. Therefore, we believe that the multi-clustered neural network which self-organized from the bursting dynamics has high efficiency in information processing.

Effects of bursting dynamic features on the generation of multi-clustered structure of neural network with symmetric spike-timing-dependent plasticity learning rule

DOE Office of Scientific and Technical Information (OSTI.GOV)

Liu, Hui; Song, Yongduan; Xue, Fangzheng

In this paper, the generation of multi-clustered structure of self-organized neural network with different neuronal firing patterns, i.e., bursting or spiking, has been investigated. The initially all-to-all-connected spiking neural network or bursting neural network can be self-organized into clustered structure through the symmetric spike-timing-dependent plasticity learning for both bursting and spiking neurons. However, the time consumption of this clustering procedure of the burst-based self-organized neural network (BSON) is much shorter than the spike-based self-organized neural network (SSON). Our results show that the BSON network has more obvious small-world properties, i.e., higher clustering coefficient and smaller shortest path length than themore » SSON network. Also, the results of larger structure entropy and activity entropy of the BSON network demonstrate that this network has higher topological complexity and dynamical diversity, which benefits for enhancing information transmission of neural circuits. Hence, we conclude that the burst firing can significantly enhance the efficiency of clustering procedure and the emergent clustered structure renders the whole network more synchronous and therefore more sensitive to weak input. This result is further confirmed from its improved performance on stochastic resonance. Therefore, we believe that the multi-clustered neural network which self-organized from the bursting dynamics has high efficiency in information processing.« less

Resting-State Brain and the FTO Obesity Risk Allele: Default Mode, Sensorimotor, and Salience Network Connectivity Underlying Different Somatosensory Integration and Reward Processing between Genotypes.

PubMed

Olivo, Gaia; Wiemerslage, Lyle; Nilsson, Emil K; Solstrand Dahlberg, Linda; Larsen, Anna L; Olaya Búcaro, Marcela; Gustafsson, Veronica P; Titova, Olga E; Bandstein, Marcus; Larsson, Elna-Marie; Benedict, Christian; Brooks, Samantha J; Schiöth, Helgi B

2016-01-01

Single-nucleotide polymorphisms (SNPs) of the fat mass and obesity associated (FTO) gene are linked to obesity, but how these SNPs influence resting-state neural activation is unknown. Few brain-imaging studies have investigated the influence of obesity-related SNPs on neural activity, and no study has investigated resting-state connectivity patterns. We tested connectivity within three, main resting-state networks: default mode (DMN), sensorimotor (SMN), and salience network (SN) in 30 male participants, grouped based on genotype for the rs9939609 FTO SNP, as well as punishment and reward sensitivity measured by the Behavioral Inhibition (BIS) and Behavioral Activation System (BAS) questionnaires. Because obesity is associated with anomalies in both systems, we calculated a BIS/BAS ratio (BBr) accounting for features of both scores. A prominence of BIS over BAS (higher BBr) resulted in increased connectivity in frontal and paralimbic regions. These alterations were more evident in the obesity-associated AA genotype, where a high BBr was also associated with increased SN connectivity in dopaminergic circuitries, and in a subnetwork involved in somatosensory integration regarding food. Participants with AA genotype and high BBr, compared to corresponding participants in the TT genotype, also showed greater DMN connectivity in regions involved in the processing of food cues, and in the SMN for regions involved in visceral perception and reward-based learning. These findings suggest that neural connectivity patterns influence the sensitivity toward punishment and reward more closely in the AA carriers, predisposing them to developing obesity. Our work explains a complex interaction between genetics, neural patterns, and behavioral measures in determining the risk for obesity and may help develop individually-tailored strategies for obesity prevention.

Resting-State Brain and the FTO Obesity Risk Allele: Default Mode, Sensorimotor, and Salience Network Connectivity Underlying Different Somatosensory Integration and Reward Processing between Genotypes

PubMed Central

Olivo, Gaia; Wiemerslage, Lyle; Nilsson, Emil K.; Solstrand Dahlberg, Linda; Larsen, Anna L.; Olaya Búcaro, Marcela; Gustafsson, Veronica P.; Titova, Olga E.; Bandstein, Marcus; Larsson, Elna-Marie; Benedict, Christian; Brooks, Samantha J.; Schiöth, Helgi B.

2016-01-01

Single-nucleotide polymorphisms (SNPs) of the fat mass and obesity associated (FTO) gene are linked to obesity, but how these SNPs influence resting-state neural activation is unknown. Few brain-imaging studies have investigated the influence of obesity-related SNPs on neural activity, and no study has investigated resting-state connectivity patterns. We tested connectivity within three, main resting-state networks: default mode (DMN), sensorimotor (SMN), and salience network (SN) in 30 male participants, grouped based on genotype for the rs9939609 FTO SNP, as well as punishment and reward sensitivity measured by the Behavioral Inhibition (BIS) and Behavioral Activation System (BAS) questionnaires. Because obesity is associated with anomalies in both systems, we calculated a BIS/BAS ratio (BBr) accounting for features of both scores. A prominence of BIS over BAS (higher BBr) resulted in increased connectivity in frontal and paralimbic regions. These alterations were more evident in the obesity-associated AA genotype, where a high BBr was also associated with increased SN connectivity in dopaminergic circuitries, and in a subnetwork involved in somatosensory integration regarding food. Participants with AA genotype and high BBr, compared to corresponding participants in the TT genotype, also showed greater DMN connectivity in regions involved in the processing of food cues, and in the SMN for regions involved in visceral perception and reward-based learning. These findings suggest that neural connectivity patterns influence the sensitivity toward punishment and reward more closely in the AA carriers, predisposing them to developing obesity. Our work explains a complex interaction between genetics, neural patterns, and behavioral measures in determining the risk for obesity and may help develop individually-tailored strategies for obesity prevention. PMID:26924971

Robustness of a distributed neural network controller for locomotion in a hexapod robot

NASA Technical Reports Server (NTRS)

Chiel, Hillel J.; Beer, Randall D.; Quinn, Roger D.; Espenschied, Kenneth S.

1992-01-01

A distributed neural-network controller for locomotion, based on insect neurobiology, has been used to control a hexapod robot. How robust is this controller? Disabling any single sensor, effector, or central component did not prevent the robot from walking. Furthermore, statically stable gaits could be established using either sensor input or central connections. Thus, a complex interplay between central neural elements and sensor inputs is responsible for the robustness of the controller and its ability to generate a continuous range of gaits. These results suggest that biologically inspired neural-network controllers may be a robust method for robotic control.

Increased functional connectivity within memory networks following memory rehabilitation in multiple sclerosis.

PubMed

Leavitt, Victoria M; Wylie, Glenn R; Girgis, Peter A; DeLuca, John; Chiaravalloti, Nancy D

2014-09-01

Identifying effective behavioral treatments to improve memory in persons with learning and memory impairment is a primary goal for neurorehabilitation researchers. Memory deficits are the most common cognitive symptom in multiple sclerosis (MS), and hold negative professional and personal consequences for people who are often in the prime of their lives when diagnosed. A 10-session behavioral treatment, the modified Story Memory Technique (mSMT), was studied in a randomized, placebo-controlled clinical trial. Behavioral improvements and increased fMRI activation were shown after treatment. Here, connectivity within the neural networks underlying memory function was examined with resting-state functional connectivity (RSFC) in a subset of participants from the clinical trial. We hypothesized that the treatment would result in increased integrity of connections within two primary memory networks of the brain, the hippocampal memory network, and the default network (DN). Seeds were placed in left and right hippocampus, and the posterior cingulate cortex. Increased connectivity was found between left hippocampus and cortical regions specifically involved in memory for visual imagery, as well as among critical hubs of the DN. These results represent the first evidence for efficacy of a behavioral intervention to impact the integrity of neural networks subserving memory functions in persons with MS.

Altered neural connectivity during response inhibition in adolescents with attention-deficit/hyperactivity disorder and their unaffected siblings

PubMed Central

van Rooij, Daan; Hartman, Catharina A.; Mennes, Maarten; Oosterlaan, Jaap; Franke, Barbara; Rommelse, Nanda; Heslenfeld, Dirk; Faraone, Stephen V.; Buitelaar, Jan K.; Hoekstra, Pieter J.

2015-01-01

Introduction Response inhibition is one of the executive functions impaired in attention-deficit/hyperactivity disorder (ADHD). Increasing evidence indicates that altered functional and structural neural connectivity are part of the neurobiological basis of ADHD. Here, we investigated if adolescents with ADHD show altered functional connectivity during response inhibition compared to their unaffected siblings and healthy controls. Methods Response inhibition was assessed using the stop signal paradigm. Functional connectivity was assessed using psycho-physiological interaction analyses applied to BOLD time courses from seed regions within inferior- and superior frontal nodes of the response inhibition network. Resulting networks were compared between adolescents with ADHD (N = 185), their unaffected siblings (N = 111), and controls (N = 125). Results Control subjects showed stronger functional connectivity than the other two groups within the response inhibition network, while subjects with ADHD showed relatively stronger connectivity between default mode network (DMN) nodes. Stronger connectivity within the response inhibition network was correlated with lower ADHD severity, while stronger connectivity with the DMN was correlated with increased ADHD severity. Siblings showed connectivity patterns similar to controls during successful inhibition and to ADHD subjects during failed inhibition. Additionally, siblings showed decreased connectivity with the primary motor areas as compared to both participants with ADHD and controls. Discussion Subjects with ADHD fail to integrate activation within the response inhibition network and to inhibit connectivity with task-irrelevant regions. Unaffected siblings show similar alterations only during failed stop trials, as well as unique suppression of motor areas, suggesting compensatory strategies. These findings support the role of altered functional connectivity in understanding the neurobiology and familial transmission of ADHD. PMID:25610797

Altered neural connectivity during response inhibition in adolescents with attention-deficit/hyperactivity disorder and their unaffected siblings.

PubMed

van Rooij, Daan; Hartman, Catharina A; Mennes, Maarten; Oosterlaan, Jaap; Franke, Barbara; Rommelse, Nanda; Heslenfeld, Dirk; Faraone, Stephen V; Buitelaar, Jan K; Hoekstra, Pieter J

2015-01-01

Response inhibition is one of the executive functions impaired in attention-deficit/hyperactivity disorder (ADHD). Increasing evidence indicates that altered functional and structural neural connectivity are part of the neurobiological basis of ADHD. Here, we investigated if adolescents with ADHD show altered functional connectivity during response inhibition compared to their unaffected siblings and healthy controls. Response inhibition was assessed using the stop signal paradigm. Functional connectivity was assessed using psycho-physiological interaction analyses applied to BOLD time courses from seed regions within inferior- and superior frontal nodes of the response inhibition network. Resulting networks were compared between adolescents with ADHD (N = 185), their unaffected siblings (N = 111), and controls (N = 125). Control subjects showed stronger functional connectivity than the other two groups within the response inhibition network, while subjects with ADHD showed relatively stronger connectivity between default mode network (DMN) nodes. Stronger connectivity within the response inhibition network was correlated with lower ADHD severity, while stronger connectivity with the DMN was correlated with increased ADHD severity. Siblings showed connectivity patterns similar to controls during successful inhibition and to ADHD subjects during failed inhibition. Additionally, siblings showed decreased connectivity with the primary motor areas as compared to both participants with ADHD and controls. Subjects with ADHD fail to integrate activation within the response inhibition network and to inhibit connectivity with task-irrelevant regions. Unaffected siblings show similar alterations only during failed stop trials, as well as unique suppression of motor areas, suggesting compensatory strategies. These findings support the role of altered functional connectivity in understanding the neurobiology and familial transmission of ADHD.

Relationships between cortical myeloarchitecture and electrophysiological networks

PubMed Central

Hunt, Benjamin A. E.; Tewarie, Prejaas K.; Mougin, Olivier E.; Geades, Nicolas; Singh, Krish D.; Morris, Peter G.; Gowland, Penny A.; Brookes, Matthew J.

2016-01-01

The human brain relies upon the dynamic formation and dissolution of a hierarchy of functional networks to support ongoing cognition. However, how functional connectivities underlying such networks are supported by cortical microstructure remains poorly understood. Recent animal work has demonstrated that electrical activity promotes myelination. Inspired by this, we test a hypothesis that gray-matter myelin is related to electrophysiological connectivity. Using ultra-high field MRI and the principle of structural covariance, we derive a structural network showing how myelin density differs across cortical regions and how separate regions can exhibit similar myeloarchitecture. Building upon recent evidence that neural oscillations mediate connectivity, we use magnetoencephalography to elucidate networks that represent the major electrophysiological pathways of communication in the brain. Finally, we show that a significant relationship exists between our functional and structural networks; this relationship differs as a function of neural oscillatory frequency and becomes stronger when integrating oscillations over frequency bands. Our study sheds light on the way in which cortical microstructure supports functional networks. Further, it paves the way for future investigations of the gray-matter structure/function relationship and its breakdown in pathology. PMID:27830650

Disruption of thalamic functional connectivity is a neural correlate of dexmedetomidine-induced unconsciousness

PubMed Central

Akeju, Oluwaseun; Loggia, Marco L; Catana, Ciprian; Pavone, Kara J; Vazquez, Rafael; Rhee, James; Contreras Ramirez, Violeta; Chonde, Daniel B; Izquierdo-Garcia, David; Arabasz, Grae; Hsu, Shirley; Habeeb, Kathleen; Hooker, Jacob M; Napadow, Vitaly; Brown, Emery N; Purdon, Patrick L

2014-01-01

Understanding the neural basis of consciousness is fundamental to neuroscience research. Disruptions in cortico-cortical connectivity have been suggested as a primary mechanism of unconsciousness. By using a novel combination of positron emission tomography and functional magnetic resonance imaging, we studied anesthesia-induced unconsciousness and recovery using the α2-agonist dexmedetomidine. During unconsciousness, cerebral metabolic rate of glucose and cerebral blood flow were preferentially decreased in the thalamus, the Default Mode Network (DMN), and the bilateral Frontoparietal Networks (FPNs). Cortico-cortical functional connectivity within the DMN and FPNs was preserved. However, DMN thalamo-cortical functional connectivity was disrupted. Recovery from this state was associated with sustained reduction in cerebral blood flow and restored DMN thalamo-cortical functional connectivity. We report that loss of thalamo-cortical functional connectivity is sufficient to produce unconsciousness. DOI: http://dx.doi.org/10.7554/eLife.04499.001 PMID:25432022

Mean Field Analysis of Stochastic Neural Network Models with Synaptic Depression

NASA Astrophysics Data System (ADS)

Yasuhiko Igarashi,; Masafumi Oizumi,; Masato Okada,

2010-08-01

We investigated the effects of synaptic depression on the macroscopic behavior of stochastic neural networks. Dynamical mean field equations were derived for such networks by taking the average of two stochastic variables: a firing-state variable and a synaptic variable. In these equations, the average product of thesevariables is decoupled as the product of their averages because the two stochastic variables are independent. We proved the independence of these two stochastic variables assuming that the synaptic weight Jij is of the order of 1/N with respect to the number of neurons N. Using these equations, we derived macroscopic steady-state equations for a network with uniform connections and for a ring attractor network with Mexican hat type connectivity and investigated the stability of the steady-state solutions. An oscillatory uniform state was observed in the network with uniform connections owing to a Hopf instability. For the ring network, high-frequency perturbations were shown not to affect system stability. Two mechanisms destabilize the inhomogeneous steady state, leading to two oscillatory states. A Turing instability leads to a rotating bump state, while a Hopf instability leads to an oscillatory bump state, which was previously unreported. Various oscillatory states take place in a network with synaptic depression depending on the strength of the interneuron connections.

Learning neural connectivity from firing activity: efficient algorithms with provable guarantees on topology.

PubMed

Karbasi, Amin; Salavati, Amir Hesam; Vetterli, Martin

2018-04-01

The connectivity of a neuronal network has a major effect on its functionality and role. It is generally believed that the complex network structure of the brain provides a physiological basis for information processing. Therefore, identifying the network's topology has received a lot of attentions in neuroscience and has been the center of many research initiatives such as Human Connectome Project. Nevertheless, direct and invasive approaches that slice and observe the neural tissue have proven to be time consuming, complex and costly. As a result, the inverse methods that utilize firing activity of neurons in order to identify the (functional) connections have gained momentum recently, especially in light of rapid advances in recording technologies; It will soon be possible to simultaneously monitor the activities of tens of thousands of neurons in real time. While there are a number of excellent approaches that aim to identify the functional connections from firing activities, the scalability of the proposed techniques plays a major challenge in applying them on large-scale datasets of recorded firing activities. In exceptional cases where scalability has not been an issue, the theoretical performance guarantees are usually limited to a specific family of neurons or the type of firing activities. In this paper, we formulate the neural network reconstruction as an instance of a graph learning problem, where we observe the behavior of nodes/neurons (i.e., firing activities) and aim to find the links/connections. We develop a scalable learning mechanism and derive the conditions under which the estimated graph for a network of Leaky Integrate and Fire (LIf) neurons matches the true underlying synaptic connections. We then validate the performance of the algorithm using artificially generated data (for benchmarking) and real data recorded from multiple hippocampal areas in rats.

A reverse engineering algorithm for neural networks, applied to the subthalamopallidal network of basal ganglia.

PubMed

Floares, Alexandru George

2008-01-01

Modeling neural networks with ordinary differential equations systems is a sensible approach, but also very difficult. This paper describes a new algorithm based on linear genetic programming which can be used to reverse engineer neural networks. The RODES algorithm automatically discovers the structure of the network, including neural connections, their signs and strengths, estimates its parameters, and can even be used to identify the biophysical mechanisms involved. The algorithm is tested on simulated time series data, generated using a realistic model of the subthalamopallidal network of basal ganglia. The resulting ODE system is highly accurate, and results are obtained in a matter of minutes. This is because the problem of reverse engineering a system of coupled differential equations is reduced to one of reverse engineering individual algebraic equations. The algorithm allows the incorporation of common domain knowledge to restrict the solution space. To our knowledge, this is the first time a realistic reverse engineering algorithm based on linear genetic programming has been applied to neural networks.

Wind power prediction based on genetic neural network

NASA Astrophysics Data System (ADS)

Zhang, Suhan

2017-04-01

The scale of grid connected wind farms keeps increasing. To ensure the stability of power system operation, make a reasonable scheduling scheme and improve the competitiveness of wind farm in the electricity generation market, it's important to accurately forecast the short-term wind power. To reduce the influence of the nonlinear relationship between the disturbance factor and the wind power, the improved prediction model based on genetic algorithm and neural network method is established. To overcome the shortcomings of long training time of BP neural network and easy to fall into local minimum and improve the accuracy of the neural network, genetic algorithm is adopted to optimize the parameters and topology of neural network. The historical data is used as input to predict short-term wind power. The effectiveness and feasibility of the method is verified by the actual data of a certain wind farm as an example.

Coherent periodic activity in excitatory Erdös-Renyi neural networks: the role of network connectivity.

PubMed

Tattini, Lorenzo; Olmi, Simona; Torcini, Alessandro

2012-06-01

In this article, we investigate the role of connectivity in promoting coherent activity in excitatory neural networks. In particular, we would like to understand if the onset of collective oscillations can be related to a minimal average connectivity and how this critical connectivity depends on the number of neurons in the networks. For these purposes, we consider an excitatory random network of leaky integrate-and-fire pulse coupled neurons. The neurons are connected as in a directed Erdös-Renyi graph with average connectivity scaling as a power law with the number of neurons in the network. The scaling is controlled by a parameter γ, which allows to pass from massively connected to sparse networks and therefore to modify the topology of the system. At a macroscopic level, we observe two distinct dynamical phases: an asynchronous state corresponding to a desynchronized dynamics of the neurons and a regime of partial synchronization (PS) associated with a coherent periodic activity of the network. At low connectivity, the system is in an asynchronous state, while PS emerges above a certain critical average connectivity (c). For sufficiently large networks, (c) saturates to a constant value suggesting that a minimal average connectivity is sufficient to observe coherent activity in systems of any size irrespectively of the kind of considered network: sparse or massively connected. However, this value depends on the nature of the synapses: reliable or unreliable. For unreliable synapses, the critical value required to observe the onset of macroscopic behaviors is noticeably smaller than for reliable synaptic transmission. Due to the disorder present in the system, for finite number of neurons we have inhomogeneities in the neuronal behaviors, inducing a weak form of chaos, which vanishes in the thermodynamic limit. In such a limit, the disordered systems exhibit regular (non chaotic) dynamics and their properties correspond to that of a homogeneous fully connected network for any γ-value. Apart for the peculiar exception of sparse networks, which remain intrinsically inhomogeneous at any system size.

Modeling polyvinyl chloride Plasma Modification by Neural Networks

NASA Astrophysics Data System (ADS)

Wang, Changquan

2018-03-01

Neural networks model were constructed to analyze the connection between dielectric barrier discharge parameters and surface properties of material. The experiment data were generated from polyvinyl chloride plasma modification by using uniform design. Discharge voltage, discharge gas gap and treatment time were as neural network input layer parameters. The measured values of contact angle were as the output layer parameters. A nonlinear mathematical model of the surface modification for polyvinyl chloride was developed based upon the neural networks. The optimum model parameters were obtained by the simulation evaluation and error analysis. The results of the optimal model show that the predicted value is very close to the actual test value. The prediction model obtained here are useful for discharge plasma surface modification analysis.

On the Relationships between Generative Encodings, Regularity, and Learning Abilities when Evolving Plastic Artificial Neural Networks

PubMed Central

Tonelli, Paul; Mouret, Jean-Baptiste

2013-01-01

A major goal of bio-inspired artificial intelligence is to design artificial neural networks with abilities that resemble those of animal nervous systems. It is commonly believed that two keys for evolving nature-like artificial neural networks are (1) the developmental process that links genes to nervous systems, which enables the evolution of large, regular neural networks, and (2) synaptic plasticity, which allows neural networks to change during their lifetime. So far, these two topics have been mainly studied separately. The present paper shows that they are actually deeply connected. Using a simple operant conditioning task and a classic evolutionary algorithm, we compare three ways to encode plastic neural networks: a direct encoding, a developmental encoding inspired by computational neuroscience models, and a developmental encoding inspired by morphogen gradients (similar to HyperNEAT). Our results suggest that using a developmental encoding could improve the learning abilities of evolved, plastic neural networks. Complementary experiments reveal that this result is likely the consequence of the bias of developmental encodings towards regular structures: (1) in our experimental setup, encodings that tend to produce more regular networks yield networks with better general learning abilities; (2) whatever the encoding is, networks that are the more regular are statistically those that have the best learning abilities. PMID:24236099

Modular representation of layered neural networks.

PubMed

Watanabe, Chihiro; Hiramatsu, Kaoru; Kashino, Kunio

2018-01-01

Layered neural networks have greatly improved the performance of various applications including image processing, speech recognition, natural language processing, and bioinformatics. However, it is still difficult to discover or interpret knowledge from the inference provided by a layered neural network, since its internal representation has many nonlinear and complex parameters embedded in hierarchical layers. Therefore, it becomes important to establish a new methodology by which layered neural networks can be understood. In this paper, we propose a new method for extracting a global and simplified structure from a layered neural network. Based on network analysis, the proposed method detects communities or clusters of units with similar connection patterns. We show its effectiveness by applying it to three use cases. (1) Network decomposition: it can decompose a trained neural network into multiple small independent networks thus dividing the problem and reducing the computation time. (2) Training assessment: the appropriateness of a trained result with a given hyperparameter or randomly chosen initial parameters can be evaluated by using a modularity index. And (3) data analysis: in practical data it reveals the community structure in the input, hidden, and output layers, which serves as a clue for discovering knowledge from a trained neural network. Copyright © 2017 Elsevier Ltd. All rights reserved.

F77NNS - A FORTRAN-77 NEURAL NETWORK SIMULATOR

NASA Technical Reports Server (NTRS)

Mitchell, P. H.

1994-01-01

F77NNS (A FORTRAN-77 Neural Network Simulator) simulates the popular back error propagation neural network. F77NNS is an ANSI-77 FORTRAN program designed to take advantage of vectorization when run on machines having this capability, but it will run on any computer with an ANSI-77 FORTRAN Compiler. Artificial neural networks are formed from hundreds or thousands of simulated neurons, connected to each other in a manner similar to biological nerve cells. Problems which involve pattern matching or system modeling readily fit the class of problems which F77NNS is designed to solve. The program's formulation trains a neural network using Rumelhart's back-propagation algorithm. Typically the nodes of a network are grouped together into clumps called layers. A network will generally have an input layer through which the various environmental stimuli are presented to the network, and an output layer for determining the network's response. The number of nodes in these two layers is usually tied to features of the problem being solved. Other layers, which form intermediate stops between the input and output layers, are called hidden layers. The back-propagation training algorithm can require massive computational resources to implement a large network such as a network capable of learning text-to-phoneme pronunciation rules as in the famous Sehnowski experiment. The Sehnowski neural network learns to pronounce 1000 common English words. The standard input data defines the specific inputs that control the type of run to be made, and input files define the NN in terms of the layers and nodes, as well as the input/output (I/O) pairs. The program has a restart capability so that a neural network can be solved in stages suitable to the user's resources and desires. F77NNS allows the user to customize the patterns of connections between layers of a network. The size of the neural network to be solved is limited only by the amount of random access memory (RAM) available to the user. The program has a memory requirement of about 900K. The standard distribution medium for this package is a .25 inch streaming magnetic tape cartridge in UNIX tar format. It is also available on a 3.5 inch diskette in UNIX tar format. F77NNS was developed in 1989.

Modified neural networks for rapid recovery of tokamak plasma parameters for real time control

NASA Astrophysics Data System (ADS)

Sengupta, A.; Ranjan, P.

2002-07-01

Two modified neural network techniques are used for the identification of the equilibrium plasma parameters of the Superconducting Steady State Tokamak I from external magnetic measurements. This is expected to ultimately assist in a real time plasma control. As different from the conventional network structure where a single network with the optimum number of processing elements calculates the outputs, a multinetwork system connected in parallel does the calculations here in one of the methods. This network is called the double neural network. The accuracy of the recovered parameters is clearly more than the conventional network. The other type of neural network used here is based on the statistical function parametrization combined with a neural network. The principal component transformation removes linear dependences from the measurements and a dimensional reduction process reduces the dimensionality of the input space. This reduced and transformed input set, rather than the entire set, is fed into the neural network input. This is known as the principal component transformation-based neural network. The accuracy of the recovered parameters in the latter type of modified network is found to be a further improvement over the accuracy of the double neural network. This result differs from that obtained in an earlier work where the double neural network showed better performance. The conventional network and the function parametrization methods have also been used for comparison. The conventional network has been used for an optimization of the set of magnetic diagnostics. The effective set of sensors, as assessed by this network, are compared with the principal component based network. Fault tolerance of the neural networks has been tested. The double neural network showed the maximum resistance to faults in the diagnostics, while the principal component based network performed poorly. Finally the processing times of the methods have been compared. The double network and the principal component network involve the minimum computation time, although the conventional network also performs well enough to be used in real time.

Programmable synaptic chip for electronic neural networks

NASA Technical Reports Server (NTRS)

Moopenn, A.; Langenbacher, H.; Thakoor, A. P.; Khanna, S. K.

1988-01-01

A binary synaptic matrix chip has been developed for electronic neural networks. The matrix chip contains a programmable 32X32 array of 'long channel' NMOSFET binary connection elements implemented in a 3-micron bulk CMOS process. Since the neurons are kept off-chip, the synaptic chip serves as a 'cascadable' building block for a multi-chip synaptic network as large as 512X512 in size. As an alternative to the programmable NMOSFET (long channel) connection elements, tailored thin film resistors are deposited, in series with FET switches, on some CMOS test chips, to obtain the weak synaptic connections. Although deposition and patterning of the resistors require additional processing steps, they promise substantial savings in silicon area. The performance of synaptic chip in a 32-neuron breadboard system in an associative memory test application is discussed.

Multisensory integration processing during olfactory-visual stimulation-An fMRI graph theoretical network analysis.

PubMed

Ripp, Isabelle; Zur Nieden, Anna-Nora; Blankenagel, Sonja; Franzmeier, Nicolai; Lundström, Johan N; Freiherr, Jessica

2018-05-07

In this study, we aimed to understand how whole-brain neural networks compute sensory information integration based on the olfactory and visual system. Task-related functional magnetic resonance imaging (fMRI) data was obtained during unimodal and bimodal sensory stimulation. Based on the identification of multisensory integration processing (MIP) specific hub-like network nodes analyzed with network-based statistics using region-of-interest based connectivity matrices, we conclude the following brain areas to be important for processing the presented bimodal sensory information: right precuneus connected contralaterally to the supramarginal gyrus for memory-related imagery and phonology retrieval, and the left middle occipital gyrus connected ipsilaterally to the inferior frontal gyrus via the inferior fronto-occipital fasciculus including functional aspects of working memory. Applied graph theory for quantification of the resulting complex network topologies indicates a significantly increased global efficiency and clustering coefficient in networks including aspects of MIP reflecting a simultaneous better integration and segregation. Graph theoretical analysis of positive and negative network correlations allowing for inferences about excitatory and inhibitory network architectures revealed-not significant, but very consistent-that MIP-specific neural networks are dominated by inhibitory relationships between brain regions involved in stimulus processing. © 2018 Wiley Periodicals, Inc.

An FPGA-Based Massively Parallel Neuromorphic Cortex Simulator

PubMed Central

Wang, Runchun M.; Thakur, Chetan S.; van Schaik, André

2018-01-01

This paper presents a massively parallel and scalable neuromorphic cortex simulator designed for simulating large and structurally connected spiking neural networks, such as complex models of various areas of the cortex. The main novelty of this work is the abstraction of a neuromorphic architecture into clusters represented by minicolumns and hypercolumns, analogously to the fundamental structural units observed in neurobiology. Without this approach, simulating large-scale fully connected networks needs prohibitively large memory to store look-up tables for point-to-point connections. Instead, we use a novel architecture, based on the structural connectivity in the neocortex, such that all the required parameters and connections can be stored in on-chip memory. The cortex simulator can be easily reconfigured for simulating different neural networks without any change in hardware structure by programming the memory. A hierarchical communication scheme allows one neuron to have a fan-out of up to 200 k neurons. As a proof-of-concept, an implementation on one Altera Stratix V FPGA was able to simulate 20 million to 2.6 billion leaky-integrate-and-fire (LIF) neurons in real time. We verified the system by emulating a simplified auditory cortex (with 100 million neurons). This cortex simulator achieved a low power dissipation of 1.62 μW per neuron. With the advent of commercially available FPGA boards, our system offers an accessible and scalable tool for the design, real-time simulation, and analysis of large-scale spiking neural networks. PMID:29692702

An FPGA-Based Massively Parallel Neuromorphic Cortex Simulator.

PubMed

Wang, Runchun M; Thakur, Chetan S; van Schaik, André

2018-01-01

This paper presents a massively parallel and scalable neuromorphic cortex simulator designed for simulating large and structurally connected spiking neural networks, such as complex models of various areas of the cortex. The main novelty of this work is the abstraction of a neuromorphic architecture into clusters represented by minicolumns and hypercolumns, analogously to the fundamental structural units observed in neurobiology. Without this approach, simulating large-scale fully connected networks needs prohibitively large memory to store look-up tables for point-to-point connections. Instead, we use a novel architecture, based on the structural connectivity in the neocortex, such that all the required parameters and connections can be stored in on-chip memory. The cortex simulator can be easily reconfigured for simulating different neural networks without any change in hardware structure by programming the memory. A hierarchical communication scheme allows one neuron to have a fan-out of up to 200 k neurons. As a proof-of-concept, an implementation on one Altera Stratix V FPGA was able to simulate 20 million to 2.6 billion leaky-integrate-and-fire (LIF) neurons in real time. We verified the system by emulating a simplified auditory cortex (with 100 million neurons). This cortex simulator achieved a low power dissipation of 1.62 μW per neuron. With the advent of commercially available FPGA boards, our system offers an accessible and scalable tool for the design, real-time simulation, and analysis of large-scale spiking neural networks.

Working Memory-Related Effective Connectivity in Huntington's Disease Patients.

PubMed

Lahr, Jacob; Minkova, Lora; Tabrizi, Sarah J; Stout, Julie C; Klöppel, Stefan; Scheller, Elisa

2018-01-01

Huntington's disease (HD) is a genetically caused neurodegenerative disorder characterized by heterogeneous motor, psychiatric, and cognitive symptoms. Although motor symptoms may be the most prominent presentation, cognitive symptoms such as memory deficits and executive dysfunction typically co-occur. We used functional magnetic resonance imaging (fMRI) and task fMRI-based dynamic causal modeling (DCM) to evaluate HD-related changes in the neural network underlying working memory (WM). Sixty-four pre-symptomatic HD mutation carriers (preHD), 20 patients with early manifest HD symptoms (earlyHD), and 83 healthy control subjects performed an n -back fMRI task with two levels of WM load. Effective connectivity was assessed in five predefined regions of interest, comprising bilateral inferior parietal cortex, left anterior cingulate cortex, and bilateral dorsolateral prefrontal cortex. HD mutation carriers performed less accurately and more slowly at high WM load compared with the control group. While between-group comparisons of brain activation did not reveal differential recruitment of the cortical WM network in mutation carriers, comparisons of brain connectivity as identified with DCM revealed a number of group differences across the whole WM network. Most strikingly, we observed decreasing connectivity from several regions toward right dorsolateral prefrontal cortex (rDLPFC) in preHD and even more so in earlyHD. The deterioration in rDLPFC connectivity complements results from previous studies and might mirror beginning cortical neural decline at premanifest and early manifest stages of HD. We were able to characterize effective connectivity in a WM network of HD mutation carriers yielding further insight into patterns of cognitive decline and accompanying neural deterioration.

Electronic device aspects of neural network memories

NASA Technical Reports Server (NTRS)

Lambe, J.; Moopenn, A.; Thakoor, A. P.

1985-01-01

The basic issues related to the electronic implementation of the neural network model (NNM) for content addressable memories are examined. A brief introduction to the principles of the NNM is followed by an analysis of the information storage of the neural network in the form of a binary connection matrix and the recall capability of such matrix memories based on a hardware simulation study. In addition, materials and device architecture issues involved in the future realization of such networks in VLSI-compatible ultrahigh-density memories are considered. A possible space application of such devices would be in the area of large-scale information storage without mechanical devices.

Proceedings of the Third International Workshop on Neural Networks and Fuzzy Logic, volume 1

NASA Technical Reports Server (NTRS)

Culbert, Christopher J. (Editor)

1993-01-01

Documented here are papers presented at the Neural Networks and Fuzzy Logic Workshop sponsored by the National Aeronautics and Space Administration and cosponsored by the University of Houston, Clear Lake. The workshop was held June 1-3, 1992 at the Lyndon B. Johnson Space Center in Houston, Texas. During the three days approximately 50 papers were presented. Technical topics addressed included adaptive systems; learning algorithms; network architectures; vision; robotics; neurobiological connections; speech recognition and synthesis; fuzzy set theory and application, control, and dynamics processing; space applications; fuzzy logic and neural network computers; approximate reasoning; and multiobject decision making.

Stress-Induced Activation of the HPA Axis Predicts Connectivity between Subgenual Cingulate and Salience Network during Rest in Adolescents

ERIC Educational Resources Information Center

Thomason, Moriah E.; Hamilton, J. Paul; Gotlib, Ian H.

2011-01-01

Background: Responses to stress vary greatly in young adolescents, and little is known about neural correlates of the stress response in youth. The purpose of this study was to examine whether variability in cortisol responsivity following a social stress test in young adolescents is associated with altered neural functional connectivity (FC) of…

In Search of Neural Endophenotypes of Postpartum Psychopathology and Disrupted Maternal Caregiving

PubMed Central

Moses-Kolko, E. L.; Horner, M. S.; Phillips, M. L.; Hipwell, A. E.; Swain, J. E.

2015-01-01

This is a selective review that provides the context for the study of perinatal affective disorder mechanisms and outlines directions for future research. We integrate existing literature along neural networks of interest for affective disorders and maternal caregiving: (i) the salience/fear network; (ii) the executive network; (iii) the reward/social attachment network; and (iv) the default mode network. Extant salience/fear network research reveals disparate responses and corticolimbic coupling to various stimuli based upon a predominantly depressive versus anxious (post-traumatic stress disorder) clinical phenotype. Executive network and default mode connectivity abnormalities have been described in postpartum depression (PPD), although studies are very limited in these domains. Reward/social attachment studies confirm a robust ventral striatal response to infant stimuli, including cry and happy infant faces, which is diminished in depressed, insecurely attached and substance-using mothers. The adverse parenting experiences received and the attachment insecurity of current mothers are factors that are associated with a diminution in infant stimulus-related neural activity similar to that in PPD, and raise the need for additional studies that integrate mood and attachment concepts in larger study samples. Several studies examining functional connectivity in resting state and emotional activation functional magnetic resonance imaging paradigms have revealed attenuated corticolimbic connectivity, which remains an important outcome that requires dissection with increasing precision to better define neural treatment targets. Methodological progress is expected in the coming years in terms of refining clinical phenotypes of interest and experimental paradigms, as well as enlarging samples to facilitate the examination of multiple constructs. Functional imaging promises to determine neural mechanisms underlying maternal psychopathology and impaired caregiving, such that earlier and more precise detection of abnormalities will be possible. Ultimately, the discovery of such mechanisms will promote the refinement of treatment approaches toward maternal affective disturbance, parenting behaviours and the augmentation of parenting resiliency. PMID:25059408

Computational neural networks in chemistry: Model free mapping devices for predicting chemical reactivity from molecular structure

DOE Office of Scientific and Technical Information (OSTI.GOV)

Elrod, D.W.

1992-01-01

Computational neural networks (CNNs) are a computational paradigm inspired by the brain's massively parallel network of highly interconnected neurons. The power of computational neural networks derives not so much from their ability to model the brain as from their ability to learn by example and to map highly complex, nonlinear functions, without the need to explicitly specify the functional relationship. Two central questions about CNNs were investigated in the context of predicting chemical reactions: (1) the mapping properties of neural networks and (2) the representation of chemical information for use in CNNs. Chemical reactivity is here considered an example ofmore » a complex, nonlinear function of molecular structure. CNN's were trained using modifications of the back propagation learning rule to map a three dimensional response surface similar to those typically observed in quantitative structure-activity and structure-property relationships. The computational neural network's mapping of the response surface was found to be robust to the effects of training sample size, noisy data and intercorrelated input variables. The investigation of chemical structure representation led to the development of a molecular structure-based connection-table representation suitable for neural network training. An extension of this work led to a BE-matrix structure representation that was found to be general for several classes of reactions. The CNN prediction of chemical reactivity and regiochemistry was investigated for electrophilic aromatic substitution reactions, Markovnikov addition to alkenes, Saytzeff elimination from haloalkanes, Diels-Alder cycloaddition, and retro Diels-Alder ring opening reactions using these connectivity-matrix derived representations. The reaction predictions made by the CNNs were more accurate than those of an expert system and were comparable to predictions made by chemists.« less

Abnormal network connectivity in frontotemporal dementia: evidence for prefrontal isolation.

PubMed

Farb, Norman A S; Grady, Cheryl L; Strother, Stephen; Tang-Wai, David F; Masellis, Mario; Black, Sandra; Freedman, Morris; Pollock, Bruce G; Campbell, Karen L; Hasher, Lynn; Chow, Tiffany W

2013-01-01

Degraded social function, disinhibition, and stereotypy are defining characteristics of frontotemporal dementia (FTD), manifesting in both the behavioral variant of frontotemporal dementia (bvFTD) and semantic dementia (SD) subtypes. Recent neuroimaging research also associates FTD with alterations in the brain's intrinsic connectivity networks. The present study explored the relationship between neural network connectivity and specific behavioral symptoms in FTD. Resting-state functional magnetic resonance imaging was employed to investigate neural network changes in bvFTD and SD. We used independent components analysis (ICA) to examine changes in frontolimbic network connectivity, as well as several metrics of local network strength, such as the fractional amplitude of low-frequency fluctuations, regional homogeneity, and seed-based functional connectivity. For each analysis, we compared each FTD subgroup to healthy controls, characterizing general and subtype-unique network changes. The relationship between abnormal connectivity in FTD and behavior disturbances was explored. Across multiple analytic approaches, both bvFTD and SD were associated with disrupted frontolimbic connectivity and elevated local connectivity within the prefrontal cortex. Even after controlling for structural atrophy, prefrontal hyperconnectivity was robustly associated with apathy scores. Frontolimbic disconnection was associated with lower disinhibition scores, suggesting that abnormal frontolimbic connectivity contributes to positive symptoms in dementia. Unique to bvFTD, stereotypy was associated with elevated default network connectivity in the right angular gyrus. The behavioral variant was also associated with marginally higher apathy scores and a more diffuse pattern of prefrontal hyperconnectivity than SD. The present findings support a theory of FTD as a disorder of frontolimbic disconnection leading to unconstrained prefrontal connectivity. Prefrontal hyperconnectivity may represent a compensatory response to the absence of affective feedback during the planning and execution of behavior. Increased reliance upon prefrontal processes in isolation from subcortical structures appears to be maladaptive and may drive behavioral withdrawal that is commonly observed in later phases of neurodegeneration. Copyright © 2012 Elsevier Ltd. All rights reserved.

Optimal stimulus scheduling for active estimation of evoked brain networks.

PubMed

Kafashan, MohammadMehdi; Ching, ShiNung

2015-12-01

We consider the problem of optimal probing to learn connections in an evoked dynamic network. Such a network, in which each edge measures an input-output relationship between sites in sensor/actuator-space, is relevant to emerging applications in neural mapping and neural connectivity estimation. We show that the problem of scheduling nodes to a probe (i.e., stimulate) amounts to a problem of optimal sensor scheduling. By formulating the evoked network in state-space, we show that the solution to the greedy probing strategy has a convenient form and, under certain conditions, is optimal over a finite horizon. We adopt an expectation maximization technique to update the state-space parameters in an online fashion and demonstrate the efficacy of the overall approach in a series of detailed numerical examples. The proposed method provides a principled means to actively probe time-varying connections in neuronal networks. The overall method can be implemented in real time and is particularly well-suited to applications in stimulation-based cortical mapping in which the underlying network dynamics are changing over time.

Optimal stimulus scheduling for active estimation of evoked brain networks

NASA Astrophysics Data System (ADS)

Kafashan, MohammadMehdi; Ching, ShiNung

2015-12-01

Objective. We consider the problem of optimal probing to learn connections in an evoked dynamic network. Such a network, in which each edge measures an input-output relationship between sites in sensor/actuator-space, is relevant to emerging applications in neural mapping and neural connectivity estimation. Approach. We show that the problem of scheduling nodes to a probe (i.e., stimulate) amounts to a problem of optimal sensor scheduling. Main results. By formulating the evoked network in state-space, we show that the solution to the greedy probing strategy has a convenient form and, under certain conditions, is optimal over a finite horizon. We adopt an expectation maximization technique to update the state-space parameters in an online fashion and demonstrate the efficacy of the overall approach in a series of detailed numerical examples. Significance. The proposed method provides a principled means to actively probe time-varying connections in neuronal networks. The overall method can be implemented in real time and is particularly well-suited to applications in stimulation-based cortical mapping in which the underlying network dynamics are changing over time.

Analysis of connectivity map: Control to glutamate injured and phenobarbital treated neuronal network

NASA Astrophysics Data System (ADS)

Kamal, Hassan; Kanhirodan, Rajan; Srinivas, Kalyan V.; Sikdar, Sujit K.

2010-04-01

We study the responses of a cultured neural network when it is exposed to epileptogenesis glutamate injury causing epilepsy and subsequent treatment with phenobarbital by constructing connectivity map of neurons using correlation matrix. This study is particularly useful in understanding the pharmaceutical drug induced changes in the neuronal network properties with insights into changes at the systems biology level.

Neural model of gene regulatory network: a survey on supportive meta-heuristics.

PubMed

Biswas, Surama; Acharyya, Sriyankar

2016-06-01

Gene regulatory network (GRN) is produced as a result of regulatory interactions between different genes through their coded proteins in cellular context. Having immense importance in disease detection and drug finding, GRN has been modelled through various mathematical and computational schemes and reported in survey articles. Neural and neuro-fuzzy models have been the focus of attraction in bioinformatics. Predominant use of meta-heuristic algorithms in training neural models has proved its excellence. Considering these facts, this paper is organized to survey neural modelling schemes of GRN and the efficacy of meta-heuristic algorithms towards parameter learning (i.e. weighting connections) within the model. This survey paper renders two different structure-related approaches to infer GRN which are global structure approach and substructure approach. It also describes two neural modelling schemes, such as artificial neural network/recurrent neural network based modelling and neuro-fuzzy modelling. The meta-heuristic algorithms applied so far to learn the structure and parameters of neutrally modelled GRN have been reviewed here.

Brain networks for visual creativity: a functional connectivity study of planning a visual artwork.

PubMed

De Pisapia, Nicola; Bacci, Francesca; Parrott, Danielle; Melcher, David

2016-12-19

Throughout recorded history, and across cultures, humans have made visual art. In recent years, the neural bases of creativity, including artistic creativity, have become a topic of interest. In this study we investigated the neural bases of the visual creative process with both professional artists and a group of control participants. We tested the idea that creativity (planning an artwork) would influence the functional connectivity between regions involved in the default mode network (DMN), implicated in divergent thinking and generating novel ideas, and the executive control network (EN), implicated in evaluating and selecting ideas. We measured functional connectivity with functional Magnetic Resonance Imaging (fMRI) during three different conditions: rest, visual imagery of the alphabet and planning an artwork to be executed immediately after the scanning session. Consistent with our hypothesis, we found stronger connectivity between areas of the DMN and EN during the creative task, and this difference was enhanced in professional artists. These findings suggest that creativity involves an expert balance of two brain networks typically viewed as being in opposition.

Brain networks for visual creativity: a functional connectivity study of planning a visual artwork

PubMed Central

De Pisapia, Nicola; Bacci, Francesca; Parrott, Danielle; Melcher, David

2016-01-01

Throughout recorded history, and across cultures, humans have made visual art. In recent years, the neural bases of creativity, including artistic creativity, have become a topic of interest. In this study we investigated the neural bases of the visual creative process with both professional artists and a group of control participants. We tested the idea that creativity (planning an artwork) would influence the functional connectivity between regions involved in the default mode network (DMN), implicated in divergent thinking and generating novel ideas, and the executive control network (EN), implicated in evaluating and selecting ideas. We measured functional connectivity with functional Magnetic Resonance Imaging (fMRI) during three different conditions: rest, visual imagery of the alphabet and planning an artwork to be executed immediately after the scanning session. Consistent with our hypothesis, we found stronger connectivity between areas of the DMN and EN during the creative task, and this difference was enhanced in professional artists. These findings suggest that creativity involves an expert balance of two brain networks typically viewed as being in opposition. PMID:27991592

Spatial-temporal-spectral EEG patterns of BOLD functional network connectivity dynamics

NASA Astrophysics Data System (ADS)

Lamoš, Martin; Mareček, Radek; Slavíček, Tomáš; Mikl, Michal; Rektor, Ivan; Jan, Jiří

2018-06-01

Objective. Growing interest in the examination of large-scale brain network functional connectivity dynamics is accompanied by an effort to find the electrophysiological correlates. The commonly used constraints applied to spatial and spectral domains during electroencephalogram (EEG) data analysis may leave part of the neural activity unrecognized. We propose an approach that blindly reveals multimodal EEG spectral patterns that are related to the dynamics of the BOLD functional network connectivity. Approach. The blind decomposition of EEG spectrogram by parallel factor analysis has been shown to be a useful technique for uncovering patterns of neural activity. The simultaneously acquired BOLD fMRI data were decomposed by independent component analysis. Dynamic functional connectivity was computed on the component’s time series using a sliding window correlation, and between-network connectivity states were then defined based on the values of the correlation coefficients. ANOVA tests were performed to assess the relationships between the dynamics of between-network connectivity states and the fluctuations of EEG spectral patterns. Main results. We found three patterns related to the dynamics of between-network connectivity states. The first pattern has dominant peaks in the alpha, beta, and gamma bands and is related to the dynamics between the auditory, sensorimotor, and attentional networks. The second pattern, with dominant peaks in the theta and low alpha bands, is related to the visual and default mode network. The third pattern, also with peaks in the theta and low alpha bands, is related to the auditory and frontal network. Significance. Our previous findings revealed a relationship between EEG spectral pattern fluctuations and the hemodynamics of large-scale brain networks. In this study, we suggest that the relationship also exists at the level of functional connectivity dynamics among large-scale brain networks when no standard spatial and spectral constraints are applied on the EEG data.

Symmetry Breaking in Space-Time Hierarchies Shapes Brain Dynamics and Behavior.

PubMed

Pillai, Ajay S; Jirsa, Viktor K

2017-06-07

In order to maintain brain function, neural activity needs to be tightly coordinated within the brain network. How this coordination is achieved and related to behavior is largely unknown. It has been previously argued that the study of the link between brain and behavior is impossible without a guiding vision. Here we propose behavioral-level concepts and mechanisms embodied as structured flows on manifold (SFM) that provide a formal description of behavior as a low-dimensional process emerging from a network's dynamics dependent on the symmetry and invariance properties of the network connectivity. Specifically, we demonstrate that the symmetry breaking of network connectivity constitutes a timescale hierarchy resulting in the emergence of an attractive functional subspace. We show that behavior emerges when appropriate conditions imposed upon the couplings are satisfied, justifying the conductance-based nature of synaptic couplings. Our concepts propose design principles for networks predicting how behavior and task rules are represented in real neural circuits and open new avenues for the analyses of neural data. Copyright © 2017 Elsevier Inc. All rights reserved.

Iris double recognition based on modified evolutionary neural network

NASA Astrophysics Data System (ADS)

Liu, Shuai; Liu, Yuan-Ning; Zhu, Xiao-Dong; Huo, Guang; Liu, Wen-Tao; Feng, Jia-Kai

2017-11-01

Aiming at multicategory iris recognition under illumination and noise interference, this paper proposes a method of iris double recognition based on a modified evolutionary neural network. An equalization histogram and Laplace of Gaussian operator are used to process the iris to suppress illumination and noise interference and Haar wavelet to convert the iris feature to binary feature encoding. Calculate the Hamming distance for the test iris and template iris , and compare with classification threshold, determine the type of iris. If the iris cannot be identified as a different type, there needs to be a secondary recognition. The connection weights in back-propagation (BP) neural network use modified evolutionary neural network to adaptively train. The modified neural network is composed of particle swarm optimization with mutation operator and BP neural network. According to different iris libraries in different circumstances of experimental results, under illumination and noise interference, the correct recognition rate of this algorithm is higher, the ROC curve is closer to the coordinate axis, the training and recognition time is shorter, and the stability and the robustness are better.

Target recognition based on convolutional neural network

NASA Astrophysics Data System (ADS)

Wang, Liqiang; Wang, Xin; Xi, Fubiao; Dong, Jian

2017-11-01

One of the important part of object target recognition is the feature extraction, which can be classified into feature extraction and automatic feature extraction. The traditional neural network is one of the automatic feature extraction methods, while it causes high possibility of over-fitting due to the global connection. The deep learning algorithm used in this paper is a hierarchical automatic feature extraction method, trained with the layer-by-layer convolutional neural network (CNN), which can extract the features from lower layers to higher layers. The features are more discriminative and it is beneficial to the object target recognition.

Connectivity strategies for higher-order neural networks applied to pattern recognition

NASA Technical Reports Server (NTRS)

Spirkovska, Lilly; Reid, Max B.

1990-01-01

Different strategies for non-fully connected HONNs (higher-order neural networks) are discussed, showing that by using such strategies an input field of 128 x 128 pixels can be attained while still achieving in-plane rotation and translation-invariant recognition. These techniques allow HONNs to be used with the larger input scenes required for practical pattern-recognition applications. The number of interconnections that must be stored has been reduced by a factor of approximately 200,000 in a T/C case and about 2000 in a Space Shuttle/F-18 case by using regional connectivity. Third-order networks have been simulated using several connection strategies. The method found to work best is regional connectivity. The main advantages of this strategy are the following: (1) it considers features of various scales within the image and thus gets a better sample of what the image looks like; (2) it is invariant to shape-preserving geometric transformations, such as translation and rotation; (3) the connections are predetermined so that no extra computations are necessary during run time; and (4) it does not require any extra storage for recording which connections were formed.

Cortical connectivity and memory performance in cognitive decline: A study via graph theory from EEG data.

PubMed

Vecchio, F; Miraglia, F; Quaranta, D; Granata, G; Romanello, R; Marra, C; Bramanti, P; Rossini, P M

2016-03-01

Functional brain abnormalities including memory loss are found to be associated with pathological changes in connectivity and network neural structures. Alzheimer's disease (AD) interferes with memory formation from the molecular level, to synaptic functions and neural networks organization. Here, we determined whether brain connectivity of resting-state networks correlate with memory in patients affected by AD and in subjects with mild cognitive impairment (MCI). One hundred and forty-four subjects were recruited: 70 AD (MMSE Mini Mental State Evaluation 21.4), 50 MCI (MMSE 25.2) and 24 healthy subjects (MMSE 29.8). Undirected and weighted cortical brain network was built to evaluate graph core measures to obtain Small World parameters. eLORETA lagged linear connectivity as extracted by electroencephalogram (EEG) signals was used to weight the network. A high statistical correlation between Small World and memory performance was found. Namely, higher Small World characteristic in EEG gamma frequency band during the resting state, better performance in short-term memory as evaluated by the digit span tests. Such Small World pattern might represent a biomarker of working memory impairment in older people both in physiological and pathological conditions. Copyright © 2015 IBRO. Published by Elsevier Ltd. All rights reserved.

Hierarchical singleton-type recurrent neural fuzzy networks for noisy speech recognition.

PubMed

Juang, Chia-Feng; Chiou, Chyi-Tian; Lai, Chun-Lung

2007-05-01

This paper proposes noisy speech recognition using hierarchical singleton-type recurrent neural fuzzy networks (HSRNFNs). The proposed HSRNFN is a hierarchical connection of two singleton-type recurrent neural fuzzy networks (SRNFNs), where one is used for noise filtering and the other for recognition. The SRNFN is constructed by recurrent fuzzy if-then rules with fuzzy singletons in the consequences, and their recurrent properties make them suitable for processing speech patterns with temporal characteristics. In n words recognition, n SRNFNs are created for modeling n words, where each SRNFN receives the current frame feature and predicts the next one of its modeling word. The prediction error of each SRNFN is used as recognition criterion. In filtering, one SRNFN is created, and each SRNFN recognizer is connected to the same SRNFN filter, which filters noisy speech patterns in the feature domain before feeding them to the SRNFN recognizer. Experiments with Mandarin word recognition under different types of noise are performed. Other recognizers, including multilayer perceptron (MLP), time-delay neural networks (TDNNs), and hidden Markov models (HMMs), are also tested and compared. These experiments and comparisons demonstrate good results with HSRNFN for noisy speech recognition tasks.

Schaffer Collateral Inputs to CA1 Excitatory and Inhibitory Neurons Follow Different Connectivity Rules.

PubMed

Kwon, Osung; Feng, Linqing; Druckmann, Shaul; Kim, Jinhyun

2018-05-30

Neural circuits, governed by a complex interplay between excitatory and inhibitory neurons, are the substrate for information processing, and the organization of synaptic connectivity in neural network is an important determinant of circuit function. Here, we analyzed the fine structure of connectivity in hippocampal CA1 excitatory and inhibitory neurons innervated by Schaffer collaterals (SCs) using mGRASP in male mice. Our previous study revealed spatially structured synaptic connectivity between CA3 and CA1 pyramidal cells (PCs). Surprisingly, parvalbumin-positive interneurons (PVs) showed a significantly more random pattern spatial structure. Notably, application of Peters' rule for synapse prediction by random overlap between axons and dendrites enhanced structured connectivity in PCs, but, by contrast, made the connectivity pattern in PVs more random. In addition, PCs in a deep sublayer of striatum pyramidale appeared more highly structured than PCs in superficial layers, and little or no sublayer specificity was found in PVs. Our results show that CA1 excitatory PCs and inhibitory PVs innervated by the same SC inputs follow different connectivity rules. The different organizations of fine scale structured connectivity in hippocampal excitatory and inhibitory neurons provide important insights into the development and functions of neural networks. SIGNIFICANCE STATEMENT Understanding how neural circuits generate behavior is one of the central goals of neuroscience. An important component of this endeavor is the mapping of fine-scale connection patterns that underlie, and help us infer, signal processing in the brain. Here, using our recently developed synapse detection technology (mGRASP and neuTube), we provide detailed profiles of synaptic connectivity in excitatory (CA1 pyramidal) and inhibitory (CA1 parvalbumin-positive) neurons innervated by the same presynaptic inputs (CA3 Schaffer collaterals). Our results reveal that these two types of CA1 neurons follow different connectivity patterns. Our new evidence for differently structured connectivity at a fine scale in hippocampal excitatory and inhibitory neurons provides a better understanding of hippocampal networks and will guide theoretical and experimental studies. Copyright © 2018 the authors 0270-6474/18/385140-13$15.00/0.

Increased resting state functional connectivity in the fronto-parietal and default mode network in anorexia nervosa

PubMed Central

Boehm, Ilka; Geisler, Daniel; King, Joseph A.; Ritschel, Franziska; Seidel, Maria; Deza Araujo, Yacila; Petermann, Juliane; Lohmeier, Heidi; Weiss, Jessika; Walter, Martin; Roessner, Veit; Ehrlich, Stefan

2014-01-01

The etiology of anorexia nervosa (AN) is poorly understood. Results from functional brain imaging studies investigating the neural profile of AN using cognitive and emotional task paradigms are difficult to reconcile. Task-related imaging studies often require a high level of compliance and can only partially explore the distributed nature and complexity of brain function. In this study, resting state functional connectivity imaging was used to investigate well-characterized brain networks potentially relevant to understand the neural mechanisms underlying the symptomatology and etiology of AN. Resting state functional magnetic resonance imaging data was obtained from 35 unmedicated female acute AN patients and 35 closely matched healthy controls female participants (HC) and decomposed using spatial group independent component analyses (ICA). Using validated templates, we identified components covering the fronto-parietal “control” network, the default mode network (DMN), the salience network, the visual and the sensory-motor network. Group comparison revealed an increased functional connectivity between the angular gyrus and the other parts of the fronto-parietal network in patients with AN in comparison to HC. Connectivity of the angular gyrus was positively associated with self-reported persistence in HC. In the DMN, AN patients also showed an increased functional connectivity strength in the anterior insula in comparison to HC. Anterior insula connectivity was associated with self-reported problems with interoceptive awareness. This study, with one of the largest sample to date, shows that acute AN is associated with abnormal brain connectivity in two major resting state networks (RSN). The finding of an increased functional connectivity in the fronto-parietal network adds novel support for the notion of AN as a disorder of excessive cognitive control, whereas the elevated functional connectivity of the anterior insula with the DMN may reflect the high levels of self- and body-focused ruminations when AN patients are at rest. PMID:25324749

Fuzzy logic and neural networks in artificial intelligence and pattern recognition

NASA Astrophysics Data System (ADS)

Sanchez, Elie

1991-10-01

With the use of fuzzy logic techniques, neural computing can be integrated in symbolic reasoning to solve complex real world problems. In fact, artificial neural networks, expert systems, and fuzzy logic systems, in the context of approximate reasoning, share common features and techniques. A model of Fuzzy Connectionist Expert System is introduced, in which an artificial neural network is designed to construct the knowledge base of an expert system from, training examples (this model can also be used for specifications of rules in fuzzy logic control). Two types of weights are associated with the synaptic connections in an AND-OR structure: primary linguistic weights, interpreted as labels of fuzzy sets, and secondary numerical weights. Cell activation is computed through min-max fuzzy equations of the weights. Learning consists in finding the (numerical) weights and the network topology. This feedforward network is described and first illustrated in a biomedical application (medical diagnosis assistance from inflammatory-syndromes/proteins profiles). Then, it is shown how this methodology can be utilized for handwritten pattern recognition (characters play the role of diagnoses): in a fuzzy neuron describing a number for example, the linguistic weights represent fuzzy sets on cross-detecting lines and the numerical weights reflect the importance (or weakness) of connections between cross-detecting lines and characters.

Parameter diagnostics of phases and phase transition learning by neural networks

NASA Astrophysics Data System (ADS)

Suchsland, Philippe; Wessel, Stefan

2018-05-01

We present an analysis of neural network-based machine learning schemes for phases and phase transitions in theoretical condensed matter research, focusing on neural networks with a single hidden layer. Such shallow neural networks were previously found to be efficient in classifying phases and locating phase transitions of various basic model systems. In order to rationalize the emergence of the classification process and for identifying any underlying physical quantities, it is feasible to examine the weight matrices and the convolutional filter kernels that result from the learning process of such shallow networks. Furthermore, we demonstrate how the learning-by-confusing scheme can be used, in combination with a simple threshold-value classification method, to diagnose the learning parameters of neural networks. In particular, we study the classification process of both fully-connected and convolutional neural networks for the two-dimensional Ising model with extended domain wall configurations included in the low-temperature regime. Moreover, we consider the two-dimensional XY model and contrast the performance of the learning-by-confusing scheme and convolutional neural networks trained on bare spin configurations to the case of preprocessed samples with respect to vortex configurations. We discuss these findings in relation to similar recent investigations and possible further applications.

Integrated Circuit For Simulation Of Neural Network

NASA Technical Reports Server (NTRS)

Thakoor, Anilkumar P.; Moopenn, Alexander W.; Khanna, Satish K.

1988-01-01

Ballast resistors deposited on top of circuit structure. Cascadable, programmable binary connection matrix fabricated in VLSI form as basic building block for assembly of like units into content-addressable electronic memory matrices operating somewhat like networks of neurons. Connections formed during storage of data, and data recalled from memory by prompting matrix with approximate or partly erroneous signals. Redundancy in pattern of connections causes matrix to respond with correct stored data.

A neural network prototyping package within IRAF

NASA Technical Reports Server (NTRS)

Bazell, D.; Bankman, I.

1992-01-01

We outline our plans for incorporating a Neural Network Prototyping Package into the IRAF environment. The package we are developing will allow the user to choose between different types of networks and to specify the details of the particular architecture chosen. Neural networks consist of a highly interconnected set of simple processing units. The strengths of the connections between units are determined by weights which are adaptively set as the network 'learns'. In some cases, learning can be a separate phase of the user cycle of the network while in other cases the network learns continuously. Neural networks have been found to be very useful in pattern recognition and image processing applications. They can form very general 'decision boundaries' to differentiate between objects in pattern space and they can be used for associative recall of patterns based on partial cures and for adaptive filtering. We discuss the different architectures we plan to use and give examples of what they can do.

Semantic disturbance in schizophrenia and its relationship to the cognitive neuroscience of attention

PubMed Central

Nestor, P.G.; Han, S.D.; Niznikiewicz, M.; Salisbury, D.; Spencer, K.; Shenton, M.E.; McCarley, R.W.

2010-01-01

We view schizophrenia as producing a failure of attentional modulation that leads to a breakdown in the selective enhancement or inhibition of semantic/lexical representations whose biological substrata are widely distributed across left (dominant) temporal and frontal lobes. Supporting behavioral evidence includes word recall studies that have pointed to a disturbance in connectivity (associative strength) but not network size (number of associates) in patients with schizophrenia. Paralleling these findings are recent neural network simulation studies of the abnormal connectivity effect in schizophrenia through ‘lesioning’ network connection weights while holding constant network size. Supporting evidence at the level of biology are in vitro studies examining N-methyl-d-aspartate (NMDA) receptor antagonists on recurrent inhibition; simulations in neural populations with realistically modeled biophysical properties show NMDA antagonists produce a schizophrenia-like disturbance in pattern association. We propose a similar failure of NMDA-mediated recurrent inhibition as a candidate biological substrate for attention and semantic anomalies of schizophrenia. PMID:11454433

Communication of brain network core connections altered in behavioral variant frontotemporal dementia but possibly preserved in early-onset Alzheimer's disease

NASA Astrophysics Data System (ADS)

Daianu, Madelaine; Jahanshad, Neda; Mendez, Mario F.; Bartzokis, George; Jimenez, Elvira E.; Thompson, Paul M.

2015-03-01

Diffusion imaging and brain connectivity analyses can assess white matter deterioration in the brain, revealing the underlying patterns of how brain structure declines. Fiber tractography methods can infer neural pathways and connectivity patterns, yielding sensitive mathematical metrics of network integrity. Here, we analyzed 1.5-Tesla wholebrain diffusion-weighted images from 64 participants - 15 patients with behavioral variant frontotemporal dementia (bvFTD), 19 with early-onset Alzheimer's disease (EOAD), and 30 healthy elderly controls. Using whole-brain tractography, we reconstructed structural brain connectivity networks to map connections between cortical regions. We evaluated the brain's networks focusing on the most highly central and connected regions, also known as hubs, in each diagnostic group - specifically the "high-cost" structural backbone used in global and regional communication. The high-cost backbone of the brain, predicted by fiber density and minimally short pathways between brain regions, accounted for 81-92% of the overall brain communication metric in all diagnostic groups. Furthermore, we found that the set of pathways interconnecting high-cost and high-capacity regions of the brain's communication network are globally and regionally altered in bvFTD, compared to healthy participants; however, the overall organization of the high-cost and high-capacity networks were relatively preserved in EOAD participants, relative to controls. Disruption of the major central hubs that transfer information between brain regions may impair neural communication and functional integrity in characteristic ways typical of each subtype of dementia.

Neural signal registration and analysis of axons grown in microchannels

NASA Astrophysics Data System (ADS)

Pigareva, Y.; Malishev, E.; Gladkov, A.; Kolpakov, V.; Bukatin, A.; Mukhina, I.; Kazantsev, V.; Pimashkin, A.

2016-08-01

Registration of neuronal bioelectrical signals remains one of the main physical tools to study fundamental mechanisms of signal processing in the brain. Neurons generate spiking patterns which propagate through complex map of neural network connectivity. Extracellular recording of isolated axons grown in microchannels provides amplification of the signal for detailed study of spike propagation. In this study we used neuronal hippocampal cultures grown in microfluidic devices combined with microelectrode arrays to investigate a changes of electrical activity during neural network development. We found that after 5 days in vitro after culture plating the spiking activity appears first in microchannels and on the next 2-3 days appears on the electrodes of overall neural network. We conclude that such approach provides a convenient method to study neural signal processing and functional structure development on a single cell and network level of the neuronal culture.

Lithofacies classification of the Barnett Shale gas reservoir using neural network

NASA Astrophysics Data System (ADS)

Aliouane, Leila; Ouadfeul, Sid-Ali

2017-04-01

Here, we show the contribution of the artificial intelligence such as neural network to predict the lithofacies in the lower Barnett shale gas reservoir. The Multilayer Perceptron (MLP) neural network with Hidden Weight Optimization Algorithm is used. The input is raw well-logs data recorded in a horizontal well drilled in the Lower Barnett shale formation, however the output is the concentration of the Clay and the Quartz calculated using the ELAN model and confirmed with the core rock measurement. After training of the MLP machine weights of connection are calculated, the raw well-logs data of two other horizontal wells drilled in the same reservoir are propagated though the neural machine and an output is calculated. Comparison between the predicted and measured clay and Quartz concentrations in these two horizontal wells shows the ability of neural network to improve shale gas reservoirs characterization.

Thalamic structures and associated cognitive functions: Relations with age and aging.

PubMed

Fama, Rosemary; Sullivan, Edith V

2015-07-01

The thalamus, with its cortical, subcortical, and cerebellar connections, is a critical node in networks supporting cognitive functions known to decline in normal aging, including component processes of memory and executive functions of attention and information processing. The macrostructure, microstructure, and neural connectivity of the thalamus changes across the adult lifespan. Structural and functional magnetic resonance imaging (MRI) and diffusion tensor imaging (DTI) have demonstrated, regional thalamic volume shrinkage and microstructural degradation, with anterior regions generally more compromised than posterior regions. The integrity of selective thalamic nuclei and projections decline with advancing age, particularly those in thalamofrontal, thalamoparietal, and thalamolimbic networks. This review presents studies that assess the relations between age and aging and the structure, function, and connectivity of the thalamus and associated neural networks and focuses on their relations with processes of attention, speed of information processing, and working and episodic memory. Copyright © 2015 Elsevier Ltd. All rights reserved.

Modeling neural circuits in Parkinson's disease.

PubMed

Psiha, Maria; Vlamos, Panayiotis

2015-01-01

Parkinson's disease (PD) is caused by abnormal neural activity of the basal ganglia which are connected to the cerebral cortex in the brain surface through complex neural circuits. For a better understanding of the pathophysiological mechanisms of PD, it is important to identify the underlying PD neural circuits, and to pinpoint the precise nature of the crucial aberrations in these circuits. In this paper, the general architecture of a hybrid Multilayer Perceptron (MLP) network for modeling the neural circuits in PD is presented. The main idea of the proposed approach is to divide the parkinsonian neural circuitry system into three discrete subsystems: the external stimuli subsystem, the life-threatening events subsystem, and the basal ganglia subsystem. The proposed model, which includes the key roles of brain neural circuit in PD, is based on both feed-back and feed-forward neural networks. Specifically, a three-layer MLP neural network with feedback in the second layer was designed. The feedback in the second layer of this model simulates the dopamine modulatory effect of compacta on striatum.

A Three-Threshold Learning Rule Approaches the Maximal Capacity of Recurrent Neural Networks

PubMed Central

Alemi, Alireza; Baldassi, Carlo; Brunel, Nicolas; Zecchina, Riccardo

2015-01-01

Understanding the theoretical foundations of how memories are encoded and retrieved in neural populations is a central challenge in neuroscience. A popular theoretical scenario for modeling memory function is the attractor neural network scenario, whose prototype is the Hopfield model. The model simplicity and the locality of the synaptic update rules come at the cost of a poor storage capacity, compared with the capacity achieved with perceptron learning algorithms. Here, by transforming the perceptron learning rule, we present an online learning rule for a recurrent neural network that achieves near-maximal storage capacity without an explicit supervisory error signal, relying only upon locally accessible information. The fully-connected network consists of excitatory binary neurons with plastic recurrent connections and non-plastic inhibitory feedback stabilizing the network dynamics; the memory patterns to be memorized are presented online as strong afferent currents, producing a bimodal distribution for the neuron synaptic inputs. Synapses corresponding to active inputs are modified as a function of the value of the local fields with respect to three thresholds. Above the highest threshold, and below the lowest threshold, no plasticity occurs. In between these two thresholds, potentiation/depression occurs when the local field is above/below an intermediate threshold. We simulated and analyzed a network of binary neurons implementing this rule and measured its storage capacity for different sizes of the basins of attraction. The storage capacity obtained through numerical simulations is shown to be close to the value predicted by analytical calculations. We also measured the dependence of capacity on the strength of external inputs. Finally, we quantified the statistics of the resulting synaptic connectivity matrix, and found that both the fraction of zero weight synapses and the degree of symmetry of the weight matrix increase with the number of stored patterns. PMID:26291608

A Three-Threshold Learning Rule Approaches the Maximal Capacity of Recurrent Neural Networks.

PubMed

Alemi, Alireza; Baldassi, Carlo; Brunel, Nicolas; Zecchina, Riccardo

2015-08-01

Understanding the theoretical foundations of how memories are encoded and retrieved in neural populations is a central challenge in neuroscience. A popular theoretical scenario for modeling memory function is the attractor neural network scenario, whose prototype is the Hopfield model. The model simplicity and the locality of the synaptic update rules come at the cost of a poor storage capacity, compared with the capacity achieved with perceptron learning algorithms. Here, by transforming the perceptron learning rule, we present an online learning rule for a recurrent neural network that achieves near-maximal storage capacity without an explicit supervisory error signal, relying only upon locally accessible information. The fully-connected network consists of excitatory binary neurons with plastic recurrent connections and non-plastic inhibitory feedback stabilizing the network dynamics; the memory patterns to be memorized are presented online as strong afferent currents, producing a bimodal distribution for the neuron synaptic inputs. Synapses corresponding to active inputs are modified as a function of the value of the local fields with respect to three thresholds. Above the highest threshold, and below the lowest threshold, no plasticity occurs. In between these two thresholds, potentiation/depression occurs when the local field is above/below an intermediate threshold. We simulated and analyzed a network of binary neurons implementing this rule and measured its storage capacity for different sizes of the basins of attraction. The storage capacity obtained through numerical simulations is shown to be close to the value predicted by analytical calculations. We also measured the dependence of capacity on the strength of external inputs. Finally, we quantified the statistics of the resulting synaptic connectivity matrix, and found that both the fraction of zero weight synapses and the degree of symmetry of the weight matrix increase with the number of stored patterns.

Functional complexity emerging from anatomical constraints in the brain: the significance of network modularity and rich-clubs

NASA Astrophysics Data System (ADS)

Zamora-López, Gorka; Chen, Yuhan; Deco, Gustavo; Kringelbach, Morten L.; Zhou, Changsong

2016-12-01

The large-scale structural ingredients of the brain and neural connectomes have been identified in recent years. These are, similar to the features found in many other real networks: the arrangement of brain regions into modules and the presence of highly connected regions (hubs) forming rich-clubs. Here, we examine how modules and hubs shape the collective dynamics on networks and we find that both ingredients lead to the emergence of complex dynamics. Comparing the connectomes of C. elegans, cats, macaques and humans to surrogate networks in which either modules or hubs are destroyed, we find that functional complexity always decreases in the perturbed networks. A comparison between simulated and empirically obtained resting-state functional connectivity indicates that the human brain, at rest, lies in a dynamical state that reflects the largest complexity its anatomical connectome can host. Last, we generalise the topology of neural connectomes into a new hierarchical network model that successfully combines modular organisation with rich-club forming hubs. This is achieved by centralising the cross-modular connections through a preferential attachment rule. Our network model hosts more complex dynamics than other hierarchical models widely used as benchmarks.

Functional complexity emerging from anatomical constraints in the brain: the significance of network modularity and rich-clubs

PubMed Central

Zamora-López, Gorka; Chen, Yuhan; Deco, Gustavo; Kringelbach, Morten L.; Zhou, Changsong

2016-01-01

The large-scale structural ingredients of the brain and neural connectomes have been identified in recent years. These are, similar to the features found in many other real networks: the arrangement of brain regions into modules and the presence of highly connected regions (hubs) forming rich-clubs. Here, we examine how modules and hubs shape the collective dynamics on networks and we find that both ingredients lead to the emergence of complex dynamics. Comparing the connectomes of C. elegans, cats, macaques and humans to surrogate networks in which either modules or hubs are destroyed, we find that functional complexity always decreases in the perturbed networks. A comparison between simulated and empirically obtained resting-state functional connectivity indicates that the human brain, at rest, lies in a dynamical state that reflects the largest complexity its anatomical connectome can host. Last, we generalise the topology of neural connectomes into a new hierarchical network model that successfully combines modular organisation with rich-club forming hubs. This is achieved by centralising the cross-modular connections through a preferential attachment rule. Our network model hosts more complex dynamics than other hierarchical models widely used as benchmarks. PMID:27917958

An efficient optical architecture for sparsely connected neural networks

NASA Technical Reports Server (NTRS)

Hine, Butler P., III; Downie, John D.; Reid, Max B.

1990-01-01

An architecture for general-purpose optical neural network processor is presented in which the interconnections and weights are formed by directing coherent beams holographically, thereby making use of the space-bandwidth products of the recording medium for sparsely interconnected networks more efficiently that the commonly used vector-matrix multiplier, since all of the hologram area is in use. An investigation is made of the use of computer-generated holograms recorded on such updatable media as thermoplastic materials, in order to define the interconnections and weights of a neural network processor; attention is given to limits on interconnection densities, diffraction efficiencies, and weighing accuracies possible with such an updatable thin film holographic device.

Network evolution induced by asynchronous stimuli through spike-timing-dependent plasticity.

PubMed

Yuan, Wu-Jie; Zhou, Jian-Fang; Zhou, Changsong

2013-01-01

In sensory neural system, external asynchronous stimuli play an important role in perceptual learning, associative memory and map development. However, the organization of structure and dynamics of neural networks induced by external asynchronous stimuli are not well understood. Spike-timing-dependent plasticity (STDP) is a typical synaptic plasticity that has been extensively found in the sensory systems and that has received much theoretical attention. This synaptic plasticity is highly sensitive to correlations between pre- and postsynaptic firings. Thus, STDP is expected to play an important role in response to external asynchronous stimuli, which can induce segregative pre- and postsynaptic firings. In this paper, we study the impact of external asynchronous stimuli on the organization of structure and dynamics of neural networks through STDP. We construct a two-dimensional spatial neural network model with local connectivity and sparseness, and use external currents to stimulate alternately on different spatial layers. The adopted external currents imposed alternately on spatial layers can be here regarded as external asynchronous stimuli. Through extensive numerical simulations, we focus on the effects of stimulus number and inter-stimulus timing on synaptic connecting weights and the property of propagation dynamics in the resulting network structure. Interestingly, the resulting feedforward structure induced by stimulus-dependent asynchronous firings and its propagation dynamics reflect both the underlying property of STDP. The results imply a possible important role of STDP in generating feedforward structure and collective propagation activity required for experience-dependent map plasticity in developing in vivo sensory pathways and cortices. The relevance of the results to cue-triggered recall of learned temporal sequences, an important cognitive function, is briefly discussed as well. Furthermore, this finding suggests a potential application for examining STDP by measuring neural population activity in a cultured neural network.

Implementing neural nets with programmable logic

NASA Technical Reports Server (NTRS)

Vidal, Jacques J.

1988-01-01

Networks of Boolean programmable logic modules are presented as one purely digital class of artificial neural nets. The approach contrasts with the continuous analog framework usually suggested. Programmable logic networks are capable of handling many neural-net applications. They avoid some of the limitations of threshold logic networks and present distinct opportunities. The network nodes are called dynamically programmable logic modules. They can be implemented with digitally controlled demultiplexers. Each node performs a Boolean function of its inputs which can be dynamically assigned. The overall network is therefore a combinational circuit and its outputs are Boolean global functions of the network's input variables. The approach offers definite advantages for VLSI implementation, namely, a regular architecture with limited connectivity, simplicity of the control machinery, natural modularity, and the support of a mature technology.

Resting-state hemodynamics are spatiotemporally coupled to synchronized and symmetric neural activity in excitatory neurons.

PubMed

Ma, Ying; Shaik, Mohammed A; Kozberg, Mariel G; Kim, Sharon H; Portes, Jacob P; Timerman, Dmitriy; Hillman, Elizabeth M C

2016-12-27

Brain hemodynamics serve as a proxy for neural activity in a range of noninvasive neuroimaging techniques including functional magnetic resonance imaging (fMRI). In resting-state fMRI, hemodynamic fluctuations have been found to exhibit patterns of bilateral synchrony, with correlated regions inferred to have functional connectivity. However, the relationship between resting-state hemodynamics and underlying neural activity has not been well established, making the neural underpinnings of functional connectivity networks unclear. In this study, neural activity and hemodynamics were recorded simultaneously over the bilateral cortex of awake and anesthetized Thy1-GCaMP mice using wide-field optical mapping. Neural activity was visualized via selective expression of the calcium-sensitive fluorophore GCaMP in layer 2/3 and 5 excitatory neurons. Characteristic patterns of resting-state hemodynamics were accompanied by more rapidly changing bilateral patterns of resting-state neural activity. Spatiotemporal hemodynamics could be modeled by convolving this neural activity with hemodynamic response functions derived through both deconvolution and gamma-variate fitting. Simultaneous imaging and electrophysiology confirmed that Thy1-GCaMP signals are well-predicted by multiunit activity. Neurovascular coupling between resting-state neural activity and hemodynamics was robust and fast in awake animals, whereas coupling in urethane-anesthetized animals was slower, and in some cases included lower-frequency (<0.04 Hz) hemodynamic fluctuations that were not well-predicted by local Thy1-GCaMP recordings. These results support that resting-state hemodynamics in the awake and anesthetized brain are coupled to underlying patterns of excitatory neural activity. The patterns of bilaterally-symmetric spontaneous neural activity revealed by wide-field Thy1-GCaMP imaging may depict the neural foundation of functional connectivity networks detected in resting-state fMRI.

Resting-state hemodynamics are spatiotemporally coupled to synchronized and symmetric neural activity in excitatory neurons

PubMed Central

Ma, Ying; Shaik, Mohammed A.; Kozberg, Mariel G.; Portes, Jacob P.; Timerman, Dmitriy

2016-01-01

Brain hemodynamics serve as a proxy for neural activity in a range of noninvasive neuroimaging techniques including functional magnetic resonance imaging (fMRI). In resting-state fMRI, hemodynamic fluctuations have been found to exhibit patterns of bilateral synchrony, with correlated regions inferred to have functional connectivity. However, the relationship between resting-state hemodynamics and underlying neural activity has not been well established, making the neural underpinnings of functional connectivity networks unclear. In this study, neural activity and hemodynamics were recorded simultaneously over the bilateral cortex of awake and anesthetized Thy1-GCaMP mice using wide-field optical mapping. Neural activity was visualized via selective expression of the calcium-sensitive fluorophore GCaMP in layer 2/3 and 5 excitatory neurons. Characteristic patterns of resting-state hemodynamics were accompanied by more rapidly changing bilateral patterns of resting-state neural activity. Spatiotemporal hemodynamics could be modeled by convolving this neural activity with hemodynamic response functions derived through both deconvolution and gamma-variate fitting. Simultaneous imaging and electrophysiology confirmed that Thy1-GCaMP signals are well-predicted by multiunit activity. Neurovascular coupling between resting-state neural activity and hemodynamics was robust and fast in awake animals, whereas coupling in urethane-anesthetized animals was slower, and in some cases included lower-frequency (<0.04 Hz) hemodynamic fluctuations that were not well-predicted by local Thy1-GCaMP recordings. These results support that resting-state hemodynamics in the awake and anesthetized brain are coupled to underlying patterns of excitatory neural activity. The patterns of bilaterally-symmetric spontaneous neural activity revealed by wide-field Thy1-GCaMP imaging may depict the neural foundation of functional connectivity networks detected in resting-state fMRI. PMID:27974609

Metastability and Inter-Band Frequency Modulation in Networks of Oscillating Spiking Neuron Populations

PubMed Central

Bhowmik, David; Shanahan, Murray

2013-01-01

Groups of neurons firing synchronously are hypothesized to underlie many cognitive functions such as attention, associative learning, memory, and sensory selection. Recent theories suggest that transient periods of synchronization and desynchronization provide a mechanism for dynamically integrating and forming coalitions of functionally related neural areas, and that at these times conditions are optimal for information transfer. Oscillating neural populations display a great amount of spectral complexity, with several rhythms temporally coexisting in different structures and interacting with each other. This paper explores inter-band frequency modulation between neural oscillators using models of quadratic integrate-and-fire neurons and Hodgkin-Huxley neurons. We vary the structural connectivity in a network of neural oscillators, assess the spectral complexity, and correlate the inter-band frequency modulation. We contrast this correlation against measures of metastable coalition entropy and synchrony. Our results show that oscillations in different neural populations modulate each other so as to change frequency, and that the interaction of these fluctuating frequencies in the network as a whole is able to drive different neural populations towards episodes of synchrony. Further to this, we locate an area in the connectivity space in which the system directs itself in this way so as to explore a large repertoire of synchronous coalitions. We suggest that such dynamics facilitate versatile exploration, integration, and communication between functionally related neural areas, and thereby supports sophisticated cognitive processing in the brain. PMID:23614040

Early life stress predicts thalamic hyperconnectivity: A transdiagnostic study of global connectivity.

PubMed

Philip, Noah S; Tyrka, Audrey R; Albright, Sarah E; Sweet, Lawrence H; Almeida, Jorge; Price, Lawrence H; Carpenter, Linda L

2016-08-01

Early life stress (ELS) is an established risk factor for psychiatric illness and is associated with altered functional connectivity within- and between intrinsic neural networks. The widespread nature of these disruptions suggests that broad imaging measures of neural connectivity, such as global based connectivity (GBC), may be particularly appropriate for studies of this population. GBC is designed to identify brain regions having maximal functional connectedness with the rest of the brain, and alterations in GBC may reflect a restriction or broadening of network synchronization. We evaluated whether ELS severity predicted GBC in a sample (N = 46) with a spectrum of ELS exposure. Participants included healthy controls without ELS, those with at least moderate ELS but without psychiatric disorders, and a group of patients with ELS- related psychiatric disorders. The spatial distribution of GBC peaked in regions of the salience and default mode networks, and ELS severity predicted increased GBC of the left thalamus (corrected p < 0.005, r = 0.498). Thalamic connectivity was subsequently evaluated and revealed reduced connectivity with the salience network, particularly the dorsal anterior cingulate cortex (corrected p < 0.005), only in the patient group. These findings support a model of disrupted thalamic connectivity in ELS and trauma-related negative affect states, and underscore the importance of a transdiagnostic, dimensional neuroimaging approach to understanding the sequelae of trauma exposure. Published by Elsevier Ltd.

Application of hierarchical dissociated neural network in closed-loop hybrid system integrating biological and mechanical intelligence.

PubMed

Li, Yongcheng; Sun, Rong; Zhang, Bin; Wang, Yuechao; Li, Hongyi

2015-01-01

Neural networks are considered the origin of intelligence in organisms. In this paper, a new design of an intelligent system merging biological intelligence with artificial intelligence was created. It was based on a neural controller bidirectionally connected to an actual mobile robot to implement a novel vehicle. Two types of experimental preparations were utilized as the neural controller including 'random' and '4Q' (cultured neurons artificially divided into four interconnected parts) neural network. Compared to the random cultures, the '4Q' cultures presented absolutely different activities, and the robot controlled by the '4Q' network presented better capabilities in search tasks. Our results showed that neural cultures could be successfully employed to control an artificial agent; the robot performed better and better with the stimulus because of the short-term plasticity. A new framework is provided to investigate the bidirectional biological-artificial interface and develop new strategies for a future intelligent system using these simplified model systems.

Application of Hierarchical Dissociated Neural Network in Closed-Loop Hybrid System Integrating Biological and Mechanical Intelligence

PubMed Central

Zhang, Bin; Wang, Yuechao; Li, Hongyi

2015-01-01

Neural networks are considered the origin of intelligence in organisms. In this paper, a new design of an intelligent system merging biological intelligence with artificial intelligence was created. It was based on a neural controller bidirectionally connected to an actual mobile robot to implement a novel vehicle. Two types of experimental preparations were utilized as the neural controller including ‘random’ and ‘4Q’ (cultured neurons artificially divided into four interconnected parts) neural network. Compared to the random cultures, the ‘4Q’ cultures presented absolutely different activities, and the robot controlled by the ‘4Q’ network presented better capabilities in search tasks. Our results showed that neural cultures could be successfully employed to control an artificial agent; the robot performed better and better with the stimulus because of the short-term plasticity. A new framework is provided to investigate the bidirectional biological-artificial interface and develop new strategies for a future intelligent system using these simplified model systems. PMID:25992579

Evaluation of a parallel implementation of the learning portion of the backward error propagation neural network: experiments in artifact identification.

PubMed Central

Sittig, D. F.; Orr, J. A.

1991-01-01

Various methods have been proposed in an attempt to solve problems in artifact and/or alarm identification including expert systems, statistical signal processing techniques, and artificial neural networks (ANN). ANNs consist of a large number of simple processing units connected by weighted links. To develop truly robust ANNs, investigators are required to train their networks on huge training data sets, requiring enormous computing power. We implemented a parallel version of the backward error propagation neural network training algorithm in the widely portable parallel programming language C-Linda. A maximum speedup of 4.06 was obtained with six processors. This speedup represents a reduction in total run-time from approximately 6.4 hours to 1.5 hours. We conclude that use of the master-worker model of parallel computation is an excellent method for obtaining speedups in the backward error propagation neural network training algorithm. PMID:1807607

Neural system prediction and identification challenge.

PubMed

Vlachos, Ioannis; Zaytsev, Yury V; Spreizer, Sebastian; Aertsen, Ad; Kumar, Arvind

2013-01-01

Can we infer the function of a biological neural network (BNN) if we know the connectivity and activity of all its constituent neurons?This question is at the core of neuroscience and, accordingly, various methods have been developed to record the activity and connectivity of as many neurons as possible. Surprisingly, there is no theoretical or computational demonstration that neuronal activity and connectivity are indeed sufficient to infer the function of a BNN. Therefore, we pose the Neural Systems Identification and Prediction Challenge (nuSPIC). We provide the connectivity and activity of all neurons and invite participants (1) to infer the functions implemented (hard-wired) in spiking neural networks (SNNs) by stimulating and recording the activity of neurons and, (2) to implement predefined mathematical/biological functions using SNNs. The nuSPICs can be accessed via a web-interface to the NEST simulator and the user is not required to know any specific programming language. Furthermore, the nuSPICs can be used as a teaching tool. Finally, nuSPICs use the crowd-sourcing model to address scientific issues. With this computational approach we aim to identify which functions can be inferred by systematic recordings of neuronal activity and connectivity. In addition, nuSPICs will help the design and application of new experimental paradigms based on the structure of the SNN and the presumed function which is to be discovered.

Neural system prediction and identification challenge

PubMed Central

Vlachos, Ioannis; Zaytsev, Yury V.; Spreizer, Sebastian; Aertsen, Ad; Kumar, Arvind

2013-01-01

Can we infer the function of a biological neural network (BNN) if we know the connectivity and activity of all its constituent neurons?This question is at the core of neuroscience and, accordingly, various methods have been developed to record the activity and connectivity of as many neurons as possible. Surprisingly, there is no theoretical or computational demonstration that neuronal activity and connectivity are indeed sufficient to infer the function of a BNN. Therefore, we pose the Neural Systems Identification and Prediction Challenge (nuSPIC). We provide the connectivity and activity of all neurons and invite participants (1) to infer the functions implemented (hard-wired) in spiking neural networks (SNNs) by stimulating and recording the activity of neurons and, (2) to implement predefined mathematical/biological functions using SNNs. The nuSPICs can be accessed via a web-interface to the NEST simulator and the user is not required to know any specific programming language. Furthermore, the nuSPICs can be used as a teaching tool. Finally, nuSPICs use the crowd-sourcing model to address scientific issues. With this computational approach we aim to identify which functions can be inferred by systematic recordings of neuronal activity and connectivity. In addition, nuSPICs will help the design and application of new experimental paradigms based on the structure of the SNN and the presumed function which is to be discovered. PMID:24399966

Curriculum Assessment Using Artificial Neural Network and Support Vector Machine Modeling Approaches: A Case Study. IR Applications. Volume 29

ERIC Educational Resources Information Center

Chen, Chau-Kuang

2010-01-01

Artificial Neural Network (ANN) and Support Vector Machine (SVM) approaches have been on the cutting edge of science and technology for pattern recognition and data classification. In the ANN model, classification accuracy can be achieved by using the feed-forward of inputs, back-propagation of errors, and the adjustment of connection weights. In…

Learning in Neural Networks: VLSI Implementation Strategies

NASA Technical Reports Server (NTRS)

Duong, Tuan Anh

1995-01-01

Fully-parallel hardware neural network implementations may be applied to high-speed recognition, classification, and mapping tasks in areas such as vision, or can be used as low-cost self-contained units for tasks such as error detection in mechanical systems (e.g. autos). Learning is required not only to satisfy application requirements, but also to overcome hardware-imposed limitations such as reduced dynamic range of connections.

Functional connectivity and information flow of the respiratory neural network in chronic obstructive pulmonary disease.

PubMed

Yu, Lianchun; De Mazancourt, Marine; Hess, Agathe; Ashadi, Fakhrul R; Klein, Isabelle; Mal, Hervé; Courbage, Maurice; Mangin, Laurence

2016-08-01

Breathing involves a complex interplay between the brainstem automatic network and cortical voluntary command. How these brain regions communicate at rest or during inspiratory loading is unknown. This issue is crucial for several reasons: (i) increased respiratory loading is a major feature of several respiratory diseases, (ii) failure of the voluntary motor and cortical sensory processing drives is among the mechanisms that precede acute respiratory failure, (iii) several cerebral structures involved in responding to inspiratory loading participate in the perception of dyspnea, a distressing symptom in many disease. We studied functional connectivity and Granger causality of the respiratory network in controls and patients with chronic obstructive pulmonary disease (COPD), at rest and during inspiratory loading. Compared with those of controls, the motor cortex area of patients exhibited decreased connectivity with their contralateral counterparts and no connectivity with the brainstem. In the patients, the information flow was reversed at rest with the source of the network shifted from the medulla towards the motor cortex. During inspiratory loading, the system was overwhelmed and the motor cortex became the sink of the network. This major finding may help to understand why some patients with COPD are prone to acute respiratory failure. Network connectivity and causality were related to lung function and illness severity. We validated our connectivity and causality results with a mathematical model of neural network. Our findings suggest a new therapeutic strategy involving the modulation of brain activity to increase motor cortex functional connectivity and improve respiratory muscles performance in patients. Hum Brain Mapp 37:2736-2754, 2016. © 2016 The Authors Human Brain Mapping Published by Wiley Periodicals, Inc. © 2016 The Authors Human Brain Mapping Published by Wiley Periodicals, Inc.

Reward-based training of recurrent neural networks for cognitive and value-based tasks

PubMed Central

Song, H Francis; Yang, Guangyu R; Wang, Xiao-Jing

2017-01-01

Trained neural network models, which exhibit features of neural activity recorded from behaving animals, may provide insights into the circuit mechanisms of cognitive functions through systematic analysis of network activity and connectivity. However, in contrast to the graded error signals commonly used to train networks through supervised learning, animals learn from reward feedback on definite actions through reinforcement learning. Reward maximization is particularly relevant when optimal behavior depends on an animal’s internal judgment of confidence or subjective preferences. Here, we implement reward-based training of recurrent neural networks in which a value network guides learning by using the activity of the decision network to predict future reward. We show that such models capture behavioral and electrophysiological findings from well-known experimental paradigms. Our work provides a unified framework for investigating diverse cognitive and value-based computations, and predicts a role for value representation that is essential for learning, but not executing, a task. DOI: http://dx.doi.org/10.7554/eLife.21492.001 PMID:28084991

Bio-inspired spiking neural network for nonlinear systems control.

PubMed

Pérez, Javier; Cabrera, Juan A; Castillo, Juan J; Velasco, Juan M

2018-08-01

Spiking neural networks (SNN) are the third generation of artificial neural networks. SNN are the closest approximation to biological neural networks. SNNs make use of temporal spike trains to command inputs and outputs, allowing a faster and more complex computation. As demonstrated by biological organisms, they are a potentially good approach to designing controllers for highly nonlinear dynamic systems in which the performance of controllers developed by conventional techniques is not satisfactory or difficult to implement. SNN-based controllers exploit their ability for online learning and self-adaptation to evolve when transferred from simulations to the real world. SNN's inherent binary and temporary way of information codification facilitates their hardware implementation compared to analog neurons. Biological neural networks often require a lower number of neurons compared to other controllers based on artificial neural networks. In this work, these neuronal systems are imitated to perform the control of non-linear dynamic systems. For this purpose, a control structure based on spiking neural networks has been designed. Particular attention has been paid to optimizing the structure and size of the neural network. The proposed structure is able to control dynamic systems with a reduced number of neurons and connections. A supervised learning process using evolutionary algorithms has been carried out to perform controller training. The efficiency of the proposed network has been verified in two examples of dynamic systems control. Simulations show that the proposed control based on SNN exhibits superior performance compared to other approaches based on Neural Networks and SNNs. Copyright © 2018 Elsevier Ltd. All rights reserved.

Effect of synapse dilution on the memory retrieval in structured attractor neural networks

NASA Astrophysics Data System (ADS)

Brunel, N.

1993-08-01

We investigate a simple model of structured attractor neural network (ANN). In this network a module codes for the category of the stored information, while another group of neurons codes for the remaining information. The probability distribution of stabilities of the patterns and the prototypes of the categories are calculated, for two different synaptic structures. The stability of the prototypes is shown to increase when the fraction of neurons coding for the category goes down. Then the effect of synapse destruction on the retrieval is studied in two opposite situations : first analytically in sparsely connected networks, then numerically in completely connected ones. In both cases the behaviour of the structured network and that of the usual homogeneous networks are compared. When lesions increase, two transitions are shown to appear in the behaviour of the structured network when one of the patterns is presented to the network. After the first transition the network recognizes the category of the pattern but not the individual pattern. After the second transition the network recognizes nothing. These effects are similar to syndromes caused by lesions in the central visual system, namely prosopagnosia and agnosia. In both types of networks (structured or homogeneous) the stability of the prototype is greater than the stability of individual patterns, however the first transition, for completely connected networks, occurs only when the network is structured.

The Emerging Role of Epigenetics in Stroke

PubMed Central

Qureshi, Irfan A.; Mehler, Mark F.

2013-01-01

The transplantation of exogenous stem cells and the activation of endogenous neural stem and progenitor cells (NSPCs) are promising treatments for stroke. These cells can modulate intrinsic responses to ischemic injury and may even integrate directly into damaged neural networks. However, the neuroprotective and neural regenerative effects that can be mediated by these cells are limited and may even be deleterious. Epigenetic reprogramming represents a novel strategy for enhancing the intrinsic potential of the brain to protect and repair itself by modulating pathologic neural gene expression and promoting the recapitulation of seminal neural developmental processes. In fact, recent evidence suggests that emerging epigenetic mechanisms are critical for orchestrating nearly every aspect of neural development and homeostasis, including brain patterning, neural stem cell maintenance, neurogenesis and gliogenesis, neural subtype specification, and synaptic and neural network connectivity and plasticity. In this review, we survey the therapeutic potential of exogenous stem cells and endogenous NSPCs and highlight innovative technological approaches for designing, developing, and delivering epigenetic therapies for targeted reprogramming of endogenous pools of NSPCs, neural cells at risk, and dysfunctional neural networks to rescue and restore neurologic function in the ischemic brain. PMID:21403016

Injured Brains and Adaptive Networks: The Benefits and Costs of Hyperconnectivity.

PubMed

Hillary, Frank G; Grafman, Jordan H

2017-05-01

A common finding in human functional brain-imaging studies is that damage to neural systems paradoxically results in enhanced functional connectivity between network regions, a phenomenon commonly referred to as 'hyperconnectivity'. Here, we describe the various ways that hyperconnectivity operates to benefit a neural network following injury while simultaneously negotiating the trade-off between metabolic cost and communication efficiency. Hyperconnectivity may be optimally expressed by increasing connections through the most central and metabolically efficient regions (i.e., hubs). While adaptive in the short term, we propose that chronic hyperconnectivity may leave network hubs vulnerable to secondary pathological processes over the life span due to chronically elevated metabolic stress. We conclude by offering novel, testable hypotheses for advancing our understanding of the role of hyperconnectivity in systems-level brain plasticity in neurological disorders. Copyright © 2017 Elsevier Ltd. All rights reserved.

Stability analysis and synchronization in discrete-time complex networks with delayed coupling

NASA Astrophysics Data System (ADS)

Cheng, Ranran; Peng, Mingshu; Yu, Weibin; Sun, Bo; Yu, Jinchen

2013-12-01

A new network of coupled maps is proposed in which the connections between units involve no delays but the intra-neural communication does, whereas in the work of Atay et al. [Phys. Rev. Lett. 92, 144101 (2004)], the focus is on information processing delayed by the inter-neural communication. We show that the synchronization of the network depends on not only the intrinsic dynamical features and inter-connection topology (characterized by the spectrum of the graph Laplacian) but also the delays and the coupling strength. There are two main findings: (i) the more neighbours, the easier to be synchronized; (ii) odd delays are easier to be synchronized than even ones. In addition, compared with those discussed by Atay et al. [Phys. Rev. Lett. 92, 144101 (2004)], our model has a better synchronizability for regular networks and small-world variants.

Neural Systems Underlying Individual Differences in Intertemporal Decision-making.

PubMed

Elton, Amanda; Smith, Christopher T; Parrish, Michael H; Boettiger, Charlotte A

2017-03-01

Excessively choosing immediate over larger future rewards, or delay discounting (DD), associates with multiple clinical conditions. Individual differences in DD likely depend on variations in the activation of and functional interactions between networks, representing possible endophenotypes for associated disorders, including alcohol use disorders (AUDs). Numerous fMRI studies have probed the neural bases of DD, but investigations of large-scale networks remain scant. We addressed this gap by testing whether activation within large-scale networks during Now/Later decision-making predicts individual differences in DD. To do so, we scanned 95 social drinkers (18-40 years old; 50 women) using fMRI during hypothetical choices between small monetary amounts available "today" or larger amounts available later. We identified neural networks engaged during Now/Later choice using independent component analysis and tested the relationship between component activation and degree of DD. The activity of two components during Now/Later choice correlated with individual DD rates: A temporal lobe network positively correlated with DD, whereas a frontoparietal-striatal network negatively correlated with DD. Activation differences between these networks predicted individual differences in DD, and their negative correlation during Now/Later choice suggests functional competition. A generalized psychophysiological interactions analysis confirmed a decrease in their functional connectivity during decision-making. The functional connectivity of these two networks negatively correlates with alcohol-related harm, potentially implicating these networks in AUDs. These findings provide novel insight into the neural underpinnings of individual differences in impulsive decision-making with potential implications for addiction and related disorders in which impulsivity is a defining feature.

A common functional neural network for overt production of speech and gesture.

PubMed

Marstaller, L; Burianová, H

2015-01-22

The perception of co-speech gestures, i.e., hand movements that co-occur with speech, has been investigated by several studies. The results show that the perception of co-speech gestures engages a core set of frontal, temporal, and parietal areas. However, no study has yet investigated the neural processes underlying the production of co-speech gestures. Specifically, it remains an open question whether Broca's area is central to the coordination of speech and gestures as has been suggested previously. The objective of this study was to use functional magnetic resonance imaging to (i) investigate the regional activations underlying overt production of speech, gestures, and co-speech gestures, and (ii) examine functional connectivity with Broca's area. We hypothesized that co-speech gesture production would activate frontal, temporal, and parietal regions that are similar to areas previously found during co-speech gesture perception and that both speech and gesture as well as co-speech gesture production would engage a neural network connected to Broca's area. Whole-brain analysis confirmed our hypothesis and showed that co-speech gesturing did engage brain areas that form part of networks known to subserve language and gesture. Functional connectivity analysis further revealed a functional network connected to Broca's area that is common to speech, gesture, and co-speech gesture production. This network consists of brain areas that play essential roles in motor control, suggesting that the coordination of speech and gesture is mediated by a shared motor control network. Our findings thus lend support to the idea that speech can influence co-speech gesture production on a motoric level. Copyright © 2014 IBRO. Published by Elsevier Ltd. All rights reserved.

Ion track based tunable device as humidity sensor: a neural network approach

NASA Astrophysics Data System (ADS)

Sharma, Mamta; Sharma, Anuradha; Bhattacherjee, Vandana

2013-01-01

Artificial Neural Network (ANN) has been applied in statistical model development, adaptive control system, pattern recognition in data mining, and decision making under uncertainty. The nonlinear dependence of any sensor output on the input physical variable has been the motivation for many researchers to attempt unconventional modeling techniques such as neural networks and other machine learning approaches. Artificial neural network (ANN) is a computational tool inspired by the network of neurons in biological nervous system. It is a network consisting of arrays of artificial neurons linked together with different weights of connection. The states of the neurons as well as the weights of connections among them evolve according to certain learning rules.. In the present work we focus on the category of sensors which respond to electrical property changes such as impedance or capacitance. Recently, sensor materials have been embedded in etched tracks due to their nanometric dimensions and high aspect ratio which give high surface area available for exposure to sensing material. Various materials can be used for this purpose to probe physical (light intensity, temperature etc.), chemical (humidity, ammonia gas, alcohol etc.) or biological (germs, hormones etc.) parameters. The present work involves the application of TEMPOS structures as humidity sensors. The sample to be studied was prepared using the polymer electrolyte (PEO/NH4ClO4) with CdS nano-particles dispersed in the polymer electrolyte. In the present research we have attempted to correlate the combined effects of voltage and frequency on impedance of humidity sensors using a neural network model and results have indicated that the mean absolute error of the ANN Model for the training data was 3.95% while for the validation data it was 4.65%. The corresponding values for the LR model were 8.28% and 8.35% respectively. It was also demonstrated the percentage improvement of the ANN Model with respect to the linear regression model. This demonstrates the suitability of neural networks to perform such modeling.

Simulation of short-term electric load using an artificial neural network

NASA Astrophysics Data System (ADS)

Ivanin, O. A.

2018-01-01

While solving the task of optimizing operation modes and equipment composition of small energy complexes or other tasks connected with energy planning, it is necessary to have data on energy loads of a consumer. Usually, there is a problem with obtaining real load charts and detailed information about the consumer, because a method of load-charts simulation on the basis of minimal information should be developed. The analysis of work devoted to short-term loads prediction allows choosing artificial neural networks as a most suitable mathematical instrument for solving this problem. The article provides an overview of applied short-term load simulation methods; it describes the advantages of artificial neural networks and offers a neural network structure for electric loads of residential buildings simulation. The results of modeling loads with proposed method and the estimation of its error are presented.

Recall Performance for Content-Addressable Memory Using Adiabatic Quantum Optimization

DOE Office of Scientific and Technical Information (OSTI.GOV)

Imam, Neena; Humble, Travis S.; McCaskey, Alex

A content-addressable memory (CAM) stores key-value associations such that the key is recalled by providing its associated value. While CAM recall is traditionally performed using recurrent neural network models, we show how to solve this problem using adiabatic quantum optimization. Our approach maps the recurrent neural network to a commercially available quantum processing unit by taking advantage of the common underlying Ising spin model. We then assess the accuracy of the quantum processor to store key-value associations by quantifying recall performance against an ensemble of problem sets. We observe that different learning rules from the neural network community influence recallmore » accuracy but performance appears to be limited by potential noise in the processor. The strong connection established between quantum processors and neural network problems supports the growing intersection of these two ideas.« less

Neural connectivity of the lateral geniculate body in the human brain: diffusion tensor imaging study.

PubMed

Kwon, Hyeok Gyu; Jang, Sung Ho

2014-08-22

A few studies have reported on the neural connectivity of some neural structures of the visual system in the human brain. However, little is known about the neural connectivity of the lateral geniculate body (LGB). In the current study, using diffusion tensor tractography (DTT), we attempted to investigate the neural connectivity of the LGB in normal subjects. A total of 52 healthy subjects were recruited for this study. A seed region of interest was placed on the LGB using the FMRIB Software Library which is a probabilistic tractography method based on a multi-fiber model. Connectivity was defined as the incidence of connection between the LGB and target brain areas at the threshold of 5, 25, and 50 streamlines. In addition, connectivity represented the percentage of connection in all hemispheres of 52 subjects. We found the following characteristics of connectivity of the LGB at the threshold of 5 streamline: (1) high connectivity to the corpus callosum (91.3%) and the contralateral temporal cortex (56.7%) via the corpus callosum, (2) high connectivity to the ipsilateral cerebral cortex: the temporal lobe (100%), primary visual cortex (95.2%), and visual association cortex (77.9%). The LGB appeared to have high connectivity to the corpus callosum and both temporal cortexes as well as the ipsilateral occipital cortex. We believe that the results of this study would be helpful in investigation of the neural network associated with the visual system and brain plasticity of the visual system after brain injury. Copyright © 2014 Elsevier Ireland Ltd. All rights reserved.

Spatial features of synaptic adaptation affecting learning performance.

PubMed

Berger, Damian L; de Arcangelis, Lucilla; Herrmann, Hans J

2017-09-08

Recent studies have proposed that the diffusion of messenger molecules, such as monoamines, can mediate the plastic adaptation of synapses in supervised learning of neural networks. Based on these findings we developed a model for neural learning, where the signal for plastic adaptation is assumed to propagate through the extracellular space. We investigate the conditions allowing learning of Boolean rules in a neural network. Even fully excitatory networks show very good learning performances. Moreover, the investigation of the plastic adaptation features optimizing the performance suggests that learning is very sensitive to the extent of the plastic adaptation and the spatial range of synaptic connections.

Exploring the limits of learning: Segregation of information integration and response selection is required for learning a serial reversal task

PubMed Central

Zanutto, B. Silvano

2017-01-01

Animals are proposed to learn the latent rules governing their environment in order to maximize their chances of survival. However, rules may change without notice, forcing animals to keep a memory of which one is currently at work. Rule switching can lead to situations in which the same stimulus/response pairing is positively and negatively rewarded in the long run, depending on variables that are not accessible to the animal. This fact raises questions on how neural systems are capable of reinforcement learning in environments where the reinforcement is inconsistent. Here we address this issue by asking about which aspects of connectivity, neural excitability and synaptic plasticity are key for a very general, stochastic spiking neural network model to solve a task in which rules change without being cued, taking the serial reversal task (SRT) as paradigm. Contrary to what could be expected, we found strong limitations for biologically plausible networks to solve the SRT. Especially, we proved that no network of neurons can learn a SRT if it is a single neural population that integrates stimuli information and at the same time is responsible of choosing the behavioural response. This limitation is independent of the number of neurons, neuronal dynamics or plasticity rules, and arises from the fact that plasticity is locally computed at each synapse, and that synaptic changes and neuronal activity are mutually dependent processes. We propose and characterize a spiking neural network model that solves the SRT, which relies on separating the functions of stimuli integration and response selection. The model suggests that experimental efforts to understand neural function should focus on the characterization of neural circuits according to their connectivity, neural dynamics, and the degree of modulation of synaptic plasticity with reward. PMID:29077735

Abnormal Functional Activation and Connectivity in the Working Memory Network in Early-Onset Schizophrenia

ERIC Educational Resources Information Center

Kyriakopoulos, Marinos; Dima, Danai; Roiser, Jonathan P.; Corrigall, Richard; Barker, Gareth J.; Frangou, Sophia

2012-01-01

Objective: Disruption within the working memory (WM) neural network is considered an integral feature of schizophrenia. The WM network, and the dorsolateral prefrontal cortex (DLPFC) in particular, undergo significant remodeling in late adolescence. Potential interactions between developmental changes in the WM network and disease-related…

Polarity-specific high-level information propagation in neural networks.

PubMed

Lin, Yen-Nan; Chang, Po-Yen; Hsiao, Pao-Yueh; Lo, Chung-Chuan

2014-01-01

Analyzing the connectome of a nervous system provides valuable information about the functions of its subsystems. Although much has been learned about the architectures of neural networks in various organisms by applying analytical tools developed for general networks, two distinct and functionally important properties of neural networks are often overlooked. First, neural networks are endowed with polarity at the circuit level: Information enters a neural network at input neurons, propagates through interneurons, and leaves via output neurons. Second, many functions of nervous systems are implemented by signal propagation through high-level pathways involving multiple and often recurrent connections rather than by the shortest paths between nodes. In the present study, we analyzed two neural networks: the somatic nervous system of Caenorhabditis elegans (C. elegans) and the partial central complex network of Drosophila, in light of these properties. Specifically, we quantified high-level propagation in the vertical and horizontal directions: the former characterizes how signals propagate from specific input nodes to specific output nodes and the latter characterizes how a signal from a specific input node is shared by all output nodes. We found that the two neural networks are characterized by very efficient vertical and horizontal propagation. In comparison, classic small-world networks show a trade-off between vertical and horizontal propagation; increasing the rewiring probability improves the efficiency of horizontal propagation but worsens the efficiency of vertical propagation. Our result provides insights into how the complex functions of natural neural networks may arise from a design that allows them to efficiently transform and combine input signals.

Polarity-specific high-level information propagation in neural networks

PubMed Central

Lin, Yen-Nan; Chang, Po-Yen; Hsiao, Pao-Yueh; Lo, Chung-Chuan

2014-01-01

Analyzing the connectome of a nervous system provides valuable information about the functions of its subsystems. Although much has been learned about the architectures of neural networks in various organisms by applying analytical tools developed for general networks, two distinct and functionally important properties of neural networks are often overlooked. First, neural networks are endowed with polarity at the circuit level: Information enters a neural network at input neurons, propagates through interneurons, and leaves via output neurons. Second, many functions of nervous systems are implemented by signal propagation through high-level pathways involving multiple and often recurrent connections rather than by the shortest paths between nodes. In the present study, we analyzed two neural networks: the somatic nervous system of Caenorhabditis elegans (C. elegans) and the partial central complex network of Drosophila, in light of these properties. Specifically, we quantified high-level propagation in the vertical and horizontal directions: the former characterizes how signals propagate from specific input nodes to specific output nodes and the latter characterizes how a signal from a specific input node is shared by all output nodes. We found that the two neural networks are characterized by very efficient vertical and horizontal propagation. In comparison, classic small-world networks show a trade-off between vertical and horizontal propagation; increasing the rewiring probability improves the efficiency of horizontal propagation but worsens the efficiency of vertical propagation. Our result provides insights into how the complex functions of natural neural networks may arise from a design that allows them to efficiently transform and combine input signals. PMID:24672472

BrainNetCNN: Convolutional neural networks for brain networks; towards predicting neurodevelopment.

PubMed

Kawahara, Jeremy; Brown, Colin J; Miller, Steven P; Booth, Brian G; Chau, Vann; Grunau, Ruth E; Zwicker, Jill G; Hamarneh, Ghassan

2017-02-01

We propose BrainNetCNN, a convolutional neural network (CNN) framework to predict clinical neurodevelopmental outcomes from brain networks. In contrast to the spatially local convolutions done in traditional image-based CNNs, our BrainNetCNN is composed of novel edge-to-edge, edge-to-node and node-to-graph convolutional filters that leverage the topological locality of structural brain networks. We apply the BrainNetCNN framework to predict cognitive and motor developmental outcome scores from structural brain networks of infants born preterm. Diffusion tensor images (DTI) of preterm infants, acquired between 27 and 46 weeks gestational age, were used to construct a dataset of structural brain connectivity networks. We first demonstrate the predictive capabilities of BrainNetCNN on synthetic phantom networks with simulated injury patterns and added noise. BrainNetCNN outperforms a fully connected neural-network with the same number of model parameters on both phantoms with focal and diffuse injury patterns. We then apply our method to the task of joint prediction of Bayley-III cognitive and motor scores, assessed at 18 months of age, adjusted for prematurity. We show that our BrainNetCNN framework outperforms a variety of other methods on the same data. Furthermore, BrainNetCNN is able to identify an infant's postmenstrual age to within about 2 weeks. Finally, we explore the high-level features learned by BrainNetCNN by visualizing the importance of each connection in the brain with respect to predicting the outcome scores. These findings are then discussed in the context of the anatomy and function of the developing preterm infant brain. Copyright © 2016 Elsevier Inc. All rights reserved.

Recurrent Network models of sequence generation and memory

PubMed Central

Rajan, Kanaka; Harvey, Christopher D; Tank, David W

2016-01-01

SUMMARY Sequential activation of neurons is a common feature of network activity during a variety of behaviors, including working memory and decision making. Previous network models for sequences and memory emphasized specialized architectures in which a principled mechanism is pre-wired into their connectivity. Here, we demonstrate that starting from random connectivity and modifying a small fraction of connections, a largely disordered recurrent network can produce sequences and implement working memory efficiently. We use this process, called Partial In-Network training (PINning), to model and match cellular-resolution imaging data from the posterior parietal cortex during a virtual memory-guided two-alternative forced choice task [Harvey, Coen and Tank, 2012]. Analysis of the connectivity reveals that sequences propagate by the cooperation between recurrent synaptic interactions and external inputs, rather than through feedforward or asymmetric connections. Together our results suggest that neural sequences may emerge through learning from largely unstructured network architectures. PMID:26971945

Revealing networks from dynamics: an introduction

NASA Astrophysics Data System (ADS)

Timme, Marc; Casadiego, Jose

2014-08-01

What can we learn from the collective dynamics of a complex network about its interaction topology? Taking the perspective from nonlinear dynamics, we briefly review recent progress on how to infer structural connectivity (direct interactions) from accessing the dynamics of the units. Potential applications range from interaction networks in physics, to chemical and metabolic reactions, protein and gene regulatory networks as well as neural circuits in biology and electric power grids or wireless sensor networks in engineering. Moreover, we briefly mention some standard ways of inferring effective or functional connectivity.

Neuroticism and conscientiousness respectively constrain and facilitate short-term plasticity within the working memory neural network.

PubMed

Dima, Danai; Friston, Karl J; Stephan, Klaas E; Frangou, Sophia

2015-10-01

Individual differences in cognitive efficiency, particularly in relation to working memory (WM), have been associated both with personality dimensions that reflect enduring regularities in brain configuration, and with short-term neural plasticity, that reflects task-related changes in brain connectivity. To elucidate the relationship of these two divergent mechanisms, we tested the hypothesis that personality dimensions, which reflect enduring aspects of brain configuration, inform about the neurobiological framework within which short-term, task-related plasticity, as measured by effective connectivity, can be facilitated or constrained. As WM consistently engages the dorsolateral prefrontal (DLPFC), parietal (PAR), and anterior cingulate cortex (ACC), we specified a WM network model with bidirectional, ipsilateral, and contralateral connections between these regions from a functional magnetic resonance imaging dataset obtained from 40 healthy adults while performing the 3-back WM task. Task-related effective connectivity changes within this network were estimated using Dynamic Causal Modelling. Personality was evaluated along the major dimensions of Neuroticism, Extraversion, Openness to Experience, Agreeableness, and Conscientiousness. Only two dimensions were relevant to task-dependent effective connectivity. Neuroticism and Conscientiousness respectively constrained and facilitated neuroplastic responses within the WM network. These results suggest individual differences in cognitive efficiency arise from the interplay between enduring and short-term plasticity in brain configuration. © 2015 Wiley Periodicals, Inc.

Cerebellum and Integration of Neural Networks in Dual-Task Processing

PubMed Central

Wu, Tao; Liu, Jun; Hallett, Mark; Zheng, Zheng; Chan, Piu

2014-01-01

Performing two tasks simultaneously (dual-task) is common in human daily life. The neural correlates of dual-task processing remain unclear. In the current study, we used a dual motor and counting task with functional MRI (fMRI) to determine whether there are any areas additionally activated for dual-task performance. Moreover, we investigated the functional connectivity of these added activated areas, as well as the training effect on brain activity and connectivity. We found that the right cerebellar vermis, left lobule V of the cerebellar anterior lobe and precuneus are additionally activated for this type of dual-tasking. These cerebellar regions had functional connectivity with extensive motor- and cognitive-related regions. Dual-task training induced less activation in several areas, but increased the functional connectivity between these cerebellar regions and numbers of motor- and cognitive-related areas. Our findings demonstrate that some regions within the cerebellum can be additionally activated with dual-task performance. Their role in dual motor and cognitive task processes is likely to integrate motor and cognitive networks, and may be involved in adjusting these networks to be more efficient in order to perform dual-tasking properly. The connectivity of the precuneus differs from the cerebellar regions. A possible role of the precuneus in dual-task may be monitoring the operation of active brain networks. PMID:23063842

Limbic hyperconnectivity in the vegetative state.

PubMed

Di Perri, Carol; Bastianello, Stefano; Bartsch, Andreas J; Pistarini, Caterina; Maggioni, Giorgio; Magrassi, Lorenzo; Imberti, Roberto; Pichiecchio, Anna; Vitali, Paolo; Laureys, Steven; Di Salle, Francesco

2013-10-15

To investigate functional connectivity between the default mode network (DMN) and other networks in disorders of consciousness. We analyzed MRI data from 11 patients in a vegetative state and 7 patients in a minimally conscious state along with age- and sex-matched healthy control subjects. MRI data analysis included nonlinear spatial normalization to compensate for disease-related anatomical distortions. We studied brain connectivity data from resting-state MRI temporal series, combining noninferential (independent component analysis) and inferential (seed-based general linear model) methods. In DMN hypoconnectivity conditions, a patient's DMN functional connectivity shifts and paradoxically increases in limbic structures, including the orbitofrontal cortex, insula, hypothalamus, and the ventral tegmental area. Concurrently with DMN hypoconnectivity, we report limbic hyperconnectivity in patients in vegetative and minimally conscious states. This hyperconnectivity may reflect the persistent engagement of residual neural activity in self-reinforcing neural loops, which, in turn, could disrupt normal patterns of connectivity.

A lateralized functional auditory network is involved in anuran sexual selection.

PubMed

Xue, Fei; Fang, Guangzhan; Yue, Xizi; Zhao, Ermi; Brauth, Steven E; Tang, Yezhong

2016-12-01

Right ear advantage (REA) exists in many land vertebrates in which the right ear and left hemisphere preferentially process conspecific acoustic stimuli such as those related to sexual selection. Although ecological and neural mechanisms for sexual selection have been widely studied, the brain networks involved are still poorly understood. In this study we used multi-channel electroencephalographic data in combination with Granger causal connectivity analysis to demonstrate, for the first time, that auditory neural network interconnecting the left and right midbrain and forebrain function asymmetrically in the Emei music frog (Babina daunchina), an anuran species which exhibits REA. The results showed the network was lateralized. Ascending connections between the mesencephalon and telencephalon were stronger in the left side while descending ones were stronger in the right, which matched with the REA in this species and implied that inhibition from the forebrainmay induce REA partly. Connections from the telencephalon to ipsilateral mesencephalon in response to white noise were the highest in the non-reproductive stage while those to advertisement calls were the highest in reproductive stage, implying the attention resources and living strategy shift when entered the reproductive season. Finally, these connection changes were sexually dimorphic, revealing sex differences in reproductive roles.

Towards cortex sized artificial neural systems.

PubMed

Johansson, Christopher; Lansner, Anders

2007-01-01

We propose, implement, and discuss an abstract model of the mammalian neocortex. This model is instantiated with a sparse recurrently connected neural network that has spiking leaky integrator units and continuous Hebbian learning. First we study the structure, modularization, and size of neocortex, and then we describe a generic computational model of the cortical circuitry. A characterizing feature of the model is that it is based on the modularization of neocortex into hypercolumns and minicolumns. Both a floating- and fixed-point arithmetic implementation of the model are presented along with simulation results. We conclude that an implementation on a cluster computer is not communication but computation bounded. A mouse and rat cortex sized version of our model executes in 44% and 23% of real-time respectively. Further, an instance of the model with 1.6 x 10(6) units and 2 x 10(11) connections performed noise reduction and pattern completion. These implementations represent the current frontier of large-scale abstract neural network simulations in terms of network size and running speed.

Computational properties of networks of synchronous groups of spiking neurons.

PubMed

Dayhoff, Judith E

2007-09-01

We demonstrate a model in which synchronously firing ensembles of neurons are networked to produce computational results. Each ensemble is a group of biological integrate-and-fire spiking neurons, with probabilistic interconnections between groups. An analogy is drawn in which each individual processing unit of an artificial neural network corresponds to a neuronal group in a biological model. The activation value of a unit in the artificial neural network corresponds to the fraction of active neurons, synchronously firing, in a biological neuronal group. Weights of the artificial neural network correspond to the product of the interconnection density between groups, the group size of the presynaptic group, and the postsynaptic potential heights in the synchronous group model. All three of these parameters can modulate connection strengths between neuronal groups in the synchronous group models. We give an example of nonlinear classification (XOR) and a function approximation example in which the capability of the artificial neural network can be captured by a neural network model with biological integrate-and-fire neurons configured as a network of synchronously firing ensembles of such neurons. We point out that the general function approximation capability proven for feedforward artificial neural networks appears to be approximated by networks of neuronal groups that fire in synchrony, where the groups comprise integrate-and-fire neurons. We discuss the advantages of this type of model for biological systems, its possible learning mechanisms, and the associated timing relationships.

Atypical within- and between-hemisphere motor network functional connections in children with developmental coordination disorder and attention-deficit/hyperactivity disorder.

PubMed

McLeod, Kevin R; Langevin, Lisa Marie; Dewey, Deborah; Goodyear, Bradley G

2016-01-01

Developmental coordination disorder (DCD) and attention-deficit hyperactivity disorder (ADHD) are highly comorbid neurodevelopmental disorders; however, the neural mechanisms of this comorbidity are poorly understood. Previous research has demonstrated that children with DCD and ADHD have altered brain region communication, particularly within the motor network. The structure and function of the motor network in a typically developing brain exhibits hemispheric dominance. It is plausible that functional deficits observed in children with DCD and ADHD are associated with neurodevelopmental alterations in within- and between-hemisphere motor network functional connection strength that disrupt this hemispheric dominance. We used resting-state functional magnetic resonance imaging to examine functional connections of the left and right primary and sensory motor (SM1) cortices in children with DCD, ADHD and DCD + ADHD, relative to typically developing children. Our findings revealed that children with DCD, ADHD and DCD + ADHD exhibit atypical within- and between-hemisphere functional connection strength between SM1 and regions of the basal ganglia, as well as the cerebellum. Our findings further support the assertion that development of atypical motor network connections represents common and distinct neural mechanisms underlying DCD and ADHD. In children with DCD and DCD + ADHD (but not ADHD), a significant correlation was observed between clinical assessment of motor function and the strength of functional connections between right SM1 and anterior cingulate cortex, supplementary motor area, and regions involved in visuospatial processing. This latter finding suggests that behavioral phenotypes associated with atypical motor network development differ between individuals with DCD and those with ADHD.

Altered resting-state effective connectivity of fronto-parietal motor control systems on the primary motor network following stroke

PubMed Central

Inman, Cory S.; James, G. Andrew; Hamann, Stephan; Rajendra, Justin K.; Pagnoni, Giuseppe; Butler, Andrew J.

2011-01-01

Previous brain imaging work suggests that stroke alters the effective connectivity (the influence neural regions exert upon each other) of motor execution networks. The present study examines the intrinsic effective connectivity of top-down motor control in stroke survivors (n=13) relative to healthy participants (n=12). Stroke survivors exhibited significant deficits in motor function, as assessed by the Fugl-Meyer Motor Assessment. We used structural equation modeling (SEM) of resting-state fMRI data to investigate the relationship between motor deficits and the intrinsic effective connectivity between brain regions involved in motor control and motor execution. An exploratory adaptation of SEM determined the optimal model of motor execution effective connectivity in healthy participants, and confirmatory SEM assessed stroke survivors’ fit to that model. We observed alterations in spontaneous resting-state effective connectivity from fronto-parietal guidance systems to the motor network in stroke survivors. More specifically, diminished connectivity was found in connections from the superior parietal cortex to primary motor cortex and supplementary motor cortex. Furthermore, the paths demonstrated large individual variance in stroke survivors but less variance in healthy participants. These findings suggest that characterizing the deficits in resting-state connectivity of top-down processes in stroke survivors may help optimize cognitive and physical rehabilitation therapies by individually targeting specific neural pathway. PMID:21839174

Harmonic stochastic resonance-enhanced signal detecting in NW small-world neural network

NASA Astrophysics Data System (ADS)

Wang, Dao-Guang; Liang, Xiao-Ming; Wang, Jing; Yang, Cheng-Fang; Liu, Kai; Lü, Hua-Ping

2010-11-01

The harmonic stochastic resonance-enhanced signal detecting in Newman-Watts small-world neural network is studied using the Hodgkin-Huxley dynamical equation with noise. If the connection probability p, coupling strength gsyn and noise intensity D matches well, higher order resonance will be found and an optimal signal-to-noise ratio will be obtained. Then, the reasons are given to explain the mechanism of this appearance.

Training Deep Convolutional Neural Networks with Resistive Cross-Point Devices

PubMed Central

Gokmen, Tayfun; Onen, Murat; Haensch, Wilfried

2017-01-01

In a previous work we have detailed the requirements for obtaining maximal deep learning performance benefit by implementing fully connected deep neural networks (DNN) in the form of arrays of resistive devices. Here we extend the concept of Resistive Processing Unit (RPU) devices to convolutional neural networks (CNNs). We show how to map the convolutional layers to fully connected RPU arrays such that the parallelism of the hardware can be fully utilized in all three cycles of the backpropagation algorithm. We find that the noise and bound limitations imposed by the analog nature of the computations performed on the arrays significantly affect the training accuracy of the CNNs. Noise and bound management techniques are presented that mitigate these problems without introducing any additional complexity in the analog circuits and that can be addressed by the digital circuits. In addition, we discuss digitally programmable update management and device variability reduction techniques that can be used selectively for some of the layers in a CNN. We show that a combination of all those techniques enables a successful application of the RPU concept for training CNNs. The techniques discussed here are more general and can be applied beyond CNN architectures and therefore enables applicability of the RPU approach to a large class of neural network architectures. PMID:29066942

Training Deep Convolutional Neural Networks with Resistive Cross-Point Devices.

PubMed

Gokmen, Tayfun; Onen, Murat; Haensch, Wilfried

2017-01-01

In a previous work we have detailed the requirements for obtaining maximal deep learning performance benefit by implementing fully connected deep neural networks (DNN) in the form of arrays of resistive devices. Here we extend the concept of Resistive Processing Unit (RPU) devices to convolutional neural networks (CNNs). We show how to map the convolutional layers to fully connected RPU arrays such that the parallelism of the hardware can be fully utilized in all three cycles of the backpropagation algorithm. We find that the noise and bound limitations imposed by the analog nature of the computations performed on the arrays significantly affect the training accuracy of the CNNs. Noise and bound management techniques are presented that mitigate these problems without introducing any additional complexity in the analog circuits and that can be addressed by the digital circuits. In addition, we discuss digitally programmable update management and device variability reduction techniques that can be used selectively for some of the layers in a CNN. We show that a combination of all those techniques enables a successful application of the RPU concept for training CNNs. The techniques discussed here are more general and can be applied beyond CNN architectures and therefore enables applicability of the RPU approach to a large class of neural network architectures.

Experiments in Neural-Network Control of a Free-Flying Space Robot

NASA Technical Reports Server (NTRS)

Wilson, Edward

1995-01-01

Four important generic issues are identified and addressed in some depth in this thesis as part of the development of an adaptive neural network based control system for an experimental free flying space robot prototype. The first issue concerns the importance of true system level design of the control system. A new hybrid strategy is developed here, in depth, for the beneficial integration of neural networks into the total control system. A second important issue in neural network control concerns incorporating a priori knowledge into the neural network. In many applications, it is possible to get a reasonably accurate controller using conventional means. If this prior information is used purposefully to provide a starting point for the optimizing capabilities of the neural network, it can provide much faster initial learning. In a step towards addressing this issue, a new generic Fully Connected Architecture (FCA) is developed for use with backpropagation. A third issue is that neural networks are commonly trained using a gradient based optimization method such as backpropagation; but many real world systems have Discrete Valued Functions (DVFs) that do not permit gradient based optimization. One example is the on-off thrusters that are common on spacecraft. A new technique is developed here that now extends backpropagation learning for use with DVFs. The fourth issue is that the speed of adaptation is often a limiting factor in the implementation of a neural network control system. This issue has been strongly resolved in the research by drawing on the above new contributions.

Modified-hybrid optical neural network filter for multiple object recognition within cluttered scenes

NASA Astrophysics Data System (ADS)

Kypraios, Ioannis; Young, Rupert C. D.; Chatwin, Chris R.

2009-08-01

Motivated by the non-linear interpolation and generalization abilities of the hybrid optical neural network filter between the reference and non-reference images of the true-class object we designed the modifiedhybrid optical neural network filter. We applied an optical mask to the hybrid optical neural network's filter input. The mask was built with the constant weight connections of a randomly chosen image included in the training set. The resulted design of the modified-hybrid optical neural network filter is optimized for performing best in cluttered scenes of the true-class object. Due to the shift invariance properties inherited by its correlator unit the filter can accommodate multiple objects of the same class to be detected within an input cluttered image. Additionally, the architecture of the neural network unit of the general hybrid optical neural network filter allows the recognition of multiple objects of different classes within the input cluttered image by modifying the output layer of the unit. We test the modified-hybrid optical neural network filter for multiple objects of the same and of different classes' recognition within cluttered input images and video sequences of cluttered scenes. The filter is shown to exhibit with a single pass over the input data simultaneously out-of-plane rotation, shift invariance and good clutter tolerance. It is able to successfully detect and classify correctly the true-class objects within background clutter for which there has been no previous training.

Preferential degradation of cognitive networks differentiates Alzheimer's disease from ageing.

PubMed

Chhatwal, Jasmeer P; Schultz, Aaron P; Johnson, Keith A; Hedden, Trey; Jaimes, Sehily; Benzinger, Tammie L S; Jack, Clifford; Ances, Beau M; Ringman, John M; Marcus, Daniel S; Ghetti, Bernardino; Farlow, Martin R; Danek, Adrian; Levin, Johannes; Yakushev, Igor; Laske, Christoph; Koeppe, Robert A; Galasko, Douglas R; Xiong, Chengjie; Masters, Colin L; Schofield, Peter R; Kinnunen, Kirsi M; Salloway, Stephen; Martins, Ralph N; McDade, Eric; Cairns, Nigel J; Buckles, Virginia D; Morris, John C; Bateman, Randall; Sperling, Reisa A

2018-05-01

Converging evidence from structural, metabolic and functional connectivity MRI suggests that neurodegenerative diseases, such as Alzheimer's disease, target specific neural networks. However, age-related network changes commonly co-occur with neuropathological cascades, limiting efforts to disentangle disease-specific alterations in network function from those associated with normal ageing. Here we elucidate the differential effects of ageing and Alzheimer's disease pathology through simultaneous analyses of two functional connectivity MRI datasets: (i) young participants harbouring highly-penetrant mutations leading to autosomal-dominant Alzheimer's disease from the Dominantly Inherited Alzheimer's Network (DIAN), an Alzheimer's disease cohort in which age-related comorbidities are minimal and likelihood of progression along an Alzheimer's disease trajectory is extremely high; and (ii) young and elderly participants from the Harvard Aging Brain Study, a cohort in which imaging biomarkers of amyloid burden and neurodegeneration can be used to disambiguate ageing alone from preclinical Alzheimer's disease. Consonant with prior reports, we observed the preferential degradation of cognitive (especially the default and dorsal attention networks) over motor and sensory networks in early autosomal-dominant Alzheimer's disease, and found that this distinctive degradation pattern was magnified in more advanced stages of disease. Importantly, a nascent form of the pattern observed across the autosomal-dominant Alzheimer's disease spectrum was also detectable in clinically normal elderly with clear biomarker evidence of Alzheimer's disease pathology (preclinical Alzheimer's disease). At the more granular level of individual connections between node pairs, we observed that connections within cognitive networks were preferentially targeted in Alzheimer's disease (with between network connections relatively spared), and that connections between positively coupled nodes (correlations) were preferentially degraded as compared to connections between negatively coupled nodes (anti-correlations). In contrast, ageing in the absence of Alzheimer's disease biomarkers was characterized by a far less network-specific degradation across cognitive and sensory networks, of between- and within-network connections, and of connections between positively and negatively coupled nodes. We go on to demonstrate that formalizing the differential patterns of network degradation in ageing and Alzheimer's disease may have the practical benefit of yielding connectivity measurements that highlight early Alzheimer's disease-related connectivity changes over those due to age-related processes. Together, the contrasting patterns of connectivity in Alzheimer's disease and ageing add to prior work arguing against Alzheimer's disease as a form of accelerated ageing, and suggest multi-network composite functional connectivity MRI metrics may be useful in the detection of early Alzheimer's disease-specific alterations co-occurring with age-related connectivity changes. More broadly, our findings are consistent with a specific pattern of network degradation associated with the spreading of Alzheimer's disease pathology within targeted neural networks.

Task-Rest Modulation of Basal Ganglia Connectivity in Mild to Moderate Parkinson’s Disease

PubMed Central

Müller-Oehring, Eva M.; Sullivan, Edith V.; Pfefferbaum, Adolf; Huang, Neng C.; Poston, Kathleen L.; Bronte-Stewart, Helen M.; Schulte, Tilman

2014-01-01

Parkinson’s disease (PD) is associated with abnormal synchronization in basal ganglia-thalamo-cortical loops. We tested whether early PD patients without demonstrable cognitive impairment exhibit abnormal modulation of functional connectivity at rest, while engaged in a task, or both. PD and healthy controls underwent two functional MRI scans: a resting-state scan and a Stroop Match-to-Sample task scan. Rest-task modulation of basal ganglia (BG) connectivity was tested using seed-to-voxel connectivity analysis with task and rest time series as conditions. Despite substantial overlap of BG–cortical connectivity patterns in both groups, connectivity differences between groups had clinical and behavioral correlates. During rest, stronger putamen–medial parietal and pallidum–occipital connectivity in PD than controls was associated with worse task performance and more severe PD symptoms suggesting that abnormalities in resting-state connectivity denote neural network dedifferentiation. During the executive task, PD patients showed weaker BG-cortical connectivity than controls, i.e., between caudate–supramarginal gyrus and pallidum–inferior prefrontal regions, that was related to more severe PD symptoms and worse task performance. Yet, task processing also evoked stronger striatal–cortical connectivity, specifically between caudate–prefrontal, caudate–precuneus, and putamen–motor/premotor regions in PD relative to controls, which was related to less severe PD symptoms and better performance on the Stroop task. Thus, stronger task-evoked striatal connectivity in PD demonstrated compensatory neural network enhancement to meet task demands and improve performance levels. fMRI-based network analysis revealed that despite resting-state BG network compromise in PD, BG connectivity to prefrontal, premotor, and precuneus regions can be adequately invoked during executive control demands enabling near normal task performance. PMID:25280970

Synaptogenesis Is Modulated by Heparan Sulfate in Caenorhabditis elegans

PubMed Central

Lázaro-Peña, María I.; Díaz-Balzac, Carlos A.; Bülow, Hannes E.; Emmons, Scott W.

2018-01-01

The nervous system regulates complex behaviors through a network of neurons interconnected by synapses. How specific synaptic connections are genetically determined is still unclear. Male mating is the most complex behavior in Caenorhabditis elegans. It is composed of sequential steps that are governed by > 3000 chemical connections. Here, we show that heparan sulfates (HS) play a role in the formation and function of the male neural network. HS, sulfated in position 3 by the HS modification enzyme HST-3.1/HS 3-O-sulfotransferase and attached to the HS proteoglycan glypicans LON-2/glypican and GPN-1/glypican, functions cell-autonomously and nonautonomously for response to hermaphrodite contact during mating. Loss of 3-O sulfation resulted in the presynaptic accumulation of RAB-3, a molecule that localizes to synaptic vesicles, and disrupted the formation of synapses in a component of the mating circuits. We also show that the neural cell adhesion protein NRX-1/neurexin promotes and the neural cell adhesion protein NLG-1/neuroligin inhibits the formation of the same set of synapses in a parallel pathway. Thus, neural cell adhesion proteins and extracellular matrix components act together in the formation of synaptic connections. PMID:29559501

Emergence of small-world structure in networks of spiking neurons through STDP plasticity.

PubMed

Basalyga, Gleb; Gleiser, Pablo M; Wennekers, Thomas

2011-01-01

In this work, we use a complex network approach to investigate how a neural network structure changes under synaptic plasticity. In particular, we consider a network of conductance-based, single-compartment integrate-and-fire excitatory and inhibitory neurons. Initially the neurons are connected randomly with uniformly distributed synaptic weights. The weights of excitatory connections can be strengthened or weakened during spiking activity by the mechanism known as spike-timing-dependent plasticity (STDP). We extract a binary directed connection matrix by thresholding the weights of the excitatory connections at every simulation step and calculate its major topological characteristics such as the network clustering coefficient, characteristic path length and small-world index. We numerically demonstrate that, under certain conditions, a nontrivial small-world structure can emerge from a random initial network subject to STDP learning.

Resting state electrical brain activity and connectivity in fibromyalgia

PubMed Central

Vanneste, Sven; Ost, Jan; Van Havenbergh, Tony; De Ridder, Dirk

2017-01-01

The exact mechanism underlying fibromyalgia is unknown, but increased facilitatory modulation and/or dysfunctional descending inhibitory pathway activity are posited as possible mechanisms contributing to sensitization of the central nervous system. The primary goal of this study is to identify a fibromyalgia neural circuit that can account for these abnormalities in central pain. The second goal is to gain a better understanding of the functional connectivity between the default and the executive attention network (salience network plus dorsal lateral prefrontal cortex) in fibromyalgia. We examine neural activity associated with fibromyalgia (N = 44) and compare these with healthy controls (N = 44) using resting state source localized EEG. Our data support an important role of the pregenual anterior cingulate cortex but also suggest that the degree of activation and the degree of integration between different brain areas is important. The inhibition of the connectivity between the dorsal lateral prefrontal cortex and the posterior cingulate cortex on the pain inhibitory pathway seems to be limited by decreased functional connectivity with the pregenual anterior cingulate cortex. Our data highlight the functional dynamics of brain regions integrated in brain networks in fibromyalgia patients. PMID:28650974

Cascade Back-Propagation Learning in Neural Networks

NASA Technical Reports Server (NTRS)

Duong, Tuan A.

2003-01-01

The cascade back-propagation (CBP) algorithm is the basis of a conceptual design for accelerating learning in artificial neural networks. The neural networks would be implemented as analog very-large-scale integrated (VLSI) circuits, and circuits to implement the CBP algorithm would be fabricated on the same VLSI circuit chips with the neural networks. Heretofore, artificial neural networks have learned slowly because it has been necessary to train them via software, for lack of a good on-chip learning technique. The CBP algorithm is an on-chip technique that provides for continuous learning in real time. Artificial neural networks are trained by example: A network is presented with training inputs for which the correct outputs are known, and the algorithm strives to adjust the weights of synaptic connections in the network to make the actual outputs approach the correct outputs. The input data are generally divided into three parts. Two of the parts, called the "training" and "cross-validation" sets, respectively, must be such that the corresponding input/output pairs are known. During training, the cross-validation set enables verification of the status of the input-to-output transformation learned by the network to avoid over-learning. The third part of the data, termed the "test" set, consists of the inputs that are required to be transformed into outputs; this set may or may not include the training set and/or the cross-validation set. Proposed neural-network circuitry for on-chip learning would be divided into two distinct networks; one for training and one for validation. Both networks would share the same synaptic weights.

Emergent spatial synaptic structure from diffusive plasticity.

PubMed

Sweeney, Yann; Clopath, Claudia

2017-04-01

Some neurotransmitters can diffuse freely across cell membranes, influencing neighbouring neurons regardless of their synaptic coupling. This provides a means of neural communication, alternative to synaptic transmission, which can influence the way in which neural networks process information. Here, we ask whether diffusive neurotransmission can also influence the structure of synaptic connectivity in a network undergoing plasticity. We propose a form of Hebbian synaptic plasticity which is mediated by a diffusive neurotransmitter. Whenever a synapse is modified at an individual neuron through our proposed mechanism, similar but smaller modifications occur in synapses connecting to neighbouring neurons. The effects of this diffusive plasticity are explored in networks of rate-based neurons. This leads to the emergence of spatial structure in the synaptic connectivity of the network. We show that this spatial structure can coexist with other forms of structure in the synaptic connectivity, such as with groups of strongly interconnected neurons that form in response to correlated external drive. Finally, we explore diffusive plasticity in a simple feedforward network model of receptive field development. We show that, as widely observed across sensory cortex, the preferred stimulus identity of neurons in our network become spatially correlated due to diffusion. Our proposed mechanism of diffusive plasticity provides an efficient mechanism for generating these spatial correlations in stimulus preference which can flexibly interact with other forms of synaptic organisation. © 2016 Federation of European Neuroscience Societies and John Wiley & Sons Ltd.

Modulation of steady state functional connectivity in the default mode and working memory networks by cognitive load.

PubMed

Newton, Allen T; Morgan, Victoria L; Rogers, Baxter P; Gore, John C

2011-10-01

Interregional correlations between blood oxygen level dependent (BOLD) magnetic resonance imaging (fMRI) signals in the resting state have been interpreted as measures of connectivity across the brain. Here we investigate whether such connectivity in the working memory and default mode networks is modulated by changes in cognitive load. Functional connectivity was measured in a steady-state verbal identity N-back task for three different conditions (N = 1, 2, and 3) as well as in the resting state. We found that as cognitive load increases, the functional connectivity within both the working memory the default mode network increases. To test whether functional connectivity between the working memory and the default mode networks changed, we constructed maps of functional connectivity to the working memory network as a whole and found that increasingly negative correlations emerged in a dorsal region of the posterior cingulate cortex. These results provide further evidence that low frequency fluctuations in BOLD signals reflect variations in neural activity and suggests interaction between the default mode network and other cognitive networks. Copyright © 2010 Wiley-Liss, Inc.

Population coding in sparsely connected networks of noisy neurons.

PubMed

Tripp, Bryan P; Orchard, Jeff

2012-01-01

This study examines the relationship between population coding and spatial connection statistics in networks of noisy neurons. Encoding of sensory information in the neocortex is thought to require coordinated neural populations, because individual cortical neurons respond to a wide range of stimuli, and exhibit highly variable spiking in response to repeated stimuli. Population coding is rooted in network structure, because cortical neurons receive information only from other neurons, and because the information they encode must be decoded by other neurons, if it is to affect behavior. However, population coding theory has often ignored network structure, or assumed discrete, fully connected populations (in contrast with the sparsely connected, continuous sheet of the cortex). In this study, we modeled a sheet of cortical neurons with sparse, primarily local connections, and found that a network with this structure could encode multiple internal state variables with high signal-to-noise ratio. However, we were unable to create high-fidelity networks by instantiating connections at random according to spatial connection probabilities. In our models, high-fidelity networks required additional structure, with higher cluster factors and correlations between the inputs to nearby neurons.

Abnormal regional activity and functional connectivity in resting-state brain networks associated with etiology confirmed unilateral pulsatile tinnitus in the early stage of disease.

PubMed

Lv, Han; Zhao, Pengfei; Liu, Zhaohui; Li, Rui; Zhang, Ling; Wang, Peng; Yan, Fei; Liu, Liheng; Wang, Guopeng; Zeng, Rong; Li, Ting; Dong, Cheng; Gong, Shusheng; Wang, Zhenchang

2017-03-01

Abnormal neural activities can be revealed by resting-state functional magnetic resonance imaging (rs-fMRI) using analyses of the regional activity and functional connectivity (FC) of the networks in the brain. This study was designed to demonstrate the functional network alterations in the patients with pulsatile tinnitus (PT). In this study, we recruited 45 patients with unilateral PT in the early stage of disease (less than 48 months of disease duration) and 45 normal controls. We used regional homogeneity (ReHo) and seed-based FC computational methods to reveal resting-state brain activity features associated with pulsatile tinnitus. Compared with healthy controls, PT patients showed regional abnormalities mainly in the left middle occipital gyrus (MOG), posterior cingulate gyrus (PCC), precuneus and right anterior insula (AI). When these regions were defined as seeds, we demonstrated widespread modification of interaction between the auditory and non-auditory networks. The auditory network was positively connected with the cognitive control network (CCN), which may associate with tinnitus related distress. Both altered regional activity and changed FC were found in the visual network. The modification of interactions of higher order networks were mainly found in the DMN, CCN and limbic networks. Functional connectivity between the left MOG and left parahippocampal gyrus could also be an index to reflect the disease duration. This study helped us gain a better understanding of the characteristics of neural network modifications in patients with pulsatile tinnitus. Copyright © 2017 Elsevier B.V. All rights reserved.

Multitask neurovision processor with extensive feedback and feedforward connections

NASA Astrophysics Data System (ADS)

Gupta, Madan M.; Knopf, George K.

1991-11-01

A multi-task neuro-vision parameter which performs a variety of information processing operations associated with the early stages of biological vision is presented. The network architecture of this neuro-vision processor, called the positive-negative (PN) neural processor, is loosely based on the neural activity fields exhibited by thalamic and cortical nervous tissue layers. The computational operation performed by the processor arises from the strength of the recurrent feedback among the numerous positive and negative neural computing units. By adjusting the feedback connections it is possible to generate diverse dynamic behavior that may be used for short-term visual memory (STVM), spatio-temporal filtering (STF), and pulse frequency modulation (PFM). The information attributes that are to be processes may be regulated by modifying the feedforward connections from the signal space to the neural processor.

Caged Neuron MEA: A system for long-term investigation of cultured neural network connectivity

PubMed Central

Erickson, Jonathan; Tooker, Angela; Tai, Y-C.; Pine, Jerome

2008-01-01

Traditional techniques for investigating cultured neural networks, such as the patch clamp and multi-electrode array, are limited by: 1) the number of identified cells which can be simultaneously electrically contacted, 2) the length of time for which cells can be studied, and 3) the lack of one-to-one neuron-to-electrode specificity. Here, we present a new device—the caged neuron multi-electrode array—which overcomes these limitations. This micro-machined device consists of an array of neurocages which mechanically trap a neuron near an extracellular electrode. While the cell body is trapped, the axon and dendrites can freely grow into the surrounding area to form a network. The electrode is bi-directional, capable of both stimulating and recording action potentials. This system is non-invasive, so that all constituent neurons of a network can be studied over its lifetime with stable one-to-one neuron-to-electrode correspondence. Proof-of-concept experiments are described to illustrate that functional networks form in a neurochip system of 16 cages in a 4×4 array, and that suprathreshold connectivity can be fully mapped over several weeks. The neurochip opens a new domain in neurobiology for studying small cultured neural networks. PMID:18775453

Diminished neural network dynamics after moderate and severe traumatic brain injury.

PubMed

Gilbert, Nicholas; Bernier, Rachel A; Calhoun, Vincent D; Brenner, Einat; Grossner, Emily; Rajtmajer, Sarah M; Hillary, Frank G

2018-01-01

Over the past decade there has been increasing enthusiasm in the cognitive neurosciences around using network science to understand the system-level changes associated with brain disorders. A growing literature has used whole-brain fMRI analysis to examine changes in the brain's subnetworks following traumatic brain injury (TBI). Much of network modeling in this literature has focused on static network mapping, which provides a window into gross inter-nodal relationships, but is insensitive to more subtle fluctuations in network dynamics, which may be an important predictor of neural network plasticity. In this study, we examine the dynamic connectivity with focus on state-level connectivity (state) and evaluate the reliability of dynamic network states over the course of two runs of intermittent task and resting data. The goal was to examine the dynamic properties of neural networks engaged periodically with task stimulation in order to determine: 1) the reliability of inter-nodal and network-level characteristics over time and 2) the transitions between distinct network states after traumatic brain injury. To do so, we enrolled 23 individuals with moderate and severe TBI at least 1-year post injury and 19 age- and education-matched healthy adults using functional MRI methods, dynamic connectivity modeling, and graph theory. The results reveal several distinct network "states" that were reliably evident when comparing runs; the overall frequency of dynamic network states are highly reproducible (r-values>0.8) for both samples. Analysis of movement between states resulted in fewer state transitions in the TBI sample and, in a few cases, brain injury resulted in the appearance of states not exhibited by the healthy control (HC) sample. Overall, the findings presented here demonstrate the reliability of observable dynamic mental states during periods of on-task performance and support emerging evidence that brain injury may result in diminished network dynamics.

Diminished neural network dynamics after moderate and severe traumatic brain injury

PubMed Central

Gilbert, Nicholas; Bernier, Rachel A.; Calhoun, Vincent D.; Brenner, Einat; Grossner, Emily; Rajtmajer, Sarah M.

2018-01-01

Over the past decade there has been increasing enthusiasm in the cognitive neurosciences around using network science to understand the system-level changes associated with brain disorders. A growing literature has used whole-brain fMRI analysis to examine changes in the brain’s subnetworks following traumatic brain injury (TBI). Much of network modeling in this literature has focused on static network mapping, which provides a window into gross inter-nodal relationships, but is insensitive to more subtle fluctuations in network dynamics, which may be an important predictor of neural network plasticity. In this study, we examine the dynamic connectivity with focus on state-level connectivity (state) and evaluate the reliability of dynamic network states over the course of two runs of intermittent task and resting data. The goal was to examine the dynamic properties of neural networks engaged periodically with task stimulation in order to determine: 1) the reliability of inter-nodal and network-level characteristics over time and 2) the transitions between distinct network states after traumatic brain injury. To do so, we enrolled 23 individuals with moderate and severe TBI at least 1-year post injury and 19 age- and education-matched healthy adults using functional MRI methods, dynamic connectivity modeling, and graph theory. The results reveal several distinct network “states” that were reliably evident when comparing runs; the overall frequency of dynamic network states are highly reproducible (r-values>0.8) for both samples. Analysis of movement between states resulted in fewer state transitions in the TBI sample and, in a few cases, brain injury resulted in the appearance of states not exhibited by the healthy control (HC) sample. Overall, the findings presented here demonstrate the reliability of observable dynamic mental states during periods of on-task performance and support emerging evidence that brain injury may result in diminished network dynamics. PMID:29883447

Brain without mind: Computer simulation of neural networks with modifiable neuronal interactions

NASA Astrophysics Data System (ADS)

Clark, John W.; Rafelski, Johann; Winston, Jeffrey V.

1985-07-01

Aspects of brain function are examined in terms of a nonlinear dynamical system of highly interconnected neuron-like binary decision elements. The model neurons operate synchronously in discrete time, according to deterministic or probabilistic equations of motion. Plasticity of the nervous system, which underlies such cognitive collective phenomena as adaptive development, learning, and memory, is represented by temporal modification of interneuronal connection strengths depending on momentary or recent neural activity. A formal basis is presented for the construction of local plasticity algorithms, or connection-modification routines, spanning a large class. To build an intuitive understanding of the behavior of discrete-time network models, extensive computer simulations have been carried out (a) for nets with fixed, quasirandom connectivity and (b) for nets with connections that evolve under one or another choice of plasticity algorithm. From the former experiments, insights are gained concerning the spontaneous emergence of order in the form of cyclic modes of neuronal activity. In the course of the latter experiments, a simple plasticity routine (“brainwashing,” or “anti-learning”) was identified which, applied to nets with initially quasirandom connectivity, creates model networks which provide more felicitous starting points for computer experiments on the engramming of content-addressable memories and on learning more generally. The potential relevance of this algorithm to developmental neurobiology and to sleep states is discussed. The model considered is at the same time a synthesis of earlier synchronous neural-network models and an elaboration upon them; accordingly, the present article offers both a focused review of the dynamical properties of such systems and a selection of new findings derived from computer simulation.

Short-Term Memory in Orthogonal Neural Networks

NASA Astrophysics Data System (ADS)

White, Olivia L.; Lee, Daniel D.; Sompolinsky, Haim

2004-04-01

We study the ability of linear recurrent networks obeying discrete time dynamics to store long temporal sequences that are retrievable from the instantaneous state of the network. We calculate this temporal memory capacity for both distributed shift register and random orthogonal connectivity matrices. We show that the memory capacity of these networks scales with system size.

Classification of urine sediment based on convolution neural network

NASA Astrophysics Data System (ADS)

Pan, Jingjing; Jiang, Cunbo; Zhu, Tiantian

2018-04-01

By designing a new convolution neural network framework, this paper breaks the constraints of the original convolution neural network framework requiring large training samples and samples of the same size. Move and cropping the input images, generate the same size of the sub-graph. And then, the generated sub-graph uses the method of dropout, increasing the diversity of samples and preventing the fitting generation. Randomly select some proper subset in the sub-graphic set and ensure that the number of elements in the proper subset is same and the proper subset is not the same. The proper subsets are used as input layers for the convolution neural network. Through the convolution layer, the pooling, the full connection layer and output layer, we can obtained the classification loss rate of test set and training set. In the red blood cells, white blood cells, calcium oxalate crystallization classification experiment, the classification accuracy rate of 97% or more.

Neuromorphic photonic networks using silicon photonic weight banks.

PubMed

Tait, Alexander N; de Lima, Thomas Ferreira; Zhou, Ellen; Wu, Allie X; Nahmias, Mitchell A; Shastri, Bhavin J; Prucnal, Paul R

2017-08-07

Photonic systems for high-performance information processing have attracted renewed interest. Neuromorphic silicon photonics has the potential to integrate processing functions that vastly exceed the capabilities of electronics. We report first observations of a recurrent silicon photonic neural network, in which connections are configured by microring weight banks. A mathematical isomorphism between the silicon photonic circuit and a continuous neural network model is demonstrated through dynamical bifurcation analysis. Exploiting this isomorphism, a simulated 24-node silicon photonic neural network is programmed using "neural compiler" to solve a differential system emulation task. A 294-fold acceleration against a conventional benchmark is predicted. We also propose and derive power consumption analysis for modulator-class neurons that, as opposed to laser-class neurons, are compatible with silicon photonic platforms. At increased scale, Neuromorphic silicon photonics could access new regimes of ultrafast information processing for radio, control, and scientific computing.

The hierarchical brain network for face recognition.

PubMed

Zhen, Zonglei; Fang, Huizhen; Liu, Jia

2013-01-01

Numerous functional magnetic resonance imaging (fMRI) studies have identified multiple cortical regions that are involved in face processing in the human brain. However, few studies have characterized the face-processing network as a functioning whole. In this study, we used fMRI to identify face-selective regions in the entire brain and then explore the hierarchical structure of the face-processing network by analyzing functional connectivity among these regions. We identified twenty-five regions mainly in the occipital, temporal and frontal cortex that showed a reliable response selective to faces (versus objects) across participants and across scan sessions. Furthermore, these regions were clustered into three relatively independent sub-networks in a face-recognition task on the basis of the strength of functional connectivity among them. The functionality of the sub-networks likely corresponds to the recognition of individual identity, retrieval of semantic knowledge and representation of emotional information. Interestingly, when the task was switched to object recognition from face recognition, the functional connectivity between the inferior occipital gyrus and the rest of the face-selective regions were significantly reduced, suggesting that this region may serve as an entry node in the face-processing network. In sum, our study provides empirical evidence for cognitive and neural models of face recognition and helps elucidate the neural mechanisms underlying face recognition at the network level.

Neural Predictors of Visuomotor Adaptation Rate and Multi-Day Savings

NASA Technical Reports Server (NTRS)

Cassady, Kaitlin; Ruitenberg, Marit; Koppelmans, Vincent; Reuter-Lorenz, Patricia; De Dios, Yiri; Gadd, Nichole; Wood, Scott; Riascos Castenada, Roy; Kofman, Igor; Bloomberg, Jacob;

Neural networks supporting autobiographical memory retrieval in post-traumatic stress disorder

PubMed Central

Jacques, Peggy L.; Kragel, Philip A.; Rubin, David C.

2013-01-01

Post-traumatic stress disorder (PTSD) affects the functional recruitment and connectivity between neural regions during autobiographical memory (AM) retrieval that overlap with default and control networks. Whether such univariate changes relate to potential differences in the contribution of large-scale neural networks supporting cognition in PTSD is unknown. In the current functional MRI (fMRI) study we employ independent component analysis to examine the influence the engagement of neural networks during the recall of personal memories in PTSD (15 participants) compared to non-trauma exposed, healthy controls (14 participants). We found that the PTSD group recruited similar neural networks when compared to controls during AM recall, including default network subsystems and control networks, but there were group differences in the spatial and temporal characteristics of these networks. First, there were spatial differences in the contribution of the anterior and posterior midline across the networks, and with the amygdala in particular for the medial temporal subsystem of the default network. Second, there were temporal differences in the relationship of the medial prefrontal subsystem of the default network, with less temporal coupling of this network during AM retrieval in PTSD relative to controls. These findings suggest that spatial and temporal characteristics of the default and control networks potentially differ in PTSD versus healthy controls, and contribute to altered recall of personal memory. PMID:23483523

Distributed synaptic weights in a LIF neural network and learning rules

NASA Astrophysics Data System (ADS)

Perthame, Benoît; Salort, Delphine; Wainrib, Gilles

2017-09-01

Leaky integrate-and-fire (LIF) models are mean-field limits, with a large number of neurons, used to describe neural networks. We consider inhomogeneous networks structured by a connectivity parameter (strengths of the synaptic weights) with the effect of processing the input current with different intensities. We first study the properties of the network activity depending on the distribution of synaptic weights and in particular its discrimination capacity. Then, we consider simple learning rules and determine the synaptic weight distribution it generates. We outline the role of noise as a selection principle and the capacity to memorize a learned signal.

Decreasing-Rate Pruning Optimizes the Construction of Efficient and Robust Distributed Networks.

PubMed

Navlakha, Saket; Barth, Alison L; Bar-Joseph, Ziv

2015-07-01

Robust, efficient, and low-cost networks are advantageous in both biological and engineered systems. During neural network development in the brain, synapses are massively over-produced and then pruned-back over time. This strategy is not commonly used when designing engineered networks, since adding connections that will soon be removed is considered wasteful. Here, we show that for large distributed routing networks, network function is markedly enhanced by hyper-connectivity followed by aggressive pruning and that the global rate of pruning, a developmental parameter not previously studied by experimentalists, plays a critical role in optimizing network structure. We first used high-throughput image analysis techniques to quantify the rate of pruning in the mammalian neocortex across a broad developmental time window and found that the rate is decreasing over time. Based on these results, we analyzed a model of computational routing networks and show using both theoretical analysis and simulations that decreasing rates lead to more robust and efficient networks compared to other rates. We also present an application of this strategy to improve the distributed design of airline networks. Thus, inspiration from neural network formation suggests effective ways to design distributed networks across several domains.

Decreasing-Rate Pruning Optimizes the Construction of Efficient and Robust Distributed Networks

PubMed Central

Navlakha, Saket; Barth, Alison L.; Bar-Joseph, Ziv

2015-01-01

Robust, efficient, and low-cost networks are advantageous in both biological and engineered systems. During neural network development in the brain, synapses are massively over-produced and then pruned-back over time. This strategy is not commonly used when designing engineered networks, since adding connections that will soon be removed is considered wasteful. Here, we show that for large distributed routing networks, network function is markedly enhanced by hyper-connectivity followed by aggressive pruning and that the global rate of pruning, a developmental parameter not previously studied by experimentalists, plays a critical role in optimizing network structure. We first used high-throughput image analysis techniques to quantify the rate of pruning in the mammalian neocortex across a broad developmental time window and found that the rate is decreasing over time. Based on these results, we analyzed a model of computational routing networks and show using both theoretical analysis and simulations that decreasing rates lead to more robust and efficient networks compared to other rates. We also present an application of this strategy to improve the distributed design of airline networks. Thus, inspiration from neural network formation suggests effective ways to design distributed networks across several domains. PMID:26217933

The Influence of Mexican Hat Recurrent Connectivity on Noise Correlations and Stimulus Encoding

PubMed Central

Meyer, Robert; Ladenbauer, Josef; Obermayer, Klaus

2017-01-01

Noise correlations are a common feature of neural responses and have been observed in many cortical areas across different species. These correlations can influence information processing by enhancing or diminishing the quality of the neural code, but the origin of these correlations is still a matter of controversy. In this computational study we explore the hypothesis that noise correlations are the result of local recurrent excitatory and inhibitory connections. We simulated two-dimensional networks of adaptive spiking neurons with local connection patterns following Gaussian kernels. Noise correlations decay with distance between neurons but are only observed if the range of excitatory connections is smaller than the range of inhibitory connections (“Mexican hat” connectivity) and if the connection strengths are sufficiently strong. These correlations arise from a moving blob-like structure of evoked activity, which is absent if inhibitory interactions have a smaller range (“inverse Mexican hat” connectivity). Spatially structured external inputs fixate these blobs to certain locations and thus effectively reduce noise correlations. We further investigated the influence of these network configurations on stimulus encoding. On the one hand, the observed correlations diminish information about a stimulus encoded by a network. On the other hand, correlated activity allows for more precise encoding of stimulus information if the decoder has only access to a limited amount of neurons. PMID:28539881

External modulation of the sustained attention network in traumatic brain injury.

PubMed

Richard, Nadine M; O'Connor, Charlene; Dey, Ayan; Robertson, Ian H; Levine, Brian

2018-05-07

Traumatic brain injury (TBI) is associated with impairments in processing speed as well as higher-level cognitive functions that depend on distributed neural networks, such as regulating and sustaining attention. Although exogenous alerting cues have been shown to support patients in sustaining attentive, goal-directed behavior, the neural correlates of this rehabilitative effect are unclear. The purpose of this study was to explore the effects of moderate to severe TBI on activity and functional connectivity in the well-documented right-lateralized frontal-subcortical-parietal sustained attention network, and to assess the effects of alerting cues. Using multivariate analysis of fMRI data, TBI patients and matched neurologically healthy (NH) comparison participants were scanned as they performed the Sustained Attention to Response Task (SART) in 60-s blocks, with or without exogenous cueing through brief auditory alerting tones. Results documented inefficient voluntary control of attention in the TBI patients, with reduced functional connectivity in the sustained attention network relative to NH participants. When alerting cues were present during the SART, however, functional connectivity increased and became comparable to activity patterns seen in the NH group. These findings provide novel evidence of a neural mechanism for the facilitatory effects of alerting cues on goal-directed behavior in patients with damaged attentional brain systems, and support their use in cognitive rehabilitation. (PsycINFO Database Record (c) 2018 APA, all rights reserved).

Empirical modeling for intelligent, real-time manufacture control

NASA Technical Reports Server (NTRS)

Xu, Xiaoshu

1994-01-01

Artificial neural systems (ANS), also known as neural networks, are an attempt to develop computer systems that emulate the neural reasoning behavior of biological neural systems (e.g. the human brain). As such, they are loosely based on biological neural networks. The ANS consists of a series of nodes (neurons) and weighted connections (axons) that, when presented with a specific input pattern, can associate specific output patterns. It is essentially a highly complex, nonlinear, mathematical relationship or transform. These constructs have two significant properties that have proven useful to the authors in signal processing and process modeling: noise tolerance and complex pattern recognition. Specifically, the authors have developed a new network learning algorithm that has resulted in the successful application of ANS's to high speed signal processing and to developing models of highly complex processes. Two of the applications, the Weld Bead Geometry Control System and the Welding Penetration Monitoring System, are discussed in the body of this paper.

Centralized and decentralized global outer-synchronization of asymmetric recurrent time-varying neural network by data-sampling.

PubMed

Lu, Wenlian; Zheng, Ren; Chen, Tianping

2016-03-01

In this paper, we discuss outer-synchronization of the asymmetrically connected recurrent time-varying neural networks. By using both centralized and decentralized discretization data sampling principles, we derive several sufficient conditions based on three vector norms to guarantee that the difference of any two trajectories starting from different initial values of the neural network converges to zero. The lower bounds of the common time intervals between data samples in centralized and decentralized principles are proved to be positive, which guarantees exclusion of Zeno behavior. A numerical example is provided to illustrate the efficiency of the theoretical results. Copyright © 2015 Elsevier Ltd. All rights reserved.

A class of convergent neural network dynamics

NASA Astrophysics Data System (ADS)

Fiedler, Bernold; Gedeon, Tomáš

1998-01-01

We consider a class of systems of differential equations in Rn which exhibits convergent dynamics. We find a Lyapunov function and show that every bounded trajectory converges to the set of equilibria. Our result generalizes the results of Cohen and Grossberg (1983) for convergent neural networks. It replaces the symmetry assumption on the matrix of weights by the assumption on the structure of the connections in the neural network. We prove the convergence result also for a large class of Lotka-Volterra systems. These are naturally defined on the closed positive orthant. We show that there are no heteroclinic cycles on the boundary of the positive orthant for the systems in this class.

Geometry correction Algorithm for UAV Remote Sensing Image Based on Improved Neural Network

NASA Astrophysics Data System (ADS)

Liu, Ruian; Liu, Nan; Zeng, Beibei; Chen, Tingting; Yin, Ninghao

2018-03-01

Aiming at the disadvantage of current geometry correction algorithm for UAV remote sensing image, a new algorithm is proposed. Adaptive genetic algorithm (AGA) and RBF neural network are introduced into this algorithm. And combined with the geometry correction principle for UAV remote sensing image, the algorithm and solving steps of AGA-RBF are presented in order to realize geometry correction for UAV remote sensing. The correction accuracy and operational efficiency is improved through optimizing the structure and connection weight of RBF neural network separately with AGA and LMS algorithm. Finally, experiments show that AGA-RBF algorithm has the advantages of high correction accuracy, high running rate and strong generalization ability.

Shortcomings with Tree-Structured Edge Encodings for Neural Networks

NASA Technical Reports Server (NTRS)

Hornby, Gregory S.

2004-01-01

In evolutionary algorithms a common method for encoding neural networks is to use a tree structured assembly procedure for constructing them. Since node operators have difficulties in specifying edge weights and these operators are execution-order dependent, an alternative is to use edge operators. Here we identify three problems with edge operators: in the initialization phase most randomly created genotypes produce an incorrect number of inputs and outputs; variation operators can easily change the number of input/output (I/O) units; and units have a connectivity bias based on their order of creation. Instead of creating I/O nodes as part of the construction process we propose using parameterized operators to connect to preexisting I/O units. Results from experiments show that these parameterized operators greatly improve the probability of creating and maintaining networks with the correct number of I/O units, remove the connectivity bias with I/O units and produce better controllers for a goal-scoring task.

The neural circuits for arithmetic principles.

PubMed

Liu, Jie; Zhang, Han; Chen, Chuansheng; Chen, Hui; Cui, Jiaxin; Zhou, Xinlin

2017-02-15

Arithmetic principles are the regularities underlying arithmetic computation. Little is known about how the brain supports the processing of arithmetic principles. The current fMRI study examined neural activation and functional connectivity during the processing of verbalized arithmetic principles, as compared to numerical computation and general language processing. As expected, arithmetic principles elicited stronger activation in bilateral horizontal intraparietal sulcus and right supramarginal gyrus than did language processing, and stronger activation in left middle temporal lobe and left orbital part of inferior frontal gyrus than did computation. In contrast, computation elicited greater activation in bilateral horizontal intraparietal sulcus (extending to posterior superior parietal lobule) than did either arithmetic principles or language processing. Functional connectivity analysis with the psychophysiological interaction approach (PPI) showed that left temporal-parietal (MTG-HIPS) connectivity was stronger during the processing of arithmetic principle and language than during computation, whereas parietal-occipital connectivities were stronger during computation than during the processing of arithmetic principles and language. Additionally, the left fronto-parietal (orbital IFG-HIPS) connectivity was stronger during the processing of arithmetic principles than during computation. The results suggest that verbalized arithmetic principles engage a neural network that overlaps but is distinct from the networks for computation and language processing. Copyright © 2016 Elsevier Inc. All rights reserved.

Distributed computing methodology for training neural networks in an image-guided diagnostic application.

PubMed

Plagianakos, V P; Magoulas, G D; Vrahatis, M N

2006-03-01

Distributed computing is a process through which a set of computers connected by a network is used collectively to solve a single problem. In this paper, we propose a distributed computing methodology for training neural networks for the detection of lesions in colonoscopy. Our approach is based on partitioning the training set across multiple processors using a parallel virtual machine. In this way, interconnected computers of varied architectures can be used for the distributed evaluation of the error function and gradient values, and, thus, training neural networks utilizing various learning methods. The proposed methodology has large granularity and low synchronization, and has been implemented and tested. Our results indicate that the parallel virtual machine implementation of the training algorithms developed leads to considerable speedup, especially when large network architectures and training sets are used.

Causal relationship between effective connectivity within the default mode network and mind-wandering regulation and facilitation.

PubMed

Kajimura, Shogo; Kochiyama, Takanori; Nakai, Ryusuke; Abe, Nobuhito; Nomura, Michio

2016-06-01

Transcranial direct current stimulation (tDCS) can modulate mind wandering, which is a shift in the contents of thought away from an ongoing task and/or from events in the external environment to self-generated thoughts and feelings. Although modulation of the mind-wandering propensity is thought to be associated with neural alterations of the lateral prefrontal cortex (LPFC) and regions in the default mode network (DMN), the precise neural mechanisms remain unknown. Using functional magnetic resonance imaging (fMRI), we investigated the causal relationships among tDCS (one electrode placed over the right IPL, which is a core region of the DMN, and another placed over the left LPFC), stimulation-induced directed connection alterations within the DMN, and modulation of the mind-wandering propensity. At the behavioral level, anodal tDCS on the right IPL (with cathodal tDCS on the left LPFC) reduced mind wandering compared to the reversed stimulation. At the neural level, the anodal tDCS on the right IPL decreased the afferent connections of the posterior cingulate cortex (PCC) from the right IPL and the medial prefrontal cortex (mPFC). Furthermore, mediation analysis revealed that the changes in the connections from the right IPL and mPFC correlated with the facilitation and inhibition of mind wandering, respectively. These effects are the result of the heterogeneous function of effective connectivity: the connection from the right IPL to the PCC inhibits mind wandering, whereas the connection from the mPFC to the PCC facilitates mind wandering. The present study is the first to demonstrate the neural mechanisms underlying tDCS modulation of mind-wandering propensity. Copyright © 2016 Elsevier Inc. All rights reserved.

Neural network based feed-forward high density associative memory

NASA Technical Reports Server (NTRS)

Daud, T.; Moopenn, A.; Lamb, J. L.; Ramesham, R.; Thakoor, A. P.

1987-01-01

A novel thin film approach to neural-network-based high-density associative memory is described. The information is stored locally in a memory matrix of passive, nonvolatile, binary connection elements with a potential to achieve a storage density of 10 to the 9th bits/sq cm. Microswitches based on memory switching in thin film hydrogenated amorphous silicon, and alternatively in manganese oxide, have been used as programmable read-only memory elements. Low-energy switching has been ascertained in both these materials. Fabrication and testing of memory matrix is described. High-speed associative recall approaching 10 to the 7th bits/sec and high storage capacity in such a connection matrix memory system is also described.

An Interactive Simulation Program for Exploring Computational Models of Auto-Associative Memory.

PubMed

Fink, Christian G

2017-01-01

While neuroscience students typically learn about activity-dependent plasticity early in their education, they often struggle to conceptually connect modification at the synaptic scale with network-level neuronal dynamics, not to mention with their own everyday experience of recalling a memory. We have developed an interactive simulation program (based on the Hopfield model of auto-associative memory) that enables the user to visualize the connections generated by any pattern of neural activity, as well as to simulate the network dynamics resulting from such connectivity. An accompanying set of student exercises introduces the concepts of pattern completion, pattern separation, and sparse versus distributed neural representations. Results from a conceptual assessment administered before and after students worked through these exercises indicate that the simulation program is a useful pedagogical tool for illustrating fundamental concepts of computational models of memory.

Neural Networks For Demodulation Of Phase-Modulated Signals

NASA Technical Reports Server (NTRS)

Altes, Richard A.

1995-01-01

Hopfield neural networks proposed for demodulating quadrature phase-shift-keyed (QPSK) signals carrying digital information. Networks solve nonlinear integral equations prior demodulation circuits cannot solve. Consists of set of N operational amplifiers connected in parallel, with weighted feedback from output terminal of each amplifier to input terminals of other amplifiers. Used to solve signal processing problems. Implemented as analog very-large-scale integrated circuit that achieves rapid convergence. Alternatively, implemented as digital simulation of such circuit. Also used to improve phase estimation performance over that of phase-locked loop.

Memory replay in balanced recurrent networks

PubMed Central

Chenkov, Nikolay; Sprekeler, Henning; Kempter, Richard

2017-01-01

Complex patterns of neural activity appear during up-states in the neocortex and sharp waves in the hippocampus, including sequences that resemble those during prior behavioral experience. The mechanisms underlying this replay are not well understood. How can small synaptic footprints engraved by experience control large-scale network activity during memory retrieval and consolidation? We hypothesize that sparse and weak synaptic connectivity between Hebbian assemblies are boosted by pre-existing recurrent connectivity within them. To investigate this idea, we connect sequences of assemblies in randomly connected spiking neuronal networks with a balance of excitation and inhibition. Simulations and analytical calculations show that recurrent connections within assemblies allow for a fast amplification of signals that indeed reduces the required number of inter-assembly connections. Replay can be evoked by small sensory-like cues or emerge spontaneously by activity fluctuations. Global—potentially neuromodulatory—alterations of neuronal excitability can switch between network states that favor retrieval and consolidation. PMID:28135266

Dynamical synapses enhance neural information processing: gracefulness, accuracy, and mobility.

PubMed

Fung, C C Alan; Wong, K Y Michael; Wang, He; Wu, Si

2012-05-01

Experimental data have revealed that neuronal connection efficacy exhibits two forms of short-term plasticity: short-term depression (STD) and short-term facilitation (STF). They have time constants residing between fast neural signaling and rapid learning and may serve as substrates for neural systems manipulating temporal information on relevant timescales. This study investigates the impact of STD and STF on the dynamics of continuous attractor neural networks and their potential roles in neural information processing. We find that STD endows the network with slow-decaying plateau behaviors: the network that is initially being stimulated to an active state decays to a silent state very slowly on the timescale of STD rather than on that of neuralsignaling. This provides a mechanism for neural systems to hold sensory memory easily and shut off persistent activities gracefully. With STF, we find that the network can hold a memory trace of external inputs in the facilitated neuronal interactions, which provides a way to stabilize the network response to noisy inputs, leading to improved accuracy in population decoding. Furthermore, we find that STD increases the mobility of the network states. The increased mobility enhances the tracking performance of the network in response to time-varying stimuli, leading to anticipative neural responses. In general, we find that STD and STP tend to have opposite effects on network dynamics and complementary computational advantages, suggesting that the brain may employ a strategy of weighting them differentially depending on the computational purpose.

Genetic learning in rule-based and neural systems

NASA Technical Reports Server (NTRS)

Smith, Robert E.

1993-01-01

The design of neural networks and fuzzy systems can involve complex, nonlinear, and ill-conditioned optimization problems. Often, traditional optimization schemes are inadequate or inapplicable for such tasks. Genetic Algorithms (GA's) are a class of optimization procedures whose mechanics are based on those of natural genetics. Mathematical arguments show how GAs bring substantial computational leverage to search problems, without requiring the mathematical characteristics often necessary for traditional optimization schemes (e.g., modality, continuity, availability of derivative information, etc.). GA's have proven effective in a variety of search tasks that arise in neural networks and fuzzy systems. This presentation begins by introducing the mechanism and theoretical underpinnings of GA's. GA's are then related to a class of rule-based machine learning systems called learning classifier systems (LCS's). An LCS implements a low-level production-system that uses a GA as its primary rule discovery mechanism. This presentation illustrates how, despite its rule-based framework, an LCS can be thought of as a competitive neural network. Neural network simulator code for an LCS is presented. In this context, the GA is doing more than optimizing and objective function. It is searching for an ecology of hidden nodes with limited connectivity. The GA attempts to evolve this ecology such that effective neural network performance results. The GA is particularly well adapted to this task, given its naturally-inspired basis. The LCS/neural network analogy extends itself to other, more traditional neural networks. Conclusions to the presentation discuss the implications of using GA's in ecological search problems that arise in neural and fuzzy systems.

Neural network alterations across eating disorders: a narrative review of fMRI studies.

PubMed

Steward, Trevor; Menchón, José M; Jiménez-Murcia, Susana; Soriano-Mas, Carles; Fernández-Aranda, Fernando

2017-10-17

Functional magnetic resonance imaging (fMRI) has provided insight on how neural abnormalities are related to the symptomatology of the eating disorders (EDs): anorexia nervosa (AN), bulimia nervosa (BN), and binge eating disorder (BED). More specifically, an increasingly growing number of brain imaging studies has shed light on how functionally connected brain networks contribute not only to disturbed eating behavior, but also to transdiagnostic alterations in body/interoceptive perception, reward processing and executive functions. This narrative review aims to summarize recent advances in fMRI studies of patients with EDs by highlighting studies investigating network alterations that are shared across EDs. Findings on reward processing in both AN and BN patients point to the presence of altered sensitivity to salient food stimuli in striatal regions and to the possibility of hypothalamic inputs being overridden by top-down cognitive control regions. Additionally, innovative new lines of research suggest that increased activations in fronto-striatal circuits are strongly associated with the maintenance of restrictive eating habits in AN patients. Although significantly fewer studies have been carried out in patients with BN and BED, aberrant neural responses to both food cues and anticipated food receipt appear to occur in these populations. These altered responses, coupled with diminished recruitment of prefrontal cognitive control circuitry, are believed to contribute to the binge eating of palatable foods. Results from functional network connectivity studies are diverse, but findings tend to converge on indicating disrupted resting-state connectivity in executive networks, the default-mode network and the salience network across EDs. Copyright© Bentham Science Publishers; For any queries, please email at epub@benthamscience.org.

DCS-Neural-Network Program for Aircraft Control and Testing

NASA Technical Reports Server (NTRS)

Jorgensen, Charles C.

2006-01-01

A computer program implements a dynamic-cell-structure (DCS) artificial neural network that can perform such tasks as learning selected aerodynamic characteristics of an airplane from wind-tunnel test data and computing real-time stability and control derivatives of the airplane for use in feedback linearized control. A DCS neural network is one of several types of neural networks that can incorporate additional nodes in order to rapidly learn increasingly complex relationships between inputs and outputs. In the DCS neural network implemented by the present program, the insertion of nodes is based on accumulated error. A competitive Hebbian learning rule (a supervised-learning rule in which connection weights are adjusted to minimize differences between actual and desired outputs for training examples) is used. A Kohonen-style learning rule (derived from a relatively simple training algorithm, implements a Delaunay triangulation layout of neurons) is used to adjust node positions during training. Neighborhood topology determines which nodes are used to estimate new values. The network learns, starting with two nodes, and adds new nodes sequentially in locations chosen to maximize reductions in global error. At any given time during learning, the error becomes homogeneously distributed over all nodes.

Resting-state brain networks in patients with Parkinson's disease and impulse control disorders.

PubMed

Tessitore, Alessandro; Santangelo, Gabriella; De Micco, Rosa; Giordano, Alfonso; Raimo, Simona; Amboni, Marianna; Esposito, Fabrizio; Barone, Paolo; Tedeschi, Gioacchino; Vitale, Carmine

2017-09-01

To investigate intrinsic neural networks connectivity changes in Parkinson's disease (PD) patients with and without impulse control disorders (ICD). Fifteen patients with PD with ICD (ICD+), 15 patients with PD without ICD (ICD-) and 24 age and sex-matched healthy controls (HC) were enrolled in the study. To identify patients with and without ICD and/or punding, we used the Minnesota Impulsive Disorders Interview (MIDI) and a clinical interview based on diagnostic criteria for each symptom. All patients underwent a detailed neuropsychological evaluation. Whole brain structural and functional imaging was performed on a 3T GE MR scanner. Statistical analysis of functional data was completed using BrainVoyager QX software. Voxel-based morphometry (VBM) was used to test whether between-group differences in resting-state connectivity were related to structural abnormalities. The presence of ICD symptoms was associated with an increased connectivity within the salience and default-mode networks, as well as with a decreased connectivity within the central executive network (p < .05 corrected). ICD severity was correlated with both salience and default mode networks connectivity changes only in the ICD+ group. VBM analysis did not reveal any statistically significant differences in local grey matter volume between ICD+ and ICD- patients and between all patients and HC (p < .05. FWE). The presence of a disrupted connectivity within the three core neurocognitive networks may be considered as a potential neural correlate of ICD presence in patients with PD. Our findings provide additional insights into the mechanisms underlying ICD in PD, confirming the crucial role of an abnormal prefrontal-limbic-striatal homeostasis in their development. Copyright © 2017 Elsevier Ltd. All rights reserved.

SPIDER OR NO SPIDER? NEURAL CORRELATES OF SUSTAINED AND PHASIC FEAR IN SPIDER PHOBIA.

PubMed

Münsterkötter, Anna Luisa; Notzon, Swantje; Redlich, Ronny; Grotegerd, Dominik; Dohm, Katharina; Arolt, Volker; Kugel, Harald; Zwanzger, Peter; Dannlowski, Udo

2015-09-01

Processes of phasic fear responses to threatening stimuli are thought to be distinct from sustained, anticipatory anxiety toward an unpredicted, potential threat. There is evidence for dissociable neural correlates of phasic fear and sustained anxiety. Whereas increased amygdala activity has been associated with phasic fear, sustained anxiety has been linked with activation of the bed nucleus of stria terminalis (BNST), anterior cingulate cortex (ACC), and the insula. So far, only a few studies have focused on the dissociation of neural processes related to both phasic and sustained fear in specific phobia. We suggested that first, conditions of phasic and sustained fear would involve different neural networks and, second, that overall neural activity would be enhanced in a sample of phobic compared to nonphobic participants. Pictures of spiders and neutral stimuli under conditions of either predicted (phasic) or unpredicted (sustained) fear were presented to 28 subjects with spider phobia and 28 nonphobic control subjects during functional magnetic resonance imaging (fMRI) scanning. Phobic patients revealed significantly higher amygdala activation than controls under conditions of phasic fear. Sustained fear processing was significantly related to activation in the insula and ACC, and phobic patients showed a stronger activation than controls of the BNST and the right ACC under conditions of sustained fear. Functional connectivity analysis revealed enhanced connectivity of the BNST and the amygdala in phobic subjects. Our findings support the idea of distinct neural correlates of phasic and sustained fear processes. Increased neural activity and functional connectivity in these networks might be crucial for the development and maintenance of anxiety disorders. © 2015 Wiley Periodicals, Inc.

Cascade process modeling with mechanism-based hierarchical neural networks.

PubMed

Cong, Qiumei; Yu, Wen; Chai, Tianyou

2010-02-01

Cascade process, such as wastewater treatment plant, includes many nonlinear sub-systems and many variables. When the number of sub-systems is big, the input-output relation in the first block and the last block cannot represent the whole process. In this paper we use two techniques to overcome the above problem. Firstly we propose a new neural model: hierarchical neural networks to identify the cascade process; then we use serial structural mechanism model based on the physical equations to connect with neural model. A stable learning algorithm and theoretical analysis are given. Finally, this method is used to model a wastewater treatment plant. Real operational data of wastewater treatment plant is applied to illustrate the modeling approach.

Generation of optimal artificial neural networks using a pattern search algorithm: application to approximation of chemical systems.

PubMed

Ihme, Matthias; Marsden, Alison L; Pitsch, Heinz

2008-02-01

A pattern search optimization method is applied to the generation of optimal artificial neural networks (ANNs). Optimization is performed using a mixed variable extension to the generalized pattern search method. This method offers the advantage that categorical variables, such as neural transfer functions and nodal connectivities, can be used as parameters in optimization. When used together with a surrogate, the resulting algorithm is highly efficient for expensive objective functions. Results demonstrate the effectiveness of this method in optimizing an ANN for the number of neurons, the type of transfer function, and the connectivity among neurons. The optimization method is applied to a chemistry approximation of practical relevance. In this application, temperature and a chemical source term are approximated as functions of two independent parameters using optimal ANNs. Comparison of the performance of optimal ANNs with conventional tabulation methods demonstrates equivalent accuracy by considerable savings in memory storage. The architecture of the optimal ANN for the approximation of the chemical source term consists of a fully connected feedforward network having four nonlinear hidden layers and 117 synaptic weights. An equivalent representation of the chemical source term using tabulation techniques would require a 500 x 500 grid point discretization of the parameter space.

Dynamic Changes in Amygdala Psychophysiological Connectivity Reveal Distinct Neural Networks for Facial Expressions of Basic Emotions.

PubMed

Diano, Matteo; Tamietto, Marco; Celeghin, Alessia; Weiskrantz, Lawrence; Tatu, Mona-Karina; Bagnis, Arianna; Duca, Sergio; Geminiani, Giuliano; Cauda, Franco; Costa, Tommaso

2017-03-27

The quest to characterize the neural signature distinctive of different basic emotions has recently come under renewed scrutiny. Here we investigated whether facial expressions of different basic emotions modulate the functional connectivity of the amygdala with the rest of the brain. To this end, we presented seventeen healthy participants (8 females) with facial expressions of anger, disgust, fear, happiness, sadness and emotional neutrality and analyzed amygdala's psychophysiological interaction (PPI). In fact, PPI can reveal how inter-regional amygdala communications change dynamically depending on perception of various emotional expressions to recruit different brain networks, compared to the functional interactions it entertains during perception of neutral expressions. We found that for each emotion the amygdala recruited a distinctive and spatially distributed set of structures to interact with. These changes in amygdala connectional patters characterize the dynamic signature prototypical of individual emotion processing, and seemingly represent a neural mechanism that serves to implement the distinctive influence that each emotion exerts on perceptual, cognitive, and motor responses. Besides these differences, all emotions enhanced amygdala functional integration with premotor cortices compared to neutral faces. The present findings thus concur to reconceptualise the structure-function relation between brain-emotion from the traditional one-to-one mapping toward a network-based and dynamic perspective.

The neural correlates of risk propensity in males and females using resting-state fMRI

PubMed Central

Zhou, Yuan; Li, Shu; Dunn, John; Li, Huandong; Qin, Wen; Zhu, Maohu; Rao, Li-Lin; Song, Ming; Yu, Chunshui; Jiang, Tianzi

2014-01-01

Men are more risk prone than women, but the underlying basis remains unclear. To investigate this question, we developed a trait-like measure of risk propensity which we correlated with resting-state functional connectivity to identify sex differences. Specifically, we used short- and long-range functional connectivity densities to identify associated brain regions and examined their functional connectivities in resting-state functional magnetic resonance imaging (fMRI) data collected from a large sample of healthy young volunteers. We found that men had a higher level of general risk propensity (GRP) than women. At the neural level, although they shared a common neural correlate of GRP in a network centered at the right inferior frontal gyrus, men and women differed in a network centered at the right secondary somatosensory cortex, which included the bilateral dorsal anterior/middle insular cortices and the dorsal anterior cingulate cortex. In addition, men and women differed in a local network centered at the left inferior orbitofrontal cortex. Most of the regions identified by this resting-state fMRI study have been previously implicated in risk processing when people make risky decisions. This study provides a new perspective on the brain-behavioral relationships in risky decision making and contributes to our understanding of sex differences in risk propensity. PMID:24478649

Neural networks underlying trait aggression depend on MAOA gene alleles.

PubMed

Klasen, Martin; Wolf, Dhana; Eisner, Patrick D; Habel, Ute; Repple, Jonathan; Vernaleken, Ingo; Schlüter, Thorben; Eggermann, Thomas; Zerres, Klaus; Zepf, Florian D; Mathiak, Klaus

2018-03-01

Low expressing alleles of the MAOA gene (MAOA-L) have been associated with an increased risk for developing an aggressive personality. This suggests an MAOA-L-specific neurobiological vulnerability associated with trait aggression. The neural networks underlying this vulnerability are unknown. The present study investigated genotype-specific associations between resting state brain networks and trait aggression (Buss-Perry Aggression Questionnaire) in 82 healthy Caucasian males. Genotype influences on aggression-related networks were studied for intrinsic and seed-based brain connectivity. Intrinsic connectivity was higher in the ventromedial prefrontal cortex (VMPFC) of MAOA-L compared to high expressing allele (MAOA-H) carriers. Seed-based connectivity analyses revealed genotype differences in the functional involvement of this region. MAOA genotype modulated the relationship between trait aggression and VMPFC connectivity with supramarginal gyrus (SMG) and areas of the default mode network (DMN). Separate analyses for the two groups were performed to better understand how the genotype modulated the relationship between aggression and brain networks. They revealed a positive correlation between VMPFC connectivity and aggression in right angular gyrus (AG) and a negative correlation in right SMG in the MAOA-L group. No such effect emerged in the MAOA-H carriers. The results indicate a particular relevance of VMPFC for aggression in MAOA-L carriers; in specific, a detachment from the DMN along with a strengthened coupling to the AG seems to go along with lower trait aggression. MAOA-L carriers may thus depend on a synchronization of emotion regulation systems (VMPFC) with core areas of empathy (SMG) to prevent aggression.

Pruning Neural Networks with Distribution Estimation Algorithms

DOE Office of Scientific and Technical Information (OSTI.GOV)

Cantu-Paz, E

2003-01-15

This paper describes the application of four evolutionary algorithms to the pruning of neural networks used in classification problems. Besides of a simple genetic algorithm (GA), the paper considers three distribution estimation algorithms (DEAs): a compact GA, an extended compact GA, and the Bayesian Optimization Algorithm. The objective is to determine if the DEAs present advantages over the simple GA in terms of accuracy or speed in this problem. The experiments used a feed forward neural network trained with standard back propagation and public-domain and artificial data sets. The pruned networks seemed to have better or equal accuracy than themore » original fully-connected networks. Only in a few cases, pruning resulted in less accurate networks. We found few differences in the accuracy of the networks pruned by the four EAs, but found important differences in the execution time. The results suggest that a simple GA with a small population might be the best algorithm for pruning networks on the data sets we tested.« less

Studying emotion theories through connectivity analysis: Evidence from generalized psychophysiological interactions and graph theory.

PubMed

Huang, Yun-An; Jastorff, Jan; Van den Stock, Jan; Van de Vliet, Laura; Dupont, Patrick; Vandenbulcke, Mathieu

2018-05-15

Psychological construction models of emotion state that emotions are variable concepts constructed by fundamental psychological processes, whereas according to basic emotion theory, emotions cannot be divided into more fundamental units and each basic emotion is represented by a unique and innate neural circuitry. In a previous study, we found evidence for the psychological construction account by showing that several brain regions were commonly activated when perceiving different emotions (i.e. a general emotion network). Moreover, this set of brain regions included areas associated with core affect, conceptualization and executive control, as predicted by psychological construction models. Here we investigate directed functional brain connectivity in the same dataset to address two questions: 1) is there a common pathway within the general emotion network for the perception of different emotions and 2) if so, does this common pathway contain information to distinguish between different emotions? We used generalized psychophysiological interactions and information flow indices to examine the connectivity within the general emotion network. The results revealed a general emotion pathway that connects neural nodes involved in core affect, conceptualization, language and executive control. Perception of different emotions could not be accurately classified based on the connectivity patterns from the nodes of the general emotion pathway. Successful classification was achieved when connections outside the general emotion pathway were included. We propose that the general emotion pathway functions as a common pathway within the general emotion network and is involved in shared basic psychological processes across emotions. However, additional connections within the general emotion network are required to classify different emotions, consistent with a constructionist account. Copyright © 2018 Elsevier Inc. All rights reserved.

Effects of Neuromodulation on Excitatory-Inhibitory Neural Network Dynamics Depend on Network Connectivity Structure

NASA Astrophysics Data System (ADS)

Rich, Scott; Zochowski, Michal; Booth, Victoria

2018-01-01

Acetylcholine (ACh), one of the brain's most potent neuromodulators, can affect intrinsic neuron properties through blockade of an M-type potassium current. The effect of ACh on excitatory and inhibitory cells with this potassium channel modulates their membrane excitability, which in turn affects their tendency to synchronize in networks. Here, we study the resulting changes in dynamics in networks with inter-connected excitatory and inhibitory populations (E-I networks), which are ubiquitous in the brain. Utilizing biophysical models of E-I networks, we analyze how the network connectivity structure in terms of synaptic connectivity alters the influence of ACh on the generation of synchronous excitatory bursting. We investigate networks containing all combinations of excitatory and inhibitory cells with high (Type I properties) or low (Type II properties) modulatory tone. To vary network connectivity structure, we focus on the effects of the strengths of inter-connections between excitatory and inhibitory cells (E-I synapses and I-E synapses), and the strengths of intra-connections among excitatory cells (E-E synapses) and among inhibitory cells (I-I synapses). We show that the presence of ACh may or may not affect the generation of network synchrony depending on the network connectivity. Specifically, strong network inter-connectivity induces synchronous excitatory bursting regardless of the cellular propensity for synchronization, which aligns with predictions of the PING model. However, when a network's intra-connectivity dominates its inter-connectivity, the propensity for synchrony of either inhibitory or excitatory cells can determine the generation of network-wide bursting.

Network analysis of mesoscale optical recordings to assess regional, functional connectivity.

PubMed

Lim, Diana H; LeDue, Jeffrey M; Murphy, Timothy H

2015-10-01

With modern optical imaging methods, it is possible to map structural and functional connectivity. Optical imaging studies that aim to describe large-scale neural connectivity often need to handle large and complex datasets. In order to interpret these datasets, new methods for analyzing structural and functional connectivity are being developed. Recently, network analysis, based on graph theory, has been used to describe and quantify brain connectivity in both experimental and clinical studies. We outline how to apply regional, functional network analysis to mesoscale optical imaging using voltage-sensitive-dye imaging and channelrhodopsin-2 stimulation in a mouse model. We include links to sample datasets and an analysis script. The analyses we employ can be applied to other types of fluorescence wide-field imaging, including genetically encoded calcium indicators, to assess network properties. We discuss the benefits and limitations of using network analysis for interpreting optical imaging data and define network properties that may be used to compare across preparations or other manipulations such as animal models of disease.

A neural substrate for behavioral inhibition in the risk for major depressive disorder.

PubMed

Frost Bellgowan, Julie; Molfese, Peter; Marx, Michael; Thomason, Moriah; Glen, Daniel; Santiago, Jessica; Gotlib, Ian H; Drevets, Wayne C; Hamilton, J Paul

2015-10-01

Behavioral inhibition (BI) is an early developing trait associated with cautiousness and development of clinical depression and anxiety. Little is known about the neural basis of BI and its predictive importance concerning risk for internalizing disorders. We looked at functional connectivity of the default-mode network (DMN) and salience network (SN), given their respective roles in self-relational and threat processing, in the risk for internalizing disorders, with an emphasis on determining the functional significance of these networks for BI. We used functional magnetic resonance imaging to scan, during the resting state, children and adolescents 8 to 17 years of age who were either at high familial risk (HR; n = 16) or low familial risk (LR; n = 18) for developing clinical depression and/or anxiety. Whole-brain DMN and SN functional connectivity were estimated for each participant and compared across groups. We also compared the LR and HR groups on levels of BI and anxiety, and incorporated these data into follow-up neurobehavioral correlation analyses. The HR group, relative to the LR group, showed significantly decreased DMN connectivity with the ventral striatum and bilateral sensorimotor cortices. Within the HR group, trait BI increased as DMN connectivity with the ventral striatum and sensorimotor cortex decreased. The HR and LR groups did not differ with respect to SN connectivity. Our findings show, in the risk for internalizing disorders, a negative functional relation between brain regions supporting self-relational processes and reward prediction. These findings represent a potential neural substrate for behavioral inhibition in the risk for clinical depression and anxiety. Published by Elsevier Inc.

Construction of a pulse-coupled dipole network capable of fear-like and relief-like responses

NASA Astrophysics Data System (ADS)

Lungsi Sharma, B.

2016-07-01

The challenge for neuroscience as an interdisciplinary programme is the integration of ideas among the disciplines to achieve a common goal. This paper deals with the problem of deriving a pulse-coupled neural network that is capable of demonstrating behavioural responses (fear-like and relief-like). Current pulse-coupled neural networks are designed mostly for engineering applications, particularly image processing. The discovered neural network was constructed using the method of minimal anatomies approach. The behavioural response of a level-coded activity-based model was used as a reference. Although the spiking-based model and the activity-based model are of different scales, the use of model-reference principle means that the characteristics that is referenced is its functional properties. It is demonstrated that this strategy of dissection and systematic construction is effective in the functional design of pulse-coupled neural network system with nonlinear signalling. The differential equations for the elastic weights in the reference model are replicated in the pulse-coupled network geometrically. The network reflects a possible solution to the problem of punishment and avoidance. The network developed in this work is a new network topology for pulse-coupled neural networks. Therefore, the model-reference principle is a powerful tool in connecting neuroscience disciplines. The continuity of concepts and phenomena is further maintained by systematic construction using methods like the method of minimal anatomies.

Fitness landscape complexity and the emergence of modularity in neural networks

NASA Astrophysics Data System (ADS)

Lowell, Jessica

Previous research has shown that the shape of the fitness landscape can affect the evolution of modularity. We evolved neural networks to solve different tasks with different fitness landscapes, using NEAT, a popular neuroevolution algorithm that quantifies similarity between genomes in order to divide them into species. We used this speciation mechanism as a means to examine fitness landscape complexity, and to examine connections between fitness landscape complexity and the emergence of modularity.

Design of a neural network simulator on a transputer array

NASA Technical Reports Server (NTRS)

Mcintire, Gary; Villarreal, James; Baffes, Paul; Rua, Monica

1987-01-01

A brief summary of neural networks is presented which concentrates on the design constraints imposed. Major design issues are discussed together with analysis methods and the chosen solutions. Although the system will be capable of running on most transputer architectures, it currently is being implemented on a 40-transputer system connected to a toroidal architecture. Predictions show a performance level equivalent to that of a highly optimized simulator running on the SX-2 supercomputer.

Successful group psychotherapy of depression in adolescents alters fronto-limbic resting-state connectivity.

PubMed

Straub, J; Metzger, C D; Plener, P L; Koelch, M G; Groen, G; Abler, B

2017-02-01

Current resting state imaging findings support suggestions that the neural signature of depression and therefore also its therapy should be conceptualized as a network disorder rather than a dysfunction of specific brain regions. In this study, we compared neural connectivity of adolescent patients with depression (PAT) and matched healthy controls (HC) and analysed pre-to-post changes of seed-based network connectivities in PAT after participation in a cognitive behavioral group psychotherapy (CBT). 38 adolescents (30 female; 19 patients; 13-18 years) underwent an eyes-closed resting-state scan. PAT were scanned before (pre) and after (post) five sessions of CBT. Resting-state functional connectivity was analysed in a seed-based approach for right-sided amygdala and subgenual anterior cingulate cortex (sgACC). Symptom severity was assessed using the Beck Depression Inventory Revision (BDI-II). Prior to group CBT, between groups amygdala and sgACC connectivity with regions of the default mode network was stronger in the patients group relative to controls. Within the PAT group, a similar pattern significantly decreased after successful CBT. Conversely, seed-based connectivity with affective regions and regions processing cognition and salient stimuli was stronger in HC relative to PAT before CBT. Within the PAT group, a similar pattern changed with CBT. Changes in connectivity correlated with the significant pre-to-post symptom improvement, and pre-treatment amygdala connectivity predicted treatment response in depressed adolescents. Sample size and missing long-term follow-up limit the interpretability. Successful group psychotherapy of depression in adolescents involved connectivity changes in resting state networks to that of healthy controls. Copyright © 2016 Elsevier B.V. All rights reserved.

From neural-based object recognition toward microelectronic eyes

NASA Technical Reports Server (NTRS)

Sheu, Bing J.; Bang, Sa Hyun

1994-01-01

Engineering neural network systems are best known for their abilities to adapt to the changing characteristics of the surrounding environment by adjusting system parameter values during the learning process. Rapid advances in analog current-mode design techniques have made possible the implementation of major neural network functions in custom VLSI chips. An electrically programmable analog synapse cell with large dynamic range can be realized in a compact silicon area. New designs of the synapse cells, neurons, and analog processor are presented. A synapse cell based on Gilbert multiplier structure can perform the linear multiplication for back-propagation networks. A double differential-pair synapse cell can perform the Gaussian function for radial-basis network. The synapse cells can be biased in the strong inversion region for high-speed operation or biased in the subthreshold region for low-power operation. The voltage gain of the sigmoid-function neurons is externally adjustable which greatly facilitates the search of optimal solutions in certain networks. Various building blocks can be intelligently connected to form useful industrial applications. Efficient data communication is a key system-level design issue for large-scale networks. We also present analog neural processors based on perceptron architecture and Hopfield network for communication applications. Biologically inspired neural networks have played an important role towards the creation of powerful intelligent machines. Accuracy, limitations, and prospects of analog current-mode design of the biologically inspired vision processing chips and cellular neural network chips are key design issues.

Frequency-specific alterations in functional connectivity in treatment-resistant and -sensitive major depressive disorder.

PubMed

He, Zongling; Cui, Qian; Zheng, Junjie; Duan, Xujun; Pang, Yajing; Gao, Qing; Han, Shaoqiang; Long, Zhiliang; Wang, Yifeng; Li, Jiao; Wang, Xiao; Zhao, Jingping; Chen, Huafu

2016-11-01

Major depressive disorder (MDD) may involve alterations in brain functional connectivity in multiple neural circuits and present large-scale network dysfunction. Patients with treatment-resistant depression (TRD) and treatment-sensitive depression (TSD) show different responses to antidepressants and aberrant brain functions. This study aims to investigate functional connectivity patterns of TRD and TSD at the whole brain resting state. Seventeen patients with TRD, 17 patients with TSD, and 17 healthy controls matched with age, gender, and years of education were recruited in this study. The brain was divided using an automated anatomical labeling atlas into 90 regions of interest, which were used to construct the entire brain functional networks. An analysis method called network-based statistic was used to explore the dysconnected subnetworks of TRD and TSD at different frequency bands. At resting state, TSD and TRD present characteristic patterns of network dysfunction at special frequency bands. The dysconnected subnetwork of TSD mainly lies in the fronto-parietal top-down control network. Moreover, the abnormal neural circuits of TRD are extensive and complex. These circuits not only depend on the abnormal affective network but also involve other networks, including salience network, auditory network, visual network, and language processing cortex. Our findings reflect that the pathological mechanism of TSD may refer to impairment in cognitive control, whereas TRD mainly triggers the dysfunction of emotion processing and affective cognition. This study reveals that differences in brain functional connectivity at resting state reflect distinct pathophysiological mechanisms in TSD and TRD. These findings may be helpful in differentiating two types of MDD and predicting treatment responses. Copyright © 2016 Elsevier Ltd. All rights reserved.

Functional connectivity dynamics during film viewing reveal common networks for different emotional experiences.

PubMed

Raz, Gal; Touroutoglou, Alexandra; Wilson-Mendenhall, Christine; Gilam, Gadi; Lin, Tamar; Gonen, Tal; Jacob, Yael; Atzil, Shir; Admon, Roee; Bleich-Cohen, Maya; Maron-Katz, Adi; Hendler, Talma; Barrett, Lisa Feldman

2016-08-01

Recent theoretical and empirical work has highlighted the role of domain-general, large-scale brain networks in generating emotional experiences. These networks are hypothesized to process aspects of emotional experiences that are not unique to a specific emotional category (e.g., "sadness," "happiness"), but rather that generalize across categories. In this article, we examined the dynamic interactions (i.e., changing cohesiveness) between specific domain-general networks across time while participants experienced various instances of sadness, fear, and anger. We used a novel method for probing the network connectivity dynamics between two salience networks and three amygdala-based networks. We hypothesized, and found, that the functional connectivity between these networks covaried with the intensity of different emotional experiences. Stronger connectivity between the dorsal salience network and the medial amygdala network was associated with more intense ratings of emotional experience across six different instances of the three emotion categories examined. Also, stronger connectivity between the dorsal salience network and the ventrolateral amygdala network was associated with more intense ratings of emotional experience across five out of the six different instances. Our findings demonstrate that a variety of emotional experiences are associated with dynamic interactions of domain-general neural systems.

Neural networks mediating sentence reading in the deaf

PubMed Central

Hirshorn, Elizabeth A.; Dye, Matthew W. G.; Hauser, Peter C.; Supalla, Ted R.; Bavelier, Daphne

2014-01-01

The present work addresses the neural bases of sentence reading in deaf populations. To better understand the relative role of deafness and spoken language knowledge in shaping the neural networks that mediate sentence reading, three populations with different degrees of English knowledge and depth of hearing loss were included—deaf signers, oral deaf and hearing individuals. The three groups were matched for reading comprehension and scanned while reading sentences. A similar neural network of left perisylvian areas was observed, supporting the view of a shared network of areas for reading despite differences in hearing and English knowledge. However, differences were observed, in particular in the auditory cortex, with deaf signers and oral deaf showing greatest bilateral superior temporal gyrus (STG) recruitment as compared to hearing individuals. Importantly, within deaf individuals, the same STG area in the left hemisphere showed greater recruitment as hearing loss increased. To further understand the functional role of such auditory cortex re-organization after deafness, connectivity analyses were performed from the STG regions identified above. Connectivity from the left STG toward areas typically associated with semantic processing (BA45 and thalami) was greater in deaf signers and in oral deaf as compared to hearing. In contrast, connectivity from left STG toward areas identified with speech-based processing was greater in hearing and in oral deaf as compared to deaf signers. These results support the growing literature indicating recruitment of auditory areas after congenital deafness for visually-mediated language functions, and establish that both auditory deprivation and language experience shape its functional reorganization. Implications for differential reliance on semantic vs. phonological pathways during reading in the three groups is discussed. PMID:24959127

Network-Level Structure-Function Relationships in Human Neocortex

PubMed Central

Mišić, Bratislav; Betzel, Richard F.; de Reus, Marcel A.; van den Heuvel, Martijn P.; Berman, Marc G.; McIntosh, Anthony R.; Sporns, Olaf

2016-01-01

The dynamics of spontaneous fluctuations in neural activity are shaped by underlying patterns of anatomical connectivity. While numerous studies have demonstrated edge-wise correspondence between structural and functional connections, much less is known about how large-scale coherent functional network patterns emerge from the topology of structural networks. In the present study, we deploy a multivariate statistical technique, partial least squares, to investigate the association between spatially extended structural networks and functional networks. We find multiple statistically robust patterns, reflecting reliable combinations of structural and functional subnetworks that are optimally associated with one another. Importantly, these patterns generally do not show a one-to-one correspondence between structural and functional edges, but are instead distributed and heterogeneous, with many functional relationships arising from nonoverlapping sets of anatomical connections. We also find that structural connections between high-degree hubs are disproportionately represented, suggesting that these connections are particularly important in establishing coherent functional networks. Altogether, these results demonstrate that the network organization of the cerebral cortex supports the emergence of diverse functional network configurations that often diverge from the underlying anatomical substrate. PMID:27102654

Computational modeling of neural plasticity for self-organization of neural networks.

PubMed

Chrol-Cannon, Joseph; Jin, Yaochu

2014-11-01

Self-organization in biological nervous systems during the lifetime is known to largely occur through a process of plasticity that is dependent upon the spike-timing activity in connected neurons. In the field of computational neuroscience, much effort has been dedicated to building up computational models of neural plasticity to replicate experimental data. Most recently, increasing attention has been paid to understanding the role of neural plasticity in functional and structural neural self-organization, as well as its influence on the learning performance of neural networks for accomplishing machine learning tasks such as classification and regression. Although many ideas and hypothesis have been suggested, the relationship between the structure, dynamics and learning performance of neural networks remains elusive. The purpose of this article is to review the most important computational models for neural plasticity and discuss various ideas about neural plasticity's role. Finally, we suggest a few promising research directions, in particular those along the line that combines findings in computational neuroscience and systems biology, and their synergetic roles in understanding learning, memory and cognition, thereby bridging the gap between computational neuroscience, systems biology and computational intelligence. Copyright © 2014 Elsevier Ireland Ltd. All rights reserved.

Comments on "The multisynapse neural network and its application to fuzzy clustering".

PubMed

Yu, Jian; Hao, Pengwei

2005-05-01

In the above-mentioned paper, Wei and Fahn proposed a neural architecture, the multisynapse neural network, to solve constrained optimization problems including high-order, logarithmic, and sinusoidal forms, etc. As one of its main applications, a fuzzy bidirectional associative clustering network (FBACN) was proposed for fuzzy-partition clustering according to the objective-functional method. The connection between the objective-functional-based fuzzy c-partition algorithms and FBACN is the Lagrange multiplier approach. Unfortunately, the Lagrange multiplier approach was incorrectly applied so that FBACN does not equivalently minimize its corresponding constrained objective-function. Additionally, Wei and Fahn adopted traditional definition of fuzzy c-partition, which is not satisfied by FBACN. Therefore, FBACN can not solve constrained optimization problems, either.

Gas Classification Using Deep Convolutional Neural Networks.

PubMed

Peng, Pai; Zhao, Xiaojin; Pan, Xiaofang; Ye, Wenbin

2018-01-08

In this work, we propose a novel Deep Convolutional Neural Network (DCNN) tailored for gas classification. Inspired by the great success of DCNN in the field of computer vision, we designed a DCNN with up to 38 layers. In general, the proposed gas neural network, named GasNet, consists of: six convolutional blocks, each block consist of six layers; a pooling layer; and a fully-connected layer. Together, these various layers make up a powerful deep model for gas classification. Experimental results show that the proposed DCNN method is an effective technique for classifying electronic nose data. We also demonstrate that the DCNN method can provide higher classification accuracy than comparable Support Vector Machine (SVM) methods and Multiple Layer Perceptron (MLP).

Gas Classification Using Deep Convolutional Neural Networks

PubMed Central

Peng, Pai; Zhao, Xiaojin; Pan, Xiaofang; Ye, Wenbin

2018-01-01

In this work, we propose a novel Deep Convolutional Neural Network (DCNN) tailored for gas classification. Inspired by the great success of DCNN in the field of computer vision, we designed a DCNN with up to 38 layers. In general, the proposed gas neural network, named GasNet, consists of: six convolutional blocks, each block consist of six layers; a pooling layer; and a fully-connected layer. Together, these various layers make up a powerful deep model for gas classification. Experimental results show that the proposed DCNN method is an effective technique for classifying electronic nose data. We also demonstrate that the DCNN method can provide higher classification accuracy than comparable Support Vector Machine (SVM) methods and Multiple Layer Perceptron (MLP). PMID:29316723

Pulse-coupled neural network implementation in FPGA

NASA Astrophysics Data System (ADS)

Waldemark, Joakim T. A.; Lindblad, Thomas; Lindsey, Clark S.; Waldemark, Karina E.; Oberg, Johnny; Millberg, Mikael

1998-03-01

Pulse Coupled Neural Networks (PCNN) are biologically inspired neural networks, mainly based on studies of the visual cortex of small mammals. The PCNN is very well suited as a pre- processor for image processing, particularly in connection with object isolation, edge detection and segmentation. Several implementations of PCNN on von Neumann computers, as well as on special parallel processing hardware devices (e.g. SIMD), exist. However, these implementations are not as flexible as required for many applications. Here we present an implementation in Field Programmable Gate Arrays (FPGA) together with a performance analysis. The FPGA hardware implementation may be considered a platform for further, extended implementations and easily expanded into various applications. The latter may include advanced on-line image analysis with close to real-time performance.

Retrieving infinite numbers of patterns in a spin-glass model of immune networks

NASA Astrophysics Data System (ADS)

Agliari, E.; Annibale, A.; Barra, A.; Coolen, A. C. C.; Tantari, D.

2017-01-01

The similarity between neural and (adaptive) immune networks has been known for decades, but so far we did not understand the mechanism that allows the immune system, unlike associative neural networks, to recall and execute a large number of memorized defense strategies in parallel. The explanation turns out to lie in the network topology. Neurons interact typically with a large number of other neurons, whereas interactions among lymphocytes in immune networks are very specific, and described by graphs with finite connectivity. In this paper we use replica techniques to solve a statistical mechanical immune network model with “coordinator branches” (T-cells) and “effector branches” (B-cells), and show how the finite connectivity enables the coordinators to manage an extensive number of effectors simultaneously, even above the percolation threshold (where clonal cross-talk is not negligible). A consequence of its underlying topological sparsity is that the adaptive immune system exhibits only weak ergodicity breaking, so that also spontaneous switch-like effects as bi-stabilities are present: the latter may play a significant role in the maintenance of immune homeostasis.

Localized states in an unbounded neural field equation with smooth firing rate function: a multi-parameter analysis.

PubMed

Faye, Grégory; Rankin, James; Chossat, Pascal

2013-05-01

The existence of spatially localized solutions in neural networks is an important topic in neuroscience as these solutions are considered to characterize working (short-term) memory. We work with an unbounded neural network represented by the neural field equation with smooth firing rate function and a wizard hat spatial connectivity. Noting that stationary solutions of our neural field equation are equivalent to homoclinic orbits in a related fourth order ordinary differential equation, we apply normal form theory for a reversible Hopf bifurcation to prove the existence of localized solutions; further, we present results concerning their stability. Numerical continuation is used to compute branches of localized solution that exhibit snaking-type behaviour. We describe in terms of three parameters the exact regions for which localized solutions persist.

Large-Scale Network Dysfunction in Major Depressive Disorder: A Meta-analysis of Resting-State Functional Connectivity.

PubMed

Kaiser, Roselinde H; Andrews-Hanna, Jessica R; Wager, Tor D; Pizzagalli, Diego A

2015-06-01

Major depressive disorder (MDD) has been linked to imbalanced communication among large-scale brain networks, as reflected by abnormal resting-state functional connectivity (rsFC). However, given variable methods and results across studies, identifying consistent patterns of network dysfunction in MDD has been elusive. To investigate network dysfunction in MDD through a meta-analysis of rsFC studies. Seed-based voxelwise rsFC studies comparing individuals with MDD with healthy controls (published before June 30, 2014) were retrieved from electronic databases (PubMed, Web of Science, and EMBASE) and authors contacted for additional data. Twenty-seven seed-based voxel-wise rsFC data sets from 25 publications (556 individuals with MDD and 518 healthy controls) were included in the meta-analysis. Coordinates of seed regions of interest and between-group effects were extracted. Seeds were categorized into seed-networks by their location within a priori functional networks. Multilevel kernel density analysis of between-group effects identified brain systems in which MDD was associated with hyperconnectivity (increased positive or reduced negative connectivity) or hypoconnectivity (increased negative or reduced positive connectivity) with each seed-network. Major depressive disorder was characterized by hypoconnectivity within the frontoparietal network, a set of regions involved in cognitive control of attention and emotion regulation, and hypoconnectivity between frontoparietal systems and parietal regions of the dorsal attention network involved in attending to the external environment. Major depressive disorder was also associated with hyperconnectivity within the default network, a network believed to support internally oriented and self-referential thought, and hyperconnectivity between frontoparietal control systems and regions of the default network. Finally, the MDD groups exhibited hypoconnectivity between neural systems involved in processing emotion or salience and midline cortical regions that may mediate top-down regulation of such functions. Reduced connectivity within frontoparietal control systems and imbalanced connectivity between control systems and networks involved in internal or external attention may reflect depressive biases toward internal thoughts at the cost of engaging with the external world. Meanwhile, altered connectivity between neural systems involved in cognitive control and those that support salience or emotion processing may relate to deficits regulating mood. These findings provide an empirical foundation for a neurocognitive model in which network dysfunction underlies core cognitive and affective abnormalities in depression.

Elimination of spiral waves in a locally connected chaotic neural network by a dynamic phase space constraint.

PubMed

Li, Yang; Oku, Makito; He, Guoguang; Aihara, Kazuyuki

2017-04-01

In this study, a method is proposed that eliminates spiral waves in a locally connected chaotic neural network (CNN) under some simplified conditions, using a dynamic phase space constraint (DPSC) as a control method. In this method, a control signal is constructed from the feedback internal states of the neurons to detect phase singularities based on their amplitude reduction, before modulating a threshold value to truncate the refractory internal states of the neurons and terminate the spirals. Simulations showed that with appropriate parameter settings, the network was directed from a spiral wave state into either a plane wave (PW) state or a synchronized oscillation (SO) state, where the control vanished automatically and left the original CNN model unaltered. Each type of state had a characteristic oscillation frequency, where spiral wave states had the highest, and the intra-control dynamics was dominated by low-frequency components, thereby indicating slow adjustments to the state variables. In addition, the PW-inducing and SO-inducing control processes were distinct, where the former generally had longer durations but smaller average proportions of affected neurons in the network. Furthermore, variations in the control parameter allowed partial selectivity of the control results, which were accompanied by modulation of the control processes. The results of this study broaden the applicability of DPSC to chaos control and they may also facilitate the utilization of locally connected CNNs in memory retrieval and the exploration of traveling wave dynamics in biological neural networks. Copyright © 2017 Elsevier Ltd. All rights reserved.

A Markovian event-based framework for stochastic spiking neural networks.

PubMed

Touboul, Jonathan D; Faugeras, Olivier D

2011-11-01

In spiking neural networks, the information is conveyed by the spike times, that depend on the intrinsic dynamics of each neuron, the input they receive and on the connections between neurons. In this article we study the Markovian nature of the sequence of spike times in stochastic neural networks, and in particular the ability to deduce from a spike train the next spike time, and therefore produce a description of the network activity only based on the spike times regardless of the membrane potential process. To study this question in a rigorous manner, we introduce and study an event-based description of networks of noisy integrate-and-fire neurons, i.e. that is based on the computation of the spike times. We show that the firing times of the neurons in the networks constitute a Markov chain, whose transition probability is related to the probability distribution of the interspike interval of the neurons in the network. In the cases where the Markovian model can be developed, the transition probability is explicitly derived in such classical cases of neural networks as the linear integrate-and-fire neuron models with excitatory and inhibitory interactions, for different types of synapses, possibly featuring noisy synaptic integration, transmission delays and absolute and relative refractory period. This covers most of the cases that have been investigated in the event-based description of spiking deterministic neural networks.

Emergence of the neural network underlying phonological processing from the prereading to the emergent reading stage: A longitudinal study.

PubMed

Yu, Xi; Raney, Talia; Perdue, Meaghan V; Zuk, Jennifer; Ozernov-Palchik, Ola; Becker, Bryce L C; Raschle, Nora M; Gaab, Nadine

2018-05-01

Numerous studies have shown that phonological skills are critical for successful reading acquisition. However, how the brain network supporting phonological processing evolves and how it supports the initial course of learning to read is largely unknown. Here, for the first time, we characterized the emergence of the phonological network in 28 children over three stages (prereading, beginning reading, and emergent reading) longitudinally. Across these three time points, decreases in neural activation in the left inferior parietal cortex (LIPC) were observed during an audiovisual phonological processing task, suggesting a specialization process in response to reading instruction/experience. Furthermore, using the LIPC as the seed, a functional network consisting of the left inferior frontal, left posterior occipitotemporal, and right angular gyri was identified. The connection strength in this network co-developed with the growth of phonological skills. Moreover, children with above-average gains in phonological processing showed a significant developmental increase in connection strength in this network longitudinally, while children with below-average gains in phonological processing exhibited the opposite trajectory. Finally, the connection strength between the LIPC and the left posterior occipitotemporal cortex at the prereading level significantly predicted reading performance at the emergent reading stage. Our findings highlight the importance of the early emerging phonological network for reading development, providing direct evidence for the Interactive Specialization Theory and neurodevelopmental models of reading. © 2018 Wiley Periodicals, Inc.

The Hierarchical Brain Network for Face Recognition

PubMed Central

Zhen, Zonglei; Fang, Huizhen; Liu, Jia

2013-01-01

Numerous functional magnetic resonance imaging (fMRI) studies have identified multiple cortical regions that are involved in face processing in the human brain. However, few studies have characterized the face-processing network as a functioning whole. In this study, we used fMRI to identify face-selective regions in the entire brain and then explore the hierarchical structure of the face-processing network by analyzing functional connectivity among these regions. We identified twenty-five regions mainly in the occipital, temporal and frontal cortex that showed a reliable response selective to faces (versus objects) across participants and across scan sessions. Furthermore, these regions were clustered into three relatively independent sub-networks in a face-recognition task on the basis of the strength of functional connectivity among them. The functionality of the sub-networks likely corresponds to the recognition of individual identity, retrieval of semantic knowledge and representation of emotional information. Interestingly, when the task was switched to object recognition from face recognition, the functional connectivity between the inferior occipital gyrus and the rest of the face-selective regions were significantly reduced, suggesting that this region may serve as an entry node in the face-processing network. In sum, our study provides empirical evidence for cognitive and neural models of face recognition and helps elucidate the neural mechanisms underlying face recognition at the network level. PMID:23527282

Altered Functional Connectivity of the Default Mode Network in Low-Empathy Subjects

PubMed Central

Kim, Seung Jun; Kim, Sung-Eun; Kim, Hyo Eun; Han, Kiwan; Jeong, Bumseok; Kim, Jae-Jin; Namkoong, Kee

2017-01-01

Empathy is the ability to identify with or make a vicariously experience of another person's feelings or thoughts based on memory and/or self-referential mental simulation. The default mode network in particular is related to self-referential empathy. In order to elucidate the possible neural mechanisms underlying empathy, we investigated the functional connectivity of the default mode network in subjects from a general population. Resting state functional magnetic resonance imaging data were acquired from 19 low-empathy subjects and 18 medium-empathy subjects. An independent component analysis was used to identify the default mode network, and differences in functional connectivity strength were compared between the two groups. The low-empathy group showed lower functional connectivity of the medial prefrontal cortex and anterior cingulate cortex (Brodmann areas 9 and 32) within the default mode network, compared to the medium-empathy group. The results of the present study suggest that empathy is related to functional connectivity of the medial prefrontal cortex/anterior cingulate cortex within the default mode network. Functional decreases in connectivity among low-empathy subjects may reflect an impairment of self-referential mental simulation. PMID:28792155

Synapse-Centric Mapping of Cortical Models to the SpiNNaker Neuromorphic Architecture

PubMed Central

Knight, James C.; Furber, Steve B.

2016-01-01

While the adult human brain has approximately 8.8 × 1010 neurons, this number is dwarfed by its 1 × 1015 synapses. From the point of view of neuromorphic engineering and neural simulation in general this makes the simulation of these synapses a particularly complex problem. SpiNNaker is a digital, neuromorphic architecture designed for simulating large-scale spiking neural networks at speeds close to biological real-time. Current solutions for simulating spiking neural networks on SpiNNaker are heavily inspired by work on distributed high-performance computing. However, while SpiNNaker shares many characteristics with such distributed systems, its component nodes have much more limited resources and, as the system lacks global synchronization, the computation performed on each node must complete within a fixed time step. We first analyze the performance of the current SpiNNaker neural simulation software and identify several problems that occur when it is used to simulate networks of the type often used to model the cortex which contain large numbers of sparsely connected synapses. We then present a new, more flexible approach for mapping the simulation of such networks to SpiNNaker which solves many of these problems. Finally we analyze the performance of our new approach using both benchmarks, designed to represent cortical connectivity, and larger, functional cortical models. In a benchmark network where neurons receive input from 8000 STDP synapses, our new approach allows 4× more neurons to be simulated on each SpiNNaker core than has been previously possible. We also demonstrate that the largest plastic neural network previously simulated on neuromorphic hardware can be run in real time using our new approach: double the speed that was previously achieved. Additionally this network contains two types of plastic synapse which previously had to be trained separately but, using our new approach, can be trained simultaneously. PMID:27683540

Robust prediction of individual creative ability from brain functional connectivity.

PubMed

Beaty, Roger E; Kenett, Yoed N; Christensen, Alexander P; Rosenberg, Monica D; Benedek, Mathias; Chen, Qunlin; Fink, Andreas; Qiu, Jiang; Kwapil, Thomas R; Kane, Michael J; Silvia, Paul J

2018-01-30

People's ability to think creatively is a primary means of technological and cultural progress, yet the neural architecture of the highly creative brain remains largely undefined. Here, we employed a recently developed method in functional brain imaging analysis-connectome-based predictive modeling-to identify a brain network associated with high-creative ability, using functional magnetic resonance imaging (fMRI) data acquired from 163 participants engaged in a classic divergent thinking task. At the behavioral level, we found a strong correlation between creative thinking ability and self-reported creative behavior and accomplishment in the arts and sciences ( r = 0.54). At the neural level, we found a pattern of functional brain connectivity related to high-creative thinking ability consisting of frontal and parietal regions within default, salience, and executive brain systems. In a leave-one-out cross-validation analysis, we show that this neural model can reliably predict the creative quality of ideas generated by novel participants within the sample. Furthermore, in a series of external validation analyses using data from two independent task fMRI samples and a large task-free resting-state fMRI sample, we demonstrate robust prediction of individual creative thinking ability from the same pattern of brain connectivity. The findings thus reveal a whole-brain network associated with high-creative ability comprised of cortical hubs within default, salience, and executive systems-intrinsic functional networks that tend to work in opposition-suggesting that highly creative people are characterized by the ability to simultaneously engage these large-scale brain networks.

Traffic sign recognition based on deep convolutional neural network

NASA Astrophysics Data System (ADS)

Yin, Shi-hao; Deng, Ji-cai; Zhang, Da-wei; Du, Jing-yuan

2017-11-01

Traffic sign recognition (TSR) is an important component of automated driving systems. It is a rather challenging task to design a high-performance classifier for the TSR system. In this paper, we propose a new method for TSR system based on deep convolutional neural network. In order to enhance the expression of the network, a novel structure (dubbed block-layer below) which combines network-in-network and residual connection is designed. Our network has 10 layers with parameters (block-layer seen as a single layer): the first seven are alternate convolutional layers and block-layers, and the remaining three are fully-connected layers. We train our TSR network on the German traffic sign recognition benchmark (GTSRB) dataset. To reduce overfitting, we perform data augmentation on the training images and employ a regularization method named "dropout". The activation function we employ in our network adopts scaled exponential linear units (SELUs), which can induce self-normalizing properties. To speed up the training, we use an efficient GPU to accelerate the convolutional operation. On the test dataset of GTSRB, we achieve the accuracy rate of 99.67%, exceeding the state-of-the-art results.

Synchronization and coordination of sequences in two neural ensembles

NASA Astrophysics Data System (ADS)

Venaille, Antoine; Varona, Pablo; Rabinovich, Mikhail I.

2005-06-01

There are many types of neural networks involved in the sequential motor behavior of animals. For high species, the control and coordination of the network dynamics is a function of the higher levels of the central nervous system, in particular the cerebellum. However, in many cases, especially for invertebrates, such coordination is the result of direct synaptic connections between small circuits. We show here that even the chaotic sequential activity of small model networks can be coordinated by electrotonic synapses connecting one or several pairs of neurons that belong to two different networks. As an example, we analyzed the coordination and synchronization of the sequential activity of two statocyst model networks of the marine mollusk Clione. The statocysts are gravity sensory organs that play a key role in postural control of the animal and the generation of a complex hunting motor program. Each statocyst network was modeled by a small ensemble of neurons with Lotka-Volterra type dynamics and nonsymmetric inhibitory interactions. We studied how two such networks were synchronized by electrical coupling in the presence of an external signal which lead to winnerless competition among the neurons. We found that as a function of the number and the strength of connections between the two networks, it is possible to coordinate and synchronize the sequences that each network generates with its own chaotic dynamics. In spite of the chaoticity, the coordination of the signals is established through an activation sequence lock for those neurons that are active at a particular instant of time.

Large-scale functional networks connect differently for processing words and symbol strings.

PubMed

Liljeström, Mia; Vartiainen, Johanna; Kujala, Jan; Salmelin, Riitta

2018-01-01

Reconfigurations of synchronized large-scale networks are thought to be central neural mechanisms that support cognition and behavior in the human brain. Magnetoencephalography (MEG) recordings together with recent advances in network analysis now allow for sub-second snapshots of such networks. In the present study, we compared frequency-resolved functional connectivity patterns underlying reading of single words and visual recognition of symbol strings. Word reading emphasized coherence in a left-lateralized network with nodes in classical perisylvian language regions, whereas symbol processing recruited a bilateral network, including connections between frontal and parietal regions previously associated with spatial attention and visual working memory. Our results illustrate the flexible nature of functional networks, whereby processing of different form categories, written words vs. symbol strings, leads to the formation of large-scale functional networks that operate at distinct oscillatory frequencies and incorporate task-relevant regions. These results suggest that category-specific processing should be viewed not so much as a local process but as a distributed neural process implemented in signature networks. For words, increased coherence was detected particularly in the alpha (8-13 Hz) and high gamma (60-90 Hz) frequency bands, whereas increased coherence for symbol strings was observed in the high beta (21-29 Hz) and low gamma (30-45 Hz) frequency range. These findings attest to the role of coherence in specific frequency bands as a general mechanism for integrating stimulus-dependent information across brain regions.

A New Measure for Neural Compensation Is Positively Correlated With Working Memory and Gait Speed.

PubMed

Ji, Lanxin; Pearlson, Godfrey D; Hawkins, Keith A; Steffens, David C; Guo, Hua; Wang, Lihong

2018-01-01

Neuroimaging studies suggest that older adults may compensate for declines in brain function and cognition through reorganization of neural resources. A limitation of prior research is reliance on between-group comparisons of neural activation (e.g., younger vs. older), which cannot be used to assess compensatory ability quantitatively. It is also unclear about the relationship between compensatory ability with cognitive function or how other factors such as physical exercise modulates compensatory ability. Here, we proposed a data-driven method to semi-quantitatively measure neural compensation under a challenging cognitive task, and we then explored connections between neural compensation to cognitive engagement and cognitive reserve (CR). Functional and structural magnetic resonance imaging scans were acquired for 26 healthy older adults during a face-name memory task. Spatial independent component analysis (ICA) identified visual, attentional and left executive as core networks. Results show that the smaller the volumes of the gray matter (GM) structures within core networks, the more networks were needed to conduct the task ( r = -0.408, p = 0.035). Therefore, the number of task-activated networks controlling for the GM volume within core networks was defined as a measure of neural compensatory ability. We found that compensatory ability correlated with working memory performance ( r = 0.528, p = 0.035). Among subjects with good memory task performance, those with higher CR used fewer networks than subjects with lower CR. Among poor-performance subjects, those using more networks had higher CR. Our results indicated that using a high cognitive-demanding task to measure the number of activated neural networks could be a useful and sensitive measure of neural compensation in older adults.

Dynamic Network Drivers of Seizure Generation, Propagation and Termination in Human Neocortical Epilepsy

PubMed Central

Khambhati, Ankit N.; Davis, Kathryn A.; Oommen, Brian S.; Chen, Stephanie H.; Lucas, Timothy H.; Litt, Brian; Bassett, Danielle S.

2015-01-01

The epileptic network is characterized by pathologic, seizure-generating ‘foci’ embedded in a web of structural and functional connections. Clinically, seizure foci are considered optimal targets for surgery. However, poor surgical outcome suggests a complex relationship between foci and the surrounding network that drives seizure dynamics. We developed a novel technique to objectively track seizure states from dynamic functional networks constructed from intracranial recordings. Each dynamical state captures unique patterns of network connections that indicate synchronized and desynchronized hubs of neural populations. Our approach suggests that seizures are generated when synchronous relationships near foci work in tandem with rapidly changing desynchronous relationships from the surrounding epileptic network. As seizures progress, topographical and geometrical changes in network connectivity strengthen and tighten synchronous connectivity near foci—a mechanism that may aid seizure termination. Collectively, our observations implicate distributed cortical structures in seizure generation, propagation and termination, and may have practical significance in determining which circuits to modulate with implantable devices. PMID:26680762

Abnormal functional network connectivity among resting-state networks in children with frontal lobe epilepsy.

PubMed

Widjaja, E; Zamyadi, M; Raybaud, C; Snead, O C; Smith, M L

2013-12-01

Epilepsy is considered a disorder of neural networks. The aims of this study were to assess functional connectivity within resting-state networks and functional network connectivity across resting-state networks by use of resting-state fMRI in children with frontal lobe epilepsy and to relate changes in resting-state networks with neuropsychological function. Fifteen patients with frontal lobe epilepsy and normal MR imaging and 14 healthy control subjects were recruited. Spatial independent component analysis was used to identify the resting-state networks, including frontal, attention, default mode network, sensorimotor, visual, and auditory networks. The Z-maps of resting-state networks were compared between patients and control subjects. The relation between abnormal connectivity and neuropsychological function was assessed. Correlations from all pair-wise combinations of independent components were performed for each group and compared between groups. The frontal network was the only network that showed reduced connectivity in patients relative to control subjects. The remaining 5 networks demonstrated both reduced and increased functional connectivity within resting-state networks in patients. There was a weak association between connectivity in frontal network and executive function (P = .029) and a significant association between sensorimotor network and fine motor function (P = .004). Control subjects had 79 pair-wise independent components that showed significant temporal coherence across all resting-state networks except for default mode network-auditory network. Patients had 66 pairs of independent components that showed significant temporal coherence across all resting-state networks. Group comparison showed reduced functional network connectivity between default mode network-attention, frontal-sensorimotor, and frontal-visual networks and increased functional network connectivity between frontal-attention, default mode network-sensorimotor, and frontal-visual networks in patients relative to control subjects. We found abnormal functional connectivity within and across resting-state networks in children with frontal lobe epilepsy. Impairment in functional connectivity was associated with impaired neuropsychological function.

Differential Patterns of Dysconnectivity in Mirror Neuron and Mentalizing Networks in Schizophrenia

PubMed Central

Schilbach, Leonhard; Derntl, Birgit; Aleman, Andre; Caspers, Svenja; Clos, Mareike; Diederen, Kelly M. J.; Gruber, Oliver; Kogler, Lydia; Liemburg, Edith J.; Sommer, Iris E.; Müller, Veronika I.; Cieslik, Edna C.; Eickhoff, Simon B.

2016-01-01

Impairments of social cognition are well documented in patients with schizophrenia (SCZ), but the neural basis remains poorly understood. In light of evidence that suggests that the “mirror neuron system” (MNS) and the “mentalizing network” (MENT) are key substrates of intersubjectivity and joint action, it has been suggested that dysfunction of these neural networks may underlie social difficulties in SCZ patients. Additionally, MNS and MENT might be associated differently with positive vs negative symptoms, given prior social cognitive and symptom associations. We assessed resting state functional connectivity (RSFC) in meta-analytically defined MNS and MENT networks in this patient group. Magnetic resonance imaging (MRI) scans were obtained from 116 patients and 133 age-, gender- and movement-matched healthy controls (HC) at 5 different MRI sites. Network connectivity was analyzed for group differences and correlations with clinical symptoms. Results demonstrated decreased connectivity within the MNS and also the MENT in patients compared to controls. Notably, dysconnectivity of the MNS was related to symptom severity, while no such relationship was observed for the MENT. In sum, these findings demonstrate that differential patterns of dysconnectivity exist in SCZ patients, which may contribute differently to the interpersonal difficulties commonly observed in the disorder. PMID:26940699

Hemispheric Connectivity and the Visual-Spatial Divergent-Thinking Component of Creativity

ERIC Educational Resources Information Center

Moore, Dana W.; Bhadelia, Rafeeque A.; Billings, Rebecca L.; Fulwiler, Carl; Heilman, Kenneth M.; Rood, Kenneth M. J.; Gansler, David A.

2009-01-01

Background/hypothesis: Divergent thinking is an important measurable component of creativity. This study tested the postulate that divergent thinking depends on large distributed inter- and intra-hemispheric networks. Although preliminary evidence supports increased brain connectivity during divergent thinking, the neural correlates of this…

Laser programmable integrated circuit for forming synapses in neural networks

DOEpatents

Fu, C.Y.

1997-02-11

Customizable neural network in which one or more resistors form each synapse is disclosed. All the resistors in the synaptic array are identical, thus simplifying the processing issues. Highly doped, amorphous silicon is used as the resistor material, to create extremely high resistances occupying very small spaces. Connected in series with each resistor in the array is at least one severable conductor whose uppermost layer has a lower reflectivity of laser energy than typical metal conductors at a desired laser wavelength. 5 figs.

Process for forming synapses in neural networks and resistor therefor

DOEpatents

Fu, C.Y.

1996-07-23

Customizable neural network in which one or more resistors form each synapse is disclosed. All the resistors in the synaptic array are identical, thus simplifying the processing issues. Highly doped, amorphous silicon is used as the resistor material, to create extremely high resistances occupying very small spaces. Connected in series with each resistor in the array is at least one severable conductor whose uppermost layer has a lower reflectivity of laser energy than typical metal conductors at a desired laser wavelength. 5 figs.

Laser programmable integrated curcuit for forming synapses in neural networks

DOEpatents

Fu, Chi Y.

1997-01-01

Customizable neural network in which one or more resistors form each synapse. All the resistors in the synaptic array are identical, thus simplifying the processing issues. Highly doped, amorphous silicon is used as the resistor material, to create extremely high resistances occupying very small spaces. Connected in series with each resistor in the array is at least one severable conductor whose uppermost layer has a lower reflectivity of laser energy than typical metal conductors at a desired laser wavelength.

The Use of Neural Networks for Determining Tank Routes

DTIC Science & Technology

1992-09-01

ADDRESS (City, State, and ZIP Code) Monterey, CA 93943-5000 Monterey, CA 93943-5000 &a. NAME OF FUNDINGJSPONSORING 8b. OFFICE SYMBOL 9. PROCUREMENT...Weights Figure 1. Neural Network Architecture 6 The back-error propagation technique iteratively assigns weights to connections, computes the errors...neurons as the start. From that we decided to try 4, 6 , 8, 10, 12, 15, 20, 25, 30, 35, 40, 45, 50, 60, 70, 80, 90 and 100 or until it was obvious that

Process for forming synapses in neural networks and resistor therefor

DOEpatents

Fu, Chi Y.

1996-01-01

Customizable neural network in which one or more resistors form each synapse. All the resistors in the synaptic array are identical, thus simplifying the processing issues. Highly doped, amorphous silicon is used as the resistor material, to create extremely high resistances occupying very small spaces. Connected in series with each resistor in the array is at least one severable conductor whose uppermost layer has a lower reflectivity of laser energy than typical metal conductors at a desired laser wavelength.

Studying the Relationship between High-Latitude Geomagnetic Activity and Parameters of Interplanetary Magnetic Clouds with the Use of Artificial Neural Networks

NASA Astrophysics Data System (ADS)

Barkhatov, N. A.; Revunov, S. E.; Vorobjev, V. G.; Yagodkina, O. I.

2018-03-01

The cause-and-effect relations of the dynamics of high-latitude geomagnetic activity (in terms of the AL index) and the type of the magnetic cloud of the solar wind are studied with the use of artificial neural networks. A recurrent neural network model has been created based on the search for the optimal physically coupled input and output parameters characterizing the action of a plasma flux belonging to a certain magnetic cloud type on the magnetosphere. It has been shown that, with IMF components as input parameters of neural networks with allowance for a 90-min prehistory, it is possible to retrieve the AL sequence with an accuracy to 80%. The successful retrieval of the AL dynamics by the used data indicates the presence of a close nonlinear connection of the AL index with cloud parameters. The created neural network models can be applied with high efficiency to retrieve the AL index, both in periods of isolated magnetospheric substorms and in periods of the interaction between the Earth's magnetosphere and magnetic clouds of different types. The developed model of AL index retrieval can be used to detect magnetic clouds.

Deep learning for brain tumor classification

NASA Astrophysics Data System (ADS)

Paul, Justin S.; Plassard, Andrew J.; Landman, Bennett A.; Fabbri, Daniel

2017-03-01

Recent research has shown that deep learning methods have performed well on supervised machine learning, image classification tasks. The purpose of this study is to apply deep learning methods to classify brain images with different tumor types: meningioma, glioma, and pituitary. A dataset was publicly released containing 3,064 T1-weighted contrast enhanced MRI (CE-MRI) brain images from 233 patients with either meningioma, glioma, or pituitary tumors split across axial, coronal, or sagittal planes. This research focuses on the 989 axial images from 191 patients in order to avoid confusing the neural networks with three different planes containing the same diagnosis. Two types of neural networks were used in classification: fully connected and convolutional neural networks. Within these two categories, further tests were computed via the augmentation of the original 512×512 axial images. Training neural networks over the axial data has proven to be accurate in its classifications with an average five-fold cross validation of 91.43% on the best trained neural network. This result demonstrates that a more general method (i.e. deep learning) can outperform specialized methods that require image dilation and ring-forming subregions on tumors.

The implications of brain connectivity in the neuropsychology of autism

PubMed Central

Maximo, Jose O.; Cadena, Elyse J.; Kana, Rajesh K.

2014-01-01

Autism is a neurodevelopmental disorder that has been associated with atypical brain functioning. Functional connectivity MRI (fcMRI) studies examining neural networks in autism have seen an exponential rise over the last decade. Such investigations have led to characterization of autism as a distributed neural systems disorder. Studies have found widespread cortical underconnectivity, local overconnectivity, and mixed results suggesting disrupted brain connectivity as a potential neural signature of autism. In this review, we summarize the findings of previous fcMRI studies in autism with a detailed examination of their methodology, in order to better understand its potential and to delineate the pitfalls. We also address how a multimodal neuroimaging approach (incorporating different measures of brain connectivity) may help characterize the complex neurobiology of autism at a global level. Finally, we also address the potential of neuroimaging-based markers in assisting neuropsychological assessment of autism. The quest for a biomarker for autism is still ongoing, yet new findings suggest that aberrant brain connectivity may be a promising candidate. PMID:24496901

Estimation of effective connectivity via data-driven neural modeling

PubMed Central

Freestone, Dean R.; Karoly, Philippa J.; Nešić, Dragan; Aram, Parham; Cook, Mark J.; Grayden, David B.

2014-01-01

This research introduces a new method for functional brain imaging via a process of model inversion. By estimating parameters of a computational model, we are able to track effective connectivity and mean membrane potential dynamics that cannot be directly measured using electrophysiological measurements alone. The ability to track the hidden aspects of neurophysiology will have a profound impact on the way we understand and treat epilepsy. For example, under the assumption the model captures the key features of the cortical circuits of interest, the framework will provide insights into seizure initiation and termination on a patient-specific basis. It will enable investigation into the effect a particular drug has on specific neural populations and connectivity structures using minimally invasive measurements. The method is based on approximating brain networks using an interconnected neural population model. The neural population model is based on a neural mass model that describes the functional activity of the brain, capturing the mesoscopic biophysics and anatomical structure. The model is made subject-specific by estimating the strength of intra-cortical connections within a region and inter-cortical connections between regions using a novel Kalman filtering method. We demonstrate through simulation how the framework can be used to track the mechanisms involved in seizure initiation and termination. PMID:25506315

Data-driven inference of network connectivity for modeling the dynamics of neural codes in the insect antennal lobe

PubMed Central

Shlizerman, Eli; Riffell, Jeffrey A.; Kutz, J. Nathan

2014-01-01

The antennal lobe (AL), olfactory processing center in insects, is able to process stimuli into distinct neural activity patterns, called olfactory neural codes. To model their dynamics we perform multichannel recordings from the projection neurons in the AL driven by different odorants. We then derive a dynamic neuronal network from the electrophysiological data. The network consists of lateral-inhibitory neurons and excitatory neurons (modeled as firing-rate units), and is capable of producing unique olfactory neural codes for the tested odorants. To construct the network, we (1) design a projection, an odor space, for the neural recording from the AL, which discriminates between distinct odorants trajectories (2) characterize scent recognition, i.e., decision-making based on olfactory signals and (3) infer the wiring of the neural circuit, the connectome of the AL. We show that the constructed model is consistent with biological observations, such as contrast enhancement and robustness to noise. The study suggests a data-driven approach to answer a key biological question in identifying how lateral inhibitory neurons can be wired to excitatory neurons to permit robust activity patterns. PMID:25165442

Functional model of biological neural networks.

PubMed

Lo, James Ting-Ho

2010-12-01

A functional model of biological neural networks, called temporal hierarchical probabilistic associative memory (THPAM), is proposed in this paper. THPAM comprises functional models of dendritic trees for encoding inputs to neurons, a first type of neuron for generating spike trains, a second type of neuron for generating graded signals to modulate neurons of the first type, supervised and unsupervised Hebbian learning mechanisms for easy learning and retrieving, an arrangement of dendritic trees for maximizing generalization, hardwiring for rotation-translation-scaling invariance, and feedback connections with different delay durations for neurons to make full use of present and past informations generated by neurons in the same and higher layers. These functional models and their processing operations have many functions of biological neural networks that have not been achieved by other models in the open literature and provide logically coherent answers to many long-standing neuroscientific questions. However, biological justifications of these functional models and their processing operations are required for THPAM to qualify as a macroscopic model (or low-order approximate) of biological neural networks.

Computing by robust transience: How the fronto-parietal network performs sequential category-based decisions

PubMed Central

Chaisangmongkon, Warasinee; Swaminathan, Sruthi K.; Freedman, David J.; Wang, Xiao-Jing

2017-01-01

Summary Decision making involves dynamic interplay between internal judgements and external perception, which has been investigated in delayed match-to-category (DMC) experiments. Our analysis of neural recordings shows that, during DMC tasks, LIP and PFC neurons demonstrate mixed, time-varying, and heterogeneous selectivity, but previous theoretical work has not established the link between these neural characteristics and population-level computations. We trained a recurrent network model to perform DMC tasks and found that the model can remarkably reproduce key features of neuronal selectivity at the single-neuron and population levels. Analysis of the trained networks elucidates that robust transient trajectories of the neural population are the key driver of sequential categorical decisions. The directions of trajectories are governed by network self-organized connectivity, defining a ‘neural landscape’, consisting of a task-tailored arrangement of slow states and dynamical tunnels. With this model, we can identify functionally-relevant circuit motifs and generalize the framework to solve other categorization tasks. PMID:28334612

Neural mechanisms of the rejection-aggression link.

PubMed

Chester, David S; Lynam, Donald R; Milich, Richard; DeWall, C Nathan

2018-05-01

Social rejection is a painful event that often increases aggression. However, the neural mechanisms of this rejection-aggression link remain unclear. A potential clue may be that rejected people often recruit the ventrolateral prefrontal cortex's (VLPFC) self-regulatory processes to manage the pain of rejection. Using functional MRI, we replicated previous links between rejection and activity in the brain's mentalizing network, social pain network and VLPFC. VLPFC recruitment during rejection was associated with greater activity in the brain's reward network (i.e. the ventral striatum) when individuals were given an opportunity to retaliate. This retaliation-related striatal response was associated with greater levels of retaliatory aggression. Dispositionally aggressive individuals exhibited less functional connectivity between the ventral striatum and the right VLPFC during aggression. This connectivity exerted a suppressing effect on dispositionally aggressive individuals' greater aggressive responses to rejection. These results help explain how the pain of rejection and reward of revenge motivate rejected people to behave aggressively.

Altered attentional control over the salience network in complex regional pain syndrome.

PubMed

Kim, Jungyoon; Kang, Ilhyang; Chung, Yong-An; Kim, Tae-Suk; Namgung, Eun; Lee, Suji; Oh, Jin Kyoung; Jeong, Hyeonseok S; Cho, Hanbyul; Kim, Myeong Ju; Kim, Tammy D; Choi, Soo Hyun; Lim, Soo Mee; Lyoo, In Kyoon; Yoon, Sujung

2018-05-10

The degree and salience of pain have been known to be constantly monitored and modulated by the brain. In the case of maladaptive neural responses as reported in centralized pain conditions such as complex regional pain syndrome (CRPS), the perception of pain is amplified and remains elevated even without sustained peripheral pain inputs. Given that the attentional state of the brain greatly influences the perception and interpretation of pain, we investigated the role of the attention network and its dynamic interactions with other pain-related networks of the brain in CRPS. We examined alterations in the intra- and inter-network functional connectivities in 21 individuals with CRPS and 49 controls. CRPS-related reduction in intra-network functional connectivity was found in the attention network. Individuals with CRPS had greater inter-network connectivities between the attention and salience networks as compared with healthy controls. Furthermore, individuals within the CRPS group with high levels of pain catastrophizing showed greater inter-network connectivities between the attention and salience networks. Taken together, the current findings suggest that these altered connectivities may be potentially associated with the maladaptive pain coping as found in CRPS patients.

Inferring multi-scale neural mechanisms with brain network modelling

PubMed Central

Schirner, Michael; McIntosh, Anthony Randal; Jirsa, Viktor; Deco, Gustavo

2018-01-01

The neurophysiological processes underlying non-invasive brain activity measurements are incompletely understood. Here, we developed a connectome-based brain network model that integrates individual structural and functional data with neural population dynamics to support multi-scale neurophysiological inference. Simulated populations were linked by structural connectivity and, as a novelty, driven by electroencephalography (EEG) source activity. Simulations not only predicted subjects' individual resting-state functional magnetic resonance imaging (fMRI) time series and spatial network topologies over 20 minutes of activity, but more importantly, they also revealed precise neurophysiological mechanisms that underlie and link six empirical observations from different scales and modalities: (1) resting-state fMRI oscillations, (2) functional connectivity networks, (3) excitation-inhibition balance, (4, 5) inverse relationships between α-rhythms, spike-firing and fMRI on short and long time scales, and (6) fMRI power-law scaling. These findings underscore the potential of this new modelling framework for general inference and integration of neurophysiological knowledge to complement empirical studies. PMID:29308767

Image inpainting and super-resolution using non-local recursive deep convolutional network with skip connections

NASA Astrophysics Data System (ADS)

Liu, Miaofeng

2017-07-01

In recent years, deep convolutional neural networks come into use in image inpainting and super-resolution in many fields. Distinct to most of the former methods requiring to know beforehand the local information for corrupted pixels, we propose a 20-depth fully convolutional network to learn an end-to-end mapping a dataset of damaged/ground truth subimage pairs realizing non-local blind inpainting and super-resolution. As there often exist image with huge corruptions or inpainting on a low-resolution image that the existing approaches unable to perform well, we also share parameters in local area of layers to achieve spatial recursion and enlarge the receptive field. To avoid the difficulty of training this deep neural network, skip-connections between symmetric convolutional layers are designed. Experimental results shows that the proposed method outperforms state-of-the-art methods for diverse corrupting and low-resolution conditions, it works excellently when realizing super-resolution and image inpainting simultaneously

An artificial neural network model for periodic trajectory generation

NASA Astrophysics Data System (ADS)

Shankar, S.; Gander, R. E.; Wood, H. C.

A neural network model based on biological systems was developed for potential robotic application. The model consists of three interconnected layers of artificial neurons or units: an input layer subdivided into state and plan units, an output layer, and a hidden layer between the two outer layers which serves to implement nonlinear mappings between the input and output activation vectors. Weighted connections are created between the three layers, and learning is effected by modifying these weights. Feedback connections between the output and the input state serve to make the network operate as a finite state machine. The activation vector of the plan units of the input layer emulates the supraspinal commands in biological central pattern generators in that different plan activation vectors correspond to different sequences or trajectories being recalled, even with different frequencies. Three trajectories were chosen for implementation, and learning was accomplished in 10,000 trials. The fault tolerant behavior, adaptiveness, and phase maintenance of the implemented network are discussed.

Synaptic plasticity in a recurrent neural network for versatile and adaptive behaviors of a walking robot.

PubMed

Grinke, Eduard; Tetzlaff, Christian; Wörgötter, Florentin; Manoonpong, Poramate

2015-01-01

Walking animals, like insects, with little neural computing can effectively perform complex behaviors. For example, they can walk around their environment, escape from corners/deadlocks, and avoid or climb over obstacles. While performing all these behaviors, they can also adapt their movements to deal with an unknown situation. As a consequence, they successfully navigate through their complex environment. The versatile and adaptive abilities are the result of an integration of several ingredients embedded in their sensorimotor loop. Biological studies reveal that the ingredients include neural dynamics, plasticity, sensory feedback, and biomechanics. Generating such versatile and adaptive behaviors for a many degrees-of-freedom (DOFs) walking robot is a challenging task. Thus, in this study, we present a bio-inspired approach to solve this task. Specifically, the approach combines neural mechanisms with plasticity, exteroceptive sensory feedback, and biomechanics. The neural mechanisms consist of adaptive neural sensory processing and modular neural locomotion control. The sensory processing is based on a small recurrent neural network consisting of two fully connected neurons. Online correlation-based learning with synaptic scaling is applied to adequately change the connections of the network. By doing so, we can effectively exploit neural dynamics (i.e., hysteresis effects and single attractors) in the network to generate different turning angles with short-term memory for a walking robot. The turning information is transmitted as descending steering signals to the neural locomotion control which translates the signals into motor actions. As a result, the robot can walk around and adapt its turning angle for avoiding obstacles in different situations. The adaptation also enables the robot to effectively escape from sharp corners or deadlocks. Using backbone joint control embedded in the the locomotion control allows the robot to climb over small obstacles. Consequently, it can successfully explore and navigate in complex environments. We firstly tested our approach on a physical simulation environment and then applied it to our real biomechanical walking robot AMOSII with 19 DOFs to adaptively avoid obstacles and navigate in the real world.

Synaptic plasticity in a recurrent neural network for versatile and adaptive behaviors of a walking robot

PubMed Central

Grinke, Eduard; Tetzlaff, Christian; Wörgötter, Florentin; Manoonpong, Poramate

2015-01-01

Walking animals, like insects, with little neural computing can effectively perform complex behaviors. For example, they can walk around their environment, escape from corners/deadlocks, and avoid or climb over obstacles. While performing all these behaviors, they can also adapt their movements to deal with an unknown situation. As a consequence, they successfully navigate through their complex environment. The versatile and adaptive abilities are the result of an integration of several ingredients embedded in their sensorimotor loop. Biological studies reveal that the ingredients include neural dynamics, plasticity, sensory feedback, and biomechanics. Generating such versatile and adaptive behaviors for a many degrees-of-freedom (DOFs) walking robot is a challenging task. Thus, in this study, we present a bio-inspired approach to solve this task. Specifically, the approach combines neural mechanisms with plasticity, exteroceptive sensory feedback, and biomechanics. The neural mechanisms consist of adaptive neural sensory processing and modular neural locomotion control. The sensory processing is based on a small recurrent neural network consisting of two fully connected neurons. Online correlation-based learning with synaptic scaling is applied to adequately change the connections of the network. By doing so, we can effectively exploit neural dynamics (i.e., hysteresis effects and single attractors) in the network to generate different turning angles with short-term memory for a walking robot. The turning information is transmitted as descending steering signals to the neural locomotion control which translates the signals into motor actions. As a result, the robot can walk around and adapt its turning angle for avoiding obstacles in different situations. The adaptation also enables the robot to effectively escape from sharp corners or deadlocks. Using backbone joint control embedded in the the locomotion control allows the robot to climb over small obstacles. Consequently, it can successfully explore and navigate in complex environments. We firstly tested our approach on a physical simulation environment and then applied it to our real biomechanical walking robot AMOSII with 19 DOFs to adaptively avoid obstacles and navigate in the real world. PMID:26528176

Synaptic convergence regulates synchronization-dependent spike transfer in feedforward neural networks.

PubMed

Sailamul, Pachaya; Jang, Jaeson; Paik, Se-Bum

2017-12-01

Correlated neural activities such as synchronizations can significantly alter the characteristics of spike transfer between neural layers. However, it is not clear how this synchronization-dependent spike transfer can be affected by the structure of convergent feedforward wiring. To address this question, we implemented computer simulations of model neural networks: a source and a target layer connected with different types of convergent wiring rules. In the Gaussian-Gaussian (GG) model, both the connection probability and the strength are given as Gaussian distribution as a function of spatial distance. In the Uniform-Constant (UC) and Uniform-Exponential (UE) models, the connection probability density is a uniform constant within a certain range, but the connection strength is set as a constant value or an exponentially decaying function, respectively. Then we examined how the spike transfer function is modulated under these conditions, while static or synchronized input patterns were introduced to simulate different levels of feedforward spike synchronization. We observed that the synchronization-dependent modulation of the transfer function appeared noticeably different for each convergence condition. The modulation of the spike transfer function was largest in the UC model, and smallest in the UE model. Our analysis showed that this difference was induced by the different spike weight distributions that was generated from convergent synapses in each model. Our results suggest that, the structure of the feedforward convergence is a crucial factor for correlation-dependent spike control, thus must be considered important to understand the mechanism of information transfer in the brain.

Mindfulness Meditation Training and Executive Control Network Resting State Functional Connectivity: A Randomized Controlled Trial.

PubMed

Taren, Adrienne A; Gianaros, Peter J; Greco, Carol M; Lindsay, Emily K; Fairgrieve, April; Brown, Kirk Warren; Rosen, Rhonda K; Ferris, Jennifer L; Julson, Erica; Marsland, Anna L; Creswell, J David

Mindfulness meditation training has been previously shown to enhance behavioral measures of executive control (e.g., attention, working memory, cognitive control), but the neural mechanisms underlying these improvements are largely unknown. Here, we test whether mindfulness training interventions foster executive control by strengthening functional connections between dorsolateral prefrontal cortex (dlPFC)-a hub of the executive control network-and frontoparietal regions that coordinate executive function. Thirty-five adults with elevated levels of psychological distress participated in a 3-day randomized controlled trial of intensive mindfulness meditation or relaxation training. Participants completed a resting state functional magnetic resonance imaging scan before and after the intervention. We tested whether mindfulness meditation training increased resting state functional connectivity (rsFC) between dlPFC and frontoparietal control network regions. Left dlPFC showed increased connectivity to the right inferior frontal gyrus (T = 3.74), right middle frontal gyrus (MFG) (T = 3.98), right supplementary eye field (T = 4.29), right parietal cortex (T = 4.44), and left middle temporal gyrus (T = 3.97, all p < .05) after mindfulness training relative to the relaxation control. Right dlPFC showed increased connectivity to right MFG (T = 4.97, p < .05). We report that mindfulness training increases rsFC between dlPFC and dorsal network (superior parietal lobule, supplementary eye field, MFG) and ventral network (right IFG, middle temporal/angular gyrus) regions. These findings extend previous work showing increased functional connectivity among brain regions associated with executive function during active meditation by identifying specific neural circuits in which rsFC is enhanced by a mindfulness intervention in individuals with high levels of psychological distress. Clinicaltrials.gov,NCT01628809.

Parsing recursive sentences with a connectionist model including a neural stack and synaptic gating.

PubMed

Fedor, Anna; Ittzés, Péter; Szathmáry, Eörs

2011-02-21

It is supposed that humans are genetically predisposed to be able to recognize sequences of context-free grammars with centre-embedded recursion while other primates are restricted to the recognition of finite state grammars with tail-recursion. Our aim was to construct a minimalist neural network that is able to parse artificial sentences of both grammars in an efficient way without using the biologically unrealistic backpropagation algorithm. The core of this network is a neural stack-like memory where the push and pop operations are regulated by synaptic gating on the connections between the layers of the stack. The network correctly categorizes novel sentences of both grammars after training. We suggest that the introduction of the neural stack memory will turn out to be substantial for any biological 'hierarchical processor' and the minimalist design of the model suggests a quest for similar, realistic neural architectures. Copyright © 2010 Elsevier Ltd. All rights reserved.

Contextual Modulation is Related to Efficiency in a Spiking Network Model of Visual Cortex.

PubMed

Sharifian, Fariba; Heikkinen, Hanna; Vigário, Ricardo; Vanni, Simo

2015-01-01

In the visual cortex, stimuli outside the classical receptive field (CRF) modulate the neural firing rate, without driving the neuron by themselves. In the primary visual cortex (V1), such contextual modulation can be parametrized with an area summation function (ASF): increasing stimulus size causes first an increase and then a decrease of firing rate before reaching an asymptote. Earlier work has reported increase of sparseness when CRF stimulation is extended to its surroundings. However, there has been no clear connection between the ASF and network efficiency. Here we aimed to investigate possible link between ASF and network efficiency. In this study, we simulated the responses of a biomimetic spiking neural network model of the visual cortex to a set of natural images. We varied the network parameters, and compared the V1 excitatory neuron spike responses to the corresponding responses predicted from earlier single neuron data from primate visual cortex. The network efficiency was quantified with firing rate (which has direct association to neural energy consumption), entropy per spike and population sparseness. All three measures together provided a clear association between the network efficiency and the ASF. The association was clear when varying the horizontal connectivity within V1, which influenced both the efficiency and the distance to ASF, DAS. Given the limitations of our biophysical model, this association is qualitative, but nevertheless suggests that an ASF-like receptive field structure can cause efficient population response.

Auditory mismatch impairments are characterized by core neural dysfunctions in schizophrenia

PubMed Central

Gaebler, Arnim Johannes; Mathiak, Klaus; Koten, Jan Willem; König, Andrea Anna; Koush, Yury; Weyer, David; Depner, Conny; Matentzoglu, Simeon; Edgar, James Christopher; Willmes, Klaus; Zvyagintsev, Mikhail

2015-01-01

Major theories on the neural basis of schizophrenic core symptoms highlight aberrant salience network activity (insula and anterior cingulate cortex), prefrontal hypoactivation, sensory processing deficits as well as an impaired connectivity between temporal and prefrontal cortices. The mismatch negativity is a potential biomarker of schizophrenia and its reduction might be a consequence of each of these mechanisms. In contrast to the previous electroencephalographic studies, functional magnetic resonance imaging may disentangle the involved brain networks at high spatial resolution and determine contributions from localized brain responses and functional connectivity to the schizophrenic impairments. Twenty-four patients and 24 matched control subjects underwent functional magnetic resonance imaging during an optimized auditory mismatch task. Haemodynamic responses and functional connectivity were compared between groups. These data sets further entered a diagnostic classification analysis to assess impairments on the individual patient level. In the control group, mismatch responses were detected in the auditory cortex, prefrontal cortex and the salience network (insula and anterior cingulate cortex). Furthermore, mismatch processing was associated with a deactivation of the visual system and the dorsal attention network indicating a shift of resources from the visual to the auditory domain. The patients exhibited reduced activation in all of the respective systems (right auditory cortex, prefrontal cortex, and the salience network) as well as reduced deactivation of the visual system and the dorsal attention network. Group differences were most prominent in the anterior cingulate cortex and adjacent prefrontal areas. The latter regions also exhibited a reduced functional connectivity with the auditory cortex in the patients. In the classification analysis, haemodynamic responses yielded a maximal accuracy of 83% based on four features; functional connectivity data performed similarly or worse for up to about 10 features. However, connectivity data yielded a better performance when including more than 10 features yielding up to 90% accuracy. Among others, the most discriminating features represented functional connections between the auditory cortex and the anterior cingulate cortex as well as adjacent prefrontal areas. Auditory mismatch impairments incorporate major neural dysfunctions in schizophrenia. Our data suggest synergistic effects of sensory processing deficits, aberrant salience attribution, prefrontal hypoactivation as well as a disrupted connectivity between temporal and prefrontal cortices. These deficits are associated with subsequent disturbances in modality-specific resource allocation. Capturing different schizophrenic core dysfunctions, functional magnetic resonance imaging during this optimized mismatch paradigm reveals processing impairments on the individual patient level, rendering it a potential biomarker of schizophrenia. PMID:25743635

Large-scale network dysfunction in Major Depressive Disorder: Meta-analysis of resting-state functional connectivity

PubMed Central

Kaiser, Roselinde H.; Andrews-Hanna, Jessica R.; Wager, Tor D.; Pizzagalli, Diego A.

2015-01-01

IMPORTANCE Major depressive disorder (MDD) has been linked to imbalanced communication among large-scale brain networks, as reflected by abnormal resting-state functional connectivity (rsFC). However, given variable methods and results across studies, identifying consistent patterns of network dysfunction in MDD has been elusive. OBJECTIVE To investigate network dysfunction in MDD through the first meta-analysis of rsFC studies. DATA SOURCES Seed-based voxel-wise rsFC studies comparing MDD with healthy individuals (published before June 30, 2014) were retrieved from electronic databases (PubMed, Web-of-Science, EMBASE), and authors contacted for additional data. STUDY SELECTION Twenty-seven datasets from 25 publications (556 MDD adults/teens; 518 controls) were included in the meta-analysis. DATA EXTRACTION AND SYNTHESIS Coordinates of seed regions-of-interest and between-group effects were extracted. Seeds were categorized into “seed-networks” by their location within a priori functional networks. Multilevel kernel density analysis of between-group effects identified brain systems in which MDD was associated with hyperconnectivity (increased positive, or reduced negative, connectivity) or hypoconnectivity (increased negative, or reduced positive, connectivity) with each seed-network. RESULTS MDD was characterized by hypoconnectivity within the frontoparietal network (FN), a set of regions involved in cognitive control of attention and emotion regulation, and hypoconnectivity between frontoparietal systems and parietal regions of the dorsal attention network (DAN) involved in attending to the external environment. MDD was also associated with hyperconnectivity within the default network (DN), a network believed to support internally-oriented and self-referential thought, and hyperconnectivity between FN control systems and regions of DN. Finally, MDD groups exhibited hypoconnectivity between neural systems involved in processing emotion or salience and midline cortical regions that may mediate top-down regulation of such functions. CONCLUSIONS AND RELEVANCE Reduced connectivity within frontoparietal control systems, and imbalanced connectivity between control systems and networks involved in internal- or external-attention, may reflect depressive biases towards internal thoughts at the cost of engaging with the external world. Meanwhile, altered connectivity between neural systems involved in cognitive control and those that support salience or emotion processing may relate to deficits regulating mood. These findings provide an empirical foundation for a neurocognitive model in which network dysfunction underlies core cognitive and affective abnormalities in depression. PMID:25785575

Functional connectivity decreases in autism in emotion, self, and face circuits identified by Knowledge-based Enrichment Analysis.

PubMed

Cheng, Wei; Rolls, Edmund T; Zhang, Jie; Sheng, Wenbo; Ma, Liang; Wan, Lin; Luo, Qiang; Feng, Jianfeng

2017-03-01

A powerful new method is described called Knowledge based functional connectivity Enrichment Analysis (KEA) for interpreting resting state functional connectivity, using circuits that are functionally identified using search terms with the Neurosynth database. The method derives its power by focusing on neural circuits, sets of brain regions that share a common biological function, instead of trying to interpret single functional connectivity links. This provides a novel way of investigating how task- or function-related networks have resting state functional connectivity differences in different psychiatric states, provides a new way to bridge the gap between task and resting-state functional networks, and potentially helps to identify brain networks that might be treated. The method was applied to interpreting functional connectivity differences in autism. Functional connectivity decreases at the network circuit level in 394 patients with autism compared with 473 controls were found in networks involving the orbitofrontal cortex, anterior cingulate cortex, middle temporal gyrus cortex, and the precuneus, in networks that are implicated in the sense of self, face processing, and theory of mind. The decreases were correlated with symptom severity. Copyright © 2017. Published by Elsevier Inc.

Altered Structural and Functional Connectivity in Late Preterm Preadolescence: An Anatomic Seed-Based Study of Resting State Networks Related to the Posteromedial and Lateral Parietal Cortex.

PubMed

Degnan, Andrew J; Wisnowski, Jessica L; Choi, SoYoung; Ceschin, Rafael; Bhushan, Chitresh; Leahy, Richard M; Corby, Patricia; Schmithorst, Vincent J; Panigrahy, Ashok

2015-01-01

Late preterm birth confers increased risk of developmental delay, academic difficulties and social deficits. The late third trimester may represent a critical period of development of neural networks including the default mode network (DMN), which is essential to normal cognition. Our objective is to identify functional and structural connectivity differences in the posteromedial cortex related to late preterm birth. Thirty-eight preadolescents (ages 9-13; 19 born in the late preterm period (≥32 weeks gestational age) and 19 at term) without access to advanced neonatal care were recruited from a low socioeconomic status community in Brazil. Participants underwent neurocognitive testing, 3-dimensional T1-weighted imaging, diffusion-weighted imaging and resting state functional MRI (RS-fMRI). Seed-based probabilistic diffusion tractography and RS-fMRI analyses were performed using unilateral seeds within the posterior DMN (posterior cingulate cortex, precuneus) and lateral parietal DMN (superior marginal and angular gyri). Late preterm children demonstrated increased functional connectivity within the posterior default mode networks and increased anti-correlation with the central-executive network when seeded from the posteromedial cortex (PMC). Key differences were demonstrated between PMC components with increased anti-correlation with the salience network seen only with posterior cingulate cortex seeding but not with precuneus seeding. Probabilistic tractography showed increased streamlines within the right inferior longitudinal fasciculus and inferior fronto-occipital fasciculus within late preterm children while decreased intrahemispheric streamlines were also observed. No significant differences in neurocognitive testing were demonstrated between groups. Late preterm preadolescence is associated with altered functional connectivity from the PMC and lateral parietal cortex to known distributed functional cortical networks despite no significant executive neurocognitive differences. Selective increased structural connectivity was observed in the setting of decreased posterior interhemispheric connections. Future work is needed to determine if these findings represent a compensatory adaptation employing alternate neural circuitry or could reflect subtle pathology resulting in emotional processing deficits not seen with neurocognitive testing.

Emerging Frontiers of Neuroengineering: A Network Science of Brain Connectivity

PubMed Central

Bassett, Danielle S.; Khambhati, Ankit N.; Grafton, Scott T.

2018-01-01

Neuroengineering is faced with unique challenges in repairing or replacing complex neural systems that are composed of many interacting parts. These interactions form intricate patterns over large spatiotemporal scales and produce emergent behaviors that are difficult to predict from individual elements. Network science provides a particularly appropriate framework in which to study and intervene in such systems by treating neural elements (cells, volumes) as nodes in a graph and neural interactions (synapses, white matter tracts) as edges in that graph. Here, we review the emerging discipline of network neuroscience, which uses and develops tools from graph theory to better understand and manipulate neural systems from micro- to macroscales. We present examples of how human brain imaging data are being modeled with network analysis and underscore potential pitfalls. We then highlight current computational and theoretical frontiers and emphasize their utility in informing diagnosis and monitoring, brain–machine interfaces, and brain stimulation. A flexible and rapidly evolving enterprise, network neuroscience provides a set of powerful approaches and fundamental insights that are critical for the neuroengineer’s tool kit. PMID:28375650

Comparison of RF spectrum prediction methods for dynamic spectrum access

NASA Astrophysics Data System (ADS)

Kovarskiy, Jacob A.; Martone, Anthony F.; Gallagher, Kyle A.; Sherbondy, Kelly D.; Narayanan, Ram M.

2017-05-01

Dynamic spectrum access (DSA) refers to the adaptive utilization of today's busy electromagnetic spectrum. Cognitive radio/radar technologies require DSA to intelligently transmit and receive information in changing environments. Predicting radio frequency (RF) activity reduces sensing time and energy consumption for identifying usable spectrum. Typical spectrum prediction methods involve modeling spectral statistics with Hidden Markov Models (HMM) or various neural network structures. HMMs describe the time-varying state probabilities of Markov processes as a dynamic Bayesian network. Neural Networks model biological brain neuron connections to perform a wide range of complex and often non-linear computations. This work compares HMM, Multilayer Perceptron (MLP), and Recurrent Neural Network (RNN) algorithms and their ability to perform RF channel state prediction. Monte Carlo simulations on both measured and simulated spectrum data evaluate the performance of these algorithms. Generalizing spectrum occupancy as an alternating renewal process allows Poisson random variables to generate simulated data while energy detection determines the occupancy state of measured RF spectrum data for testing. The results suggest that neural networks achieve better prediction accuracy and prove more adaptable to changing spectral statistics than HMMs given sufficient training data.

Parsing Heterogeneity in the Brain Connectivity of Depressed and Healthy Adults During Positive Mood.

PubMed

Price, Rebecca B; Lane, Stephanie; Gates, Kathleen; Kraynak, Thomas E; Horner, Michelle S; Thase, Michael E; Siegle, Greg J

2017-02-15

There is well-known heterogeneity in affective mechanisms in depression that may extend to positive affect. We used data-driven parsing of neural connectivity to reveal subgroups present across depressed and healthy individuals during positive processing, informing targets for mechanistic intervention. Ninety-two individuals (68 depressed patients, 24 never-depressed control subjects) completed a sustained positive mood induction during functional magnetic resonance imaging. Directed functional connectivity paths within a depression-relevant network were characterized using Group Iterative Multiple Model Estimation (GIMME), a method shown to accurately recover the direction and presence of connectivity paths in individual participants. During model selection, individuals were clustered using community detection on neural connectivity estimates. Subgroups were externally tested across multiple levels of analysis. Two connectivity-based subgroups emerged: subgroup A, characterized by weaker connectivity overall, and subgroup B, exhibiting hyperconnectivity (relative to subgroup A), particularly among ventral affective regions. Subgroup predicted diagnostic status (subgroup B contained 81% of patients; 50% of control subjects; χ 2 = 8.6, p = .003) and default mode network connectivity during a separate resting-state task. Among patients, subgroup B members had higher self-reported symptoms, lower sustained positive mood during the induction, and higher negative bias on a reaction-time task. Symptom-based depression subgroups did not predict these external variables. Neural connectivity-based categorization travels with diagnostic category and is clinically predictive, but not clinically deterministic. Both patients and control subjects showed heterogeneous, and overlapping, profiles. The larger and more severely affected patient subgroup was characterized by ventrally driven hyperconnectivity during positive processing. Data-driven parsing suggests heterogeneous substrates of depression and possible resilience in control subjects in spite of biological overlap. Copyright © 2016 Society of Biological Psychiatry. Published by Elsevier Inc. All rights reserved.

Neural correlates of consciousness in patients who have emerged from a minimally conscious state: a cross-sectional multimodal imaging study.

PubMed

Di Perri, Carol; Bahri, Mohamed Ali; Amico, Enrico; Thibaut, Aurore; Heine, Lizette; Antonopoulos, Georgios; Charland-Verville, Vanessa; Wannez, Sarah; Gomez, Francisco; Hustinx, Roland; Tshibanda, Luaba; Demertzi, Athena; Soddu, Andrea; Laureys, Steven

2016-07-01

Between pathologically impaired consciousness and normal consciousness exists a scarcely researched transition zone, referred to as emergence from minimally conscious state, in which patients regain the capacity for functional communication, object use, or both. We investigated neural correlates of consciousness in these patients compared with patients with disorders of consciousness and healthy controls, by multimodal imaging. In this cross-sectional, multimodal imaging study, patients with unresponsive wakefulness syndrome, patients in a minimally conscious state, and patients who had emerged from a minimally conscious state, diagnosed with the Coma Recovery Scale-Revised, were recruited from the neurology department of the Centre Hospitalier Universitaire de Liège, Belgium. Key exclusion criteria were neuroimaging examination in an acute state, sedation or anaesthesia during scanning, large focal brain damage, motion parameters of more than 3 mm in translation and 3° in rotation, and suboptimal segmentation and normalisation. We acquired resting state functional and structural MRI data and (18)F-fluorodeoxyglucose (FDG) PET data; we used seed-based functional MRI (fMRI) analysis to investigate positive default mode network connectivity (within-network correlations) and negative default mode network connectivity (between-network anticorrelations). We correlated FDG-PET brain metabolism with fMRI connectivity. We used voxel-based morphometry to test the effect of anatomical deformations on functional connectivity. We recruited a convenience sample of 58 patients (21 [36%] with unresponsive wakefulness syndrome, 24 [41%] in a minimally conscious state, and 13 [22%] who had emerged from a minimally conscious state) and 35 healthy controls between Oct 1, 2009, and Oct 31, 2014. We detected consciousness-level-dependent increases (from unresponsive wakefulness syndrome, minimally conscious state, emergence from minimally conscious state, to healthy controls) for positive and negative default mode network connectivity, brain metabolism, and grey matter volume (p<0·05 false discovery rate corrected for multiple comparisons). Positive default mode network connectivity differed between patients and controls but not among patient groups (F test p<0·0001). Negative default mode network connectivity was only detected in healthy controls and in those who had emerged from a minimally conscious state; patients with unresponsive wakefulness syndrome or in a minimally conscious state showed pathological between-network positive connectivity (hyperconnectivity; F test p<0·0001). Brain metabolism correlated with positive default mode network connectivity (Spearman's r=0·50 [95% CI 0·26 to 0·61]; p<0·0001) and negative default mode network connectivity (Spearman's r=-0·52 [-0·35 to -0·67); p<0·0001). Grey matter volume did not differ between the studied groups (F test p=0·06). Partial preservation of between-network anticorrelations, which are seemingly of neuronal origin and cannot be solely explained by morphological deformations, characterise patients who have emerged from a minimally conscious state. Conversely, patients with disorders of consciousness show pathological between-network correlations. Apart from a deeper understanding of the neural correlates of consciousness, these findings have clinical implications and might be particularly relevant for outcome prediction and could inspire new therapeutic options. Belgian National Funds for Scientific Research (FNRS), European Commission, Natural Sciences and Engineering Research Council of Canada, James McDonnell Foundation, European Space Agency, Mind Science Foundation, French Speaking Community Concerted Research Action, Fondazione Europea di Ricerca Biomedica, University and University Hospital of Liège (Liège, Belgium), and University of Western Ontario (London, ON, Canada). Copyright © 2016 Elsevier Ltd. All rights reserved.

Temporal Sequence of Hemispheric Network Activation during Semantic Processing: A Functional Network Connectivity Analysis

ERIC Educational Resources Information Center

Assaf, Michal; Jagannathan, Kanchana; Calhoun, Vince; Kraut, Michael; Hart, John, Jr.; Pearlson, Godfrey

2009-01-01

To explore the temporal sequence of, and the relationship between, the left and right hemispheres (LH and RH) during semantic memory (SM) processing we identified the neural networks involved in the performance of functional MRI semantic object retrieval task (SORT) using group independent component analysis (ICA) in 47 healthy individuals. SORT…

Disruption of functional networks in dyslexia: A whole-brain, data-driven analysis of connectivity

PubMed Central

Finn, Emily S.; Shen, Xilin; Holahan, John M.; Scheinost, Dustin; Lacadie, Cheryl; Papademetris, Xenophon; Shaywitz, Sally E.; Shaywitz, Bennett A.; Constable, R. Todd

2013-01-01

Background Functional connectivity analyses of fMRI data are a powerful tool for characterizing brain networks and how they are disrupted in neural disorders. However, many such analyses examine only one or a small number of a priori seed regions. Studies that consider the whole brain frequently rely on anatomic atlases to define network nodes, which may result in mixing distinct activation timecourses within a single node. Here, we improve upon previous methods by using a data-driven brain parcellation to compare connectivity profiles of dyslexic (DYS) versus non-impaired (NI) readers in the first whole-brain functional connectivity analysis of dyslexia. Methods Whole-brain connectivity was assessed in children (n = 75; 43 NI, 32 DYS) and adult (n = 104; 64 NI, 40 DYS) readers. Results Compared to NI readers, DYS readers showed divergent connectivity within the visual pathway and between visual association areas and prefrontal attention areas; increased right-hemisphere connectivity; reduced connectivity in the visual word-form area (part of the left fusiform gyrus specialized for printed words); and persistent connectivity to anterior language regions around the inferior frontal gyrus. Conclusions Together, findings suggest that NI readers are better able to integrate visual information and modulate their attention to visual stimuli, allowing them to recognize words based on their visual properties, while DYS readers recruit altered reading circuits and rely on laborious phonology-based “sounding out” strategies into adulthood. These results deepen our understanding of the neural basis of dyslexia and highlight the importance of synchrony between diverse brain regions for successful reading. PMID:24124929

Learning in Artificial Neural Systems

NASA Technical Reports Server (NTRS)

Matheus, Christopher J.; Hohensee, William E.

1987-01-01

This paper presents an overview and analysis of learning in Artificial Neural Systems (ANS's). It begins with a general introduction to neural networks and connectionist approaches to information processing. The basis for learning in ANS's is then described, and compared with classical Machine learning. While similar in some ways, ANS learning deviates from tradition in its dependence on the modification of individual weights to bring about changes in a knowledge representation distributed across connections in a network. This unique form of learning is analyzed from two aspects: the selection of an appropriate network architecture for representing the problem, and the choice of a suitable learning rule capable of reproducing the desired function within the given network. The various network architectures are classified, and then identified with explicit restrictions on the types of functions they are capable of representing. The learning rules, i.e., algorithms that specify how the network weights are modified, are similarly taxonomized, and where possible, the limitations inherent to specific classes of rules are outlined.

Neural networks with multiple general neuron models: a hybrid computational intelligence approach using Genetic Programming.

PubMed

Barton, Alan J; Valdés, Julio J; Orchard, Robert

2009-01-01

Classical neural networks are composed of neurons whose nature is determined by a certain function (the neuron model), usually pre-specified. In this paper, a type of neural network (NN-GP) is presented in which: (i) each neuron may have its own neuron model in the form of a general function, (ii) any layout (i.e network interconnection) is possible, and (iii) no bias nodes or weights are associated to the connections, neurons or layers. The general functions associated to a neuron are learned by searching a function space. They are not provided a priori, but are rather built as part of an Evolutionary Computation process based on Genetic Programming. The resulting network solutions are evaluated based on a fitness measure, which may, for example, be based on classification or regression errors. Two real-world examples are presented to illustrate the promising behaviour on classification problems via construction of a low-dimensional representation of a high-dimensional parameter space associated to the set of all network solutions.

Dissociated emergent-response system and fine-processing system in human neural network and a heuristic neural architecture for autonomous humanoid robots.

PubMed

Yan, Xiaodan

2010-01-01

The current study investigated the functional connectivity of the primary sensory system with resting state fMRI and applied such knowledge into the design of the neural architecture of autonomous humanoid robots. Correlation and Granger causality analyses were utilized to reveal the functional connectivity patterns. Dissociation was within the primary sensory system, in that the olfactory cortex and the somatosensory cortex were strongly connected to the amygdala whereas the visual cortex and the auditory cortex were strongly connected with the frontal cortex. The posterior cingulate cortex (PCC) and the anterior cingulate cortex (ACC) were found to maintain constant communication with the primary sensory system, the frontal cortex, and the amygdala. Such neural architecture inspired the design of dissociated emergent-response system and fine-processing system in autonomous humanoid robots, with separate processing units and another consolidation center to coordinate the two systems. Such design can help autonomous robots to detect and respond quickly to danger, so as to maintain their sustainability and independence.

Mind-Body Practice Changes Fractional Amplitude of Low Frequency Fluctuations in Intrinsic Control Networks

PubMed Central

Wei, Gao-Xia; Gong, Zhu-Qing; Yang, Zhi; Zuo, Xi-Nian

2017-01-01

Cognitive control impairment is a typical symptom largely reported in populations with neurological disorders. Previous studies have provided evidence about the changes in cognitive control induced by mind-body training. However, the neural correlates underlying the effect of extensive mind-body practice on cognitive control remain largely unknown. Using resting-state functional magnetic resonance imaging, we characterized dynamic fluctuations in large-scale intrinsic connectivity networks associated with mind-body practice, and examined their differences between healthy controls and Tai Chi Chuan (TCC) practitioners. Compared with a control group, the TCC group revealed significantly decreased fractional Amplitude of Low Frequency Fluctuations (fALFF) in the bilateral frontoparietal network, default mode network and dorsal prefrontal-angular gyri network. Furthermore, we detected a significant association between mind-body practice experience and fALFF in the default mode network, as well as an association between cognitive control performance and fALFF of the frontoparietal network. This provides the first evidence of large-scale functional connectivity in brain networks associated with mind-body practice, shedding light on the neural network changes that accompany intensive mind-body training. It also highlights the functionally plastic role of the frontoparietal network in the context of the “immune system” of mental health recently developed in relation to flexible hub theory. PMID:28736535

Mind-Body Practice Changes Fractional Amplitude of Low Frequency Fluctuations in Intrinsic Control Networks.

PubMed

Wei, Gao-Xia; Gong, Zhu-Qing; Yang, Zhi; Zuo, Xi-Nian

2017-01-01

Cognitive control impairment is a typical symptom largely reported in populations with neurological disorders. Previous studies have provided evidence about the changes in cognitive control induced by mind-body training. However, the neural correlates underlying the effect of extensive mind-body practice on cognitive control remain largely unknown. Using resting-state functional magnetic resonance imaging, we characterized dynamic fluctuations in large-scale intrinsic connectivity networks associated with mind-body practice, and examined their differences between healthy controls and Tai Chi Chuan (TCC) practitioners. Compared with a control group, the TCC group revealed significantly decreased fractional Amplitude of Low Frequency Fluctuations (fALFF) in the bilateral frontoparietal network, default mode network and dorsal prefrontal-angular gyri network. Furthermore, we detected a significant association between mind-body practice experience and fALFF in the default mode network, as well as an association between cognitive control performance and fALFF of the frontoparietal network. This provides the first evidence of large-scale functional connectivity in brain networks associated with mind-body practice, shedding light on the neural network changes that accompany intensive mind-body training. It also highlights the functionally plastic role of the frontoparietal network in the context of the "immune system" of mental health recently developed in relation to flexible hub theory.

Individual differences in sentence comprehension: a functional magnetic resonance imaging investigation of syntactic and lexical processing demands.

PubMed

Prat, Chantel S; Keller, Timothy A; Just, Marcel Adam

2007-12-01

Language comprehension is neurally underpinned by a network of collaborating cortical processing centers; individual differences in comprehension must be related to some set of this network's properties. This study investigated the neural bases of individual differences during sentence comprehension by examining the network's response to two variations in processing demands: reading sentences containing words of high versus low lexical frequency and having simpler versus more complex syntax. In a functional magnetic resonance imaging study, readers who were independently identified as having high or low working memory capacity for language exhibited three differentiating properties of their language network, namely, neural efficiency, adaptability, and synchronization. First, greater efficiency (defined as a reduction in activation associated with improved performance) was manifested as less activation in the bilateral middle frontal and right lingual gyri in high-capacity readers. Second, increased adaptability was indexed by larger lexical frequency effects in high-capacity readers across bilateral middle frontal, bilateral inferior occipital, and right temporal regions. Third, greater synchronization was observed in high-capacity readers between left temporal and left inferior frontal, left parietal, and right occipital regions. Synchronization interacted with adaptability, such that functional connectivity remained constant or increased with increasing lexical and syntactic demands in high-capacity readers, whereas low-capacity readers either showed no reliable differentiation or a decrease in functional connectivity with increasing demands. These results are among the first to relate multiple cortical network properties to individual differences in reading capacity and suggest a more general framework for understanding the relation between neural function and individual differences in cognitive performance.

Effect of Explicit Evaluation on Neural Connectivity Related to Listening to Unfamiliar Music

PubMed Central

Liu, Chao; Brattico, Elvira; Abu-jamous, Basel; Pereira, Carlos S.; Jacobsen, Thomas; Nandi, Asoke K.

2017-01-01

People can experience different emotions when listening to music. A growing number of studies have investigated the brain structures and neural connectivities associated with perceived emotions. However, very little is known about the effect of an explicit act of judgment on the neural processing of emotionally-valenced music. In this study, we adopted the novel consensus clustering paradigm, called binarisation of consensus partition matrices (Bi-CoPaM), to study whether and how the conscious aesthetic evaluation of the music would modulate brain connectivity networks related to emotion and reward processing. Participants listened to music under three conditions – one involving a non-evaluative judgment, one involving an explicit evaluative aesthetic judgment, and one involving no judgment at all (passive listening only). During non-evaluative attentive listening we obtained auditory-limbic connectivity whereas when participants were asked to decide explicitly whether they liked or disliked the music excerpt, only two clusters of intercommunicating brain regions were found: one including areas related to auditory processing and action observation, and the other comprising higher-order structures involved with visual processing. Results indicate that explicit evaluative judgment has an impact on the neural auditory-limbic connectivity during affective processing of music. PMID:29311874

Functional Connectivity Evidence of Cortico-Cortico Inhibition in Temporal Lobe Epilepsy

PubMed Central

Tracy, Joseph I.; Osipowicz, Karol; Spechler, Philip; Sharan, Ashwini; Skidmore, Christopher; Doucet, Gaelle; Sperling, Michael R.

2012-01-01

Epileptic seizures can initiate a neural circuit and lead to aberrant neural communication with brain areas outside the epileptogenic region. We focus on interictal activity in focal temporal lobe epilepsy and evaluate functional connectivity differences that emerge as function of bilateral versus strictly unilateral epileptiform activity. We assess the strength of functional connectivity at rest between the ictal and non-ictal temporal lobes, in addition to whole brain connectivity with the ictal temporal lobe. Results revealed strong connectivity between the temporal lobes for both patient groups, but this did not vary as a function of unilateral versus bilateral interictal status. Both the left and right unilateral temporal lobe groups showed significant anti-correlated activity in regions outside the epileptogenic temporal lobe, primarily involving the contralateral (non-ictal/non-pathologic) hemisphere, with precuneus involvement prominent. The bilateral groups did not show this contralateral anti-correlated activity. This anti-correlated connectivity may represent a form of protective and adaptive inhibition, helping to constrain epileptiform activity to the pathologic temporal lobe. The absence of this activity in the bilateral groups may be indicative of flawed inhibitory mechanisms, helping to explain their more widespread epileptiform activity. Our data suggest that the location and build up of epilepsy networks in the brain are not truly random, and are not limited to the formation of strictly epileptogenic networks. Functional networks may develop to take advantage of the regulatory function of structures such as the precuneus to instantiate an anti-correlated network, generating protective cortico-cortico inhibition for the purpose of limiting seizure spread or epileptogenesis. PMID:22987774

Distinct hippocampal functional networks revealed by tractography-based parcellation.

PubMed

Adnan, Areeba; Barnett, Alexander; Moayedi, Massieh; McCormick, Cornelia; Cohn, Melanie; McAndrews, Mary Pat

2016-07-01

Recent research suggests the anterior and posterior hippocampus form part of two distinct functional neural networks. Here we investigate the structural underpinnings of this functional connectivity difference using diffusion-weighted imaging-based parcellation. Using this technique, we substantiated that the hippocampus can be parcellated into distinct anterior and posterior segments. These structurally defined segments did indeed show different patterns of resting state functional connectivity, in that the anterior segment showed greater connectivity with temporal and orbitofrontal cortex, whereas the posterior segment was more highly connected to medial and lateral parietal cortex. Furthermore, we showed that the posterior hippocampal connectivity to memory processing regions, including the dorsolateral prefrontal cortex, parahippocampal, inferior temporal and fusiform gyri and the precuneus, predicted interindividual relational memory performance. These findings provide important support for the integration of structural and functional connectivity in understanding the brain networks underlying episodic memory.

Estimate the effective connectivity in multi-coupled neural mass model using particle swarm optimization

NASA Astrophysics Data System (ADS)

Shan, Bonan; Wang, Jiang; Deng, Bin; Zhang, Zhen; Wei, Xile

2017-03-01

Assessment of the effective connectivity among different brain regions during seizure is a crucial problem in neuroscience today. As a consequence, a new model inversion framework of brain function imaging is introduced in this manuscript. This framework is based on approximating brain networks using a multi-coupled neural mass model (NMM). NMM describes the excitatory and inhibitory neural interactions, capturing the mechanisms involved in seizure initiation, evolution and termination. Particle swarm optimization method is used to estimate the effective connectivity variation (the parameters of NMM) and the epileptiform dynamics (the states of NMM) that cannot be directly measured using electrophysiological measurement alone. The estimated effective connectivity includes both the local connectivity parameters within a single region NMM and the remote connectivity parameters between multi-coupled NMMs. When the epileptiform activities are estimated, a proportional-integral controller outputs control signal so that the epileptiform spikes can be inhibited immediately. Numerical simulations are carried out to illustrate the effectiveness of the proposed framework. The framework and the results have a profound impact on the way we detect and treat epilepsy.

Hierarchical graphical-based human pose estimation via local multi-resolution convolutional neural network

NASA Astrophysics Data System (ADS)

Zhu, Aichun; Wang, Tian; Snoussi, Hichem

2018-03-01

This paper addresses the problems of the graphical-based human pose estimation in still images, including the diversity of appearances and confounding background clutter. We present a new architecture for estimating human pose using a Convolutional Neural Network (CNN). Firstly, a Relative Mixture Deformable Model (RMDM) is defined by each pair of connected parts to compute the relative spatial information in the graphical model. Secondly, a Local Multi-Resolution Convolutional Neural Network (LMR-CNN) is proposed to train and learn the multi-scale representation of each body parts by combining different levels of part context. Thirdly, a LMR-CNN based hierarchical model is defined to explore the context information of limb parts. Finally, the experimental results demonstrate the effectiveness of the proposed deep learning approach for human pose estimation.

Application of heterogeneous pulse coupled neural network in image quantization

NASA Astrophysics Data System (ADS)

Huang, Yi; Ma, Yide; Li, Shouliang; Zhan, Kun

2016-11-01

On the basis of the different strengths of synaptic connections between actual neurons, this paper proposes a heterogeneous pulse coupled neural network (HPCNN) algorithm to perform quantization on images. HPCNNs are developed from traditional pulse coupled neural network (PCNN) models, which have different parameters corresponding to different image regions. This allows pixels of different gray levels to be classified broadly into two categories: background regional and object regional. Moreover, an HPCNN also satisfies human visual characteristics. The parameters of the HPCNN model are calculated automatically according to these categories, and quantized results will be optimal and more suitable for humans to observe. At the same time, the experimental results of natural images from the standard image library show the validity and efficiency of our proposed quantization method.

Energy-efficient neural information processing in individual neurons and neuronal networks.

PubMed

Yu, Lianchun; Yu, Yuguo

2017-11-01

Brains are composed of networks of an enormous number of neurons interconnected with synapses. Neural information is carried by the electrical signals within neurons and the chemical signals among neurons. Generating these electrical and chemical signals is metabolically expensive. The fundamental issue raised here is whether brains have evolved efficient ways of developing an energy-efficient neural code from the molecular level to the circuit level. Here, we summarize the factors and biophysical mechanisms that could contribute to the energy-efficient neural code for processing input signals. The factors range from ion channel kinetics, body temperature, axonal propagation of action potentials, low-probability release of synaptic neurotransmitters, optimal input and noise, the size of neurons and neuronal clusters, excitation/inhibition balance, coding strategy, cortical wiring, and the organization of functional connectivity. Both experimental and computational evidence suggests that neural systems may use these factors to maximize the efficiency of energy consumption in processing neural signals. Studies indicate that efficient energy utilization may be universal in neuronal systems as an evolutionary consequence of the pressure of limited energy. As a result, neuronal connections may be wired in a highly economical manner to lower energy costs and space. Individual neurons within a network may encode independent stimulus components to allow a minimal number of neurons to represent whole stimulus characteristics efficiently. This basic principle may fundamentally change our view of how billions of neurons organize themselves into complex circuits to operate and generate the most powerful intelligent cognition in nature. © 2017 Wiley Periodicals, Inc. © 2017 Wiley Periodicals, Inc.

Shared atypical default mode and salience network functional connectivity between autism and schizophrenia.

PubMed

Chen, Heng; Uddin, Lucina Q; Duan, Xujun; Zheng, Junjie; Long, Zhiliang; Zhang, Youxue; Guo, Xiaonan; Zhang, Yan; Zhao, Jingping; Chen, Huafu

2017-11-01

Schizophrenia and autism spectrum disorder (ASD) are two prevalent neurodevelopmental disorders sharing some similar genetic basis and clinical features. The extent to which they share common neural substrates remains unclear. Resting-state fMRI data were collected from 35 drug-naïve adolescent participants with first-episode schizophrenia (15.6 ± 1.8 years old) and 31 healthy controls (15.4 ± 1.6 years old). Data from 22 participants with ASD (13.1 ± 3.1 years old) and 21 healthy controls (12.9 ± 2.9 years old) were downloaded from the Autism Brain Imaging Data Exchange. Resting-state functional networks were constructed using predefined regions of interest. Multivariate pattern analysis combined with multi-task regression feature selection methods were conducted in two datasets separately. Classification between individuals with disorders and controls was achieved with high accuracy (schizophrenia dataset: accuracy = 83%; ASD dataset: accuracy = 80%). Shared atypical brain connections contributing to classification were mostly present in the default mode network (DMN) and salience network (SN). These functional connections were further related to severity of social deficits in ASD (p = 0.002). Distinct atypical connections were also more related to the DMN and SN, but showed different atypical connectivity patterns between the two disorders. These results suggest some common neural mechanisms contributing to schizophrenia and ASD, and may aid in understanding the pathology of these two neurodevelopmental disorders. Autism Res 2017, 10: 1776-1786. © 2017 International Society for Autism Research, Wiley Periodicals, Inc. Autism spectrum disorder (ASD) and schizophrenia are two common neurodevelopmental disorders which share several genetic and behavioral features. The present study identified common neural mechanisms contributing to ASD and schizophrenia using resting-state functional MRI data. The results may help to understand the pathology of these two neurodevelopmental disorders. © 2017 International Society for Autism Research, Wiley Periodicals, Inc.

Thinking About a Task Is Associated with Increased Connectivity in Regions Activated by Task Performance

PubMed Central

Robertson, Edwin M.; Manoach, Dara S.; Stickgold, Robert

2016-01-01

Abstract We investigated whether functional neuroimaging of quiet “rest” can reveal the neural correlates of conscious thought. Using resting-state functional MRI, we measured functional connectivity during a resting scan that immediately followed performance of a finger tapping motor sequence task. Self-reports of the amount of time spent thinking about the task during the resting scan correlated with connectivity between regions of the motor network activated during task performance. Thus, thinking about a task is associated with coordinated activity in brain regions responsible for that task's performance. More generally, this study demonstrates the feasibility of using the combination of functional connectivity MRI and self-reports to examine the neural correlates of thought. PMID:26650337

Rapid Postnatal Expansion of Neural Networks Occurs in an Environment of Altered Neurovascular and Neurometabolic Coupling.

PubMed

Kozberg, Mariel G; Ma, Ying; Shaik, Mohammed A; Kim, Sharon H; Hillman, Elizabeth M C

2016-06-22

In the adult brain, increases in neural activity lead to increases in local blood flow. However, many prior measurements of functional hemodynamics in the neonatal brain, including functional magnetic resonance imaging (fMRI) in human infants, have noted altered and even inverted hemodynamic responses to stimuli. Here, we demonstrate that localized neural activity in early postnatal mice does not evoke blood flow increases as in the adult brain, and elucidate the neural and metabolic correlates of these altered functional hemodynamics as a function of developmental age. Using wide-field GCaMP imaging, the development of neural responses to somatosensory stimulus is visualized over the entire bilaterally exposed cortex. Neural responses are observed to progress from tightly localized, unilateral maps to bilateral responses as interhemispheric connectivity becomes established. Simultaneous hemodynamic imaging confirms that spatiotemporally coupled functional hyperemia is not present during these early stages of postnatal brain development, and develops gradually as cortical connectivity is established. Exploring the consequences of this lack of functional hyperemia, measurements of oxidative metabolism via flavoprotein fluorescence suggest that neural activity depletes local oxygen to below baseline levels at early developmental stages. Analysis of hemoglobin oxygenation dynamics at the same age confirms oxygen depletion for both stimulus-evoked and resting-state neural activity. This state of unmet metabolic demand during neural network development poses new questions about the mechanisms of neurovascular development and its role in both normal and abnormal brain development. These results also provide important insights for the interpretation of fMRI studies of the developing brain. This work demonstrates that the postnatal development of neuronal connectivity is accompanied by development of the mechanisms that regulate local blood flow in response to neural activity. Novel in vivo imaging reveals that, in the developing mouse brain, strong and localized GCaMP neural responses to stimulus fail to evoke local blood flow increases, leading to a state in which oxygen levels become locally depleted. These results demonstrate that the development of cortical connectivity occurs in an environment of altered energy availability that itself may play a role in shaping normal brain development. These findings have important implications for understanding the pathophysiology of abnormal developmental trajectories, and for the interpretation of functional magnetic resonance imaging data acquired in the developing brain. Copyright © 2016 the authors 0270-6474/16/366704-14$15.00/0.

Generative models for discovering sparse distributed representations.

PubMed Central

Hinton, G E; Ghahramani, Z

1997-01-01

We describe a hierarchical, generative model that can be viewed as a nonlinear generalization of factor analysis and can be implemented in a neural network. The model uses bottom-up, top-down and lateral connections to perform Bayesian perceptual inference correctly. Once perceptual inference has been performed the connection strengths can be updated using a very simple learning rule that only requires locally available information. We demonstrate that the network learns to extract sparse, distributed, hierarchical representations. PMID:9304685

Calibration of a Hall effect displacement measurement system for complex motion analysis using a neural network.

PubMed

Northey, G W; Oliver, M L; Rittenhouse, D M

2006-01-01

Biomechanics studies often require the analysis of position and orientation. Although a variety of transducer and camera systems can be utilized, a common inexpensive alternative is the Hall effect sensor. Hall effect sensors have been used extensively for one-dimensional position analysis but their non-linear behavior and cross-talk effects make them difficult to calibrate for effective and accurate two- and three-dimensional position and orientation analysis. The aim of this study was to develop and calibrate a displacement measurement system for a hydraulic-actuation joystick used for repetitive motion analysis of heavy equipment operators. The system utilizes an array of four Hall effect sensors that are all active during any joystick movement. This built-in redundancy allows the calibration to utilize fully connected feed forward neural networks in conjunction with a Microscribe 3D digitizer. A fully connected feed forward neural network with one hidden layer containing five neurons was developed. Results indicate that the ability of the neural network to accurately predict the x, y and z coordinates of the joystick handle was good with r(2) values of 0.98 and higher. The calibration technique was found to be equally as accurate when used on data collected 5 days after the initial calibration, indicating the system is robust and stable enough to not require calibration every time the joystick is used. This calibration system allowed an infinite number of joystick orientations and positions to be found within the range of joystick motion.

Handedness is related to neural mechanisms underlying hemispheric lateralization of face processing

PubMed Central

Frässle, Stefan; Krach, Sören; Paulus, Frieder Michel; Jansen, Andreas

2016-01-01

While the right-hemispheric lateralization of the face perception network is well established, recent evidence suggests that handedness affects the cerebral lateralization of face processing at the hierarchical level of the fusiform face area (FFA). However, the neural mechanisms underlying differential hemispheric lateralization of face perception in right- and left-handers are largely unknown. Using dynamic causal modeling (DCM) for fMRI, we aimed to unravel the putative processes that mediate handedness-related differences by investigating the effective connectivity in the bilateral core face perception network. Our results reveal an enhanced recruitment of the left FFA in left-handers compared to right-handers, as evidenced by more pronounced face-specific modulatory influences on both intra- and interhemispheric connections. As structural and physiological correlates of handedness-related differences in face processing, right- and left-handers varied with regard to their gray matter volume in the left fusiform gyrus and their pupil responses to face stimuli. Overall, these results describe how handedness is related to the lateralization of the core face perception network, and point to different neural mechanisms underlying face processing in right- and left-handers. In a wider context, this demonstrates the entanglement of structurally and functionally remote brain networks, suggesting a broader underlying process regulating brain lateralization. PMID:27250879

Shaping Early Reorganization of Neural Networks Promotes Motor Function after Stroke

PubMed Central

Volz, L. J.; Rehme, A. K.; Michely, J.; Nettekoven, C.; Eickhoff, S. B.; Fink, G. R.; Grefkes, C.

2016-01-01

Neural plasticity is a major factor driving cortical reorganization after stroke. We here tested whether repetitively enhancing motor cortex plasticity by means of intermittent theta-burst stimulation (iTBS) prior to physiotherapy might promote recovery of function early after stroke. Functional magnetic resonance imaging (fMRI) was used to elucidate underlying neural mechanisms. Twenty-six hospitalized, first-ever stroke patients (time since stroke: 1–16 days) with hand motor deficits were enrolled in a sham-controlled design and pseudo-randomized into 2 groups. iTBS was administered prior to physiotherapy on 5 consecutive days either over ipsilesional primary motor cortex (M1-stimulation group) or parieto-occipital vertex (control-stimulation group). Hand motor function, cortical excitability, and resting-state fMRI were assessed 1 day prior to the first stimulation and 1 day after the last stimulation. Recovery of grip strength was significantly stronger in the M1-stimulation compared to the control-stimulation group. Higher levels of motor network connectivity were associated with better motor outcome. Consistently, control-stimulated patients featured a decrease in intra- and interhemispheric connectivity of the motor network, which was absent in the M1-stimulation group. Hence, adding iTBS to prime physiotherapy in recovering stroke patients seems to interfere with motor network degradation, possibly reflecting alleviation of post-stroke diaschisis. PMID:26980614

Handedness is related to neural mechanisms underlying hemispheric lateralization of face processing

NASA Astrophysics Data System (ADS)

Frässle, Stefan; Krach, Sören; Paulus, Frieder Michel; Jansen, Andreas

2016-06-01

While the right-hemispheric lateralization of the face perception network is well established, recent evidence suggests that handedness affects the cerebral lateralization of face processing at the hierarchical level of the fusiform face area (FFA). However, the neural mechanisms underlying differential hemispheric lateralization of face perception in right- and left-handers are largely unknown. Using dynamic causal modeling (DCM) for fMRI, we aimed to unravel the putative processes that mediate handedness-related differences by investigating the effective connectivity in the bilateral core face perception network. Our results reveal an enhanced recruitment of the left FFA in left-handers compared to right-handers, as evidenced by more pronounced face-specific modulatory influences on both intra- and interhemispheric connections. As structural and physiological correlates of handedness-related differences in face processing, right- and left-handers varied with regard to their gray matter volume in the left fusiform gyrus and their pupil responses to face stimuli. Overall, these results describe how handedness is related to the lateralization of the core face perception network, and point to different neural mechanisms underlying face processing in right- and left-handers. In a wider context, this demonstrates the entanglement of structurally and functionally remote brain networks, suggesting a broader underlying process regulating brain lateralization.

Image quality assessment using deep convolutional networks

NASA Astrophysics Data System (ADS)

Li, Yezhou; Ye, Xiang; Li, Yong

2017-12-01

This paper proposes a method of accurately assessing image quality without a reference image by using a deep convolutional neural network. Existing training based methods usually utilize a compact set of linear filters for learning features of images captured by different sensors to assess their quality. These methods may not be able to learn the semantic features that are intimately related with the features used in human subject assessment. Observing this drawback, this work proposes training a deep convolutional neural network (CNN) with labelled images for image quality assessment. The ReLU in the CNN allows non-linear transformations for extracting high-level image features, providing a more reliable assessment of image quality than linear filters. To enable the neural network to take images of any arbitrary size as input, the spatial pyramid pooling (SPP) is introduced connecting the top convolutional layer and the fully-connected layer. In addition, the SPP makes the CNN robust to object deformations to a certain extent. The proposed method taking an image as input carries out an end-to-end learning process, and outputs the quality of the image. It is tested on public datasets. Experimental results show that it outperforms existing methods by a large margin and can accurately assess the image quality on images taken by different sensors of varying sizes.

Linear analysis of auto-organization in Hebbian neural networks.

PubMed

Carlos Letelier, J; Mpodozis, J

1995-01-01

The self-organization of neurotopies where neural connections follow Hebbian dynamics is framed in terms of linear operator theory. A general and exact equation describing the time evolution of the overall synaptic strength connecting two neural laminae is derived. This linear matricial equation, which is similar to the equations used to describe oscillating systems in physics, is modified by the introduction of non-linear terms, in order to capture self-organizing (or auto-organizing) processes. The behavior of a simple and small system, that contains a non-linearity that mimics a metabolic constraint, is analyzed by computer simulations. The emergence of a simple "order" (or degree of organization) in this low-dimensionality model system is discussed.

Resting state connectivity of the medial prefrontal cortex covaries with individual differences in high-frequency heart rate variability.

PubMed

Jennings, J Richard; Sheu, Lei K; Kuan, Dora C-H; Manuck, Stephen B; Gianaros, Peter J

2016-04-01

Resting high-frequency heart rate variability (HF-HRV) relates to cardiac vagal control and predicts individual differences in health and longevity, but its functional neural correlates are not well defined. The medial prefrontal cortex (mPFC) encompasses visceral control regions that are components of intrinsic networks of the brain, particularly the default mode network (DMN) and the salience network (SN). Might individual differences in resting HF-HRV covary with resting state neural activity in the DMN and SN, particularly within the mPFC? This question was addressed using fMRI data from an eyes-open, 5-min rest period during which echoplanar brain imaging yielded BOLD time series. Independent component analysis yielded functional connectivity estimates defining the DMN and SN. HF-HRV was measured in a rest period outside of the scanner. Midlife (52% female) adults were assessed in two studies (Study 1, N = 107; Study 2, N = 112). Neither overall DMN nor SN connectivity strength was related to HF-HRV. However, HF-HRV related to connectivity of one region within mPFC shared by the DMN and SN, namely, the perigenual anterior cingulate cortex, an area with connectivity to other regions involved in autonomic control. In sum, HF-HRV does not seem directly related to global resting state activity of intrinsic brain networks, but rather to more localized connectivity. A mPFC region was of particular interest as connectivity related to HF-HRV was shared by the DMN and SN. These findings may indicate a functional basis for the coordination of autonomic cardiac control with engagement and disengagement from the environment. © 2015 Society for Psychophysiological Research.

A new neural net approach to robot 3D perception and visuo-motor coordination

NASA Technical Reports Server (NTRS)

Lee, Sukhan

1992-01-01

A novel neural network approach to robot hand-eye coordination is presented. The approach provides a true sense of visual error servoing, redundant arm configuration control for collision avoidance, and invariant visuo-motor learning under gazing control. A 3-D perception network is introduced to represent the robot internal 3-D metric space in which visual error servoing and arm configuration control are performed. The arm kinematic network performs the bidirectional association between 3-D space arm configurations and joint angles, and enforces the legitimate arm configurations. The arm kinematic net is structured by a radial-based competitive and cooperative network with hierarchical self-organizing learning. The main goal of the present work is to demonstrate that the neural net representation of the robot 3-D perception net serves as an important intermediate functional block connecting robot eyes and arms.

A link prediction method for heterogeneous networks based on BP neural network

NASA Astrophysics Data System (ADS)

Li, Ji-chao; Zhao, Dan-ling; Ge, Bing-Feng; Yang, Ke-Wei; Chen, Ying-Wu

2018-04-01

Most real-world systems, composed of different types of objects connected via many interconnections, can be abstracted as various complex heterogeneous networks. Link prediction for heterogeneous networks is of great significance for mining missing links and reconfiguring networks according to observed information, with considerable applications in, for example, friend and location recommendations and disease-gene candidate detection. In this paper, we put forward a novel integrated framework, called MPBP (Meta-Path feature-based BP neural network model), to predict multiple types of links for heterogeneous networks. More specifically, the concept of meta-path is introduced, followed by the extraction of meta-path features for heterogeneous networks. Next, based on the extracted meta-path features, a supervised link prediction model is built with a three-layer BP neural network. Then, the solution algorithm of the proposed link prediction model is put forward to obtain predicted results by iteratively training the network. Last, numerical experiments on the dataset of examples of a gene-disease network and a combat network are conducted to verify the effectiveness and feasibility of the proposed MPBP. It shows that the MPBP with very good performance is superior to the baseline methods.

Mode of effective connectivity within a putative neural network differentiates moral cognitions related to care and justice ethics.

PubMed

Cáceda, Ricardo; James, G Andrew; Ely, Timothy D; Snarey, John; Kilts, Clinton D

2011-02-25

Moral sensitivity refers to the interpretive awareness of moral conflict and can be justice or care oriented. Justice ethics is associated primarily with human rights and the application of moral rules, whereas care ethics is related to human needs and a situational approach involving social emotions. Among the core brain regions involved in moral issue processing are: medial prefrontal cortex, anterior (ACC) and posterior (PCC) cingulate cortex, posterior superior temporal sulcus (pSTS), insula and amygdala. This study sought to inform the long standing debate of whether care and justice moral ethics represent one or two different forms of cognition. Model-free and model-based connectivity analysis were used to identify functional neural networks underlying care and justice ethics for a moral sensitivity task. In addition to modest differences in patterns of associated neural activity, distinct modes of functional and effective connectivity were observed for moral sensitivity for care and justice issues that were modulated by individual variation in moral ability. These results support a neurobiological differentiation between care and justice ethics and suggest that human moral behavior reflects the outcome of integrating opposing rule-based, self-other perspectives, and emotional responses.

Classes of real-world 'small-world' networks: From the neural network of C. Elegans to the web of human sexual contacts

NASA Astrophysics Data System (ADS)

Nunes Amaral, Luis A.

2002-03-01

We study the statistical properties of a variety of diverse real-world networks including the neural network of C. Elegans, food webs for seven distinct environments, transportation and technological networks, and a number of distinct social networks [1-5]. We present evidence of the occurrence of three classes of small-world networks [2]: (a) scale-free networks, characterized by a vertex connectivity distribution that decays as a power law; (b) broad-scale networks, characterized by a connectivity distribution that has a power-law regime followed by a sharp cut-off; (c) single-scale networks, characterized by a connectivity distribution with a fast decaying tail. Moreover, we note for the classes of broad-scale and single-scale networks that there are constraints limiting the addition of new links. Our results suggest that the nature of such constraints may be the controlling factor for the emergence of different classes of networks. [See http://polymer.bu.edu/ amaral/Networks.html for details and htpp://polymer.bu.edu/ amaral/Professional.html for access to PDF files of articles.] 1. M. Barthélémy, L. A. N. Amaral, Phys. Rev. Lett. 82, 3180-3183 (1999). 2. L. A. N. Amaral, A. Scala, M. Barthélémy, H. E. Stanley, Proc. Nat. Acad. Sci. USA 97, 11149-11152 (2000). 3. F. Liljeros, C. R. Edling, L. A. N. Amaral, H. E. Stanley, and Y. Åberg, Nature 411, 907-908 (2001). 4. J. Camacho, R. Guimera, L.A.N. Amaral, Phys. Rev. E RC (to appear). 5. S. Mossa, M. Barthelemy, H.E. Stanley, L.A.N. Amaral (submitted).

Global Synchronization of Multiple Recurrent Neural Networks With Time Delays via Impulsive Interactions.

PubMed

Yang, Shaofu; Guo, Zhenyuan; Wang, Jun

2017-07-01

In this paper, new results on the global synchronization of multiple recurrent neural networks (NNs) with time delays via impulsive interactions are presented. Impulsive interaction means that a number of NNs communicate with each other at impulse instants only, while they are independent at the remaining time. The communication topology among NNs is not required to be always connected and can switch ON and OFF at different impulse instants. By using the concept of sequential connectivity and the properties of stochastic matrices, a set of sufficient conditions depending on time delays is derived to ascertain global synchronization of multiple continuous-time recurrent NNs. In addition, a counterpart on the global synchronization of multiple discrete-time NNs is also discussed. Finally, two examples are presented to illustrate the results.

Making a Connection between Computational Modeling and Educational Research.

ERIC Educational Resources Information Center

Carbonaro, Michael

2003-01-01

Bruner, Goodnow, and Austin's (1956) research on concept development is reexamined from a connectionist perspective. A neural network was constructed which associates positive and negative instances of a concept with corresponding attribute values. Results suggest the simultaneous learning of attributes guided the network in constructing a faster…

How Useful Is Electroencephalography in the Diagnosis of Autism Spectrum Disorders and the Delineation of Subtypes: A Systematic Review

PubMed Central

Gurau, Oana; Bosl, William J.; Newton, Charles R.

2017-01-01

Autism spectrum disorders (ASD) are thought to be associated with abnormal neural connectivity. Presently, neural connectivity is a theoretical construct that cannot be easily measured. Research in network science and time series analysis suggests that neural network structure, a marker of neural activity, can be measured with electroencephalography (EEG). EEG can be quantified by different methods of analysis to potentially detect brain abnormalities. The aim of this review is to examine evidence for the utility of three methods of EEG signal analysis in the ASD diagnosis and subtype delineation. We conducted a review of literature in which 40 studies were identified and classified according to the principal method of EEG analysis in three categories: functional connectivity analysis, spectral power analysis, and information dynamics. All studies identified significant differences between ASD patients and non-ASD subjects. However, due to high heterogeneity in the results, generalizations could not be inferred and none of the methods alone are currently useful as a new diagnostic tool. The lack of studies prevented the analysis of these methods as tools for ASD subtypes delineation. These results confirm EEG abnormalities in ASD, but as yet not sufficient to help in the diagnosis. Future research with larger samples and more robust study designs could allow for higher sensitivity and consistency in characterizing ASD, paving the way for developing new means of diagnosis. PMID:28747892

Anti-correlations in the degree distribution increase stimulus detection performance in noisy spiking neural networks.

PubMed

Martens, Marijn B; Houweling, Arthur R; E Tiesinga, Paul H

2017-02-01

Neuronal circuits in the rodent barrel cortex are characterized by stable low firing rates. However, recent experiments show that short spike trains elicited by electrical stimulation in single neurons can induce behavioral responses. Hence, the underlying neural networks provide stability against internal fluctuations in the firing rate, while simultaneously making the circuits sensitive to small external perturbations. Here we studied whether stability and sensitivity are affected by the connectivity structure in recurrently connected spiking networks. We found that anti-correlation between the number of afferent (in-degree) and efferent (out-degree) synaptic connections of neurons increases stability against pathological bursting, relative to networks where the degrees were either positively correlated or uncorrelated. In the stable network state, stimulation of a few cells could lead to a detectable change in the firing rate. To quantify the ability of networks to detect the stimulation, we used a receiver operating characteristic (ROC) analysis. For a given level of background noise, networks with anti-correlated degrees displayed the lowest false positive rates, and consequently had the highest stimulus detection performance. We propose that anti-correlation in the degree distribution may be a computational strategy employed by sensory cortices to increase the detectability of external stimuli. We show that networks with anti-correlated degrees can in principle be formed by applying learning rules comprised of a combination of spike-timing dependent plasticity, homeostatic plasticity and pruning to networks with uncorrelated degrees. To test our prediction we suggest a novel experimental method to estimate correlations in the degree distribution.

Altered Functional Connectivity of the Default Mode Network in Low-Empathy Subjects.

PubMed

Kim, Seung Jun; Kim, Sung Eun; Kim, Hyo Eun; Han, Kiwan; Jeong, Bumseok; Kim, Jae Jin; Namkoong, Kee; Kim, Ji Woong

2017-09-01

Empathy is the ability to identify with or make a vicariously experience of another person's feelings or thoughts based on memory and/or self-referential mental simulation. The default mode network in particular is related to self-referential empathy. In order to elucidate the possible neural mechanisms underlying empathy, we investigated the functional connectivity of the default mode network in subjects from a general population. Resting state functional magnetic resonance imaging data were acquired from 19 low-empathy subjects and 18 medium-empathy subjects. An independent component analysis was used to identify the default mode network, and differences in functional connectivity strength were compared between the two groups. The low-empathy group showed lower functional connectivity of the medial prefrontal cortex and anterior cingulate cortex (Brodmann areas 9 and 32) within the default mode network, compared to the medium-empathy group. The results of the present study suggest that empathy is related to functional connectivity of the medial prefrontal cortex/anterior cingulate cortex within the default mode network. Functional decreases in connectivity among low-empathy subjects may reflect an impairment of self-referential mental simulation. © Copyright: Yonsei University College of Medicine 2017.

The Brain as an Efficient and Robust Adaptive Learner.

PubMed

Denève, Sophie; Alemi, Alireza; Bourdoukan, Ralph

2017-06-07

Understanding how the brain learns to compute functions reliably, efficiently, and robustly with noisy spiking activity is a fundamental challenge in neuroscience. Most sensory and motor tasks can be described as dynamical systems and could presumably be learned by adjusting connection weights in a recurrent biological neural network. However, this is greatly complicated by the credit assignment problem for learning in recurrent networks, e.g., the contribution of each connection to the global output error cannot be determined based only on locally accessible quantities to the synapse. Combining tools from adaptive control theory and efficient coding theories, we propose that neural circuits can indeed learn complex dynamic tasks with local synaptic plasticity rules as long as they associate two experimentally established neural mechanisms. First, they should receive top-down feedbacks driving both their activity and their synaptic plasticity. Second, inhibitory interneurons should maintain a tight balance between excitation and inhibition in the circuit. The resulting networks could learn arbitrary dynamical systems and produce irregular spike trains as variable as those observed experimentally. Yet, this variability in single neurons may hide an extremely efficient and robust computation at the population level. Copyright © 2017 Elsevier Inc. All rights reserved.

Recruitment and Consolidation of Cell Assemblies for Words by Way of Hebbian Learning and Competition in a Multi-Layer Neural Network

PubMed Central

Garagnani, Max; Wennekers, Thomas; Pulvermüller, Friedemann

2009-01-01

Current cognitive theories postulate either localist representations of knowledge or fully overlapping, distributed ones. We use a connectionist model that closely replicates known anatomical properties of the cerebral cortex and neurophysiological principles to show that Hebbian learning in a multi-layer neural network leads to memory traces (cell assemblies) that are both distributed and anatomically distinct. Taking the example of word learning based on action-perception correlation, we document mechanisms underlying the emergence of these assemblies, especially (i) the recruitment of neurons and consolidation of connections defining the kernel of the assembly along with (ii) the pruning of the cell assembly’s halo (consisting of very weakly connected cells). We found that, whereas a learning rule mapping covariance led to significant overlap and merging of assemblies, a neurobiologically grounded synaptic plasticity rule with fixed LTP/LTD thresholds produced minimal overlap and prevented merging, exhibiting competitive learning behaviour. Our results are discussed in light of current theories of language and memory. As simulations with neurobiologically realistic neural networks demonstrate here spontaneous emergence of lexical representations that are both cortically dispersed and anatomically distinct, both localist and distributed cognitive accounts receive partial support. PMID:20396612

Recruitment and Consolidation of Cell Assemblies for Words by Way of Hebbian Learning and Competition in a Multi-Layer Neural Network.

PubMed

Garagnani, Max; Wennekers, Thomas; Pulvermüller, Friedemann

2009-06-01

Current cognitive theories postulate either localist representations of knowledge or fully overlapping, distributed ones. We use a connectionist model that closely replicates known anatomical properties of the cerebral cortex and neurophysiological principles to show that Hebbian learning in a multi-layer neural network leads to memory traces (cell assemblies) that are both distributed and anatomically distinct. Taking the example of word learning based on action-perception correlation, we document mechanisms underlying the emergence of these assemblies, especially (i) the recruitment of neurons and consolidation of connections defining the kernel of the assembly along with (ii) the pruning of the cell assembly's halo (consisting of very weakly connected cells). We found that, whereas a learning rule mapping covariance led to significant overlap and merging of assemblies, a neurobiologically grounded synaptic plasticity rule with fixed LTP/LTD thresholds produced minimal overlap and prevented merging, exhibiting competitive learning behaviour. Our results are discussed in light of current theories of language and memory. As simulations with neurobiologically realistic neural networks demonstrate here spontaneous emergence of lexical representations that are both cortically dispersed and anatomically distinct, both localist and distributed cognitive accounts receive partial support.

Associative memory in phasing neuron networks

DOE Office of Scientific and Technical Information (OSTI.GOV)

Nair, Niketh S; Bochove, Erik J.; Braiman, Yehuda

2014-01-01

We studied pattern formation in a network of coupled Hindmarsh-Rose model neurons and introduced a new model for associative memory retrieval using networks of Kuramoto oscillators. Hindmarsh-Rose Neural Networks can exhibit a rich set of collective dynamics that can be controlled by their connectivity. Specifically, we showed an instance of Hebb's rule where spiking was correlated with network topology. Based on this, we presented a simple model of associative memory in coupled phase oscillators.

[Neuronal and synaptic properties: fundamentals of network plasticity].

PubMed

Le Masson, G

2000-02-01

Neurons, within the nervous system, are organized in different neural networks through synaptic connections. Two fundamental components are dynamically interacting in these functional units. The first one are the neurons themselves, and far from being simple action potential generators, they are capable of complex electrical integrative properties due to various types, number, distribution and modulation of voltage-gated ionic channels. The second elements are the synapses where a similar complexity and plasticity is found. Identifying both cellular and synaptic intrinsic properties is necessary to understand the links between neural networks behavior and physiological function, and is a useful step towards a better control of neurological diseases.

The neural basis of trait self-esteem revealed by the amplitude of low-frequency fluctuations and resting state functional connectivity

PubMed Central

Pan, Weigang; Liu, Congcong; Yang, Qian; Gu, Yan; Yin, Shouhang

2016-01-01

Self-esteem is an affective, self-evaluation of oneself and has a significant effect on mental and behavioral health. Although research has focused on the neural substrates of self-esteem, little is known about the spontaneous brain activity that is associated with trait self-esteem (TSE) during the resting state. In this study, we used the resting-state functional magnetic resonance imaging (fMRI) signal of the amplitude of low-frequency fluctuations (ALFFs) and resting state functional connectivity (RSFC) to identify TSE-related regions and networks. We found that a higher level of TSE was associated with higher ALFFs in the left ventral medial prefrontal cortex (vmPFC) and lower ALFFs in the left cuneus/lingual gyrus and right lingual gyrus. RSFC analyses revealed that the strengths of functional connectivity between the left vmPFC and bilateral hippocampus were positively correlated with TSE; however, the connections between the left vmPFC and right inferior frontal gyrus and posterior superior temporal sulcus were negatively associated with TSE. Furthermore, the strengths of functional connectivity between the left cuneus/lingual gyrus and right dorsolateral prefrontal cortex and anterior cingulate cortex were positively related to TSE. These findings indicate that TSE is linked to core regions in the default mode network and social cognition network, which is involved in self-referential processing, autobiographical memory and social cognition. PMID:26400859

Theta, mental flexibility, and post-traumatic stress disorder: connecting in the parietal cortex.

PubMed

Dunkley, Benjamin T; Sedge, Paul A; Doesburg, Sam M; Grodecki, Richard J; Jetly, Rakesh; Shek, Pang N; Taylor, Margot J; Pang, Elizabeth W

2015-01-01

Post-traumatic stress disorder (PTSD) is a mental health injury characterised by re-experiencing, avoidance, numbing and hyperarousal. Whilst the aetiology of the disorder is relatively well understood, there is debate about the prevalence of cognitive sequelae that manifest in PTSD. In particular, there are conflicting reports about deficits in executive function and mental flexibility. Even less is known about the neural changes that underlie such deficits. Here, we used magnetoencephalography to study differences in functional connectivity during a mental flexibility task in combat-related PTSD (all males, mean age = 37.4, n = 18) versus a military control (all males, mean age = 33.05, n = 19) group. We observed large-scale increases in theta connectivity in the PTSD group compared to controls. The PTSD group performance was compromised in the more attentionally-demanding task and this was characterised by 'late-stage' theta hyperconnectivity, concentrated in network connections involving right parietal cortex. Furthermore, we observed significant correlations with the connectivity strength in this region with a number of cognitive-behavioural outcomes, including measures of attention, depression and anxiety. These findings suggest atypical coordination of neural synchronisation in large scale networks contributes to deficits in mental flexibility for PTSD populations in timed, attentionally-demanding tasks, and this propensity toward network hyperconnectivity may play a more general role in the cognitive sequelae evident in this disorder.

Disrupted insula-based neural circuit organization and conflict interference in trauma-exposed youth.

PubMed

Marusak, Hilary A; Etkin, Amit; Thomason, Moriah E

2015-01-01

Childhood trauma exposure is a potent risk factor for psychopathology. Emerging research suggests that aberrant saliency processing underlies the link between early trauma exposure and later cognitive and socioemotional deficits that are hallmark of several psychiatric disorders. Here, we examine brain and behavioral responses during a face categorization conflict task, and relate these to intrinsic connectivity of the salience network (SN). The results demonstrate a unique pattern of SN dysfunction in youth exposed to trauma (n = 14) relative to comparison youth (n = 19) matched on age, sex, IQ, and sociodemographic risk. We find that trauma-exposed youth are more susceptible to conflict interference and this correlates with higher fronto-insular responses during conflict. Resting-state functional connectivity data collected in the same participants reveal increased connectivity of the insula to SN seed regions that is associated with diminished reward sensitivity, a critical risk/resilience trait following stress. In addition to altered intrinsic connectivity of the SN, we observed altered connectivity between the SN and default mode network (DMN) in trauma-exposed youth. These data uncover network-level disruptions in brain organization following one of the strongest predictors of illness, early life trauma, and demonstrate the relevance of observed neural effects for behavior and specific symptom dimensions. SN dysfunction may serve as a diathesis that contributes to illness and negative outcomes following childhood trauma.

Detection of network attacks based on adaptive resonance theory

NASA Astrophysics Data System (ADS)

Bukhanov, D. G.; Polyakov, V. M.

2018-05-01

The paper considers an approach to intrusion detection systems using a neural network of adaptive resonant theory. It suggests the structure of an intrusion detection system consisting of two types of program modules. The first module manages connections of user applications by preventing the undesirable ones. The second analyzes the incoming network traffic parameters to check potential network attacks. After attack detection, it notifies the required stations using a secure transmission channel. The paper describes the experiment on the detection and recognition of network attacks using the test selection. It also compares the obtained results with similar experiments carried out by other authors. It gives findings and conclusions on the sufficiency of the proposed approach. The obtained information confirms the sufficiency of applying the neural networks of adaptive resonant theory to analyze network traffic within the intrusion detection system.

Structure and plasticity potential of neural networks in the cerebral cortex

NASA Astrophysics Data System (ADS)

Fares, Tarec Edmond

In this thesis, we first described a theoretical framework for the analysis of spine remodeling plasticity. We provided a quantitative description of two models of spine remodeling in which the presence of a bouton is either required or not for the formation of a new synapse. We derived expressions for the density of potential synapses in the neuropil, the connectivity fraction, which is the ratio of actual to potential synapses, and the number of structurally different circuits attainable with spine remodeling. We calculated these parameters in mouse occipital cortex, rat CA1, monkey V1, and human temporal cortex. We found that on average a dendritic spine can choose among 4-7 potential targets in rodents and 10-20 potential targets in primates. The neuropil's potential for structural circuit remodeling is highest in rat CA1 (7.1-8.6 bits/mum3) and lowest in monkey V1 (1.3-1.5 bits/mum 3 We next studied the role neuron morphology plays in defining synaptic connectivity. As previously stated it is clear that only pairs of neurons with closely positioned axonal and dendritic branches can be synaptically coupled. For excitatory neurons in the cerebral cortex, ). We also evaluated the lower bound of neuron selectivity in the choice of synaptic partners. Post-synaptic excitatory neurons in rodents make synaptic contacts with more than 21-30% of pre-synaptic axons encountered with new spine growth. Primate neurons appear to be more selective, making synaptic connections with more than 7-15% of encountered axons. We next studied the role neuron morphology plays in defining synaptic connectivity. As previously stated it is clear that only pairs of neurons with closely positioned axonal and dendritic branches can be synaptically coupled. For excitatory neurons in the cerebral cortex, such axo-dendritic oppositions, or potential synapses, must be bridged by dendritic spines to form synaptic connections. To explore the rules by which synaptic connections are formed within the constraints imposed by neuron morphology, we compared the distributions of the numbers of actual and potential synapses between pre- and post-synaptic neurons forming different laminar projections in rat barrel cortex. Quantitative comparison explicitly ruled out the hypothesis that individual synapses between neurons are formed independently of each other. Instead, the data are consistent with a cooperative scheme of synapse formation, where multiple-synaptic connections between neurons are stabilized, while neurons that do not establish a critical number of synapses are not likely to remain synaptically coupled. In the above two projects, analysis of potential synapse numbers played an important role in shaping our understanding of connectivity and structural plasticity. In the third part of this thesis, we shift our attention to the study of the distribution of potential synapse numbers. This distribution is dependent on the details of neuron morphology and it defines synaptic connectivity patterns attainable with spine remodeling. To better understand how the distribution of potential synapse numbers is influenced by the overlap and the shapes of axonal and dendritic arbors, we first analyzed uniform disconnected arbors generated in silico. The resulting distributions are well described by binomial functions. We used a dataset of neurons reconstructed in 3D and generated the potential synapse distributions for neurons of different classes. Quantitative analysis showed that the binomial distribution is a good fit to this data as well. All distributions considered clustered into two categories, inhibitory to inhibitory and excitatory to excitatory projections. We showed that the distributions of potential synapse numbers are universally described by a family of single parameter (p) binomial functions, where p = 0.08, and for the inhibitory and p = 0.19 for the excitatory projections. In the last part of this thesis an attempt is made to incorporate some of the biological constraints we considered thus far, into an artificial neural network model. It became clear that several features of synaptic connectivity are ubiquitous among different cortical networks: (1) neural networks are predominately excitatory, containing roughly 80% of excitatory neurons and synapses, (2) neural networks are only sparsely interconnected, where the probabilities of finding connected neurons are always less than 50% even for neighboring cells, (3) the distribution of connection strengths has been shown to have a slow non-exponential decay. In the attempt to understand the advantage of such network architecture for learning and memory, we analyzed the associative memory capacity of a biologically constrained perceptron-like neural network model. The artificial neural network we consider consists of robust excitatory and inhibitory McCulloch and Pitts neurons with a constant firing threshold. Our theoretical results show that the capacity for associative memory storage in such networks increases with an addition of a small fraction of inhibitory neurons, while the connection probability remains below 50%. (Abstract shortened by UMI.)

A Dynamic Causal Modeling Analysis of the Effective Connectivities Underlying Top-Down Letter Processing

ERIC Educational Resources Information Center

Liu, Jiangang; Li, Jun; Rieth, Cory A.; Huber, David E.; Tian, Jie; Lee, Kang

2011-01-01

The present study employed dynamic causal modeling to investigate the effective functional connectivity between regions of the neural network involved in top-down letter processing. We used an illusory letter detection paradigm in which participants detected letters while viewing pure noise images. When participants detected letters, the response…

Mindfulness training induces structural connectome changes in insula networks.

PubMed

Sharp, Paul B; Sutton, Bradley P; Paul, Erick J; Sherepa, Nikolai; Hillman, Charles H; Cohen, Neal J; Kramer, Arthur F; Prakash, Ruchika Shaurya; Heller, Wendy; Telzer, Eva H; Barbey, Aron K

2018-05-21

Although mindfulness meditation is known to provide a wealth of psychological benefits, the neural mechanisms involved in these effects remain to be well characterized. A central question is whether the observed benefits of mindfulness training derive from specific changes in the structural brain connectome that do not result from alternative forms of experimental intervention. Measures of whole-brain and node-level structural connectome changes induced by mindfulness training were compared with those induced by cognitive and physical fitness training within a large, multi-group intervention protocol (n = 86). Whole-brain analyses examined global graph-theoretical changes in structural network topology. A hypothesis-driven approach was taken to investigate connectivity changes within the insula, which was predicted here to mediate interoceptive awareness skills that have been shown to improve through mindfulness training. No global changes were observed in whole-brain network topology. However, node-level results confirmed a priori hypotheses, demonstrating significant increases in mean connection strength in right insula across all of its connections. Present findings suggest that mindfulness strengthens interoception, operationalized here as the mean insula connection strength within the overall connectome. This finding further elucidates the neural mechanisms of mindfulness meditation and motivates new perspectives about the unique benefits of mindfulness training compared to contemporary cognitive and physical fitness interventions.

Connecting to create: expertise in musical improvisation is associated with increased functional connectivity between premotor and prefrontal areas.

PubMed

Pinho, Ana Luísa; de Manzano, Örjan; Fransson, Peter; Eriksson, Helene; Ullén, Fredrik

2014-04-30

Musicians have been used extensively to study neural correlates of long-term practice, but no studies have investigated the specific effects of training musical creativity. Here, we used human functional MRI to measure brain activity during improvisation in a sample of 39 professional pianists with varying backgrounds in classical and jazz piano playing. We found total hours of improvisation experience to be negatively associated with activity in frontoparietal executive cortical areas. In contrast, improvisation training was positively associated with functional connectivity of the bilateral dorsolateral prefrontal cortices, dorsal premotor cortices, and presupplementary areas. The effects were significant when controlling for hours of classical piano practice and age. These results indicate that even neural mechanisms involved in creative behaviors, which require a flexible online generation of novel and meaningful output, can be automated by training. Second, improvisational musical training can influence functional brain properties at a network level. We show that the greater functional connectivity seen in experienced improvisers may reflect a more efficient exchange of information within associative networks of importance for musical creativity.

Connecting to Create: Expertise in Musical Improvisation Is Associated with Increased Functional Connectivity between Premotor and Prefrontal Areas

PubMed Central

Pinho, Ana Luísa; de Manzano, Örjan; Fransson, Peter; Eriksson, Helene

2014-01-01

Musicians have been used extensively to study neural correlates of long-term practice, but no studies have investigated the specific effects of training musical creativity. Here, we used human functional MRI to measure brain activity during improvisation in a sample of 39 professional pianists with varying backgrounds in classical and jazz piano playing. We found total hours of improvisation experience to be negatively associated with activity in frontoparietal executive cortical areas. In contrast, improvisation training was positively associated with functional connectivity of the bilateral dorsolateral prefrontal cortices, dorsal premotor cortices, and presupplementary areas. The effects were significant when controlling for hours of classical piano practice and age. These results indicate that even neural mechanisms involved in creative behaviors, which require a flexible online generation of novel and meaningful output, can be automated by training. Second, improvisational musical training can influence functional brain properties at a network level. We show that the greater functional connectivity seen in experienced improvisers may reflect a more efficient exchange of information within associative networks of importance for musical creativity. PMID:24790186

Multispectral embedding-based deep neural network for three-dimensional human pose recovery

NASA Astrophysics Data System (ADS)

Yu, Jialin; Sun, Jifeng

2018-01-01

Monocular image-based three-dimensional (3-D) human pose recovery aims to retrieve 3-D poses using the corresponding two-dimensional image features. Therefore, the pose recovery performance highly depends on the image representations. We propose a multispectral embedding-based deep neural network (MSEDNN) to automatically obtain the most discriminative features from multiple deep convolutional neural networks and then embed their penultimate fully connected layers into a low-dimensional manifold. This compact manifold can explore not only the optimum output from multiple deep networks but also the complementary properties of them. Furthermore, the distribution of each hierarchy discriminative manifold is sufficiently smooth so that the training process of our MSEDNN can be effectively implemented only using few labeled data. Our proposed network contains a body joint detector and a human pose regressor that are jointly trained. Extensive experiments conducted on four databases show that our proposed MSEDNN can achieve the best recovery performance compared with the state-of-the-art methods.

Topologically invariant macroscopic statistics in balanced networks of conductance-based integrate-and-fire neurons.

PubMed

Yger, Pierre; El Boustani, Sami; Destexhe, Alain; Frégnac, Yves

2011-10-01

The relationship between the dynamics of neural networks and their patterns of connectivity is far from clear, despite its importance for understanding functional properties. Here, we have studied sparsely-connected networks of conductance-based integrate-and-fire (IF) neurons with balanced excitatory and inhibitory connections and with finite axonal propagation speed. We focused on the genesis of states with highly irregular spiking activity and synchronous firing patterns at low rates, called slow Synchronous Irregular (SI) states. In such balanced networks, we examined the "macroscopic" properties of the spiking activity, such as ensemble correlations and mean firing rates, for different intracortical connectivity profiles ranging from randomly connected networks to networks with Gaussian-distributed local connectivity. We systematically computed the distance-dependent correlations at the extracellular (spiking) and intracellular (membrane potential) levels between randomly assigned pairs of neurons. The main finding is that such properties, when they are averaged at a macroscopic scale, are invariant with respect to the different connectivity patterns, provided the excitatory-inhibitory balance is the same. In particular, the same correlation structure holds for different connectivity profiles. In addition, we examined the response of such networks to external input, and found that the correlation landscape can be modulated by the mean level of synchrony imposed by the external drive. This modulation was found again to be independent of the external connectivity profile. We conclude that first and second-order "mean-field" statistics of such networks do not depend on the details of the connectivity at a microscopic scale. This study is an encouraging step toward a mean-field description of topological neuronal networks.

Bimanual Motor Coordination in Older Adults Is Associated with Increased Functional Brain Connectivity – A Graph-Theoretical Analysis

PubMed Central

Heitger, Marcus H.; Goble, Daniel J.; Dhollander, Thijs; Dupont, Patrick; Caeyenberghs, Karen; Leemans, Alexander; Sunaert, Stefan; Swinnen, Stephan P.

2013-01-01

In bimanual coordination, older and younger adults activate a common cerebral network but the elderly also have additional activation in a secondary network of brain areas to master task performance. It remains unclear whether the functional connectivity within these primary and secondary motor networks differs between the old and the young and whether task difficulty modulates connectivity. We applied graph-theoretical network analysis (GTNA) to task-driven fMRI data in 16 elderly and 16 young participants using a bimanual coordination task including in-phase and anti-phase flexion/extension wrist movements. Network nodes for the GTNA comprised task-relevant brain areas as defined by fMRI activation foci. The elderly matched the motor performance of the young but showed an increased functional connectivity in both networks across a wide range of connectivity metrics, i.e., higher mean connectivity degree, connection strength, network density and efficiency, together with shorter mean communication path length between the network nodes and also a lower betweenness centrality. More difficult movements showed an increased connectivity in both groups. The network connectivity of both groups had “small world” character. The present findings indicate (a) that bimanual coordination in the aging brain is associated with a higher functional connectivity even between areas also activated in young adults, independently from task difficulty, and (b) that adequate motor coordination in the context of task-driven bimanual control in older adults may not be solely due to additional neural recruitment but also to aging-related changes of functional relationships between brain regions. PMID:23637982

Low Temperature Performance of High-Speed Neural Network Circuits

NASA Technical Reports Server (NTRS)

Duong, T.; Tran, M.; Daud, T.; Thakoor, A.

1995-01-01

Artificial neural networks, derived from their biological counterparts, offer a new and enabling computing paradigm specially suitable for such tasks as image and signal processing with feature classification/object recognition, global optimization, and adaptive control. When implemented in fully parallel electronic hardware, it offers orders of magnitude speed advantage. Basic building blocks of the new architecture are the processing elements called neurons implemented as nonlinear operational amplifiers with sigmoidal transfer function, interconnected through weighted connections called synapses implemented using circuitry for weight storage and multiply functions either in an analog, digital, or hybrid scheme.

Modeling of bromate formation by ozonation of surface waters in drinking water treatment.

PubMed

Legube, Bernard; Parinet, Bernard; Gelinet, Karine; Berne, Florence; Croue, Jean-Philippe

2004-04-01

The main objective of this paper is to try to develop statistically and chemically rational models for bromate formation by ozonation of clarified surface waters. The results presented here show that bromate formation by ozonation of natural waters in drinking water treatment is directly proportional to the "Ct" value ("Ctau" in this study). Moreover, this proportionality strongly depends on many parameters: increasing of pH, temperature and bromide level leading to an increase of bromate formation; ammonia and dissolved organic carbon concentrations causing a reverse effect. Taking into account limitation of theoretical modeling, we proposed to predict bromate formation by stochastic simulations (multi-linear regression and artificial neural networks methods) from 40 experiments (BrO(3)(-) vs. "Ctau") carried out with three sand filtered waters sampled on three different waterworks. With seven selected variables we used a simple architecture of neural networks, optimized by "neural connection" of SPSS Inc./Recognition Inc. The bromate modeling by artificial neural networks gives better result than multi-linear regression. The artificial neural networks model allowed us classifying variables by decreasing order of influence (for the studied cases in our variables scale): "Ctau", [N-NH(4)(+)], [Br(-)], pH, temperature, DOC, alkalinity.

Minimum spanning tree analysis of the human connectome

PubMed Central

Sommer, Iris E.; Bohlken, Marc M.; Tewarie, Prejaas; Draaisma, Laurijn; Zalesky, Andrew; Di Biase, Maria; Brown, Jesse A.; Douw, Linda; Otte, Willem M.; Mandl, René C.W.; Stam, Cornelis J.

2018-01-01

Abstract One of the challenges of brain network analysis is to directly compare network organization between subjects, irrespective of the number or strength of connections. In this study, we used minimum spanning tree (MST; a unique, acyclic subnetwork with a fixed number of connections) analysis to characterize the human brain network to create an empirical reference network. Such a reference network could be used as a null model of connections that form the backbone structure of the human brain. We analyzed the MST in three diffusion‐weighted imaging datasets of healthy adults. The MST of the group mean connectivity matrix was used as the empirical null‐model. The MST of individual subjects matched this reference MST for a mean 58%–88% of connections, depending on the analysis pipeline. Hub nodes in the MST matched with previously reported locations of hub regions, including the so‐called rich club nodes (a subset of high‐degree, highly interconnected nodes). Although most brain network studies have focused primarily on cortical connections, cortical–subcortical connections were consistently present in the MST across subjects. Brain network efficiency was higher when these connections were included in the analysis, suggesting that these tracts may be utilized as the major neural communication routes. Finally, we confirmed that MST characteristics index the effects of brain aging. We conclude that the MST provides an elegant and straightforward approach to analyze structural brain networks, and to test network topological features of individual subjects in comparison to empirical null models. PMID:29468769

Neural correlates and network connectivity underlying narrative production and comprehension: a combined fMRI and PET study.

PubMed

AbdulSabur, Nuria Y; Xu, Yisheng; Liu, Siyuan; Chow, Ho Ming; Baxter, Miranda; Carson, Jessica; Braun, Allen R

2014-08-01

The neural correlates of narrative production and comprehension remain poorly understood. Here, using positron emission tomography (PET), functional magnetic resonance imaging (fMRI), contrast and functional network connectivity analyses we comprehensively characterize the neural mechanisms underlying these complex behaviors. Eighteen healthy subjects told and listened to fictional stories during scanning. In addition to traditional language areas (e.g., left inferior frontal and posterior middle temporal gyri), both narrative production and comprehension engaged regions associated with mentalizing and situation model construction (e.g., dorsomedial prefrontal cortex, precuneus and inferior parietal lobules) as well as neocortical premotor areas, such as the pre-supplementary motor area and left dorsal premotor cortex. Narrative comprehension alone showed marked bilaterality, activating right hemisphere homologs of perisylvian language areas. Narrative production remained predominantly left lateralized, uniquely activating executive and motor-related regions essential to language formulation and articulation. Connectivity analyses revealed strong associations between language areas and the superior and middle temporal gyri during both tasks. However, only during storytelling were these same language-related regions connected to cortical and subcortical motor regions. In contrast, during story comprehension alone, they were strongly linked to regions supporting mentalizing. Thus, when employed in a more complex, ecologically-valid context, language production and comprehension show both overlapping and idiosyncratic patterns of activation and functional connectivity. Importantly, in each case the language system is integrated with regions that support other cognitive and sensorimotor domains. Copyright © 2014. Published by Elsevier Ltd.

Abnormal neural activities of directional brain networks in patients with long-term bilateral hearing loss.

PubMed

Xu, Long-Chun; Zhang, Gang; Zou, Yue; Zhang, Min-Feng; Zhang, Dong-Sheng; Ma, Hua; Zhao, Wen-Bo; Zhang, Guang-Yu

2017-10-13

The objective of the study is to provide some implications for rehabilitation of hearing impairment by investigating changes of neural activities of directional brain networks in patients with long-term bilateral hearing loss. Firstly, we implemented neuropsychological tests of 21 subjects (11 patients with long-term bilateral hearing loss, and 10 subjects with normal hearing), and these tests revealed significant differences between the deaf group and the controls. Then we constructed the individual specific virtual brain based on functional magnetic resonance data of participants by utilizing effective connectivity and multivariate regression methods. We exerted the stimulating signal to the primary auditory cortices of the virtual brain and observed the brain region activations. We found that patients with long-term bilateral hearing loss presented weaker brain region activations in the auditory and language networks, but enhanced neural activities in the default mode network as compared with normally hearing subjects. Especially, the right cerebral hemisphere presented more changes than the left. Additionally, weaker neural activities in the primary auditor cortices were also strongly associated with poorer cognitive performance. Finally, causal analysis revealed several interactional circuits among activated brain regions, and these interregional causal interactions implied that abnormal neural activities of the directional brain networks in the deaf patients impacted cognitive function.

Corpus callosum segmentation using deep neural networks with prior information from multi-atlas images

NASA Astrophysics Data System (ADS)

Park, Gilsoon; Hong, Jinwoo; Lee, Jong-Min

2018-03-01

In human brain, Corpus Callosum (CC) is the largest white matter structure, connecting between right and left hemispheres. Structural features such as shape and size of CC in midsagittal plane are of great significance for analyzing various neurological diseases, for example Alzheimer's disease, autism and epilepsy. For quantitative and qualitative studies of CC in brain MR images, robust segmentation of CC is important. In this paper, we present a novel method for CC segmentation. Our approach is based on deep neural networks and the prior information generated from multi-atlas images. Deep neural networks have recently shown good performance in various image processing field. Convolutional neural networks (CNN) have shown outstanding performance for classification and segmentation in medical image fields. We used convolutional neural networks for CC segmentation. Multi-atlas based segmentation model have been widely used in medical image segmentation because atlas has powerful information about the target structure we want to segment, consisting of MR images and corresponding manual segmentation of the target structure. We combined the prior information, such as location and intensity distribution of target structure (i.e. CC), made from multi-atlas images in CNN training process for more improving training. The CNN with prior information showed better segmentation performance than without.

Reward-Modulated Hebbian Plasticity as Leverage for Partially Embodied Control in Compliant Robotics

PubMed Central

Burms, Jeroen; Caluwaerts, Ken; Dambre, Joni

2015-01-01

In embodied computation (or morphological computation), part of the complexity of motor control is offloaded to the body dynamics. We demonstrate that a simple Hebbian-like learning rule can be used to train systems with (partial) embodiment, and can be extended outside of the scope of traditional neural networks. To this end, we apply the learning rule to optimize the connection weights of recurrent neural networks with different topologies and for various tasks. We then apply this learning rule to a simulated compliant tensegrity robot by optimizing static feedback controllers that directly exploit the dynamics of the robot body. This leads to partially embodied controllers, i.e., hybrid controllers that naturally integrate the computations that are performed by the robot body into a neural network architecture. Our results demonstrate the universal applicability of reward-modulated Hebbian learning. Furthermore, they demonstrate the robustness of systems trained with the learning rule. This study strengthens our belief that compliant robots should or can be seen as computational units, instead of dumb hardware that needs a complex controller. This link between compliant robotics and neural networks is also the main reason for our search for simple universal learning rules for both neural networks and robotics. PMID:26347645

Thinking Like a Human

NASA Technical Reports Server (NTRS)

1999-01-01

Accurate Automation Corporation (AAC) of Chattanooga, TN, developed a neural network processor (NNP) for use onboard the NASA- and Air Force-sponsored LoFLYTE aircraft. The processor is modeled after connections in the brain.

The Effects of GABAergic Polarity Changes on Episodic Neural Network Activity in Developing Neural Systems.

PubMed

Blanco, Wilfredo; Bertram, Richard; Tabak, Joël

2017-01-01

Early in development, neural systems have primarily excitatory coupling, where even GABAergic synapses are excitatory. Many of these systems exhibit spontaneous episodes of activity that have been characterized through both experimental and computational studies. As development progress the neural system goes through many changes, including synaptic remodeling, intrinsic plasticity in the ion channel expression, and a transformation of GABAergic synapses from excitatory to inhibitory. What effect each of these, and other, changes have on the network behavior is hard to know from experimental studies since they all happen in parallel. One advantage of a computational approach is that one has the ability to study developmental changes in isolation. Here, we examine the effects of GABAergic synapse polarity change on the spontaneous activity of both a mean field and a neural network model that has both glutamatergic and GABAergic coupling, representative of a developing neural network. We find some intuitive behavioral changes as the GABAergic neurons go from excitatory to inhibitory, shared by both models, such as a decrease in the duration of episodes. We also find some paradoxical changes in the activity that are only present in the neural network model. In particular, we find that during early development the inter-episode durations become longer on average, while later in development they become shorter. In addressing this unexpected finding, we uncover a priming effect that is particularly important for a small subset of neurons, called the "intermediate neurons." We characterize these neurons and demonstrate why they are crucial to episode initiation, and why the paradoxical behavioral change result from priming of these neurons. The study illustrates how even arguably the simplest of developmental changes that occurs in neural systems can present non-intuitive behaviors. It also makes predictions about neural network behavioral changes that occur during development that may be observable even in actual neural systems where these changes are convoluted with changes in synaptic connectivity and intrinsic neural plasticity.

Density-based clustering: A 'landscape view' of multi-channel neural data for inference and dynamic complexity analysis.

PubMed

Baglietto, Gabriel; Gigante, Guido; Del Giudice, Paolo

2017-01-01

Two, partially interwoven, hot topics in the analysis and statistical modeling of neural data, are the development of efficient and informative representations of the time series derived from multiple neural recordings, and the extraction of information about the connectivity structure of the underlying neural network from the recorded neural activities. In the present paper we show that state-space clustering can provide an easy and effective option for reducing the dimensionality of multiple neural time series, that it can improve inference of synaptic couplings from neural activities, and that it can also allow the construction of a compact representation of the multi-dimensional dynamics, that easily lends itself to complexity measures. We apply a variant of the 'mean-shift' algorithm to perform state-space clustering, and validate it on an Hopfield network in the glassy phase, in which metastable states are largely uncorrelated from memories embedded in the synaptic matrix. In this context, we show that the neural states identified as clusters' centroids offer a parsimonious parametrization of the synaptic matrix, which allows a significant improvement in inferring the synaptic couplings from the neural activities. Moving to the more realistic case of a multi-modular spiking network, with spike-frequency adaptation inducing history-dependent effects, we propose a procedure inspired by Boltzmann learning, but extending its domain of application, to learn inter-module synaptic couplings so that the spiking network reproduces a prescribed pattern of spatial correlations; we then illustrate, in the spiking network, how clustering is effective in extracting relevant features of the network's state-space landscape. Finally, we show that the knowledge of the cluster structure allows casting the multi-dimensional neural dynamics in the form of a symbolic dynamics of transitions between clusters; as an illustration of the potential of such reduction, we define and analyze a measure of complexity of the neural time series.

Fully Connected Cascade Artificial Neural Network Architecture for Attention Deficit Hyperactivity Disorder Classification From Functional Magnetic Resonance Imaging Data.

PubMed

Deshpande, Gopikrishna; Wang, Peng; Rangaprakash, D; Wilamowski, Bogdan

2015-12-01

Automated recognition and classification of brain diseases are of tremendous value to society. Attention deficit hyperactivity disorder (ADHD) is a diverse spectrum disorder whose diagnosis is based on behavior and hence will benefit from classification utilizing objective neuroimaging measures. Toward this end, an international competition was conducted for classifying ADHD using functional magnetic resonance imaging data acquired from multiple sites worldwide. Here, we consider the data from this competition as an example to illustrate the utility of fully connected cascade (FCC) artificial neural network (ANN) architecture for performing classification. We employed various directional and nondirectional brain connectivity-based methods to extract discriminative features which gave better classification accuracy compared to raw data. Our accuracy for distinguishing ADHD from healthy subjects was close to 90% and between the ADHD subtypes was close to 95%. Further, we show that, if properly used, FCC ANN performs very well compared to other classifiers such as support vector machines in terms of accuracy, irrespective of the feature used. Finally, the most discriminative connectivity features provided insights about the pathophysiology of ADHD and showed reduced and altered connectivity involving the left orbitofrontal cortex and various cerebellar regions in ADHD.

Synchrony between sensory and cognitive networks is associated with subclinical variation in autistic traits

PubMed Central

Young, Jacob S.; Smith, David V.; Coutlee, Christopher G.; Huettel, Scott A.

2015-01-01

Individuals with autistic spectrum disorders exhibit distinct personality traits linked to attentional, social, and affective functions, and those traits are expressed with varying levels of severity in the neurotypical and subclinical population. Variation in autistic traits has been linked to reduced functional and structural connectivity (i.e., underconnectivity, or reduced synchrony) with neural networks modulated by attentional, social, and affective functions. Yet, it remains unclear whether reduced synchrony between these neural networks contributes to autistic traits. To investigate this issue, we used functional magnetic resonance imaging to record brain activation while neurotypical participants who varied in their subclinical scores on the Autism-Spectrum Quotient (AQ) viewed alternating blocks of social and nonsocial stimuli (i.e., images of faces and of landscape scenes). We used independent component analysis (ICA) combined with a spatiotemporal regression to quantify synchrony between neural networks. Our results indicated that decreased synchrony between the executive control network (ECN) and a face-scene network (FSN) predicted higher scores on the AQ. This relationship was not explained by individual differences in head motion, preferences for faces, or personality variables related to social cognition. Our findings build on clinical reports by demonstrating that reduced synchrony between distinct neural networks contributes to a range of subclinical autistic traits. PMID:25852527

Atypical language laterality is associated with large-scale disruption of network integration in children with intractable focal epilepsy.

PubMed

Ibrahim, George M; Morgan, Benjamin R; Doesburg, Sam M; Taylor, Margot J; Pang, Elizabeth W; Donner, Elizabeth; Go, Cristina Y; Rutka, James T; Snead, O Carter

2015-04-01

Epilepsy is associated with disruption of integration in distributed networks, together with altered localization for functions such as expressive language. The relation between atypical network connectivity and altered localization is unknown. In the current study we tested whether atypical expressive language laterality was associated with the alteration of large-scale network integration in children with medically-intractable localization-related epilepsy (LRE). Twenty-three right-handed children (age range 8-17) with medically-intractable LRE performed a verb generation task in fMRI. Language network activation was identified and the Laterality index (LI) was calculated within the pars triangularis and pars opercularis. Resting-state data from the same cohort were subjected to independent component analysis. Dual regression was used to identify associations between resting-state integration and LI values. Higher positive values of the LI, indicating typical language localization were associated with stronger functional integration of various networks including the default mode network (DMN). The normally symmetric resting-state networks showed a pattern of lateralized connectivity mirroring that of language function. The association between atypical language localization and network integration implies a widespread disruption of neural network development. These findings may inform the interpretation of localization studies by providing novel insights into reorganization of neural networks in epilepsy. Copyright © 2015 Elsevier Ltd. All rights reserved.

Functional neural changes associated with acquired amusia across different stages of recovery after stroke.

PubMed

Sihvonen, Aleksi J; Särkämö, Teppo; Ripollés, Pablo; Leo, Vera; Saunavaara, Jani; Parkkola, Riitta; Rodríguez-Fornells, Antoni; Soinila, Seppo

2017-09-12

Brain damage causing acquired amusia disrupts the functional music processing system, creating a unique opportunity to investigate the critical neural architectures of musical processing in the brain. In this longitudinal fMRI study of stroke patients (N = 41) with a 6-month follow-up, we used natural vocal music (sung with lyrics) and instrumental music stimuli to uncover brain activation and functional network connectivity changes associated with acquired amusia and its recovery. In the acute stage, amusic patients exhibited decreased activation in right superior temporal areas compared to non-amusic patients during instrumental music listening. During the follow-up, the activation deficits expanded to comprise a wide-spread bilateral frontal, temporal, and parietal network. The amusics showed less activation deficits to vocal music, suggesting preserved processing of singing in the amusic brain. Compared to non-recovered amusics, recovered amusics showed increased activation to instrumental music in bilateral frontoparietal areas at 3 months and in right middle and inferior frontal areas at 6 months. Amusia recovery was also associated with increased functional connectivity in right and left frontoparietal attention networks to instrumental music. Overall, our findings reveal the dynamic nature of deficient activation and connectivity patterns in acquired amusia and highlight the role of dorsal networks in amusia recovery.

Role of Graph Architecture in Controlling Dynamical Networks with Applications to Neural Systems.

PubMed

Kim, Jason Z; Soffer, Jonathan M; Kahn, Ari E; Vettel, Jean M; Pasqualetti, Fabio; Bassett, Danielle S

2018-01-01

Networked systems display complex patterns of interactions between components. In physical networks, these interactions often occur along structural connections that link components in a hard-wired connection topology, supporting a variety of system-wide dynamical behaviors such as synchronization. While descriptions of these behaviors are important, they are only a first step towards understanding and harnessing the relationship between network topology and system behavior. Here, we use linear network control theory to derive accurate closed-form expressions that relate the connectivity of a subset of structural connections (those linking driver nodes to non-driver nodes) to the minimum energy required to control networked systems. To illustrate the utility of the mathematics, we apply this approach to high-resolution connectomes recently reconstructed from Drosophila, mouse, and human brains. We use these principles to suggest an advantage of the human brain in supporting diverse network dynamics with small energetic costs while remaining robust to perturbations, and to perform clinically accessible targeted manipulation of the brain's control performance by removing single edges in the network. Generally, our results ground the expectation of a control system's behavior in its network architecture, and directly inspire new directions in network analysis and design via distributed control.

Role of graph architecture in controlling dynamical networks with applications to neural systems

NASA Astrophysics Data System (ADS)

Kim, Jason Z.; Soffer, Jonathan M.; Kahn, Ari E.; Vettel, Jean M.; Pasqualetti, Fabio; Bassett, Danielle S.

2018-01-01

Networked systems display complex patterns of interactions between components. In physical networks, these interactions often occur along structural connections that link components in a hard-wired connection topology, supporting a variety of system-wide dynamical behaviours such as synchronization. Although descriptions of these behaviours are important, they are only a first step towards understanding and harnessing the relationship between network topology and system behaviour. Here, we use linear network control theory to derive accurate closed-form expressions that relate the connectivity of a subset of structural connections (those linking driver nodes to non-driver nodes) to the minimum energy required to control networked systems. To illustrate the utility of the mathematics, we apply this approach to high-resolution connectomes recently reconstructed from Drosophila, mouse, and human brains. We use these principles to suggest an advantage of the human brain in supporting diverse network dynamics with small energetic costs while remaining robust to perturbations, and to perform clinically accessible targeted manipulation of the brain's control performance by removing single edges in the network. Generally, our results ground the expectation of a control system's behaviour in its network architecture, and directly inspire new directions in network analysis and design via distributed control.

Growth-related neural reorganization and the autism phenotype: a test of the hypothesis that altered brain growth leads to altered connectivity

PubMed Central

Lewis, John D.; Elman, Jeffrey L.

2009-01-01

Theoretical considerations, and findings from computational modeling, comparative neuroanatomy and developmental neuroscience, motivate the hypothesis that a deviant brain growth trajectory will lead to deviant patterns of change in cortico-cortical connectivity. Differences in brain size during development will alter the relative cost and effectiveness of short- and long-distance connections, and should thus impact the growth and retention of connections. Reduced brain size should favor long-distance connectivity; brain overgrowth should favor short-distance connectivity; and inconsistent deviations from the normal growth trajectory – as occurs in autism – should result in potentially disruptive changes to established patterns of functional and physical connectivity during development. To explore this hypothesis, neural networks which modeled inter-hemispheric interaction were grown at the rate of either typically developing children or children with autism. The influence of the length of the inter-hemispheric connections was analyzed at multiple developmental time-points. The networks that modeled autistic growth were less affected by removal of the inter-hemispheric connections than those that modeled normal growth – indicating a reduced reliance on long-distance connections – for short response times, and this difference increased substantially at approximately 24 simulated months of age. The performance of the networks showed a corresponding decline during development. And direct analysis of the connection weights showed a parallel reduction in connectivity. These modeling results support the hypothesis that the deviant growth trajectory in autism spectrum disorders may lead to a disruption of established patterns of functional connectivity during development, with potentially negative behavioral consequences, and a subsequent reduction in physical connectivity. The results are discussed in relation to the growing body of evidence of reduced functional and structural connectivity in autism, and in relation to the behavioral phenotype, particularly the developmental aspects. PMID:18171375

White-Matter Structural Connectivity Underlying Human Laughter-Related Traits Processing.

PubMed

Wu, Ching-Lin; Zhong, Suyu; Chan, Yu-Chen; Chen, Hsueh-Chih; Gong, Gaolang; He, Yong; Li, Ping

2016-01-01

Most research into the neural mechanisms of humor has not explicitly focused on the association between emotion and humor on the brain white matter networks mediating this connection. However, this connection is especially salient in gelotophobia (the fear of being laughed at), which is regarded as the presentation of humorlessness, and two related traits, gelotophilia (the enjoyment of being laughed at) and katagelasticism (the enjoyment of laughing at others). Here, we explored whether the topological properties of white matter networks can account for the individual differences in the laughter-related traits of 31 healthy adults. We observed a significant negative correlation between gelotophobia scores and the clustering coefficient, local efficiency and global efficiency, but a positive association between gelotophobia scores and path length in the brain's white matter network. Moreover, the current study revealed that with increasing individual fear of being laughed at, the linking efficiencies in superior frontal gyrus, anterior cingulate cortex, parahippocampal gyrus, and middle temporal gyrus decreased. However, there were no significant correlations between either gelotophilia or katagelasticism scores or the topological properties of the brain white matter network. These findings suggest that the fear of being laughed at is directly related to the level of local and global information processing of the brain network, which might provide new insights into the neural mechanisms of the humor information processing.

White-Matter Structural Connectivity Underlying Human Laughter-Related Traits Processing

PubMed Central

Wu, Ching-Lin; Zhong, Suyu; Chan, Yu-Chen; Chen, Hsueh-Chih; Gong, Gaolang; He, Yong; Li, Ping

2016-01-01

Most research into the neural mechanisms of humor has not explicitly focused on the association between emotion and humor on the brain white matter networks mediating this connection. However, this connection is especially salient in gelotophobia (the fear of being laughed at), which is regarded as the presentation of humorlessness, and two related traits, gelotophilia (the enjoyment of being laughed at) and katagelasticism (the enjoyment of laughing at others). Here, we explored whether the topological properties of white matter networks can account for the individual differences in the laughter-related traits of 31 healthy adults. We observed a significant negative correlation between gelotophobia scores and the clustering coefficient, local efficiency and global efficiency, but a positive association between gelotophobia scores and path length in the brain's white matter network. Moreover, the current study revealed that with increasing individual fear of being laughed at, the linking efficiencies in superior frontal gyrus, anterior cingulate cortex, parahippocampal gyrus, and middle temporal gyrus decreased. However, there were no significant correlations between either gelotophilia or katagelasticism scores or the topological properties of the brain white matter network. These findings suggest that the fear of being laughed at is directly related to the level of local and global information processing of the brain network, which might provide new insights into the neural mechanisms of the humor information processing. PMID:27833572

Disruption of functional networks in dyslexia: a whole-brain, data-driven analysis of connectivity.

PubMed

Finn, Emily S; Shen, Xilin; Holahan, John M; Scheinost, Dustin; Lacadie, Cheryl; Papademetris, Xenophon; Shaywitz, Sally E; Shaywitz, Bennett A; Constable, R Todd

2014-09-01

Functional connectivity analyses of functional magnetic resonance imaging data are a powerful tool for characterizing brain networks and how they are disrupted in neural disorders. However, many such analyses examine only one or a small number of a priori seed regions. Studies that consider the whole brain frequently rely on anatomic atlases to define network nodes, which might result in mixing distinct activation time-courses within a single node. Here, we improve upon previous methods by using a data-driven brain parcellation to compare connectivity profiles of dyslexic (DYS) versus non-impaired (NI) readers in the first whole-brain functional connectivity analysis of dyslexia. Whole-brain connectivity was assessed in children (n = 75; 43 NI, 32 DYS) and adult (n = 104; 64 NI, 40 DYS) readers. Compared to NI readers, DYS readers showed divergent connectivity within the visual pathway and between visual association areas and prefrontal attention areas; increased right-hemisphere connectivity; reduced connectivity in the visual word-form area (part of the left fusiform gyrus specialized for printed words); and persistent connectivity to anterior language regions around the inferior frontal gyrus. Together, findings suggest that NI readers are better able to integrate visual information and modulate their attention to visual stimuli, allowing them to recognize words on the basis of their visual properties, whereas DYS readers recruit altered reading circuits and rely on laborious phonology-based "sounding out" strategies into adulthood. These results deepen our understanding of the neural basis of dyslexia and highlight the importance of synchrony between diverse brain regions for successful reading. © 2013 Society of Biological Psychiatry Published by Society of Biological Psychiatry All rights reserved.

Effects of Nerve Injury and Segmental Regeneration on the Cellular Correlates of Neural Morphallaxis

PubMed Central

Martinez, Veronica G.; Manson, Josiah M.B.; Zoran, Mark J.

2009-01-01

Functional recovery of neural networks after injury requires a series of signaling events similar to the embryonic processes that governed initial network construction. Neural morphallaxis, a form of nervous system regeneration, involves reorganization of adult neural connectivity patterns. Neural morphallaxis in the worm, Lumbriculus variegatus, occurs during asexual reproduction and segmental regeneration, as body fragments acquire new positional identities along the anterior–posterior axis. Ectopic head (EH) formation, induced by ventral nerve cord lesion, generated morphallactic plasticity including the reorganization of interneuronal sensory fields and the induction of a molecular marker of neural morphallaxis. Morphallactic changes occurred only in segments posterior to an EH. Neither EH formation, nor neural morphallaxis was observed after dorsal body lesions, indicating a role for nerve cord injury in morphallaxis induction. Furthermore, a hierarchical system of neurobehavioral control was observed, where anterior heads were dominant and an EH controlled body movements only in the absence of the anterior head. Both suppression of segmental regeneration and blockade of asexual fission, after treatment with boric acid, disrupted the maintenance of neural morphallaxis, but did not block its induction. Therefore, segmental regeneration (i.e., epimorphosis) may not be required for the induction of morphallactic remodeling of neural networks. However, on-going epimorphosis appears necessary for the long-term consolidation of cellular and molecular mechanisms underlying the morphallaxis of neural circuitry. PMID:18561185

Theory of correlation in a network with synaptic depression

NASA Astrophysics Data System (ADS)

Igarashi, Yasuhiko; Oizumi, Masafumi; Okada, Masato

2012-01-01

Synaptic depression affects not only the mean responses of neurons but also the correlation of response variability in neural populations. Although previous studies have constructed a theory of correlation in a spiking neuron model by using the mean-field theory framework, synaptic depression has not been taken into consideration. We expanded the previous theoretical framework in this study to spiking neuron models with short-term synaptic depression. On the basis of this theory we analytically calculated neural correlations in a ring attractor network with Mexican-hat-type connectivity, which was used as a model of the primary visual cortex. The results revealed that synaptic depression reduces neural correlation, which could be beneficial for sensory coding. Furthermore, our study opens the way for theoretical studies on the effect of interaction change on the linear response function in large stochastic networks.

Modeling the thermotaxis behavior of C.elegans based on the artificial neural network.

PubMed

Li, Mingxu; Deng, Xin; Wang, Jin; Chen, Qiaosong; Tang, Yun

2016-07-03

ASBTRACT This research aims at modeling the thermotaxis behavior of C.elegans which is a kind of nematode with full clarified neuronal connections. Firstly, this work establishes the motion model which can perform the undulatory locomotion with turning behavior. Secondly, the thermotaxis behavior is modeled by nonlinear functions and the nonlinear functions are learned by artificial neural network. Once the artificial neural networks have been well trained, they can perform the desired thermotaxis behavior. Last, several testing simulations are carried out to verify the effectiveness of the model for thermotaxis behavior. This work also analyzes the different performances of the model under different environments. The testing results reveal the essence of the thermotaxis of C.elegans to some extent, and theoretically support the research on the navigation of the crawling robots.

Network architecture of the cerebral nuclei (basal ganglia) association and commissural connectome.

PubMed

Swanson, Larry W; Sporns, Olaf; Hahn, Joel D

2016-10-04

The cerebral nuclei form the ventral division of the cerebral hemisphere and are thought to play an important role in neural systems controlling somatic movement and motivation. Network analysis was used to define global architectural features of intrinsic cerebral nuclei circuitry in one hemisphere (association connections) and between hemispheres (commissural connections). The analysis was based on more than 4,000 reports of histologically defined axonal connections involving all 45 gray matter regions of the rat cerebral nuclei and revealed the existence of four asymmetrically interconnected modules. The modules form four topographically distinct longitudinal columns that only partly correspond to previous interpretations of cerebral nuclei structure-function organization. The network of connections within and between modules in one hemisphere or the other is quite dense (about 40% of all possible connections), whereas the network of connections between hemispheres is weak and sparse (only about 5% of all possible connections). Particularly highly interconnected regions (rich club and hubs within it) form a topologically continuous band extending through two of the modules. Connection path lengths among numerous pairs of regions, and among some of the network's modules, are relatively long, thus accounting for low global efficiency in network communication. These results provide a starting point for reexamining the connectional organization of the cerebral hemispheres as a whole (right and left cerebral cortex and cerebral nuclei together) and their relation to the rest of the nervous system.

Diagonal recurrent neural network based adaptive control of nonlinear dynamical systems using lyapunov stability criterion.

PubMed

Kumar, Rajesh; Srivastava, Smriti; Gupta, J R P

2017-03-01

In this paper adaptive control of nonlinear dynamical systems using diagonal recurrent neural network (DRNN) is proposed. The structure of DRNN is a modification of fully connected recurrent neural network (FCRNN). Presence of self-recurrent neurons in the hidden layer of DRNN gives it an ability to capture the dynamic behaviour of the nonlinear plant under consideration (to be controlled). To ensure stability, update rules are developed using lyapunov stability criterion. These rules are then used for adjusting the various parameters of DRNN. The responses of plants obtained with DRNN are compared with those obtained when multi-layer feed forward neural network (MLFFNN) is used as a controller. Also, in example 4, FCRNN is also investigated and compared with DRNN and MLFFNN. Robustness of the proposed control scheme is also tested against parameter variations and disturbance signals. Four simulation examples including one-link robotic manipulator and inverted pendulum are considered on which the proposed controller is applied. The results so obtained show the superiority of DRNN over MLFFNN as a controller. Copyright © 2017 ISA. Published by Elsevier Ltd. All rights reserved.

From biological neural networks to thinking machines: Transitioning biological organizational principles to computer technology

NASA Technical Reports Server (NTRS)

Ross, Muriel D.

1991-01-01

The three-dimensional organization of the vestibular macula is under study by computer assisted reconstruction and simulation methods as a model for more complex neural systems. One goal of this research is to transition knowledge of biological neural network architecture and functioning to computer technology, to contribute to the development of thinking computers. Maculas are organized as weighted neural networks for parallel distributed processing of information. The network is characterized by non-linearity of its terminal/receptive fields. Wiring appears to develop through constrained randomness. A further property is the presence of two main circuits, highly channeled and distributed modifying, that are connected through feedforward-feedback collaterals and biasing subcircuit. Computer simulations demonstrate that differences in geometry of the feedback (afferent) collaterals affects the timing and the magnitude of voltage changes delivered to the spike initiation zone. Feedforward (efferent) collaterals act as voltage followers and likely inhibit neurons of the distributed modifying circuit. These results illustrate the importance of feedforward-feedback loops, of timing, and of inhibition in refining neural network output. They also suggest that it is the distributed modifying network that is most involved in adaptation, memory, and learning. Tests of macular adaptation, through hyper- and microgravitational studies, support this hypothesis since synapses in the distributed modifying circuit, but not the channeled circuit, are altered. Transitioning knowledge of biological systems to computer technology, however, remains problematical.

Dichotomous Dynamics in E-I Networks with Strongly and Weakly Intra-connected Inhibitory Neurons

PubMed Central

Rich, Scott; Zochowski, Michal; Booth, Victoria

2017-01-01

The interconnectivity between excitatory and inhibitory neural networks informs mechanisms by which rhythmic bursts of excitatory activity can be produced in the brain. One such mechanism, Pyramidal Interneuron Network Gamma (PING), relies primarily upon reciprocal connectivity between the excitatory and inhibitory networks, while also including intra-connectivity of inhibitory cells. The causal relationship between excitatory activity and the subsequent burst of inhibitory activity is of paramount importance to the mechanism and has been well studied. However, the role of the intra-connectivity of the inhibitory network, while important for PING, has not been studied in detail, as most analyses of PING simply assume that inhibitory intra-connectivity is strong enough to suppress subsequent firing following the initial inhibitory burst. In this paper we investigate the role that the strength of inhibitory intra-connectivity plays in determining the dynamics of PING-style networks. We show that networks with weak inhibitory intra-connectivity exhibit variations in burst dynamics of both the excitatory and inhibitory cells that are not obtained with strong inhibitory intra-connectivity. Networks with weak inhibitory intra-connectivity exhibit excitatory rhythmic bursts with weak excitatory-to-inhibitory synapses for which classical PING networks would show no rhythmic activity. Additionally, variations in dynamics of these networks as the excitatory-to-inhibitory synaptic weight increases illustrates the important role that consistent pattern formation in the inhibitory cells serves in maintaining organized and periodic excitatory bursts. Finally, motivated by these results and the known diversity of interneurons, we show that a PING-style network with two inhibitory subnetworks, one strongly intra-connected and one weakly intra-connected, exhibits organized and periodic excitatory activity over a larger parameter regime than networks with a homogeneous inhibitory population. Taken together, these results serve to better articulate the role of inhibitory intra-connectivity in generating PING-like rhythms, while also revealing how heterogeneity amongst inhibitory synapses might make such rhythms more robust to a variety of network parameters. PMID:29326558

Functional connectivity evidence of cortico-cortico inhibition in temporal lobe epilepsy.

PubMed

Tracy, Joseph I; Osipowicz, Karol; Spechler, Philip; Sharan, Ashwini; Skidmore, Christopher; Doucet, Gaelle; Sperling, Michael R

2014-01-01

Epileptic seizures can initiate a neural circuit and lead to aberrant neural communication with brain areas outside the epileptogenic region. We focus on interictal activity in focal temporal lobe epilepsy and evaluate functional connectivity (FC) differences that emerge as function of bilateral versus strictly unilateral epileptiform activity. We assess the strength of FC at rest between the ictal and non-ictal temporal lobes, in addition to whole brain connectivity with the ictal temporal lobe. Results revealed strong connectivity between the temporal lobes for both patient groups, but this did not vary as a function of unilateral versus bilateral interictal status. Both the left and right unilateral temporal lobe groups showed significant anti-correlated activity in regions outside the epileptogenic temporal lobe, primarily involving the contralateral (non-ictal/non-pathologic) hemisphere, with precuneus involvement prominent. The bilateral groups did not show this contralateral anti-correlated activity. This anti-correlated connectivity may represent a form of protective and adaptive inhibition, helping to constrain epileptiform activity to the pathologic temporal lobe. The absence of this activity in the bilateral groups may be indicative of flawed inhibitory mechanisms, helping to explain their more widespread epileptiform activity. Our data suggest that the location and build up of epilepsy networks in the brain are not truly random, and are not limited to the formation of strictly epileptogenic networks. Functional networks may develop to take advantage of the regulatory function of structures such as the precuneus to instantiate an anti-correlated network, generating protective cortico-cortico inhibition for the purpose of limiting seizure spread or epileptogenesis. Copyright © 2012 Wiley Periodicals, Inc.

Altered functional connectivity in default mode network in Internet gaming disorder: Influence of childhood ADHD.

PubMed

Lee, Deokjong; Lee, Junghan; Lee, Jung Eun; Jung, Young-Chul

2017-04-03

Internet gaming disorder (IGD) is a type of behavioral addiction characterized by abnormal executive control, leading to loss of control over excessive gaming. Attention deficit and hyperactivity disorder (ADHD) is one of the most common comorbid disorders in IGD, involving delayed development of the executive control system, which could predispose individuals to gaming addiction. We investigated the influence of childhood ADHD on neural network features of IGD. Resting-state functional magnetic resonance imaging analysis was performed on 44 young, male IGD subjects with and without childhood ADHD and 19 age-matched, healthy male controls. Posterior cingulate cortex (PCC)-seeded connectivity was evaluated to assess abnormalities in default mode network (DMN) connectivity, which is associated with deficits in executive control. IGD subjects without childhood ADHD showed expanded functional connectivity (FC) between DMN-related regions (PCC, medial prefrontal cortex, thalamus) compared with controls. These subjects also exhibited expanded FC between the PCC and brain regions implicated in salience processing (anterior insula, orbitofrontal cortex) compared with IGD subjects with childhood ADHD. IGD subjects with childhood ADHD showed expanded FC between the PCC and cerebellum (crus II), a region involved in executive control. The strength of connectivity between the PCC and cerebellum (crus II) was positively correlated with self-reporting scales reflecting impulsiveness. Individuals with IGD showed altered PCC-based FC, the characteristics of which might be dependent upon history of childhood ADHD. Our findings suggest that altered neural networks for executive control in ADHD would be a predisposition for developing IGD. Copyright © 2017 Elsevier Inc. All rights reserved.

Neural network for control of rearrangeable Clos networks.

PubMed

Park, Y K; Cherkassky, V

1994-09-01

Rapid evolution in the field of communication networks requires high speed switching technologies. This involves a high degree of parallelism in switching control and routing performed at the hardware level. The multistage crossbar networks have always been attractive to switch designers. In this paper a neural network approach to controlling a three-stage Clos network in real time is proposed. This controller provides optimal routing of communication traffic requests on a call-by-call basis by rearranging existing connections, with a minimum length of rearrangement sequence so that a new blocked call request can be accommodated. The proposed neural network controller uses Paull's rearrangement algorithm, along with the special (least used) switch selection rule in order to minimize the length of rearrangement sequences. The functional behavior of our model is verified by simulations and it is shown that the convergence time required for finding an optimal solution is constant, regardless of the switching network size. The performance is evaluated for random traffic with various traffic loads. Simulation results show that applying the least used switch selection rule increases the efficiency in switch rearrangements, reducing the network convergence time. The implementation aspects are also discussed to show the feasibility of the proposed approach.