Phenomenal characteristics associated with projecting oneself back into the past and forward into the future: influence of valence and temporal distance.

PubMed

D'Argembeau, Arnaud; Van der Linden, Martial

2004-12-01

As humans, we frequently engage in mental time travel, reliving past experiences and imagining possible future events. This study examined whether similar factors affect the subjective experience associated with remembering the past and imagining the future. Participants mentally "re-experienced" or "pre-experienced" positive and negative events that differed in their temporal distance from the present (close versus distant), and then rated the phenomenal characteristics (i.e., sensorial, contextual, and emotional details) associated with their representations. For both past and future, representations of positive events were associated with a greater feeling of re-experiencing (or pre-experiencing) than representations of negative events. In addition, representations of temporally close events (both past and future) contained more sensorial and contextual details, and generated a stronger feeling of re-experiencing (or pre-experiencing) than representations of temporally distant events. It is suggested that the way we both remember our past and imagine our future is constrained by our current goals.

The topography of frequency and time representation in primate auditory cortices

PubMed Central

Baumann, Simon; Joly, Olivier; Rees, Adrian; Petkov, Christopher I; Sun, Li; Thiele, Alexander; Griffiths, Timothy D

2015-01-01

Natural sounds can be characterised by their spectral content and temporal modulation, but how the brain is organized to analyse these two critical sound dimensions remains uncertain. Using functional magnetic resonance imaging, we demonstrate a topographical representation of amplitude modulation rate in the auditory cortex of awake macaques. The representation of this temporal dimension is organized in approximately concentric bands of equal rates across the superior temporal plane in both hemispheres, progressing from high rates in the posterior core to low rates in the anterior core and lateral belt cortex. In A1 the resulting gradient of modulation rate runs approximately perpendicular to the axis of the tonotopic gradient, suggesting an orthogonal organisation of spectral and temporal sound dimensions. In auditory belt areas this relationship is more complex. The data suggest a continuous representation of modulation rate across several physiological areas, in contradistinction to a separate representation of frequency within each area. DOI: http://dx.doi.org/10.7554/eLife.03256.001 PMID:25590651

Enhanced representation of soil NO emissions in the Community Multiscale Air Quality (CMAQ) model version 5.0.2

EPA Science Inventory

Modeling of soil nitric oxide (NO) emissions is highly uncertain and may misrepresent its spatial and temporal distribution. This study builds upon a recently introduced parameterization to improve the timing and spatial distribution of soil NO emission estimates in the Community...

Multi-voxel patterns of visual category representation during episodic encoding are predictive of subsequent memory

PubMed Central

Kuhl, Brice A.; Rissman, Jesse; Wagner, Anthony D.

2012-01-01

Successful encoding of episodic memories is thought to depend on contributions from prefrontal and temporal lobe structures. Neural processes that contribute to successful encoding have been extensively explored through univariate analyses of neuroimaging data that compare mean activity levels elicited during the encoding of events that are subsequently remembered vs. those subsequently forgotten. Here, we applied pattern classification to fMRI data to assess the degree to which distributed patterns of activity within prefrontal and temporal lobe structures elicited during the encoding of word-image pairs were diagnostic of the visual category (Face or Scene) of the encoded image. We then assessed whether representation of category information was predictive of subsequent memory. Classification analyses indicated that temporal lobe structures contained information robustly diagnostic of visual category. Information in prefrontal cortex was less diagnostic of visual category, but was nonetheless associated with highly reliable classifier-based evidence for category representation. Critically, trials associated with greater classifier-based estimates of category representation in temporal and prefrontal regions were associated with a higher probability of subsequent remembering. Finally, consideration of trial-by-trial variance in classifier-based measures of category representation revealed positive correlations between prefrontal and temporal lobe representations, with the strength of these correlations varying as a function of the category of image being encoded. Together, these results indicate that multi-voxel representations of encoded information can provide unique insights into how visual experiences are transformed into episodic memories. PMID:21925190

Visual representation of spatiotemporal structure

NASA Astrophysics Data System (ADS)

Schill, Kerstin; Zetzsche, Christoph; Brauer, Wilfried; Eisenkolb, A.; Musto, A.

1998-07-01

The processing and representation of motion information is addressed from an integrated perspective comprising low- level signal processing properties as well as higher-level cognitive aspects. For the low-level processing of motion information we argue that a fundamental requirement is the existence of a spatio-temporal memory. Its key feature, the provision of an orthogonal relation between external time and its internal representation, is achieved by a mapping of temporal structure into a locally distributed activity distribution accessible in parallel by higher-level processing stages. This leads to a reinterpretation of the classical concept of `iconic memory' and resolves inconsistencies on ultra-short-time processing and visual masking. The spatial-temporal memory is further investigated by experiments on the perception of spatio-temporal patterns. Results on the direction discrimination of motion paths provide evidence that information about direction and location are not processed and represented independent of each other. This suggests a unified representation on an early level, in the sense that motion information is internally available in form of a spatio-temporal compound. For the higher-level representation we have developed a formal framework for the qualitative description of courses of motion that may occur with moving objects.

Temporal Representation in Semantic Graphs

DOE Office of Scientific and Technical Information (OSTI.GOV)

Levandoski, J J; Abdulla, G M

2007-08-07

A wide range of knowledge discovery and analysis applications, ranging from business to biological, make use of semantic graphs when modeling relationships and concepts. Most of the semantic graphs used in these applications are assumed to be static pieces of information, meaning temporal evolution of concepts and relationships are not taken into account. Guided by the need for more advanced semantic graph queries involving temporal concepts, this paper surveys the existing work involving temporal representations in semantic graphs.

Action Recognition Using Nonnegative Action Component Representation and Sparse Basis Selection.

PubMed

Wang, Haoran; Yuan, Chunfeng; Hu, Weiming; Ling, Haibin; Yang, Wankou; Sun, Changyin

2014-02-01

In this paper, we propose using high-level action units to represent human actions in videos and, based on such units, a novel sparse model is developed for human action recognition. There are three interconnected components in our approach. First, we propose a new context-aware spatial-temporal descriptor, named locally weighted word context, to improve the discriminability of the traditionally used local spatial-temporal descriptors. Second, from the statistics of the context-aware descriptors, we learn action units using the graph regularized nonnegative matrix factorization, which leads to a part-based representation and encodes the geometrical information. These units effectively bridge the semantic gap in action recognition. Third, we propose a sparse model based on a joint l2,1-norm to preserve the representative items and suppress noise in the action units. Intuitively, when learning the dictionary for action representation, the sparse model captures the fact that actions from the same class share similar units. The proposed approach is evaluated on several publicly available data sets. The experimental results and analysis clearly demonstrate the effectiveness of the proposed approach.

Markup of temporal information in electronic health records.

PubMed

Hyun, Sookyung; Bakken, Suzanne; Johnson, Stephen B

2006-01-01

Temporal information plays a critical role in the understanding of clinical narrative (i.e., free text). We developed a representation for marking up temporal information in a narrative, consisting of five elements: 1) reference point, 2) direction, 3) number, 4) time unit, and 5) pattern. We identified 254 temporal expressions from 50 discharge summaries and represented them using our scheme. The overall inter-rater reliability among raters applying the representation model was 75 percent agreement. The model can contribute to temporal reasoning in computer systems for decision support, data mining, and process and outcomes analyses by providing structured temporal information.

An attention-gating recurrent working memory architecture for emergent speech representation

NASA Astrophysics Data System (ADS)

Elshaw, Mark; Moore, Roger K.; Klein, Michael

2010-06-01

This paper describes an attention-gating recurrent self-organising map approach for emergent speech representation. Inspired by evidence from human cognitive processing, the architecture combines two main neural components. The first component, the attention-gating mechanism, uses actor-critic learning to perform selective attention towards speech. Through this selective attention approach, the attention-gating mechanism controls access to working memory processing. The second component, the recurrent self-organising map memory, develops a temporal-distributed representation of speech using phone-like structures. Representing speech in terms of phonetic features in an emergent self-organised fashion, according to research on child cognitive development, recreates the approach found in infants. Using this representational approach, in a fashion similar to infants, should improve the performance of automatic recognition systems through aiding speech segmentation and fast word learning.

The loss of short-term visual representations over time: decay or temporal distinctiveness?

PubMed

Mercer, Tom

2014-12-01

There has been much recent interest in the loss of visual short-term memories over the passage of time. According to decay theory, visual representations are gradually forgotten as time passes, reflecting a slow and steady distortion of the memory trace. However, this is controversial and decay effects can be explained in other ways. The present experiment aimed to reexamine the maintenance and loss of visual information over the short term. Decay and temporal distinctiveness models were tested using a delayed discrimination task, in which participants compared complex and novel objects over unfilled retention intervals of variable length. Experiment 1 found no significant change in the accuracy of visual memory from 2 to 6 s, but the gap separating trials reliably influenced task performance. Experiment 2 found evidence for information loss at a 10-s retention interval, but temporally separating trials restored the fidelity of visual memory, possibly because temporally isolated representations are distinct from older memory traces. In conclusion, visual representations lose accuracy at some point after 6 s, but only within temporally crowded contexts. These findings highlight the importance of temporal distinctiveness within visual short-term memory. PsycINFO Database Record (c) 2014 APA, all rights reserved.

Verbal memory after temporal lobe epilepsy surgery in children: Do only mesial structures matter?

PubMed

Law, Nicole; Benifla, Mony; Rutka, James; Smith, Mary Lou

2017-02-01

Previous findings have been mixed regarding verbal memory outcome after left temporal lobectomy in children, and there are few studies comparing verbal memory change after lateral versus mesial temporal lobe resections. We compared verbal memory outcome associated with sparing or including the mesial structures in children who underwent left or right temporal lobe resection. We also investigated predictors of postsurgical verbal memory change. We retrospectively assessed verbal memory change approximately 1 year after unilateral temporal lobe epilepsy surgery using a list learning task. Participants included 23 children who underwent temporal lobe surgery with sparing of the mesial structures (13 left), and 40 children who had a temporal lobectomy that included resection of mesial structures (22 left). Children who underwent resection from the left lateral and mesial temporal lobe were the only group to show decline in verbal memory. Furthermore, when we considered language representation in the left temporal resection group, patients with left language representation and spared mesial structures showed essentially no change in verbal memory from preoperative to follow-up, whereas those with left language representation and excised mesial structures showed a decline. Postoperative seizure status had no effect on verbal memory change in children after left temporal lobe surgery. Finally, we found that patients with intact preoperative verbal memory experienced a significant decline compared to those with below average preoperative verbal memory. Our findings provide evidence of significant risk factors for verbal memory decline in children, specific to left mesial temporal lobe epilepsy. Children who undergo left temporal lobe surgery that includes mesial structures may be most vulnerable for verbal memory decline, especially when language representation is localized to the left hemisphere and when preoperative verbal memory is intact. Wiley Periodicals, Inc. © 2016 International League Against Epilepsy.

Summary statistics in auditory perception.

PubMed

McDermott, Josh H; Schemitsch, Michael; Simoncelli, Eero P

2013-04-01

Sensory signals are transduced at high resolution, but their structure must be stored in a more compact format. Here we provide evidence that the auditory system summarizes the temporal details of sounds using time-averaged statistics. We measured discrimination of 'sound textures' that were characterized by particular statistical properties, as normally result from the superposition of many acoustic features in auditory scenes. When listeners discriminated examples of different textures, performance improved with excerpt duration. In contrast, when listeners discriminated different examples of the same texture, performance declined with duration, a paradoxical result given that the information available for discrimination grows with duration. These results indicate that once these sounds are of moderate length, the brain's representation is limited to time-averaged statistics, which, for different examples of the same texture, converge to the same values with increasing duration. Such statistical representations produce good categorical discrimination, but limit the ability to discern temporal detail.

Graph-based geometric-iconic guide-wire tracking.

PubMed

Honnorat, Nicolas; Vaillant, Régis; Paragios, Nikos

2011-01-01

In this paper we introduce a novel hybrid graph-based approach for Guide-wire tracking. The image support is captured by steerable filters and improved through tensor voting. Then, a graphical model is considered that represents guide-wire extraction/tracking through a B-spline control-point model. Points with strong geometric interest (landmarks) are automatically determined and anchored to such a representation. Tracking is then performed through discrete MRFs that optimize the spatio-temporal positions of the control points while establishing landmark temporal correspondences. Promising results demonstrate the potentials of our method.

Time perception of visual motion is tuned by the motor representation of human actions

PubMed Central

Gavazzi, Gioele; Bisio, Ambra; Pozzo, Thierry

2013-01-01

Several studies have shown that the observation of a rapidly moving stimulus dilates our perception of time. However, this effect appears to be at odds with the fact that our interactions both with environment and with each other are temporally accurate. This work exploits this paradox to investigate whether the temporal accuracy of visual motion uses motor representations of actions. To this aim, the stimuli were a dot moving with kinematics belonging or not to the human motor repertoire and displayed at different velocities. Participants had to replicate its duration with two tasks differing in the underlying motor plan. Results show that independently of the task's motor plan, the temporal accuracy and precision depend on the correspondence between the stimulus' kinematics and the observer's motor competencies. Our data suggest that the temporal mechanism of visual motion exploits a temporal visuomotor representation tuned by the motor knowledge of human actions. PMID:23378903

Representation of Time-Relevant Common Data Elements in the Cancer Data Standards Repository: Statistical Evaluation of an Ontological Approach

PubMed Central

Chen, Henry W; Du, Jingcheng; Song, Hsing-Yi; Liu, Xiangyu; Jiang, Guoqian

2018-01-01

Background Today, there is an increasing need to centralize and standardize electronic health data within clinical research as the volume of data continues to balloon. Domain-specific common data elements (CDEs) are emerging as a standard approach to clinical research data capturing and reporting. Recent efforts to standardize clinical study CDEs have been of great benefit in facilitating data integration and data sharing. The importance of the temporal dimension of clinical research studies has been well recognized; however, very few studies have focused on the formal representation of temporal constraints and temporal relationships within clinical research data in the biomedical research community. In particular, temporal information can be extremely powerful to enable high-quality cancer research. Objective The objective of the study was to develop and evaluate an ontological approach to represent the temporal aspects of cancer study CDEs. Methods We used CDEs recorded in the National Cancer Institute (NCI) Cancer Data Standards Repository (caDSR) and created a CDE parser to extract time-relevant CDEs from the caDSR. Using the Web Ontology Language (OWL)–based Time Event Ontology (TEO), we manually derived representative patterns to semantically model the temporal components of the CDEs using an observing set of randomly selected time-related CDEs (n=600) to create a set of TEO ontological representation patterns. In evaluating TEO’s ability to represent the temporal components of the CDEs, this set of representation patterns was tested against two test sets of randomly selected time-related CDEs (n=425). Results It was found that 94.2% (801/850) of the CDEs in the test sets could be represented by the TEO representation patterns. Conclusions In conclusion, TEO is a good ontological model for representing the temporal components of the CDEs recorded in caDSR. Our representative model can harness the Semantic Web reasoning and inferencing functionalities and present a means for temporal CDEs to be machine-readable, streamlining meaningful searches. PMID:29472179

Reference frames for spatial frequency in face representation differ in the temporal visual cortex and amygdala.

PubMed

Inagaki, Mikio; Fujita, Ichiro

2011-07-13

Social communication in nonhuman primates and humans is strongly affected by facial information from other individuals. Many cortical and subcortical brain areas are known to be involved in processing facial information. However, how the neural representation of faces differs across different brain areas remains unclear. Here, we demonstrate that the reference frame for spatial frequency (SF) tuning of face-responsive neurons differs in the temporal visual cortex and amygdala in monkeys. Consistent with psychophysical properties for face recognition, temporal cortex neurons were tuned to image-based SFs (cycles/image) and showed viewing distance-invariant representation of face patterns. On the other hand, many amygdala neurons were influenced by retina-based SFs (cycles/degree), a characteristic that is useful for social distance computation. The two brain areas also differed in the luminance contrast sensitivity of face-responsive neurons; amygdala neurons sharply reduced their responses to low luminance contrast images, while temporal cortex neurons maintained the level of their responses. From these results, we conclude that different types of visual processing in the temporal visual cortex and the amygdala contribute to the construction of the neural representations of faces.

tOWL: Integrating Time in OWL

NASA Astrophysics Data System (ADS)

Frasincar, Flavius; Milea, Viorel; Kaymak, Uzay

The Web Ontology Language (OWL) is the most expressive standard language for modeling ontologies on the Semantic Web. In this chapter, we present the temporal OWL (tOWL) language: a temporal extension of the OWL DL language. tOWL is based on three layers added on top of OWL DL. The first layer is the Concrete Domains layer, which allows the representation of restrictions using concrete domain binary predicates. The second layer is the Time Representation layer, which adds time points, intervals, and Allen's 13 interval relations. The third layer is the Change Representation layer which supports a perdurantist view on the world, and allows the representation of complex temporal axioms, such as state transitions. A Leveraged Buyout process is used to exemplify the different tOWL constructs and show the tOWL applicability in a business context.

Motor contributions to the temporal precision of auditory attention.

PubMed

Morillon, Benjamin; Schroeder, Charles E; Wyart, Valentin

2014-10-15

In temporal-or dynamic-attending theory, it is proposed that motor activity helps to synchronize temporal fluctuations of attention with the timing of events in a task-relevant stream, thus facilitating sensory selection. Here we develop a mechanistic behavioural account for this theory by asking human participants to track a slow reference beat, by noiseless finger pressing, while extracting auditory target tones delivered on-beat and interleaved with distractors. We find that overt rhythmic motor activity improves the segmentation of auditory information by enhancing sensitivity to target tones while actively suppressing distractor tones. This effect is triggered by cyclic fluctuations in sensory gain locked to individual motor acts, scales parametrically with the temporal predictability of sensory events and depends on the temporal alignment between motor and attention fluctuations. Together, these findings reveal how top-down influences associated with a rhythmic motor routine sharpen sensory representations, enacting auditory 'active sensing'.

Sparse Representation with Spatio-Temporal Online Dictionary Learning for Efficient Video Coding.

PubMed

Dai, Wenrui; Shen, Yangmei; Tang, Xin; Zou, Junni; Xiong, Hongkai; Chen, Chang Wen

2016-07-27

Classical dictionary learning methods for video coding suer from high computational complexity and interfered coding eciency by disregarding its underlying distribution. This paper proposes a spatio-temporal online dictionary learning (STOL) algorithm to speed up the convergence rate of dictionary learning with a guarantee of approximation error. The proposed algorithm incorporates stochastic gradient descents to form a dictionary of pairs of 3-D low-frequency and highfrequency spatio-temporal volumes. In each iteration of the learning process, it randomly selects one sample volume and updates the atoms of dictionary by minimizing the expected cost, rather than optimizes empirical cost over the complete training data like batch learning methods, e.g. K-SVD. Since the selected volumes are supposed to be i.i.d. samples from the underlying distribution, decomposition coecients attained from the trained dictionary are desirable for sparse representation. Theoretically, it is proved that the proposed STOL could achieve better approximation for sparse representation than K-SVD and maintain both structured sparsity and hierarchical sparsity. It is shown to outperform batch gradient descent methods (K-SVD) in the sense of convergence speed and computational complexity, and its upper bound for prediction error is asymptotically equal to the training error. With lower computational complexity, extensive experiments validate that the STOL based coding scheme achieves performance improvements than H.264/AVC or HEVC as well as existing super-resolution based methods in ratedistortion performance and visual quality.

The Development of Invariant Object Recognition Requires Visual Experience with Temporally Smooth Objects

ERIC Educational Resources Information Center

Wood, Justin N.; Wood, Samantha M. W.

2018-01-01

How do newborns learn to recognize objects? According to temporal learning models in computational neuroscience, the brain constructs object representations by extracting smoothly changing features from the environment. To date, however, it is unknown whether newborns depend on smoothly changing features to build invariant object representations.…

Dissociating the Representation of Action- and Sound-Related Concepts in Middle Temporal Cortex

ERIC Educational Resources Information Center

Kiefer, Markus; Trumpp, Natalie; Herrnberger, Barbel; Sim, Eun-Jin; Hoenig, Klaus; Pulvermuller, Friedemann

2012-01-01

Modality-specific models of conceptual memory propose close links between concepts and the sensory-motor systems. Neuroimaging studies found, in different subject groups, that action-related and sound-related concepts activated different parts of posterior middle temporal gyrus (pMTG), suggesting a modality-specific representation of conceptual…

Gaining Insight by Transforming between Temporal Representations of Human Interaction

ERIC Educational Resources Information Center

Lund, Kristine; Quignard, Matthieu; Shaffer, David Williamson

2017-01-01

Recordings of human interaction data can be organized into temporal representations with different affordances. We use audio data of a learning-related discussion analyzed for its low-level emotional indicators and divided into four phases, each characterized by an overarching emotion. After arguing for the relevance of emotion to learning, we…

Source localization of non-stationary acoustic data using time-frequency analysis

NASA Astrophysics Data System (ADS)

Stoughton, Jack; Edmonson, William

2005-04-01

An improvement in temporal locality of the generalized cross-correlation (GCC) for angle of arrival (AOA) estimation can be achieved by employing 2-D cross-correlation of infrasonic sensor data transformed to its time-frequency (TF) representation. Intermediate to the AOA evaluation is the time delay between pairs of sensors. The signal class of interest includes far field sources which are partially coherent across the array, nonstationary, and wideband. In addition, signals can occur as multiple short bursts, for which TF representations may be more appropriate for time delay estimation. The GCC tends to smooth out such temporal energy bursts. Simulation and experimental results will demonstrate the improvement in using a TF-based GCC, using the Cohen class, over the classic GCC method. Comparative demonstration of the methods will be performed on data captured on an infrasonic sensor array located at NASA Langley Research Center (LaRC). The infrasonic data sources include Delta IV and Space Shuttle launches from Kennedy Space Center which belong to the stated signal class. Of interest is to apply this method to the AOA estimation of atmospheric turbulence. [Work supported by NASA LaRC Creativity and Innovation project: Infrasonic Detection of Clear Air Turbulence and Severe Storms.

tOWL: a temporal Web Ontology Language.

PubMed

Milea, Viorel; Frasincar, Flavius; Kaymak, Uzay

2012-02-01

Through its interoperability and reasoning capabilities, the Semantic Web opens a realm of possibilities for developing intelligent systems on the Web. The Web Ontology Language (OWL) is the most expressive standard language for modeling ontologies, the cornerstone of the Semantic Web. However, up until now, no standard way of expressing time and time-dependent information in OWL has been provided. In this paper, we present a temporal extension of the very expressive fragment SHIN(D) of the OWL Description Logic language, resulting in the temporal OWL language. Through a layered approach, we introduce three extensions: 1) concrete domains, which allow the representation of restrictions using concrete domain binary predicates; 2) temporal representation , which introduces time points, relations between time points, intervals, and Allen's 13 interval relations into the language; and 3) timeslices/fluents, which implement a perdurantist view on individuals and allow for the representation of complex temporal aspects, such as process state transitions. We illustrate the expressiveness of the newly introduced language by using an example from the financial domain.

LDRD final report :

DOE Office of Scientific and Technical Information (OSTI.GOV)

Brost, Randolph C.; McLendon, William Clarence,

2013-01-01

Modeling geospatial information with semantic graphs enables search for sites of interest based on relationships between features, without requiring strong a priori models of feature shape or other intrinsic properties. Geospatial semantic graphs can be constructed from raw sensor data with suitable preprocessing to obtain a discretized representation. This report describes initial work toward extending geospatial semantic graphs to include temporal information, and initial results applying semantic graph techniques to SAR image data. We describe an efficient graph structure that includes geospatial and temporal information, which is designed to support simultaneous spatial and temporal search queries. We also report amore » preliminary implementation of feature recognition, semantic graph modeling, and graph search based on input SAR data. The report concludes with lessons learned and suggestions for future improvements.« less

Atypical language representation in children with intractable temporal lobe epilepsy.

PubMed

Maulisova, Alice; Korman, Brandon; Rey, Gustavo; Bernal, Byron; Duchowny, Michael; Niederlova, Marketa; Krsek, Pavel; Novak, Vilem

2016-05-01

This study evaluated language organization in children with intractable epilepsy caused by temporal lobe focal cortical dysplasia (FCD) alone or dual pathology (temporal lobe FCD and hippocampal sclerosis, HS). We analyzed clinical, neurological, fMRI, neuropsychological, and histopathologic data in 46 pediatric patients with temporal lobe lesions who underwent excisional epilepsy surgery. The frequency of atypical language representation was similar in both groups, but children with dual pathology were more likely to be left-handed. Atypical receptive language cortex correlated with lower intellectual capacity, verbal abstract conceptualization, receptive language abilities, verbal working memory, and a history of status epilepticus but did not correlate with higher seizure frequency or early seizure onset. Histopathologic substrate had only a minor influence on neuropsychological status. Greater verbal comprehension deficits were noted in children with atypical receptive language representation, a risk factor for cognitive morbidity. Copyright © 2016 Elsevier Inc. All rights reserved.

The Immediate and Chronic Influence of Spatio-Temporal Metaphors on the Mental Representations of Time in English, Mandarin, and Mandarin-English Speakers

PubMed Central

Lai, Vicky Tzuyin; Boroditsky, Lera

2013-01-01

In this paper we examine whether experience with spatial metaphors for time has an influence on people’s representation of time. In particular we ask whether spatio-temporal metaphors can have both chronic and immediate effects on temporal thinking. In Study 1, we examine the prevalence of ego-moving representations for time in Mandarin speakers, English speakers, and Mandarin-English (ME) bilinguals. As predicted by observations in linguistic analyses, we find that Mandarin speakers are less likely to take an ego-moving perspective than are English speakers. Further, we find that ME bilinguals tested in English are less likely to take an ego-moving perspective than are English monolinguals (an effect of L1 on meaning-making in L2), and also that ME bilinguals tested in Mandarin are more likely to take an ego-moving perspective than are Mandarin monolinguals (an effect of L2 on meaning-making in L1). These findings demonstrate that habits of metaphor use in one language can influence temporal reasoning in another language, suggesting the metaphors can have a chronic effect on patterns in thought. In Study 2 we test Mandarin speakers using either horizontal or vertical metaphors in the immediate context of the task. We find that Mandarin speakers are more likely to construct front-back representations of time when understanding front-back metaphors, and more likely to construct up-down representations of time when understanding up-down metaphors. These findings demonstrate that spatio-temporal metaphors can also have an immediate influence on temporal reasoning. Taken together, these findings demonstrate that the metaphors we use to talk about time have both immediate and long-term consequences for how we conceptualize and reason about this fundamental domain of experience. PMID:23630505

Dynamic speech representations in the human temporal lobe.

PubMed

Leonard, Matthew K; Chang, Edward F

2014-09-01

Speech perception requires rapid integration of acoustic input with context-dependent knowledge. Recent methodological advances have allowed researchers to identify underlying information representations in primary and secondary auditory cortex and to examine how context modulates these representations. We review recent studies that focus on contextual modulations of neural activity in the superior temporal gyrus (STG), a major hub for spectrotemporal encoding. Recent findings suggest a highly interactive flow of information processing through the auditory ventral stream, including influences of higher-level linguistic and metalinguistic knowledge, even within individual areas. Such mechanisms may give rise to more abstract representations, such as those for words. We discuss the importance of characterizing representations of context-dependent and dynamic patterns of neural activity in the approach to speech perception research. Copyright © 2014 Elsevier Ltd. All rights reserved.

Encoding of Natural Sounds at Multiple Spectral and Temporal Resolutions in the Human Auditory Cortex

PubMed Central

Santoro, Roberta; Moerel, Michelle; De Martino, Federico; Goebel, Rainer; Ugurbil, Kamil; Yacoub, Essa; Formisano, Elia

2014-01-01

Functional neuroimaging research provides detailed observations of the response patterns that natural sounds (e.g. human voices and speech, animal cries, environmental sounds) evoke in the human brain. The computational and representational mechanisms underlying these observations, however, remain largely unknown. Here we combine high spatial resolution (3 and 7 Tesla) functional magnetic resonance imaging (fMRI) with computational modeling to reveal how natural sounds are represented in the human brain. We compare competing models of sound representations and select the model that most accurately predicts fMRI response patterns to natural sounds. Our results show that the cortical encoding of natural sounds entails the formation of multiple representations of sound spectrograms with different degrees of spectral and temporal resolution. The cortex derives these multi-resolution representations through frequency-specific neural processing channels and through the combined analysis of the spectral and temporal modulations in the spectrogram. Furthermore, our findings suggest that a spectral-temporal resolution trade-off may govern the modulation tuning of neuronal populations throughout the auditory cortex. Specifically, our fMRI results suggest that neuronal populations in posterior/dorsal auditory regions preferably encode coarse spectral information with high temporal precision. Vice-versa, neuronal populations in anterior/ventral auditory regions preferably encode fine-grained spectral information with low temporal precision. We propose that such a multi-resolution analysis may be crucially relevant for flexible and behaviorally-relevant sound processing and may constitute one of the computational underpinnings of functional specialization in auditory cortex. PMID:24391486

Cross-cultural differences in mental representations of time: evidence from an implicit nonlinguistic task.

PubMed

Fuhrman, Orly; Boroditsky, Lera

2010-11-01

Across cultures people construct spatial representations of time. However, the particular spatial layouts created to represent time may differ across cultures. This paper examines whether people automatically access and use culturally specific spatial representations when reasoning about time. In Experiment 1, we asked Hebrew and English speakers to arrange pictures depicting temporal sequences of natural events, and to point to the hypothesized location of events relative to a reference point. In both tasks, English speakers (who read left to right) arranged temporal sequences to progress from left to right, whereas Hebrew speakers (who read right to left) arranged them from right to left, replicating previous work. In Experiments 2 and 3, we asked the participants to make rapid temporal order judgments about pairs of pictures presented one after the other (i.e., to decide whether the second picture showed a conceptually earlier or later time-point of an event than the first picture). Participants made responses using two adjacent keyboard keys. English speakers were faster to make "earlier" judgments when the "earlier" response needed to be made with the left response key than with the right response key. Hebrew speakers showed exactly the reverse pattern. Asking participants to use a space-time mapping inconsistent with the one suggested by writing direction in their language created interference, suggesting that participants were automatically creating writing-direction consistent spatial representations in the course of their normal temporal reasoning. It appears that people automatically access culturally specific spatial representations when making temporal judgments even in nonlinguistic tasks. Copyright © 2010 Cognitive Science Society, Inc.

Temporal fluctuations of tremor signals from inertial sensor: a preliminary study in differentiating Parkinson's disease from essential tremor.

PubMed

Thanawattano, Chusak; Pongthornseri, Ronachai; Anan, Chanawat; Dumnin, Songphon; Bhidayasiri, Roongroj

2015-11-04

Parkinson's disease (PD) and essential tremor (ET) are the two most common movement disorders but the rate of misdiagnosis rate in these disorders is high due to similar characteristics of tremor. The purpose of the study is to present: (a) a solution to identify PD and ET patients by using the novel measurement of tremor signal variations while performing the resting task, (b) the improvement of the differentiation of PD from ET patients can be obtained by using the ratio of the novel measurement while performing two specific tasks. 35 PD and 22 ET patients were asked to participate in the study. They were asked to wear a 6-axis inertial sensor on his/her index finger of the tremor dominant hand and perform three tasks including kinetic, postural and resting tasks. Each task required 10 s to complete. The angular rate signal measured during the performance of these tasks was band-pass filtered and transformed into a two-dimensional representation. The ratio of the ellipse area covering 95 % of this two-dimensional representation of different tasks was investigated and the two best tasks were selected for the purpose of differentiation. The ellipse area of two-dimensional representation of the resting task of PD and ET subjects are statistically significantly different (p < 0.05). Furthermore, the fluctuation ratio, defined as a ratio of the ellipse area of two-dimensional representation of resting to kinetic tremor, of PD subjects were statistically significantly higher than ET subjects in all axes (p = 0.0014, 0.0011 and 0.0001 for x, y and z-axis, respectively). The validation shows that the proposed method provides 100 % sensitivity, specificity and accuracy of the discrimination in the 5 subjects in the validation group. While the method would have to be validated with a larger number of subjects, these preliminary results show the feasibility of the approach. This study provides the novel measurement of tremor variation in time domain termed 'temporal fluctuation'. The temporal fluctuation of the resting task can be used to discriminate PD from ET subjects. The ratio of the temporal fluctuation of the resting task to the kinetic task improves the reliability of the discrimination. While the method is powerful, it is also simple so it could be applied on low resource platforms such as smart phones and watches which are commonly equipped with inertial sensors.

Acquired word deafness, and the temporal grain of sound representation in the primary auditory cortex.

PubMed

Phillips, D P; Farmer, M E

1990-11-15

This paper explores the nature of the processing disorder which underlies the speech discrimination deficit in the syndrome of acquired word deafness following from pathology to the primary auditory cortex. A critical examination of the evidence on this disorder revealed the following. First, the most profound forms of the condition are expressed not only in an isolation of the cerebral linguistic processor from auditory input, but in a failure of even the perceptual elaboration of the relevant sounds. Second, in agreement with earlier studies, we conclude that the perceptual dimension disturbed in word deafness is a temporal one. We argue, however, that it is not a generalized disorder of auditory temporal processing, but one which is largely restricted to the processing of sounds with temporal content in the milliseconds to tens-of-milliseconds time frame. The perceptual elaboration of sounds with temporal content outside that range, in either direction, may survive the disorder. Third, we present neurophysiological evidence that the primary auditory cortex has a special role in the representation of auditory events in that time frame, but not in the representation of auditory events with temporal grains outside that range.

Amodal Semantic Representations Depend on both Anterior Temporal Lobes: Evidence from Repetitive Transcranial Magnetic Stimulation

ERIC Educational Resources Information Center

Pobric, Gorana; Jefferies, Elizabeth; Ralph, Matthew A. Lambon

2010-01-01

The key question of how the brain codes the meaning of words and pictures is the focus of vigorous debate. Is there a "semantic hub" in the temporal poles where these different inputs converge to form amodal conceptual representations? Alternatively, are there distinct neural circuits that underpin our comprehension of pictures and words?…

Three-Dimensionality as an Effective Mode of Representation for Expressing Sequential Time Perception

ERIC Educational Resources Information Center

Eden, Sigal; Passig, David

2007-01-01

The process of developing concepts of time continues from age 5 to 11 years (Zakay, 1998). This study sought the representation mode in which children could best express time concepts, especially the proper arrangement of events in a logical and temporal order. Usually, temporal order is examined and taught by 2D (2-dimensional) pictorial scripts.…

Crossmodal integration enhances neural representation of task-relevant features in audiovisual face perception.

PubMed

Li, Yuanqing; Long, Jinyi; Huang, Biao; Yu, Tianyou; Wu, Wei; Liu, Yongjian; Liang, Changhong; Sun, Pei

2015-02-01

Previous studies have shown that audiovisual integration improves identification performance and enhances neural activity in heteromodal brain areas, for example, the posterior superior temporal sulcus/middle temporal gyrus (pSTS/MTG). Furthermore, it has also been demonstrated that attention plays an important role in crossmodal integration. In this study, we considered crossmodal integration in audiovisual facial perception and explored its effect on the neural representation of features. The audiovisual stimuli in the experiment consisted of facial movie clips that could be classified into 2 gender categories (male vs. female) or 2 emotion categories (crying vs. laughing). The visual/auditory-only stimuli were created from these movie clips by removing the auditory/visual contents. The subjects needed to make a judgment about the gender/emotion category for each movie clip in the audiovisual, visual-only, or auditory-only stimulus condition as functional magnetic resonance imaging (fMRI) signals were recorded. The neural representation of the gender/emotion feature was assessed using the decoding accuracy and the brain pattern-related reproducibility indices, obtained by a multivariate pattern analysis method from the fMRI data. In comparison to the visual-only and auditory-only stimulus conditions, we found that audiovisual integration enhanced the neural representation of task-relevant features and that feature-selective attention might play a role of modulation in the audiovisual integration. © The Author 2013. Published by Oxford University Press. All rights reserved. For Permissions, please e-mail: journals.permissions@oup.com.

Motor contributions to the temporal precision of auditory attention

PubMed Central

Morillon, Benjamin; Schroeder, Charles E.; Wyart, Valentin

2014-01-01

In temporal—or dynamic—attending theory, it is proposed that motor activity helps to synchronize temporal fluctuations of attention with the timing of events in a task-relevant stream, thus facilitating sensory selection. Here we develop a mechanistic behavioural account for this theory by asking human participants to track a slow reference beat, by noiseless finger pressing, while extracting auditory target tones delivered on-beat and interleaved with distractors. We find that overt rhythmic motor activity improves the segmentation of auditory information by enhancing sensitivity to target tones while actively suppressing distractor tones. This effect is triggered by cyclic fluctuations in sensory gain locked to individual motor acts, scales parametrically with the temporal predictability of sensory events and depends on the temporal alignment between motor and attention fluctuations. Together, these findings reveal how top-down influences associated with a rhythmic motor routine sharpen sensory representations, enacting auditory ‘active sensing’. PMID:25314898

Learning viewpoint invariant object representations using a temporal coherence principle.

PubMed

Einhäuser, Wolfgang; Hipp, Jörg; Eggert, Julian; Körner, Edgar; König, Peter

2005-07-01

Invariant object recognition is arguably one of the major challenges for contemporary machine vision systems. In contrast, the mammalian visual system performs this task virtually effortlessly. How can we exploit our knowledge on the biological system to improve artificial systems? Our understanding of the mammalian early visual system has been augmented by the discovery that general coding principles could explain many aspects of neuronal response properties. How can such schemes be transferred to system level performance? In the present study we train cells on a particular variant of the general principle of temporal coherence, the "stability" objective. These cells are trained on unlabeled real-world images without a teaching signal. We show that after training, the cells form a representation that is largely independent of the viewpoint from which the stimulus is looked at. This finding includes generalization to previously unseen viewpoints. The achieved representation is better suited for view-point invariant object classification than the cells' input patterns. This property to facilitate view-point invariant classification is maintained even if training and classification take place in the presence of an--also unlabeled--distractor object. In summary, here we show that unsupervised learning using a general coding principle facilitates the classification of real-world objects, that are not segmented from the background and undergo complex, non-isomorphic, transformations.

Invariant Visual Object and Face Recognition: Neural and Computational Bases, and a Model, VisNet

PubMed Central

Rolls, Edmund T.

2012-01-01

Neurophysiological evidence for invariant representations of objects and faces in the primate inferior temporal visual cortex is described. Then a computational approach to how invariant representations are formed in the brain is described that builds on the neurophysiology. A feature hierarchy model in which invariant representations can be built by self-organizing learning based on the temporal and spatial statistics of the visual input produced by objects as they transform in the world is described. VisNet can use temporal continuity in an associative synaptic learning rule with a short-term memory trace, and/or it can use spatial continuity in continuous spatial transformation learning which does not require a temporal trace. The model of visual processing in the ventral cortical stream can build representations of objects that are invariant with respect to translation, view, size, and also lighting. The model has been extended to provide an account of invariant representations in the dorsal visual system of the global motion produced by objects such as looming, rotation, and object-based movement. The model has been extended to incorporate top-down feedback connections to model the control of attention by biased competition in, for example, spatial and object search tasks. The approach has also been extended to account for how the visual system can select single objects in complex visual scenes, and how multiple objects can be represented in a scene. The approach has also been extended to provide, with an additional layer, for the development of representations of spatial scenes of the type found in the hippocampus. PMID:22723777

Invariant Visual Object and Face Recognition: Neural and Computational Bases, and a Model, VisNet.

PubMed

Rolls, Edmund T

2012-01-01

Neurophysiological evidence for invariant representations of objects and faces in the primate inferior temporal visual cortex is described. Then a computational approach to how invariant representations are formed in the brain is described that builds on the neurophysiology. A feature hierarchy model in which invariant representations can be built by self-organizing learning based on the temporal and spatial statistics of the visual input produced by objects as they transform in the world is described. VisNet can use temporal continuity in an associative synaptic learning rule with a short-term memory trace, and/or it can use spatial continuity in continuous spatial transformation learning which does not require a temporal trace. The model of visual processing in the ventral cortical stream can build representations of objects that are invariant with respect to translation, view, size, and also lighting. The model has been extended to provide an account of invariant representations in the dorsal visual system of the global motion produced by objects such as looming, rotation, and object-based movement. The model has been extended to incorporate top-down feedback connections to model the control of attention by biased competition in, for example, spatial and object search tasks. The approach has also been extended to account for how the visual system can select single objects in complex visual scenes, and how multiple objects can be represented in a scene. The approach has also been extended to provide, with an additional layer, for the development of representations of spatial scenes of the type found in the hippocampus.

Why the Brain Knows More than We Do: Non-Conscious Representations and Their Role in the Construction of Conscious Experience

PubMed Central

Dresp-Langley, Birgitta

2011-01-01

Scientific studies have shown that non-conscious stimuli and representations influence information processing during conscious experience. In the light of such evidence, questions about potential functional links between non-conscious brain representations and conscious experience arise. This article discusses neural model capable of explaining how statistical learning mechanisms in dedicated resonant circuits could generate specific temporal activity traces of non-conscious representations in the brain. How reentrant signaling, top-down matching, and statistical coincidence of such activity traces may lead to the progressive consolidation of temporal patterns that constitute the neural signatures of conscious experience in networks extending across large distances beyond functionally specialized brain regions is then explained. PMID:24962683

Similarity-Based Fusion of MEG and fMRI Reveals Spatio-Temporal Dynamics in Human Cortex During Visual Object Recognition

PubMed Central

Cichy, Radoslaw Martin; Pantazis, Dimitrios; Oliva, Aude

2016-01-01

Every human cognitive function, such as visual object recognition, is realized in a complex spatio-temporal activity pattern in the brain. Current brain imaging techniques in isolation cannot resolve the brain's spatio-temporal dynamics, because they provide either high spatial or temporal resolution but not both. To overcome this limitation, we developed an integration approach that uses representational similarities to combine measurements of magnetoencephalography (MEG) and functional magnetic resonance imaging (fMRI) to yield a spatially and temporally integrated characterization of neuronal activation. Applying this approach to 2 independent MEG–fMRI data sets, we observed that neural activity first emerged in the occipital pole at 50–80 ms, before spreading rapidly and progressively in the anterior direction along the ventral and dorsal visual streams. Further region-of-interest analyses established that dorsal and ventral regions showed MEG–fMRI correspondence in representations later than early visual cortex. Together, these results provide a novel and comprehensive, spatio-temporally resolved view of the rapid neural dynamics during the first few hundred milliseconds of object vision. They further demonstrate the feasibility of spatially unbiased representational similarity-based fusion of MEG and fMRI, promising new insights into how the brain computes complex cognitive functions. PMID:27235099

The Representation of Object-Directed Action and Function Knowledge in the Human Brain

PubMed Central

Chen, Quanjing; Garcea, Frank E.; Mahon, Bradford Z.

2016-01-01

The appropriate use of everyday objects requires the integration of action and function knowledge. Previous research suggests that action knowledge is represented in frontoparietal areas while function knowledge is represented in temporal lobe regions. Here we used multivoxel pattern analysis to investigate the representation of object-directed action and function knowledge while participants executed pantomimes of familiar tool actions. A novel approach for decoding object knowledge was used in which classifiers were trained on one pair of objects and then tested on a distinct pair; this permitted a measurement of classification accuracy over and above object-specific information. Region of interest (ROI) analyses showed that object-directed actions could be decoded in tool-preferring regions of both parietal and temporal cortex, while no independently defined tool-preferring ROI showed successful decoding of object function. However, a whole-brain searchlight analysis revealed that while frontoparietal motor and peri-motor regions are engaged in the representation of object-directed actions, medial temporal lobe areas in the left hemisphere are involved in the representation of function knowledge. These results indicate that both action and function knowledge are represented in a topographically coherent manner that is amenable to study with multivariate approaches, and that the left medial temporal cortex represents knowledge of object function. PMID:25595179

An efficient temporal logic for robotic task planning

NASA Technical Reports Server (NTRS)

Becker, Jeffrey M.

1989-01-01

Computations required for temporal reasoning can be prohibitively expensive if fully general representations are used. Overly simple representations, such as totally ordered sequence of time points, are inadequate for use in a nonlinear task planning system. A middle ground is identified which is general enough to support a capable nonlinear task planner, but specialized enough that the system can support online task planning in real time. A Temporal Logic System (TLS) was developed during the Intelligent Task Automation (ITA) project to support robotic task planning. TLS is also used within the ITA system to support plan execution, monitoring, and exception handling.

Decoding Multiple Sound Categories in the Human Temporal Cortex Using High Resolution fMRI

PubMed Central

Zhang, Fengqing; Wang, Ji-Ping; Kim, Jieun; Parrish, Todd; Wong, Patrick C. M.

2015-01-01

Perception of sound categories is an important aspect of auditory perception. The extent to which the brain’s representation of sound categories is encoded in specialized subregions or distributed across the auditory cortex remains unclear. Recent studies using multivariate pattern analysis (MVPA) of brain activations have provided important insights into how the brain decodes perceptual information. In the large existing literature on brain decoding using MVPA methods, relatively few studies have been conducted on multi-class categorization in the auditory domain. Here, we investigated the representation and processing of auditory categories within the human temporal cortex using high resolution fMRI and MVPA methods. More importantly, we considered decoding multiple sound categories simultaneously through multi-class support vector machine-recursive feature elimination (MSVM-RFE) as our MVPA tool. Results show that for all classifications the model MSVM-RFE was able to learn the functional relation between the multiple sound categories and the corresponding evoked spatial patterns and classify the unlabeled sound-evoked patterns significantly above chance. This indicates the feasibility of decoding multiple sound categories not only within but across subjects. However, the across-subject variation affects classification performance more than the within-subject variation, as the across-subject analysis has significantly lower classification accuracies. Sound category-selective brain maps were identified based on multi-class classification and revealed distributed patterns of brain activity in the superior temporal gyrus and the middle temporal gyrus. This is in accordance with previous studies, indicating that information in the spatially distributed patterns may reflect a more abstract perceptual level of representation of sound categories. Further, we show that the across-subject classification performance can be significantly improved by averaging the fMRI images over items, because the irrelevant variations between different items of the same sound category are reduced and in turn the proportion of signals relevant to sound categorization increases. PMID:25692885

Decoding multiple sound categories in the human temporal cortex using high resolution fMRI.

PubMed

Zhang, Fengqing; Wang, Ji-Ping; Kim, Jieun; Parrish, Todd; Wong, Patrick C M

2015-01-01

Perception of sound categories is an important aspect of auditory perception. The extent to which the brain's representation of sound categories is encoded in specialized subregions or distributed across the auditory cortex remains unclear. Recent studies using multivariate pattern analysis (MVPA) of brain activations have provided important insights into how the brain decodes perceptual information. In the large existing literature on brain decoding using MVPA methods, relatively few studies have been conducted on multi-class categorization in the auditory domain. Here, we investigated the representation and processing of auditory categories within the human temporal cortex using high resolution fMRI and MVPA methods. More importantly, we considered decoding multiple sound categories simultaneously through multi-class support vector machine-recursive feature elimination (MSVM-RFE) as our MVPA tool. Results show that for all classifications the model MSVM-RFE was able to learn the functional relation between the multiple sound categories and the corresponding evoked spatial patterns and classify the unlabeled sound-evoked patterns significantly above chance. This indicates the feasibility of decoding multiple sound categories not only within but across subjects. However, the across-subject variation affects classification performance more than the within-subject variation, as the across-subject analysis has significantly lower classification accuracies. Sound category-selective brain maps were identified based on multi-class classification and revealed distributed patterns of brain activity in the superior temporal gyrus and the middle temporal gyrus. This is in accordance with previous studies, indicating that information in the spatially distributed patterns may reflect a more abstract perceptual level of representation of sound categories. Further, we show that the across-subject classification performance can be significantly improved by averaging the fMRI images over items, because the irrelevant variations between different items of the same sound category are reduced and in turn the proportion of signals relevant to sound categorization increases.

Effect of roughness formulation on the performance of a coupled wave, hydrodynamic, and sediment transport model

USGS Publications Warehouse

Ganju, Neil K.; Sherwood, Christopher R.

2010-01-01

A variety of algorithms are available for parameterizing the hydrodynamic bottom roughness associated with grain size, saltation, bedforms, and wave–current interaction in coastal ocean models. These parameterizations give rise to spatially and temporally variable bottom-drag coefficients that ostensibly provide better representations of physical processes than uniform and constant coefficients. However, few studies have been performed to determine whether improved representation of these variable bottom roughness components translates into measurable improvements in model skill. We test the hypothesis that improved representation of variable bottom roughness improves performance with respect to near-bed circulation, bottom stresses, or turbulence dissipation. The inner shelf south of Martha’s Vineyard, Massachusetts, is the site of sorted grain-size features which exhibit sharp alongshore variations in grain size and ripple geometry over gentle bathymetric relief; this area provides a suitable testing ground for roughness parameterizations. We first establish the skill of a nested regional model for currents, waves, stresses, and turbulent quantities using a uniform and constant roughness; we then gauge model skill with various parameterization of roughness, which account for the influence of the wave-boundary layer, grain size, saltation, and rippled bedforms. We find that commonly used representations of ripple-induced roughness, when combined with a wave–current interaction routine, do not significantly improve skill for circulation, and significantly decrease skill with respect to stresses and turbulence dissipation. Ripple orientation with respect to dominant currents and ripple shape may be responsible for complicating a straightforward estimate of the roughness contribution from ripples. In addition, sediment-induced stratification may be responsible for lower stresses than predicted by the wave–current interaction model.

Mapping the cortical representation of speech sounds in a syllable repetition task.

PubMed

Markiewicz, Christopher J; Bohland, Jason W

2016-11-01

Speech repetition relies on a series of distributed cortical representations and functional pathways. A speaker must map auditory representations of incoming sounds onto learned speech items, maintain an accurate representation of those items in short-term memory, interface that representation with the motor output system, and fluently articulate the target sequence. A "dorsal stream" consisting of posterior temporal, inferior parietal and premotor regions is thought to mediate auditory-motor representations and transformations, but the nature and activation of these representations for different portions of speech repetition tasks remains unclear. Here we mapped the correlates of phonetic and/or phonological information related to the specific phonemes and syllables that were heard, remembered, and produced using a series of cortical searchlight multi-voxel pattern analyses trained on estimates of BOLD responses from individual trials. Based on responses linked to input events (auditory syllable presentation), predictive vowel-level information was found in the left inferior frontal sulcus, while syllable prediction revealed significant clusters in the left ventral premotor cortex and central sulcus and the left mid superior temporal sulcus. Responses linked to output events (the GO signal cueing overt production) revealed strong clusters of vowel-related information bilaterally in the mid to posterior superior temporal sulcus. For the prediction of onset and coda consonants, input-linked responses yielded distributed clusters in the superior temporal cortices, which were further informative for classifiers trained on output-linked responses. Output-linked responses in the Rolandic cortex made strong predictions for the syllables and consonants produced, but their predictive power was reduced for vowels. The results of this study provide a systematic survey of how cortical response patterns covary with the identity of speech sounds, which will help to constrain and guide theoretical models of speech perception, speech production, and phonological working memory. Copyright © 2016 Elsevier Inc. All rights reserved.

Deep Patient: An Unsupervised Representation to Predict the Future of Patients from the Electronic Health Records

PubMed Central

Miotto, Riccardo; Li, Li; Kidd, Brian A.; Dudley, Joel T.

2016-01-01

Secondary use of electronic health records (EHRs) promises to advance clinical research and better inform clinical decision making. Challenges in summarizing and representing patient data prevent widespread practice of predictive modeling using EHRs. Here we present a novel unsupervised deep feature learning method to derive a general-purpose patient representation from EHR data that facilitates clinical predictive modeling. In particular, a three-layer stack of denoising autoencoders was used to capture hierarchical regularities and dependencies in the aggregated EHRs of about 700,000 patients from the Mount Sinai data warehouse. The result is a representation we name “deep patient”. We evaluated this representation as broadly predictive of health states by assessing the probability of patients to develop various diseases. We performed evaluation using 76,214 test patients comprising 78 diseases from diverse clinical domains and temporal windows. Our results significantly outperformed those achieved using representations based on raw EHR data and alternative feature learning strategies. Prediction performance for severe diabetes, schizophrenia, and various cancers were among the top performing. These findings indicate that deep learning applied to EHRs can derive patient representations that offer improved clinical predictions, and could provide a machine learning framework for augmenting clinical decision systems. PMID:27185194

Deep Patient: An Unsupervised Representation to Predict the Future of Patients from the Electronic Health Records

NASA Astrophysics Data System (ADS)

Miotto, Riccardo; Li, Li; Kidd, Brian A.; Dudley, Joel T.

2016-05-01

Secondary use of electronic health records (EHRs) promises to advance clinical research and better inform clinical decision making. Challenges in summarizing and representing patient data prevent widespread practice of predictive modeling using EHRs. Here we present a novel unsupervised deep feature learning method to derive a general-purpose patient representation from EHR data that facilitates clinical predictive modeling. In particular, a three-layer stack of denoising autoencoders was used to capture hierarchical regularities and dependencies in the aggregated EHRs of about 700,000 patients from the Mount Sinai data warehouse. The result is a representation we name “deep patient”. We evaluated this representation as broadly predictive of health states by assessing the probability of patients to develop various diseases. We performed evaluation using 76,214 test patients comprising 78 diseases from diverse clinical domains and temporal windows. Our results significantly outperformed those achieved using representations based on raw EHR data and alternative feature learning strategies. Prediction performance for severe diabetes, schizophrenia, and various cancers were among the top performing. These findings indicate that deep learning applied to EHRs can derive patient representations that offer improved clinical predictions, and could provide a machine learning framework for augmenting clinical decision systems.

The indexed time table approach for planning and acting

NASA Technical Reports Server (NTRS)

Ghallab, Malik; Alaoui, Amine Mounir

1989-01-01

A representation is discussed of symbolic temporal relations, called IxTeT, that is both powerful enough at the reasoning level for tasks such as plan generation, refinement and modification, and efficient enough for dealing with real time constraints in action monitoring and reactive planning. Such representation for dealing with time is needed in a teleoperated space robot. After a brief survey of known approaches, the proposed representation shows its computational efficiency for managing a large data base of temporal relations. Reactive planning with IxTeT is described and exemplified through the problem of mission planning and modification for a simple surveying satellite.

Temporal binning of time-correlated single photon counting data improves exponential decay fits and imaging speed

PubMed Central

Walsh, Alex J.; Sharick, Joe T.; Skala, Melissa C.; Beier, Hope T.

2016-01-01

Time-correlated single photon counting (TCSPC) enables acquisition of fluorescence lifetime decays with high temporal resolution within the fluorescence decay. However, many thousands of photons per pixel are required for accurate lifetime decay curve representation, instrument response deconvolution, and lifetime estimation, particularly for two-component lifetimes. TCSPC imaging speed is inherently limited due to the single photon per laser pulse nature and low fluorescence event efficiencies (<10%) required to reduce bias towards short lifetimes. Here, simulated fluorescence lifetime decays are analyzed by SPCImage and SLIM Curve software to determine the limiting lifetime parameters and photon requirements of fluorescence lifetime decays that can be accurately fit. Data analysis techniques to improve fitting accuracy for low photon count data were evaluated. Temporal binning of the decays from 256 time bins to 42 time bins significantly (p<0.0001) improved fit accuracy in SPCImage and enabled accurate fits with low photon counts (as low as 700 photons/decay), a 6-fold reduction in required photons and therefore improvement in imaging speed. Additionally, reducing the number of free parameters in the fitting algorithm by fixing the lifetimes to known values significantly reduced the lifetime component error from 27.3% to 3.2% in SPCImage (p<0.0001) and from 50.6% to 4.2% in SLIM Curve (p<0.0001). Analysis of nicotinamide adenine dinucleotide–lactate dehydrogenase (NADH-LDH) solutions confirmed temporal binning of TCSPC data and a reduced number of free parameters improves exponential decay fit accuracy in SPCImage. Altogether, temporal binning (in SPCImage) and reduced free parameters are data analysis techniques that enable accurate lifetime estimation from low photon count data and enable TCSPC imaging speeds up to 6x and 300x faster, respectively, than traditional TCSPC analysis. PMID:27446663

The effects of selective and divided attention on sensory precision and integration.

PubMed

Odegaard, Brian; Wozny, David R; Shams, Ladan

2016-02-12

In our daily lives, our capacity to selectively attend to stimuli within or across sensory modalities enables enhanced perception of the surrounding world. While previous research on selective attention has studied this phenomenon extensively, two important questions still remain unanswered: (1) how selective attention to a single modality impacts sensory integration processes, and (2) the mechanism by which selective attention improves perception. We explored how selective attention impacts performance in both a spatial task and a temporal numerosity judgment task, and employed a Bayesian Causal Inference model to investigate the computational mechanism(s) impacted by selective attention. We report three findings: (1) in the spatial domain, selective attention improves precision of the visual sensory representations (which were relatively precise), but not the auditory sensory representations (which were fairly noisy); (2) in the temporal domain, selective attention improves the sensory precision in both modalities (both of which were fairly reliable to begin with); (3) in both tasks, selective attention did not exert a significant influence over the tendency to integrate sensory stimuli. Therefore, it may be postulated that a sensory modality must possess a certain inherent degree of encoding precision in order to benefit from selective attention. It also appears that in certain basic perceptual tasks, the tendency to integrate crossmodal signals does not depend significantly on selective attention. We conclude with a discussion of how these results relate to recent theoretical considerations of selective attention. Copyright © 2015 Elsevier Ireland Ltd. All rights reserved.

Interleaved Practice in Multi-Dimensional Learning Tasks: Which Dimension Should We Interleave?

ERIC Educational Resources Information Center

Rau, Martina A.; Aleven, Vincent; Rummel, Nikol

2013-01-01

Research shows that multiple representations can enhance student learning. Many curricula use multiple representations across multiple task types. The temporal sequence of representations and task types is likely to impact student learning. Research on contextual interference shows that interleaving learning tasks leads to better learning results…

Optimization of Classification Strategies of Acetowhite Temporal Patterns towards Improving Diagnostic Performance of Colposcopy

PubMed Central

Acosta-Mesa, Héctor Gabriel; Cruz-Ramírez, Nicandro; Hernández-Jiménez, Rodolfo

2017-01-01

Efforts have been being made to improve the diagnostic performance of colposcopy, trying to help better diagnose cervical cancer, particularly in developing countries. However, improvements in a number of areas are still necessary, such as the time it takes to process the full digital image of the cervix, the performance of the computing systems used to identify different kinds of tissues, and biopsy sampling. In this paper, we explore three different, well-known automatic classification methods (k-Nearest Neighbors, Naïve Bayes, and C4.5), in addition to different data models that take full advantage of this information and improve the diagnostic performance of colposcopy based on acetowhite temporal patterns. Based on the ROC and PRC area scores, the k-Nearest Neighbors and discrete PLA representation performed better than other methods. The values of sensitivity, specificity, and accuracy reached using this method were 60% (95% CI 50–70), 79% (95% CI 71–86), and 70% (95% CI 60–80), respectively. The acetowhitening phenomenon is not exclusive to high-grade lesions, and we have found acetowhite temporal patterns of epithelial changes that are not precancerous lesions but that are similar to positive ones. These findings need to be considered when developing more robust computing systems in the future. PMID:28744318

Facilitating insights with a user adaptable dashboard, illustrated by airport connectivity data

NASA Astrophysics Data System (ADS)

Dobraja, Ieva; Kraak, Menno-Jan; Engelhardt, Yuri

2018-05-01

Since the movement data exist, there have been approaches to collect and analyze them to get insights. This kind of data is often heterogeneous, multiscale and multi-temporal. Those interested in spatio-temporal patterns of movement data do not gain insights from textual descriptions. Therefore, visualization is required. As spatio-temporal movement data can be complex because size and characteristics, it is even challenging to create an overview of it. Plotting all the data on the screen will not be the solution as it likely will result into cluttered images where no data exploration is possible. To ensure that users will receive the information they are interested in, it is important to provide a graphical data representation environment where exploration to gain insights are possible not only in the overall level but at sub-levels as well. A dashboard would be a solution the representation of heterogeneous spatio- temporal data. It provides an overview and helps to unravel the complexity of data by splitting data in multiple data representation views. The adaptability of dashboard will help to reveal the information which cannot be seen in the overview.

Temporal Organization of Sound Information in Auditory Memory.

PubMed

Song, Kun; Luo, Huan

2017-01-01

Memory is a constructive and organizational process. Instead of being stored with all the fine details, external information is reorganized and structured at certain spatiotemporal scales. It is well acknowledged that time plays a central role in audition by segmenting sound inputs into temporal chunks of appropriate length. However, it remains largely unknown whether critical temporal structures exist to mediate sound representation in auditory memory. To address the issue, here we designed an auditory memory transferring study, by combining a previously developed unsupervised white noise memory paradigm with a reversed sound manipulation method. Specifically, we systematically measured the memory transferring from a random white noise sound to its locally temporal reversed version on various temporal scales in seven experiments. We demonstrate a U-shape memory-transferring pattern with the minimum value around temporal scale of 200 ms. Furthermore, neither auditory perceptual similarity nor physical similarity as a function of the manipulating temporal scale can account for the memory-transferring results. Our results suggest that sounds are not stored with all the fine spectrotemporal details but are organized and structured at discrete temporal chunks in long-term auditory memory representation.

Spatial and temporal variability of rainfall and their effects on hydrological response in urban areas - a review

NASA Astrophysics Data System (ADS)

Cristiano, Elena; ten Veldhuis, Marie-claire; van de Giesen, Nick

2017-07-01

In urban areas, hydrological processes are characterized by high variability in space and time, making them sensitive to small-scale temporal and spatial rainfall variability. In the last decades new instruments, techniques, and methods have been developed to capture rainfall and hydrological processes at high resolution. Weather radars have been introduced to estimate high spatial and temporal rainfall variability. At the same time, new models have been proposed to reproduce hydrological response, based on small-scale representation of urban catchment spatial variability. Despite these efforts, interactions between rainfall variability, catchment heterogeneity, and hydrological response remain poorly understood. This paper presents a review of our current understanding of hydrological processes in urban environments as reported in the literature, focusing on their spatial and temporal variability aspects. We review recent findings on the effects of rainfall variability on hydrological response and identify gaps where knowledge needs to be further developed to improve our understanding of and capability to predict urban hydrological response.

Kernel Temporal Differences for Neural Decoding

PubMed Central

Bae, Jihye; Sanchez Giraldo, Luis G.; Pohlmeyer, Eric A.; Francis, Joseph T.; Sanchez, Justin C.; Príncipe, José C.

2015-01-01

We study the feasibility and capability of the kernel temporal difference (KTD)(λ) algorithm for neural decoding. KTD(λ) is an online, kernel-based learning algorithm, which has been introduced to estimate value functions in reinforcement learning. This algorithm combines kernel-based representations with the temporal difference approach to learning. One of our key observations is that by using strictly positive definite kernels, algorithm's convergence can be guaranteed for policy evaluation. The algorithm's nonlinear functional approximation capabilities are shown in both simulations of policy evaluation and neural decoding problems (policy improvement). KTD can handle high-dimensional neural states containing spatial-temporal information at a reasonable computational complexity allowing real-time applications. When the algorithm seeks a proper mapping between a monkey's neural states and desired positions of a computer cursor or a robot arm, in both open-loop and closed-loop experiments, it can effectively learn the neural state to action mapping. Finally, a visualization of the coadaptation process between the decoder and the subject shows the algorithm's capabilities in reinforcement learning brain machine interfaces. PMID:25866504

Treatment for Alexia With Agraphia Following Left Ventral Occipito-Temporal Damage: Strengthening Orthographic Representations Common to Reading and Spelling

PubMed Central

Rising, Kindle; Rapcsak, Steven Z.; Beeson, Pélagie M.

2015-01-01

Purpose Damage to left ventral occipito-temporal cortex can give rise to written language impairment characterized by pure alexia/letter-by-letter (LBL) reading, as well as surface alexia and agraphia. The purpose of this study was to examine the therapeutic effects of a combined treatment approach to address concurrent LBL reading with surface alexia/agraphia. Method Simultaneous treatment to address slow reading and errorful spelling was administered to 3 individuals with reading and spelling impairments after left ventral occipito-temporal damage due to posterior cerebral artery stroke. Single-word reading/spelling accuracy, reading latencies, and text reading were monitored as outcome measures for the combined effects of multiple oral re-reading treatment and interactive spelling treatment. Results After treatment, participants demonstrated faster and more accurate single-word reading and improved text-reading rates. Spelling accuracy also improved, particularly for untrained irregular words, demonstrating generalization of the trained interactive spelling strategy. Conclusion This case series characterizes concomitant LBL with surface alexia/agraphia and demonstrates a successful treatment approach to address both the reading and spelling impairment. PMID:26110814

Treatment for Alexia With Agraphia Following Left Ventral Occipito-Temporal Damage: Strengthening Orthographic Representations Common to Reading and Spelling.

PubMed

Kim, Esther S; Rising, Kindle; Rapcsak, Steven Z; Beeson, Pélagie M

2015-10-01

Damage to left ventral occipito-temporal cortex can give rise to written language impairment characterized by pure alexia/letter-by-letter (LBL) reading, as well as surface alexia and agraphia. The purpose of this study was to examine the therapeutic effects of a combined treatment approach to address concurrent LBL reading with surface alexia/agraphia. Simultaneous treatment to address slow reading and errorful spelling was administered to 3 individuals with reading and spelling impairments after left ventral occipito-temporal damage due to posterior cerebral artery stroke. Single-word reading/spelling accuracy, reading latencies, and text reading were monitored as outcome measures for the combined effects of multiple oral re-reading treatment and interactive spelling treatment. After treatment, participants demonstrated faster and more accurate single-word reading and improved text-reading rates. Spelling accuracy also improved, particularly for untrained irregular words, demonstrating generalization of the trained interactive spelling strategy. This case series characterizes concomitant LBL with surface alexia/agraphia and demonstrates a successful treatment approach to address both the reading and spelling impairment.

Plastic brain mechanisms for attaining auditory temporal order judgment proficiency.

PubMed

Bernasconi, Fosco; Grivel, Jeremy; Murray, Micah M; Spierer, Lucas

2010-04-15

Accurate perception of the order of occurrence of sensory information is critical for the building up of coherent representations of the external world from ongoing flows of sensory inputs. While some psychophysical evidence reports that performance on temporal perception can improve, the underlying neural mechanisms remain unresolved. Using electrical neuroimaging analyses of auditory evoked potentials (AEPs), we identified the brain dynamics and mechanism supporting improvements in auditory temporal order judgment (TOJ) during the course of the first vs. latter half of the experiment. Training-induced changes in brain activity were first evident 43-76 ms post stimulus onset and followed from topographic, rather than pure strength, AEP modulations. Improvements in auditory TOJ accuracy thus followed from changes in the configuration of the underlying brain networks during the initial stages of sensory processing. Source estimations revealed an increase in the lateralization of initially bilateral posterior sylvian region (PSR) responses at the beginning of the experiment to left-hemisphere dominance at its end. Further supporting the critical role of left and right PSR in auditory TOJ proficiency, as the experiment progressed, responses in the left and right PSR went from being correlated to un-correlated. These collective findings provide insights on the neurophysiologic mechanism and plasticity of temporal processing of sounds and are consistent with models based on spike timing dependent plasticity. Copyright 2010 Elsevier Inc. All rights reserved.

The Representation of Object-Directed Action and Function Knowledge in the Human Brain.

PubMed

Chen, Quanjing; Garcea, Frank E; Mahon, Bradford Z

2016-04-01

The appropriate use of everyday objects requires the integration of action and function knowledge. Previous research suggests that action knowledge is represented in frontoparietal areas while function knowledge is represented in temporal lobe regions. Here we used multivoxel pattern analysis to investigate the representation of object-directed action and function knowledge while participants executed pantomimes of familiar tool actions. A novel approach for decoding object knowledge was used in which classifiers were trained on one pair of objects and then tested on a distinct pair; this permitted a measurement of classification accuracy over and above object-specific information. Region of interest (ROI) analyses showed that object-directed actions could be decoded in tool-preferring regions of both parietal and temporal cortex, while no independently defined tool-preferring ROI showed successful decoding of object function. However, a whole-brain searchlight analysis revealed that while frontoparietal motor and peri-motor regions are engaged in the representation of object-directed actions, medial temporal lobe areas in the left hemisphere are involved in the representation of function knowledge. These results indicate that both action and function knowledge are represented in a topographically coherent manner that is amenable to study with multivariate approaches, and that the left medial temporal cortex represents knowledge of object function. © The Author 2015. Published by Oxford University Press. All rights reserved. For Permissions, please e-mail: journals.permissions@oup.com.

Decoding word and category-specific spatiotemporal representations from MEG and EEG

PubMed Central

Chan, Alexander M.; Halgren, Eric; Marinkovic, Ksenija; Cash, Sydney S.

2010-01-01

The organization and localization of lexico-semantic information in the brain has been debated for many years. Specifically, lesion and imaging studies have attempted to map the brain areas representing living versus non-living objects, however, results remain variable. This may be due, in part, to the fact that the univariate statistical mapping analyses used to detect these brain areas are typically insensitive to subtle, but widespread, effects. Decoding techniques, on the other hand, allow for a powerful multivariate analysis of multichannel neural data. In this study, we utilize machine-learning algorithms to first demonstrate that semantic category, as well as individual words, can be decoded from EEG and MEG recordings of subjects performing a language task. Mean accuracies of 76% (chance = 50%) and 83% (chance = 20%) were obtained for the decoding of living vs. non-living category or individual words respectively. Furthermore, we utilize this decoding analysis to demonstrate that the representations of words and semantic category are highly distributed both spatially and temporally. In particular, bilateral anterior temporal, bilateral inferior frontal, and left inferior temporal-occipital sensors are most important for discrimination. Successful intersubject and intermodality decoding shows that semantic representations between stimulus modalities and individuals are reasonably consistent. These results suggest that both word and category-specific information are present in extracranially recorded neural activity and that these representations may be more distributed, both spatially and temporally, than previous studies suggest. PMID:21040796

A simulation study of harmonics regeneration in noise reduction for electric and acoustic stimulation.

PubMed

Hu, Yi

2010-05-01

Recent research results show that combined electric and acoustic stimulation (EAS) significantly improves speech recognition in noise, and it is generally established that access to the improved F0 representation of target speech, along with the glimpse cues, provide the EAS benefits. Under noisy listening conditions, noise signals degrade these important cues by introducing undesired temporal-frequency components and corrupting harmonics structure. In this study, the potential of combining noise reduction and harmonics regeneration techniques was investigated to further improve speech intelligibility in noise by providing improved beneficial cues for EAS. Three hypotheses were tested: (1) noise reduction methods can improve speech intelligibility in noise for EAS; (2) harmonics regeneration after noise reduction can further improve speech intelligibility in noise for EAS; and (3) harmonics sideband constraints in frequency domain (or equivalently, amplitude modulation in temporal domain), even deterministic ones, can provide additional benefits. Test results demonstrate that combining noise reduction and harmonics regeneration can significantly improve speech recognition in noise for EAS, and it is also beneficial to preserve the harmonics sidebands under adverse listening conditions. This finding warrants further work into the development of algorithms that regenerate harmonics and the related sidebands for EAS processing under noisy conditions.

Orientalism(s), World Geography Textbooks, and Temporal Paradox: Questioning Representations of Southwest Asia and North Africa

ERIC Educational Resources Information Center

Zagumny, Lisa; Richey, Amanda B.

2013-01-01

In this critical discourse analysis of six high-school world geography textbooks, we explore how constructions and representations of North Africa and Southwest Asia have served to reinforce Orientalist discourse in formal curriculum. Visual and written representations in these textbooks were overwhelmingly confounded by a traditional/modern…

A real-world size organization of object responses in occipito-temporal cortex

PubMed Central

Konkle, Talia; Oliva, Aude

2012-01-01

SUMMARY While there are selective regions of occipito-temporal cortex that respond to faces, letters, and bodies, the large-scale neural organization of most object categories remains unknown. Here we find that object representations can be differentiated along the ventral temporal cortex by their real-world size. In a functional neuroimaging experiment, observers were shown pictures of big and small real-world objects (e.g. table, bathtub; paperclip, cup), presented at the same retinal size. We observed a consistent medial-to-lateral organization of big and small object preferences in the ventral temporal cortex, mirrored along the lateral surface. Regions in the lateral-occipital, infero-temporal, and parahippocampal cortices showed strong peaks of differential real-world size selectivity, and maintained these preferences over changes in retinal size and in mental imagery. These data demonstrate that the real-world size of objects can provide insight into the spatial topography of object representation. PMID:22726840

The functional architecture of the ventral temporal cortex and its role in categorization

PubMed Central

Grill-Spector, Kalanit; Weiner, Kevin S.

2014-01-01

Visual categorization is thought to occur in the human ventral temporal cortex (VTC), but how this categorization is achieved is still largely unknown. In this Review, we consider the computations and representations that are necessary for categorization and examine how the microanatomical and macroanatomical layout of the VTC might optimize them to achieve rapid and flexible visual categorization. We propose that efficient categorization is achieved by organizing representations in a nested spatial hierarchy in the VTC. This spatial hierarchy serves as a neural infrastructure for the representational hierarchy of visual information in the VTC and thereby enables flexible access to category information at several levels of abstraction. PMID:24962370

A 15-Year Review of Trends in Representation of Female Subjects in Islamic Bioethics Research.

PubMed

Hussain, Zeenat; Kuzian, Edyta; Hussain, Naveed

2017-02-01

Gender representation in Islamic bioethics research in the twenty-first century has not been studied. To study temporal trends in representation of female subjects in Islamic bioethics research, PubMed-listed publications on Islamic bioethics from years 2000 to 2014 were reviewed for gender participation in human subjects' research. There were temporal trends of increasing publications of Islamic bioethics-related human subjects' research (64 papers over 15 years; R 2  = 0.72; p < 0.0004). Female subjects were well represented with a trend toward increasing participation. This was true for women from Muslim-majority countries even in non-gender-focused studies over the past 15 years.

Spatial, Temporal and Spectral Satellite Image Fusion via Sparse Representation

NASA Astrophysics Data System (ADS)

Song, Huihui

Remote sensing provides good measurements for monitoring and further analyzing the climate change, dynamics of ecosystem, and human activities in global or regional scales. Over the past two decades, the number of launched satellite sensors has been increasing with the development of aerospace technologies and the growing requirements on remote sensing data in a vast amount of application fields. However, a key technological challenge confronting these sensors is that they tradeoff between spatial resolution and other properties, including temporal resolution, spectral resolution, swath width, etc., due to the limitations of hardware technology and budget constraints. To increase the spatial resolution of data with other good properties, one possible cost-effective solution is to explore data integration methods that can fuse multi-resolution data from multiple sensors, thereby enhancing the application capabilities of available remote sensing data. In this thesis, we propose to fuse the spatial resolution with temporal resolution and spectral resolution, respectively, based on sparse representation theory. Taking the study case of Landsat ETM+ (with spatial resolution of 30m and temporal resolution of 16 days) and MODIS (with spatial resolution of 250m ~ 1km and daily temporal resolution) reflectance, we propose two spatial-temporal fusion methods to combine the fine spatial information of Landsat image and the daily temporal resolution of MODIS image. Motivated by that the images from these two sensors are comparable on corresponding bands, we propose to link their spatial information on available Landsat- MODIS image pair (captured on prior date) and then predict the Landsat image from the MODIS counterpart on prediction date. To well-learn the spatial details from the prior images, we use a redundant dictionary to extract the basic representation atoms for both Landsat and MODIS images based on sparse representation. Under the scenario of two prior Landsat-MODIS image pairs, we build the corresponding relationship between the difference images of MODIS and ETM+ by training a low- and high-resolution dictionary pair from the given prior image pairs. In the second scenario, i.e., only one Landsat- MODIS image pair being available, we directly correlate MODIS and ETM+ data through an image degradation model. Then, the fusion stage is achieved by super-resolving the MODIS image combining the high-pass modulation in a two-layer fusion framework. Remarkably, the proposed spatial-temporal fusion methods form a unified framework for blending remote sensing images with phenology change or land-cover-type change. Based on the proposed spatial-temporal fusion models, we propose to monitor the land use/land cover changes in Shenzhen, China. As a fast-growing city, Shenzhen faces the problem of detecting the rapid changes for both rational city planning and sustainable development. However, the cloudy and rainy weather in region Shenzhen located makes the capturing circle of high-quality satellite images longer than their normal revisit periods. Spatial-temporal fusion methods are capable to tackle this problem by improving the spatial resolution of images with coarse spatial resolution but frequent temporal coverage, thereby making the detection of rapid changes possible. On two Landsat-MODIS datasets with annual and monthly changes, respectively, we apply the proposed spatial-temporal fusion methods to the task of multiple change detection. Afterward, we propose a novel spatial and spectral fusion method for satellite multispectral and hyperspectral (or high-spectral) images based on dictionary-pair learning and sparse non-negative matrix factorization. By combining the spectral information from hyperspectral image, which is characterized by low spatial resolution but high spectral resolution and abbreviated as LSHS, and the spatial information from multispectral image, which is featured by high spatial resolution but low spectral resolution and abbreviated as HSLS, this method aims to generate the fused data with both high spatial and high spectral resolutions. Motivated by the observation that each hyperspectral pixel can be represented by a linear combination of a few endmembers, this method first extracts the spectral bases of LSHS and HSLS images by making full use of the rich spectral information in LSHS data. The spectral bases of these two categories data then formulate a dictionary-pair due to their correspondence in representing each pixel spectra of LSHS data and HSLS data, respectively. Subsequently, the LSHS image is spatially unmixed by representing the HSLS image with respect to the corresponding learned dictionary to derive its representation coefficients. Combining the spectral bases of LSHS data and the representation coefficients of HSLS data, we finally derive the fused data characterized by the spectral resolution of LSHS data and the spatial resolution of HSLS data.

Formally grounding spatio-temporal thinking.

PubMed

Klippel, Alexander; Wallgrün, Jan Oliver; Yang, Jinlong; Li, Rui; Dylla, Frank

2012-08-01

To navigate through daily life, humans use their ability to conceptualize spatio-temporal information, which ultimately leads to a system of categories. Likewise, the spatial sciences rely heavily on conceptualization and categorization as means to create knowledge when they process spatio-temporal data. In the spatial sciences and in related branches of artificial intelligence, an approach has been developed for processing spatio-temporal data on the level of coarse categories: qualitative spatio-temporal representation and reasoning (QSTR). Calculi developed in QSTR allow for the meaningful processing of and reasoning with spatio-temporal information. While qualitative calculi are widely acknowledged in the cognitive sciences, there is little behavioral assessment whether these calculi are indeed cognitively adequate. This is an astonishing conundrum given that these calculi are ubiquitous, are often intended to improve processes at the human-machine interface, and are on several occasions claimed to be cognitively adequate. We have systematically evaluated several approaches to formally characterize spatial relations from a cognitive-behavioral perspective for both static and dynamically changing spatial relations. This contribution will detail our framework, which is addressing the question how formal characterization of space can help us understand how people think with, in, and about space.

The temporal evolution of conceptual object representations revealed through models of behavior, semantics and deep neural networks.

PubMed

Bankson, B B; Hebart, M N; Groen, I I A; Baker, C I

2018-05-17

Visual object representations are commonly thought to emerge rapidly, yet it has remained unclear to what extent early brain responses reflect purely low-level visual features of these objects and how strongly those features contribute to later categorical or conceptual representations. Here, we aimed to estimate a lower temporal bound for the emergence of conceptual representations by defining two criteria that characterize such representations: 1) conceptual object representations should generalize across different exemplars of the same object, and 2) these representations should reflect high-level behavioral judgments. To test these criteria, we compared magnetoencephalography (MEG) recordings between two groups of participants (n = 16 per group) exposed to different exemplar images of the same object concepts. Further, we disentangled low-level from high-level MEG responses by estimating the unique and shared contribution of models of behavioral judgments, semantics, and different layers of deep neural networks of visual object processing. We find that 1) both generalization across exemplars as well as generalization of object-related signals across time increase after 150 ms, peaking around 230 ms; 2) representations specific to behavioral judgments emerged rapidly, peaking around 160 ms. Collectively, these results suggest a lower bound for the emergence of conceptual object representations around 150 ms following stimulus onset. Copyright © 2018 Elsevier Inc. All rights reserved.

Textural timbre

PubMed Central

Hollins, Mark

2009-01-01

During haptic exploration of surfaces, complex mechanical oscillations—of surface displacement and air pressure—are generated, which are then transduced by receptors in the skin and in the inner ear. Tactile and auditory signals thus convey redundant information about texture, partially carried in the spectral content of these signals. It is no surprise, then, that the representation of temporal frequency is linked in the auditory and somatosensory systems. An emergent hypothesis is that there exists a supramodal representation of temporal frequency, and by extension texture. PMID:19721886

Frequency-Selective Attention in Auditory Scenes Recruits Frequency Representations Throughout Human Superior Temporal Cortex.

PubMed

Riecke, Lars; Peters, Judith C; Valente, Giancarlo; Kemper, Valentin G; Formisano, Elia; Sorger, Bettina

2017-05-01

A sound of interest may be tracked amid other salient sounds by focusing attention on its characteristic features including its frequency. Functional magnetic resonance imaging findings have indicated that frequency representations in human primary auditory cortex (AC) contribute to this feat. However, attentional modulations were examined at relatively low spatial and spectral resolutions, and frequency-selective contributions outside the primary AC could not be established. To address these issues, we compared blood oxygenation level-dependent (BOLD) responses in the superior temporal cortex of human listeners while they identified single frequencies versus listened selectively for various frequencies within a multifrequency scene. Using best-frequency mapping, we observed that the detailed spatial layout of attention-induced BOLD response enhancements in primary AC follows the tonotopy of stimulus-driven frequency representations-analogous to the "spotlight" of attention enhancing visuospatial representations in retinotopic visual cortex. Moreover, using an algorithm trained to discriminate stimulus-driven frequency representations, we could successfully decode the focus of frequency-selective attention from listeners' BOLD response patterns in nonprimary AC. Our results indicate that the human brain facilitates selective listening to a frequency of interest in a scene by reinforcing the fine-grained activity pattern throughout the entire superior temporal cortex that would be evoked if that frequency was present alone. © The Author 2016. Published by Oxford University Press. All rights reserved. For Permissions, please e-mail: journals.permissions@oup.com.

Temporal construal effects on abstract and concrete thinking: consequences for insight and creative cognition.

PubMed

Förster, Jens; Friedman, Ronald S; Liberman, Nira

2004-08-01

Six studies investigate whether and how distant future time perspective facilitates abstract thinking and impedes concrete thinking by altering the level at which mental representations are construed. In Experiments 1-3, participants who envisioned their lives and imagined themselves engaging in a task 1 year later as opposed to the next day subsequently performed better on a series of insight tasks. In Experiments 4 and 5 a distal perspective was found to improve creative generation of abstract solutions. Moreover, Experiment 5 demonstrated a similar effect with temporal distance manipulated indirectly, by making participants imagine their lives in general a year from now versus tomorrow prior to performance. In Experiment 6, distant time perspective undermined rather than enhanced analytical problem solving.

Differential temporal dynamics during visual imagery and perception.

PubMed

Dijkstra, Nadine; Mostert, Pim; Lange, Floris P de; Bosch, Sander; van Gerven, Marcel Aj

2018-05-29

Visual perception and imagery rely on similar representations in the visual cortex. During perception, visual activity is characterized by distinct processing stages, but the temporal dynamics underlying imagery remain unclear. Here, we investigated the dynamics of visual imagery in human participants using magnetoencephalography. Firstly, we show that, compared to perception, imagery decoding becomes significant later and representations at the start of imagery already overlap with later time points. This suggests that during imagery, the entire visual representation is activated at once or that there are large differences in the timing of imagery between trials. Secondly, we found consistent overlap between imagery and perceptual processing around 160 ms and from 300 ms after stimulus onset. This indicates that the N170 gets reactivated during imagery and that imagery does not rely on early perceptual representations. Together, these results provide important insights for our understanding of the neural mechanisms of visual imagery. © 2018, Dijkstra et al.

Sensitivity to musical structure in the human brain

PubMed Central

McDermott, Josh H.; Norman-Haignere, Sam; Kanwisher, Nancy

2012-01-01

Evidence from brain-damaged patients suggests that regions in the temporal lobes, distinct from those engaged in lower-level auditory analysis, process the pitch and rhythmic structure in music. In contrast, neuroimaging studies targeting the representation of music structure have primarily implicated regions in the inferior frontal cortices. Combining individual-subject fMRI analyses with a scrambling method that manipulated musical structure, we provide evidence of brain regions sensitive to musical structure bilaterally in the temporal lobes, thus reconciling the neuroimaging and patient findings. We further show that these regions are sensitive to the scrambling of both pitch and rhythmic structure but are insensitive to high-level linguistic structure. Our results suggest the existence of brain regions with representations of musical structure that are distinct from high-level linguistic representations and lower-level acoustic representations. These regions provide targets for future research investigating possible neural specialization for music or its associated mental processes. PMID:23019005

The sense of body ownership relaxes temporal constraints for multisensory integration.

PubMed

Maselli, Antonella; Kilteni, Konstantina; López-Moliner, Joan; Slater, Mel

2016-08-03

Experimental work on body ownership illusions showed how simple multisensory manipulation can generate the illusory experience of an artificial limb as being part of the own-body. This work highlighted how own-body perception relies on a plastic brain representation emerging from multisensory integration. The flexibility of this representation is reflected in the short-term modulations of physiological states and perceptual processing observed during these illusions. Here, we explore the impact of ownership illusions on the temporal dimension of multisensory integration. We show that, during the illusion, the temporal window for integrating touch on the physical body with touch seen on a virtual body representation, increases with respect to integration with visual events seen close but separated from the virtual body. We show that this effect is mediated by the ownership illusion. Crucially, the temporal window for visuotactile integration was positively correlated with participants' scores rating the illusory experience of owning the virtual body and touching the object seen in contact with it. Our results corroborate the recently proposed causal inference mechanism for illusory body ownership. As a novelty, they show that the ensuing illusory causal binding between stimuli from the real and fake body relaxes constraints for the integration of bodily signals.

Anatomical segregation of representations of personally familiar and famous people in the temporal and parietal cortices.

PubMed

Sugiura, Motoaki; Sassa, Yuko; Watanabe, Jobu; Akitsuki, Yuko; Maeda, Yasuhiro; Matsue, Yoshihiko; Kawashima, Ryuta

2009-10-01

Person recognition has been assumed to entail many types of person-specific cognitive responses, including retrieval of knowledge, episodic recollection, and emotional responses. To demonstrate the cortical correlates of this modular structure of multimodal person representation, we investigated neural responses preferential to personally familiar people and responses dependent on familiarity with famous people in the temporal and parietal cortices. During functional magnetic resonance imaging (fMRI) measurements, normal subjects recognized personally familiar names (personal) or famous names with high or low degrees of familiarity (high or low, respectively). Effects of familiarity with famous people (i.e., high-low) were identified in the bilateral angular gyri, the left supramarginal gyrus, the middle part of the bilateral posterior cingulate cortices, and the left precuneus. Activation preferentially relevant to personally familiar people (i.e., personal-high) was identified in the bilateral temporo-parietal junctions, the right anterolateral temporal cortices, posterior middle temporal gyrus, posterior cingulate cortex (with a peak in the posterodorsal part), and the left precuneus; these activation foci exhibited varying degrees of activation for high and low names. An equivalent extent of activation was observed for all familiar names in the bilateral temporal poles, the left orbito-insular junction, the middle temporal gyrus, and the anterior part of the posterior cingulate cortex. The results demonstrated that distinct cortical areas supported different types of cognitive responses, induced to different degrees during recognition of famous and personally familiar people, providing neuroscientific evidence for the modularity of multimodal person representation.

Distinct Effects of Memory Retrieval and Articulatory Preparation when Learning and Accessing New Word Forms

PubMed Central

Nora, Anni; Renvall, Hanna; Kim, Jeong-Young; Service, Elisabet; Salmelin, Riitta

2015-01-01

Temporal and frontal activations have been implicated in learning of novel word forms, but their specific roles remain poorly understood. The present magnetoencephalography (MEG) study examines the roles of these areas in processing newly-established word form representations. The cortical effects related to acquiring new phonological word forms during incidental learning were localized. Participants listened to and repeated back new word form stimuli that adhered to native phonology (Finnish pseudowords) or were foreign (Korean words), with a subset of the stimuli recurring four times. Subsequently, a modified 1-back task and a recognition task addressed whether the activations modulated by learning were related to planning for overt articulation, while parametrically added noise probed reliance on developing memory representations during effortful perception. Learning resulted in decreased left superior temporal and increased bilateral frontal premotor activation for familiar compared to new items. The left temporal learning effect persisted in all tasks and was strongest when stimuli were embedded in intermediate noise. In the noisy conditions, native phonotactics evoked overall enhanced left temporal activation. In contrast, the frontal learning effects were present only in conditions requiring overt repetition and were more pronounced for the foreign language. The results indicate a functional dissociation between temporal and frontal activations in learning new phonological word forms: the left superior temporal responses reflect activation of newly-established word-form representations, also during degraded sensory input, whereas the frontal premotor effects are related to planning for articulation and are not preserved in noise. PMID:25961571

Distinct effects of memory retrieval and articulatory preparation when learning and accessing new word forms.

PubMed

Nora, Anni; Renvall, Hanna; Kim, Jeong-Young; Service, Elisabet; Salmelin, Riitta

2015-01-01

Temporal and frontal activations have been implicated in learning of novel word forms, but their specific roles remain poorly understood. The present magnetoencephalography (MEG) study examines the roles of these areas in processing newly-established word form representations. The cortical effects related to acquiring new phonological word forms during incidental learning were localized. Participants listened to and repeated back new word form stimuli that adhered to native phonology (Finnish pseudowords) or were foreign (Korean words), with a subset of the stimuli recurring four times. Subsequently, a modified 1-back task and a recognition task addressed whether the activations modulated by learning were related to planning for overt articulation, while parametrically added noise probed reliance on developing memory representations during effortful perception. Learning resulted in decreased left superior temporal and increased bilateral frontal premotor activation for familiar compared to new items. The left temporal learning effect persisted in all tasks and was strongest when stimuli were embedded in intermediate noise. In the noisy conditions, native phonotactics evoked overall enhanced left temporal activation. In contrast, the frontal learning effects were present only in conditions requiring overt repetition and were more pronounced for the foreign language. The results indicate a functional dissociation between temporal and frontal activations in learning new phonological word forms: the left superior temporal responses reflect activation of newly-established word-form representations, also during degraded sensory input, whereas the frontal premotor effects are related to planning for articulation and are not preserved in noise.

The Construct of the Multisensory Temporal Binding Window and its Dysregulation in Developmental Disabilities

PubMed Central

Wallace, Mark T.; Stevenson, Ryan A.

2014-01-01

Behavior, perception and cognition are strongly shaped by the synthesis of information across the different sensory modalities. Such multisensory integration often results in performance and perceptual benefits that reflect the additional information conferred by having cues from multiple senses providing redundant or complementary information. The spatial and temporal relationships of these cues provide powerful statistical information about how these cues should be integrated or “bound” in order to create a unified perceptual representation. Much recent work has examined the temporal factors that are integral in multisensory processing, with many focused on the construct of the multisensory temporal binding window – the epoch of time within which stimuli from different modalities is likely to be integrated and perceptually bound. Emerging evidence suggests that this temporal window is altered in a series of neurodevelopmental disorders, including autism, dyslexia and schizophrenia. In addition to their role in sensory processing, these deficits in multisensory temporal function may play an important role in the perceptual and cognitive weaknesses that characterize these clinical disorders. Within this context, focus on improving the acuity of multisensory temporal function may have important implications for the amelioration of the “higher-order” deficits that serve as the defining features of these disorders. PMID:25128432

Modeling Geometric-Temporal Context With Directional Pyramid Co-Occurrence for Action Recognition.

PubMed

Yuan, Chunfeng; Li, Xi; Hu, Weiming; Ling, Haibin; Maybank, Stephen J

2014-02-01

In this paper, we present a new geometric-temporal representation for visual action recognition based on local spatio-temporal features. First, we propose a modified covariance descriptor under the log-Euclidean Riemannian metric to represent the spatio-temporal cuboids detected in the video sequences. Compared with previously proposed covariance descriptors, our descriptor can be measured and clustered in Euclidian space. Second, to capture the geometric-temporal contextual information, we construct a directional pyramid co-occurrence matrix (DPCM) to describe the spatio-temporal distribution of the vector-quantized local feature descriptors extracted from a video. DPCM characterizes the co-occurrence statistics of local features as well as the spatio-temporal positional relationships among the concurrent features. These statistics provide strong descriptive power for action recognition. To use DPCM for action recognition, we propose a directional pyramid co-occurrence matching kernel to measure the similarity of videos. The proposed method achieves the state-of-the-art performance and improves on the recognition performance of the bag-of-visual-words (BOVWs) models by a large margin on six public data sets. For example, on the KTH data set, it achieves 98.78% accuracy while the BOVW approach only achieves 88.06%. On both Weizmann and UCF CIL data sets, the highest possible accuracy of 100% is achieved.

Pattern Discovery and Change Detection of Online Music Query Streams

NASA Astrophysics Data System (ADS)

Li, Hua-Fu

In this paper, an efficient stream mining algorithm, called FTP-stream (Frequent Temporal Pattern mining of streams), is proposed to find the frequent temporal patterns over melody sequence streams. In the framework of our proposed algorithm, an effective bit-sequence representation is used to reduce the time and memory needed to slide the windows. The FTP-stream algorithm can calculate the support threshold in only a single pass based on the concept of bit-sequence representation. It takes the advantage of "left" and "and" operations of the representation. Experiments show that the proposed algorithm only scans the music query stream once, and runs significant faster and consumes less memory than existing algorithms, such as SWFI-stream and Moment.

Multivariate Pattern Analysis Reveals Category-Related Organization of Semantic Representations in Anterior Temporal Cortex.

PubMed

Malone, Patrick S; Glezer, Laurie S; Kim, Judy; Jiang, Xiong; Riesenhuber, Maximilian

2016-09-28

The neural substrates of semantic representation have been the subject of much controversy. The study of semantic representations is complicated by difficulty in disentangling perceptual and semantic influences on neural activity, as well as in identifying stimulus-driven, "bottom-up" semantic selectivity unconfounded by top-down task-related modulations. To address these challenges, we trained human subjects to associate pseudowords (TPWs) with various animal and tool categories. To decode semantic representations of these TPWs, we used multivariate pattern classification of fMRI data acquired while subjects performed a semantic oddball detection task. Crucially, the classifier was trained and tested on disjoint sets of TPWs, so that the classifier had to use the semantic information from the training set to correctly classify the test set. Animal and tool TPWs were successfully decoded based on fMRI activity in spatially distinct subregions of the left medial anterior temporal lobe (LATL). In addition, tools (but not animals) were successfully decoded from activity in the left inferior parietal lobule. The tool-selective LATL subregion showed greater functional connectivity with left inferior parietal lobule and ventral premotor cortex, indicating that each LATL subregion exhibits distinct patterns of connectivity. Our findings demonstrate category-selective organization of semantic representations in LATL into spatially distinct subregions, continuing the lateral-medial segregation of activation in posterior temporal cortex previously observed in response to images of animals and tools, respectively. Together, our results provide evidence for segregation of processing hierarchies for different classes of objects and the existence of multiple, category-specific semantic networks in the brain. The location and specificity of semantic representations in the brain are still widely debated. We trained human participants to associate specific pseudowords with various animal and tool categories, and used multivariate pattern classification of fMRI data to decode the semantic representations of the trained pseudowords. We found that: (1) animal and tool information was organized in category-selective subregions of medial left anterior temporal lobe (LATL); (2) tools, but not animals, were encoded in left inferior parietal lobe; and (3) LATL subregions exhibited distinct patterns of functional connectivity with category-related regions across cortex. Our findings suggest that semantic knowledge in LATL is organized in category-related subregions, providing evidence for the existence of multiple, category-specific semantic representations in the brain. Copyright © 2016 the authors 0270-6474/16/3610089-08$15.00/0.

Description and evaluation of the Earth System Regional Climate Model (RegCM-ES)

NASA Astrophysics Data System (ADS)

Farneti, Riccardo; Sitz, Lina; Di Sante, Fabio; Fuentes-Franco, Ramon; Coppola, Erika; Mariotti, Laura; Reale, Marco; Sannino, Gianmaria; Barreiro, Marcelo; Nogherotto, Rita; Giuliani, Graziano; Graffino, Giorgio; Solidoro, Cosimo; Giorgi, Filippo

2017-04-01

The increasing availability of satellite remote sensing data, of high temporal frequency and spatial resolution, has provided a new and enhanced view of the global ocean and atmosphere, revealing strong air-sea coupling processes throughout the ocean basins. In order to obtain an accurate representation and better understanding of the climate system, its variability and change, the inclusion of all mechanisms of interaction among the different sub-components, at high temporal and spatial resolution, becomes ever more desirable. Recently, global coupled models have been able to progressively refine their horizontal resolution to attempt to resolve smaller-scale processes. However, regional coupled ocean-atmosphere models can achieve even finer resolutions and provide additional information on the mechanisms of air-sea interactions and feedbacks. Here we describe a new, state-of-the-art, Earth System Regional Climate Model (RegCM-ES). RegCM-ES presently includes the coupling between atmosphere, ocean, land surface and sea-ice components, as well as an hydrological and ocean biogeochemistry model. The regional coupled model has been implemented and tested over some of the COordinated Regional climate Downscaling Experiment (CORDEX) domains. RegCM-ES has shown improvements in the representation of precipitation and SST fields over the tested domains, as well as realistic representations of coupled air-sea processes and interactions. The RegCM-ES model, which can be easily implemented over any regional domain of interest, is open source making it suitable for usage by the large scientific community.

Neural speech recognition: continuous phoneme decoding using spatiotemporal representations of human cortical activity

NASA Astrophysics Data System (ADS)

Moses, David A.; Mesgarani, Nima; Leonard, Matthew K.; Chang, Edward F.

2016-10-01

Objective. The superior temporal gyrus (STG) and neighboring brain regions play a key role in human language processing. Previous studies have attempted to reconstruct speech information from brain activity in the STG, but few of them incorporate the probabilistic framework and engineering methodology used in modern speech recognition systems. In this work, we describe the initial efforts toward the design of a neural speech recognition (NSR) system that performs continuous phoneme recognition on English stimuli with arbitrary vocabulary sizes using the high gamma band power of local field potentials in the STG and neighboring cortical areas obtained via electrocorticography. Approach. The system implements a Viterbi decoder that incorporates phoneme likelihood estimates from a linear discriminant analysis model and transition probabilities from an n-gram phonemic language model. Grid searches were used in an attempt to determine optimal parameterizations of the feature vectors and Viterbi decoder. Main results. The performance of the system was significantly improved by using spatiotemporal representations of the neural activity (as opposed to purely spatial representations) and by including language modeling and Viterbi decoding in the NSR system. Significance. These results emphasize the importance of modeling the temporal dynamics of neural responses when analyzing their variations with respect to varying stimuli and demonstrate that speech recognition techniques can be successfully leveraged when decoding speech from neural signals. Guided by the results detailed in this work, further development of the NSR system could have applications in the fields of automatic speech recognition and neural prosthetics.

The dynamic representation of gravity is suspended when the idiotropic vector is misaligned with gravity.

PubMed

De Sá Teixeira, Nuno Alexandre; Hecht, Heiko

2014-01-01

When people are asked to indicate the vanishing location of a moving target, errors in the direction of motion (representational momentum) and in the direction of gravity (representational gravity) are usually found. These errors possess a temporal course wherein the memory for the location of the target drifts downwards with increasing temporal intervals between target's disappearance and participant's responses (representational trajectory). To assess if representational trajectory is a body-referenced or a world-referenced phenomenon. A behavioral localization method was employed with retention times between 0 and 1400 ms systematically imposed after the target's disappearance. The target could move horizontally (rightwards or leftwards) or vertically (upwards or downwards). Body posture was varied in a counterbalanced order between sitting upright and lying on the side (left lateral decubitus position). In the upright task, the memory for target location drifted downwards with time in the direction of gravity. This time course did not emerge for the decubitus task, where idiotropic dominance was found. The dynamic visual representation of gravity is neither purely body-referenced nor world-referenced. It seems to be modulated instead by the relationship between the idiotropic vector and physical gravity.

The GuideLine Interchange Format

PubMed Central

Ohno-Machado, Lucila; Gennari, John H.; Murphy, Shawn N.; Jain, Nilesh L.; Tu, Samson W.; Oliver, Diane E.; Pattison-Gordon, Edward; Greenes, Robert A.; Shortliffe, Edward H.; Barnett, G. Octo

1998-01-01

Objective: To allow exchange of clinical practice guidelines among institutions and computer-based applications. Design: The GuideLine Interchange Format (GLIF) specification consists of the GLIF model and the GLIF syntax. The GLIF model is an object-oriented representation that consists of a set of classes for guideline entities, attributes for those classes, and data types for the attribute values. The GLIF syntax specifies the format of the test file that contains the encoding. Methods: Researchers from the InterMed Collaboratory at Columbia University, Harvard University (Brigham and Women's Hospital and Massachusetts General Hospital), and Stanford University analyzed four existing guideline systems to derive a set of requirements for guideline representation. The GLIF specification is a consensus representation developed through a brainstorming process. Four clinical guidelines were encoded in GLIF to assess its expressivity and to study the variability that occurs when two people from different sites encode the same guideline. Results: The encoders reported that GLIF was adequately expressive. A comparison of the encodings revealed substantial variability. Conclusion: GLIF was sufficient to model the guidelines for the four conditions that were examined. GLIF needs improvement in standard representation of medical concepts, criterion logic, temporal information, and uncertainty. PMID:9670133

A hierarchy of time-scales and the brain.

PubMed

Kiebel, Stefan J; Daunizeau, Jean; Friston, Karl J

2008-11-01

In this paper, we suggest that cortical anatomy recapitulates the temporal hierarchy that is inherent in the dynamics of environmental states. Many aspects of brain function can be understood in terms of a hierarchy of temporal scales at which representations of the environment evolve. The lowest level of this hierarchy corresponds to fast fluctuations associated with sensory processing, whereas the highest levels encode slow contextual changes in the environment, under which faster representations unfold. First, we describe a mathematical model that exploits the temporal structure of fast sensory input to track the slower trajectories of their underlying causes. This model of sensory encoding or perceptual inference establishes a proof of concept that slowly changing neuronal states can encode the paths or trajectories of faster sensory states. We then review empirical evidence that suggests that a temporal hierarchy is recapitulated in the macroscopic organization of the cortex. This anatomic-temporal hierarchy provides a comprehensive framework for understanding cortical function: the specific time-scale that engages a cortical area can be inferred by its location along a rostro-caudal gradient, which reflects the anatomical distance from primary sensory areas. This is most evident in the prefrontal cortex, where complex functions can be explained as operations on representations of the environment that change slowly. The framework provides predictions about, and principled constraints on, cortical structure-function relationships, which can be tested by manipulating the time-scales of sensory input.

Task alters category representations in prefrontal but not high-level visual cortex.

PubMed

Bugatus, Lior; Weiner, Kevin S; Grill-Spector, Kalanit

2017-07-15

A central question in neuroscience is how cognitive tasks affect category representations across the human brain. Regions in lateral occipito-temporal cortex (LOTC), ventral temporal cortex (VTC), and ventro-lateral prefrontal cortex (VLFPC) constitute the extended "what" pathway, which is considered instrumental for visual category processing. However, it is unknown (1) whether distributed responses across LOTC, VTC, and VLPFC explicitly represent category, task, or some combination of both, and (2) in what way representations across these subdivisions of the extended 'what' pathway may differ. To fill these gaps in knowledge, we scanned 12 participants using fMRI to test the effect of category and task on distributed responses across LOTC, VTC, and VLPFC. Results reveal that task and category modulate responses in both high-level visual regions, as well as prefrontal cortex. However, we found fundamentally different types of representations across the brain. Distributed responses in high-level visual regions are more strongly driven by category than task, and exhibit task-independent category representations. In contrast, distributed responses in prefrontal cortex are more strongly driven by task than category, and contain task-dependent category representations. Together, these findings of differential representations across the brain support a new idea that LOTC and VTC maintain stable category representations allowing efficient processing of visual information, while prefrontal cortex contains flexible representations in which category information may emerge only when relevant to the task. Copyright © 2017 Elsevier Inc. All rights reserved.

A possible role for a paralemniscal auditory pathway in the coding of slow temporal information

PubMed Central

Abrams, Daniel A.; Nicol, Trent; Zecker, Steven; Kraus, Nina

2010-01-01

Low frequency temporal information present in speech is critical for normal perception, however the neural mechanism underlying the differentiation of slow rates in acoustic signals is not known. Data from the rat trigeminal system suggest that the paralemniscal pathway may be specifically tuned to code low-frequency temporal information. We tested whether this phenomenon occurs in the auditory system by measuring the representation of temporal rate in lemniscal and paralemniscal auditory thalamus and cortex in guinea pig. Similar to the trigeminal system, responses measured in auditory thalamus indicate that slow rates are differentially represented in a paralemniscal pathway. In cortex, both lemniscal and paralemniscal neurons indicated sensitivity to slow rates. We speculate that a paralemniscal pathway in the auditory system may be specifically tuned to code low frequency temporal information present in acoustic signals. These data suggest that somatosensory and auditory modalities have parallel sub-cortical pathways that separately process slow rates and the spatial representation of the sensory periphery. PMID:21094680

Temporal and Causal Reasoning in Deaf and Hearing Novice Readers

ERIC Educational Resources Information Center

Sullivan, Susan; Oakhill, Jane; Arfé, Barbara; Boureux, Magali

2014-01-01

Temporal and causal information in text are crucial in helping the reader form a coherent representation of a narrative. Deaf novice readers are generally poor at processing linguistic markers of causal/temporal information (i.e., connectives), but what is unclear is whether this is indicative of a more general deficit in reasoning about…

Temporal binding function of dorsal CA1 is critical for declarative memory formation

PubMed Central

Sellami, Azza; Al Abed, Alice Shaam; Brayda-Bruno, Laurent; Etchamendy, Nicole; Valério, Stéphane; Oulé, Marie; Pantaléon, Laura; Lamothe, Valérie; Potier, Mylène; Bernard, Katy; Jabourian, Maritza; Herry, Cyril; Mons, Nicole; Piazza, Pier-Vincenzo; Eichenbaum, Howard; Marighetto, Aline

2017-01-01

Temporal binding, the process that enables association between discontiguous stimuli in memory, and relational organization, a process that enables the flexibility of declarative memories, are both hippocampus-dependent and decline in aging. However, how these two processes are related in supporting declarative memory formation and how they are compromised in age-related memory loss remain hypothetical. We here identify a causal link between these two features of declarative memory: Temporal binding is a necessary condition for the relational organization of discontiguous events. We demonstrate that the formation of a relational memory is limited by the capability of temporal binding, which depends on dorsal (d)CA1 activity over time intervals and diminishes in aging. Conversely, relational representation is successful even in aged individuals when the demand on temporal binding is minimized, showing that relational/declarative memory per se is not impaired in aging. Thus, bridging temporal intervals by dCA1 activity is a critical foundation of relational representation, and a deterioration of this mechanism is responsible for the age-associated memory impairment. PMID:28874586

Temporal binding function of dorsal CA1 is critical for declarative memory formation.

PubMed

Sellami, Azza; Al Abed, Alice Shaam; Brayda-Bruno, Laurent; Etchamendy, Nicole; Valério, Stéphane; Oulé, Marie; Pantaléon, Laura; Lamothe, Valérie; Potier, Mylène; Bernard, Katy; Jabourian, Maritza; Herry, Cyril; Mons, Nicole; Piazza, Pier-Vincenzo; Eichenbaum, Howard; Marighetto, Aline

2017-09-19

Temporal binding, the process that enables association between discontiguous stimuli in memory, and relational organization, a process that enables the flexibility of declarative memories, are both hippocampus-dependent and decline in aging. However, how these two processes are related in supporting declarative memory formation and how they are compromised in age-related memory loss remain hypothetical. We here identify a causal link between these two features of declarative memory: Temporal binding is a necessary condition for the relational organization of discontiguous events. We demonstrate that the formation of a relational memory is limited by the capability of temporal binding, which depends on dorsal (d)CA1 activity over time intervals and diminishes in aging. Conversely, relational representation is successful even in aged individuals when the demand on temporal binding is minimized, showing that relational/declarative memory per se is not impaired in aging. Thus, bridging temporal intervals by dCA1 activity is a critical foundation of relational representation, and a deterioration of this mechanism is responsible for the age-associated memory impairment.

SSCC TD: A Serial and Simultaneous Configural-Cue Compound Stimuli Representation for Temporal Difference Learning

PubMed Central

Mondragón, Esther; Gray, Jonathan; Alonso, Eduardo; Bonardi, Charlotte; Jennings, Dómhnall J.

2014-01-01

This paper presents a novel representational framework for the Temporal Difference (TD) model of learning, which allows the computation of configural stimuli – cumulative compounds of stimuli that generate perceptual emergents known as configural cues. This Simultaneous and Serial Configural-cue Compound Stimuli Temporal Difference model (SSCC TD) can model both simultaneous and serial stimulus compounds, as well as compounds including the experimental context. This modification significantly broadens the range of phenomena which the TD paradigm can explain, and allows it to predict phenomena which traditional TD solutions cannot, particularly effects that depend on compound stimuli functioning as a whole, such as pattern learning and serial structural discriminations, and context-related effects. PMID:25054799

Self-other disturbance in borderline personality disorder: Neural, self-report, and performance-based evidence.

PubMed

Beeney, Joseph E; Hallquist, Michael N; Ellison, William D; Levy, Kenneth N

2016-01-01

Individuals with borderline personality disorder (BPD) display an impoverished sense of self and representations of self and others that shift between positive and negative poles. However, little research has investigated the nature of representational disturbance in BPD. The present study takes a multimodal approach. A card sort task was used to investigate complexity, integration, and valence of self-representation in BPD. Impairment in maintenance of self and other representations was assessed using a personality representational maintenance task. Finally, functional MRI (fMRI) was used to assess whether individuals with BPD show neural abnormalities related specifically to the self and what brain areas may be related to poor representational maintenance. Individuals with BPD sorted self-aspects suggesting more complexity of self-representation, but also less integration and more negative valence overall. On the representational maintenance task, individuals with BPD showed less consistency in their representations of self and others over the 3-hr period, but only for abstract, personality-based representations. Performance on this measure mediated between-groups brain activation in several areas supporting social cognition. We found no evidence for social-cognitive disturbance specific to the self. Additionally, the BPD group showed main effects, insensitive to condition, of hyperactivation in the medial prefrontal cortex, temporal parietal junction, several regions of the frontal pole, the precuneus and middle temporal gyrus, all areas crucial social cognition. In contrast, controls evidenced greater activation in visual, sensory, motor, and mirror neuron regions. These findings are discussed in relation to research regarding hypermentalization and the overlap between self- and other-disturbance. (c) 2016 APA, all rights reserved).

Recurrent Coupling Improves Discrimination of Temporal Spike Patterns

PubMed Central

Yuan, Chun-Wei; Leibold, Christian

2012-01-01

Despite the ubiquitous presence of recurrent synaptic connections in sensory neuronal systems, their general functional purpose is not well understood. A recent conceptual advance has been achieved by theories of reservoir computing in which recurrent networks have been proposed to generate short-term memory as well as to improve neuronal representation of the sensory input for subsequent computations. Here, we present a numerical study on the distinct effects of inhibitory and excitatory recurrence in a canonical linear classification task. It is found that both types of coupling improve the ability to discriminate temporal spike patterns as compared to a purely feed-forward system, although in different ways. For a large class of inhibitory networks, the network’s performance is optimal as long as a fraction of roughly 50% of neurons per stimulus is active in the resulting population code. Thereby the contribution of inactive neurons to the neural code is found to be even more informative than that of the active neurons, generating an inherent robustness of classification performance against temporal jitter of the input spikes. Excitatory couplings are found to not only produce a short-term memory buffer but also to improve linear separability of the population patterns by evoking more irregular firing as compared to the purely inhibitory case. As the excitatory connectivity becomes more sparse, firing becomes more variable, and pattern separability improves. We argue that the proposed paradigm is particularly well-suited as a conceptual framework for processing of sensory information in the auditory pathway. PMID:22586392

Comparison of deep neural networks to spatio-temporal cortical dynamics of human visual object recognition reveals hierarchical correspondence

PubMed Central

Cichy, Radoslaw Martin; Khosla, Aditya; Pantazis, Dimitrios; Torralba, Antonio; Oliva, Aude

2016-01-01

The complex multi-stage architecture of cortical visual pathways provides the neural basis for efficient visual object recognition in humans. However, the stage-wise computations therein remain poorly understood. Here, we compared temporal (magnetoencephalography) and spatial (functional MRI) visual brain representations with representations in an artificial deep neural network (DNN) tuned to the statistics of real-world visual recognition. We showed that the DNN captured the stages of human visual processing in both time and space from early visual areas towards the dorsal and ventral streams. Further investigation of crucial DNN parameters revealed that while model architecture was important, training on real-world categorization was necessary to enforce spatio-temporal hierarchical relationships with the brain. Together our results provide an algorithmically informed view on the spatio-temporal dynamics of visual object recognition in the human visual brain. PMID:27282108

Comparison of deep neural networks to spatio-temporal cortical dynamics of human visual object recognition reveals hierarchical correspondence.

PubMed

Cichy, Radoslaw Martin; Khosla, Aditya; Pantazis, Dimitrios; Torralba, Antonio; Oliva, Aude

2016-06-10

The complex multi-stage architecture of cortical visual pathways provides the neural basis for efficient visual object recognition in humans. However, the stage-wise computations therein remain poorly understood. Here, we compared temporal (magnetoencephalography) and spatial (functional MRI) visual brain representations with representations in an artificial deep neural network (DNN) tuned to the statistics of real-world visual recognition. We showed that the DNN captured the stages of human visual processing in both time and space from early visual areas towards the dorsal and ventral streams. Further investigation of crucial DNN parameters revealed that while model architecture was important, training on real-world categorization was necessary to enforce spatio-temporal hierarchical relationships with the brain. Together our results provide an algorithmically informed view on the spatio-temporal dynamics of visual object recognition in the human visual brain.

Representing and querying now-relative relational medical data.

PubMed

Anselma, Luca; Piovesan, Luca; Stantic, Bela; Terenziani, Paolo

2018-03-01

Temporal information plays a crucial role in medicine. Patients' clinical records are intrinsically temporal. Thus, in Medical Informatics there is an increasing need to store, support and query temporal data (particularly in relational databases), in order, for instance, to supplement decision-support systems. In this paper, we show that current approaches to relational data have remarkable limitations in the treatment of "now-relative" data (i.e., data holding true at the current time). This can severely compromise their applicability in general, and specifically in the medical context, where "now-relative" data are essential to assess the current status of the patients. We propose a theoretically grounded and application-independent relational approach to cope with now-relative data (which can be paired, e.g., with different decision support systems) overcoming such limitations. We propose a new temporal relational representation, which is the first relational model coping with the temporal indeterminacy intrinsic in now-relative data. We also propose new temporal algebraic operators to query them, supporting the distinction between possible and necessary time, and Allen's temporal relations between data. We exemplify the impact of our approach, and study the theoretical and computational properties of the new representation and algebra. Copyright © 2018 Elsevier B.V. All rights reserved.

Water Quality Sensing and Spatio-Temporal Monitoring Structure with Autocorrelation Kernel Methods.

PubMed

Vizcaíno, Iván P; Carrera, Enrique V; Muñoz-Romero, Sergio; Cumbal, Luis H; Rojo-Álvarez, José Luis

2017-10-16

Pollution on water resources is usually analyzed with monitoring campaigns, which consist of programmed sampling, measurement, and recording of the most representative water quality parameters. These campaign measurements yields a non-uniform spatio-temporal sampled data structure to characterize complex dynamics phenomena. In this work, we propose an enhanced statistical interpolation method to provide water quality managers with statistically interpolated representations of spatial-temporal dynamics. Specifically, our proposal makes efficient use of the a priori available information of the quality parameter measurements through Support Vector Regression (SVR) based on Mercer's kernels. The methods are benchmarked against previously proposed methods in three segments of the Machángara River and one segment of the San Pedro River in Ecuador, and their different dynamics are shown by statistically interpolated spatial-temporal maps. The best interpolation performance in terms of mean absolute error was the SVR with Mercer's kernel given by either the Mahalanobis spatial-temporal covariance matrix or by the bivariate estimated autocorrelation function. In particular, the autocorrelation kernel provides with significant improvement of the estimation quality, consistently for all the six water quality variables, which points out the relevance of including a priori knowledge of the problem.

Water Quality Sensing and Spatio-Temporal Monitoring Structure with Autocorrelation Kernel Methods

PubMed Central

Vizcaíno, Iván P.; Muñoz-Romero, Sergio; Cumbal, Luis H.

2017-01-01

Pollution on water resources is usually analyzed with monitoring campaigns, which consist of programmed sampling, measurement, and recording of the most representative water quality parameters. These campaign measurements yields a non-uniform spatio-temporal sampled data structure to characterize complex dynamics phenomena. In this work, we propose an enhanced statistical interpolation method to provide water quality managers with statistically interpolated representations of spatial-temporal dynamics. Specifically, our proposal makes efficient use of the a priori available information of the quality parameter measurements through Support Vector Regression (SVR) based on Mercer’s kernels. The methods are benchmarked against previously proposed methods in three segments of the Machángara River and one segment of the San Pedro River in Ecuador, and their different dynamics are shown by statistically interpolated spatial-temporal maps. The best interpolation performance in terms of mean absolute error was the SVR with Mercer’s kernel given by either the Mahalanobis spatial-temporal covariance matrix or by the bivariate estimated autocorrelation function. In particular, the autocorrelation kernel provides with significant improvement of the estimation quality, consistently for all the six water quality variables, which points out the relevance of including a priori knowledge of the problem. PMID:29035333

A generalized time-frequency subtraction method for robust speech enhancement based on wavelet filter banks modeling of human auditory system.

PubMed

Shao, Yu; Chang, Chip-Hong

2007-08-01

We present a new speech enhancement scheme for a single-microphone system to meet the demand for quality noise reduction algorithms capable of operating at a very low signal-to-noise ratio. A psychoacoustic model is incorporated into the generalized perceptual wavelet denoising method to reduce the residual noise and improve the intelligibility of speech. The proposed method is a generalized time-frequency subtraction algorithm, which advantageously exploits the wavelet multirate signal representation to preserve the critical transient information. Simultaneous masking and temporal masking of the human auditory system are modeled by the perceptual wavelet packet transform via the frequency and temporal localization of speech components. The wavelet coefficients are used to calculate the Bark spreading energy and temporal spreading energy, from which a time-frequency masking threshold is deduced to adaptively adjust the subtraction parameters of the proposed method. An unvoiced speech enhancement algorithm is also integrated into the system to improve the intelligibility of speech. Through rigorous objective and subjective evaluations, it is shown that the proposed speech enhancement system is capable of reducing noise with little speech degradation in adverse noise environments and the overall performance is superior to several competitive methods.

Learning temporal context shapes prestimulus alpha oscillations and improves visual discrimination performance.

PubMed

Toosi, Tahereh; K Tousi, Ehsan; Esteky, Hossein

2017-08-01

Time is an inseparable component of every physical event that we perceive, yet it is not clear how the brain processes time or how the neuronal representation of time affects our perception of events. Here we asked subjects to perform a visual discrimination task while we changed the temporal context in which the stimuli were presented. We collected electroencephalography (EEG) signals in two temporal contexts. In predictable blocks stimuli were presented after a constant delay relative to a visual cue, and in unpredictable blocks stimuli were presented after variable delays relative to the visual cue. Four subsecond delays of 83, 150, 400, and 800 ms were used in the predictable and unpredictable blocks. We observed that predictability modulated the power of prestimulus alpha oscillations in the parieto-occipital sites: alpha power increased in the 300-ms window before stimulus onset in the predictable blocks compared with the unpredictable blocks. This modulation only occurred in the longest delay period, 800 ms, in which predictability also improved the behavioral performance of the subjects. Moreover, learning the temporal context shaped the prestimulus alpha power: modulation of prestimulus alpha power grew during the predictable block and correlated with performance enhancement. These results suggest that the brain is able to learn the subsecond temporal context of stimuli and use this to enhance sensory processing. Furthermore, the neural correlate of this temporal prediction is reflected in the alpha oscillations. NEW & NOTEWORTHY It is not well understood how the uncertainty in the timing of an external event affects its processing, particularly at subsecond scales. Here we demonstrate how a predictable timing scheme improves visual processing. We found that learning the predictable scheme gradually shaped the prestimulus alpha power. These findings indicate that the human brain is able to extract implicit subsecond patterns in the temporal context of events. Copyright © 2017 the American Physiological Society.

LANGUAGE EXPERIENCE SHAPES PROCESSING OF PITCH RELEVANT INFORMATION IN THE HUMAN BRAINSTEM AND AUDITORY CORTEX: ELECTROPHYSIOLOGICAL EVIDENCE.

PubMed

Krishnan, Ananthanarayan; Gandour, Jackson T

2014-12-01

Pitch is a robust perceptual attribute that plays an important role in speech, language, and music. As such, it provides an analytic window to evaluate how neural activity relevant to pitch undergo transformation from early sensory to later cognitive stages of processing in a well coordinated hierarchical network that is subject to experience-dependent plasticity. We review recent evidence of language experience-dependent effects in pitch processing based on comparisons of native vs. nonnative speakers of a tonal language from electrophysiological recordings in the auditory brainstem and auditory cortex. We present evidence that shows enhanced representation of linguistically-relevant pitch dimensions or features at both the brainstem and cortical levels with a stimulus-dependent preferential activation of the right hemisphere in native speakers of a tone language. We argue that neural representation of pitch-relevant information in the brainstem and early sensory level processing in the auditory cortex is shaped by the perceptual salience of domain-specific features. While both stages of processing are shaped by language experience, neural representations are transformed and fundamentally different at each biological level of abstraction. The representation of pitch relevant information in the brainstem is more fine-grained spectrotemporally as it reflects sustained neural phase-locking to pitch relevant periodicities contained in the stimulus. In contrast, the cortical pitch relevant neural activity reflects primarily a series of transient temporal neural events synchronized to certain temporal attributes of the pitch contour. We argue that experience-dependent enhancement of pitch representation for Chinese listeners most likely reflects an interaction between higher-level cognitive processes and early sensory-level processing to improve representations of behaviorally-relevant features that contribute optimally to perception. It is our view that long-term experience shapes this adaptive process wherein the top-down connections provide selective gating of inputs to both cortical and subcortical structures to enhance neural responses to specific behaviorally-relevant attributes of the stimulus. A theoretical framework for a neural network is proposed involving coordination between local, feedforward, and feedback components that can account for experience-dependent enhancement of pitch representations at multiple levels of the auditory pathway. The ability to record brainstem and cortical pitch relevant responses concurrently may provide a new window to evaluate the online interplay between feedback, feedforward, and local intrinsic components in the hierarchical processing of pitch relevant information.

LANGUAGE EXPERIENCE SHAPES PROCESSING OF PITCH RELEVANT INFORMATION IN THE HUMAN BRAINSTEM AND AUDITORY CORTEX: ELECTROPHYSIOLOGICAL EVIDENCE

PubMed Central

Krishnan, Ananthanarayan; Gandour, Jackson T.

2015-01-01

Pitch is a robust perceptual attribute that plays an important role in speech, language, and music. As such, it provides an analytic window to evaluate how neural activity relevant to pitch undergo transformation from early sensory to later cognitive stages of processing in a well coordinated hierarchical network that is subject to experience-dependent plasticity. We review recent evidence of language experience-dependent effects in pitch processing based on comparisons of native vs. nonnative speakers of a tonal language from electrophysiological recordings in the auditory brainstem and auditory cortex. We present evidence that shows enhanced representation of linguistically-relevant pitch dimensions or features at both the brainstem and cortical levels with a stimulus-dependent preferential activation of the right hemisphere in native speakers of a tone language. We argue that neural representation of pitch-relevant information in the brainstem and early sensory level processing in the auditory cortex is shaped by the perceptual salience of domain-specific features. While both stages of processing are shaped by language experience, neural representations are transformed and fundamentally different at each biological level of abstraction. The representation of pitch relevant information in the brainstem is more fine-grained spectrotemporally as it reflects sustained neural phase-locking to pitch relevant periodicities contained in the stimulus. In contrast, the cortical pitch relevant neural activity reflects primarily a series of transient temporal neural events synchronized to certain temporal attributes of the pitch contour. We argue that experience-dependent enhancement of pitch representation for Chinese listeners most likely reflects an interaction between higher-level cognitive processes and early sensory-level processing to improve representations of behaviorally-relevant features that contribute optimally to perception. It is our view that long-term experience shapes this adaptive process wherein the top-down connections provide selective gating of inputs to both cortical and subcortical structures to enhance neural responses to specific behaviorally-relevant attributes of the stimulus. A theoretical framework for a neural network is proposed involving coordination between local, feedforward, and feedback components that can account for experience-dependent enhancement of pitch representations at multiple levels of the auditory pathway. The ability to record brainstem and cortical pitch relevant responses concurrently may provide a new window to evaluate the online interplay between feedback, feedforward, and local intrinsic components in the hierarchical processing of pitch relevant information. PMID:25838636

Cortical processing of pitch: Model-based encoding and decoding of auditory fMRI responses to real-life sounds.

PubMed

De Angelis, Vittoria; De Martino, Federico; Moerel, Michelle; Santoro, Roberta; Hausfeld, Lars; Formisano, Elia

2017-11-13

Pitch is a perceptual attribute related to the fundamental frequency (or periodicity) of a sound. So far, the cortical processing of pitch has been investigated mostly using synthetic sounds. However, the complex harmonic structure of natural sounds may require different mechanisms for the extraction and analysis of pitch. This study investigated the neural representation of pitch in human auditory cortex using model-based encoding and decoding analyses of high field (7 T) functional magnetic resonance imaging (fMRI) data collected while participants listened to a wide range of real-life sounds. Specifically, we modeled the fMRI responses as a function of the sounds' perceived pitch height and salience (related to the fundamental frequency and the harmonic structure respectively), which we estimated with a computational algorithm of pitch extraction (de Cheveigné and Kawahara, 2002). First, using single-voxel fMRI encoding, we identified a pitch-coding region in the antero-lateral Heschl's gyrus (HG) and adjacent superior temporal gyrus (STG). In these regions, the pitch representation model combining height and salience predicted the fMRI responses comparatively better than other models of acoustic processing and, in the right hemisphere, better than pitch representations based on height/salience alone. Second, we assessed with model-based decoding that multi-voxel response patterns of the identified regions are more informative of perceived pitch than the remainder of the auditory cortex. Further multivariate analyses showed that complementing a multi-resolution spectro-temporal sound representation with pitch produces a small but significant improvement to the decoding of complex sounds from fMRI response patterns. In sum, this work extends model-based fMRI encoding and decoding methods - previously employed to examine the representation and processing of acoustic sound features in the human auditory system - to the representation and processing of a relevant perceptual attribute such as pitch. Taken together, the results of our model-based encoding and decoding analyses indicated that the pitch of complex real life sounds is extracted and processed in lateral HG/STG regions, at locations consistent with those indicated in several previous fMRI studies using synthetic sounds. Within these regions, pitch-related sound representations reflect the modulatory combination of height and the salience of the pitch percept. Copyright © 2017 Elsevier Inc. All rights reserved.

Bird sound spectrogram decomposition through Non-Negative Matrix Factorization for the acoustic classification of bird species.

PubMed

Ludeña-Choez, Jimmy; Quispe-Soncco, Raisa; Gallardo-Antolín, Ascensión

2017-01-01

Feature extraction for Acoustic Bird Species Classification (ABSC) tasks has traditionally been based on parametric representations that were specifically developed for speech signals, such as Mel Frequency Cepstral Coefficients (MFCC). However, the discrimination capabilities of these features for ABSC could be enhanced by accounting for the vocal production mechanisms of birds, and, in particular, the spectro-temporal structure of bird sounds. In this paper, a new front-end for ABSC is proposed that incorporates this specific information through the non-negative decomposition of bird sound spectrograms. It consists of the following two different stages: short-time feature extraction and temporal feature integration. In the first stage, which aims at providing a better spectral representation of bird sounds on a frame-by-frame basis, two methods are evaluated. In the first method, cepstral-like features (NMF_CC) are extracted by using a filter bank that is automatically learned by means of the application of Non-Negative Matrix Factorization (NMF) on bird audio spectrograms. In the second method, the features are directly derived from the activation coefficients of the spectrogram decomposition as performed through NMF (H_CC). The second stage summarizes the most relevant information contained in the short-time features by computing several statistical measures over long segments. The experiments show that the use of NMF_CC and H_CC in conjunction with temporal integration significantly improves the performance of a Support Vector Machine (SVM)-based ABSC system with respect to conventional MFCC.

Bird sound spectrogram decomposition through Non-Negative Matrix Factorization for the acoustic classification of bird species

PubMed Central

Quispe-Soncco, Raisa

2017-01-01

Feature extraction for Acoustic Bird Species Classification (ABSC) tasks has traditionally been based on parametric representations that were specifically developed for speech signals, such as Mel Frequency Cepstral Coefficients (MFCC). However, the discrimination capabilities of these features for ABSC could be enhanced by accounting for the vocal production mechanisms of birds, and, in particular, the spectro-temporal structure of bird sounds. In this paper, a new front-end for ABSC is proposed that incorporates this specific information through the non-negative decomposition of bird sound spectrograms. It consists of the following two different stages: short-time feature extraction and temporal feature integration. In the first stage, which aims at providing a better spectral representation of bird sounds on a frame-by-frame basis, two methods are evaluated. In the first method, cepstral-like features (NMF_CC) are extracted by using a filter bank that is automatically learned by means of the application of Non-Negative Matrix Factorization (NMF) on bird audio spectrograms. In the second method, the features are directly derived from the activation coefficients of the spectrogram decomposition as performed through NMF (H_CC). The second stage summarizes the most relevant information contained in the short-time features by computing several statistical measures over long segments. The experiments show that the use of NMF_CC and H_CC in conjunction with temporal integration significantly improves the performance of a Support Vector Machine (SVM)-based ABSC system with respect to conventional MFCC. PMID:28628630

A Unified Mathematical Framework for Coding Time, Space, and Sequences in the Hippocampal Region

PubMed Central

MacDonald, Christopher J.; Tiganj, Zoran; Shankar, Karthik H.; Du, Qian; Hasselmo, Michael E.; Eichenbaum, Howard

2014-01-01

The medial temporal lobe (MTL) is believed to support episodic memory, vivid recollection of a specific event situated in a particular place at a particular time. There is ample neurophysiological evidence that the MTL computes location in allocentric space and more recent evidence that the MTL also codes for time. Space and time represent a similar computational challenge; both are variables that cannot be simply calculated from the immediately available sensory information. We introduce a simple mathematical framework that computes functions of both spatial location and time as special cases of a more general computation. In this framework, experience unfolding in time is encoded via a set of leaky integrators. These leaky integrators encode the Laplace transform of their input. The information contained in the transform can be recovered using an approximation to the inverse Laplace transform. In the temporal domain, the resulting representation reconstructs the temporal history. By integrating movements, the equations give rise to a representation of the path taken to arrive at the present location. By modulating the transform with information about allocentric velocity, the equations code for position of a landmark. Simulated cells show a close correspondence to neurons observed in various regions for all three cases. In the temporal domain, novel secondary analyses of hippocampal time cells verified several qualitative predictions of the model. An integrated representation of spatiotemporal context can be computed by taking conjunctions of these elemental inputs, leading to a correspondence with conjunctive neural representations observed in dorsal CA1. PMID:24672015

Neural pathways for visual speech perception

PubMed Central

Bernstein, Lynne E.; Liebenthal, Einat

2014-01-01

This paper examines the questions, what levels of speech can be perceived visually, and how is visual speech represented by the brain? Review of the literature leads to the conclusions that every level of psycholinguistic speech structure (i.e., phonetic features, phonemes, syllables, words, and prosody) can be perceived visually, although individuals differ in their abilities to do so; and that there are visual modality-specific representations of speech qua speech in higher-level vision brain areas. That is, the visual system represents the modal patterns of visual speech. The suggestion that the auditory speech pathway receives and represents visual speech is examined in light of neuroimaging evidence on the auditory speech pathways. We outline the generally agreed-upon organization of the visual ventral and dorsal pathways and examine several types of visual processing that might be related to speech through those pathways, specifically, face and body, orthography, and sign language processing. In this context, we examine the visual speech processing literature, which reveals widespread diverse patterns of activity in posterior temporal cortices in response to visual speech stimuli. We outline a model of the visual and auditory speech pathways and make several suggestions: (1) The visual perception of speech relies on visual pathway representations of speech qua speech. (2) A proposed site of these representations, the temporal visual speech area (TVSA) has been demonstrated in posterior temporal cortex, ventral and posterior to multisensory posterior superior temporal sulcus (pSTS). (3) Given that visual speech has dynamic and configural features, its representations in feedforward visual pathways are expected to integrate these features, possibly in TVSA. PMID:25520611

Unitary vs multiple semantics: PET studies of word and picture processing.

PubMed

Bright, P; Moss, H; Tyler, L K

2004-06-01

In this paper we examine a central issue in cognitive neuroscience: are there separate conceptual representations associated with different input modalities (e.g., Paivio, 1971, 1986; Warrington & Shallice, 1984) or do inputs from different modalities converge on to the same set of representations (e.g., Caramazza, Hillis, Rapp, & Romani, 1990; Lambon Ralph, Graham, Patterson, & Hodges, 1999; Rapp, Hillis, & Caramazza, 1993)? We present an analysis of four PET studies (three semantic categorisation tasks and one lexical decision task), two of which employ words as stimuli and two of which employ pictures. Using conjunction analyses, we found robust semantic activation, common to both input modalities in anterior and medial aspects of the left fusiform gyrus, left parahippocampal and perirhinal cortices, and left inferior frontal gyrus (BA 47). There were modality-specific activations in both temporal poles (words) and occipitotemporal cortices (pictures). We propose that the temporal poles are involved in processing both words and pictures, but their engagement might be primarily determined by the level of specificity at which an object is processed. Activation in posterior temporal regions associated with picture processing most likely reflects intermediate, pre-semantic stages of visual processing. Our data are most consistent with a hierarchically structured, unitary system of semantic representations for both verbal and visual modalities, subserved by anterior regions of the inferior temporal cortex.

Of Time and the Media: Issues of Temporality in Communication Research.

ERIC Educational Resources Information Center

Ritchie, L. David

The role of temporality as a cognitive and cultural factor in communication processes has been largely neglected in communication research. However, it is possible to examine the representation of time on three levels: allocation of events or actions to categories (as in sacred time versus profane time), temporal orientation, and the content of…

What puts the how in where? Tool use and the divided visual streams hypothesis.

PubMed

Frey, Scott H

2007-04-01

An influential theory suggests that the dorsal (occipito-parietal) visual stream computes representations of objects for purposes of guiding actions (determining 'how') independently of ventral (occipito-temporal) stream processes supporting object recognition and semantic processing (determining 'what'). Yet, the ability of the dorsal stream alone to account for one of the most common forms of human action, tool use, is limited. While experience-dependent modifications to existing dorsal stream representations may explain simple tool use behaviors (e.g., using sticks to extend reach) found among a variety of species, skillful use of manipulable artifacts (e.g., cups, hammers, pencils) requires in addition access to semantic representations of objects' functions and uses. Functional neuroimaging suggests that this latter information is represented in a left-lateralized network of temporal, frontal and parietal areas. I submit that the well-established dominance of the human left hemisphere in the representation of familiar skills stems from the ability for this acquired knowledge to influence the organization of actions within the dorsal pathway.

ARM - Midlatitude Continental Convective Clouds

DOE Data Explorer

Jensen, Mike; Bartholomew, Mary Jane; Genio, Anthony Del; Giangrande, Scott; Kollias, Pavlos

2012-01-19

Convective processes play a critical role in the Earth's energy balance through the redistribution of heat and moisture in the atmosphere and their link to the hydrological cycle. Accurate representation of convective processes in numerical models is vital towards improving current and future simulations of Earths climate system. Despite improvements in computing power, current operational weather and global climate models are unable to resolve the natural temporal and spatial scales important to convective processes and therefore must turn to parameterization schemes to represent these processes. In turn, parameterization schemes in cloud-resolving models need to be evaluated for their generality and application to a variety of atmospheric conditions. Data from field campaigns with appropriate forcing descriptors have been traditionally used by modelers for evaluating and improving parameterization schemes.

ARM - Midlatitude Continental Convective Clouds (comstock-hvps)

DOE Data Explorer

Jensen, Mike; Comstock, Jennifer; Genio, Anthony Del; Giangrande, Scott; Kollias, Pavlos

2012-01-06

Convective processes play a critical role in the Earth's energy balance through the redistribution of heat and moisture in the atmosphere and their link to the hydrological cycle. Accurate representation of convective processes in numerical models is vital towards improving current and future simulations of Earths climate system. Despite improvements in computing power, current operational weather and global climate models are unable to resolve the natural temporal and spatial scales important to convective processes and therefore must turn to parameterization schemes to represent these processes. In turn, parameterization schemes in cloud-resolving models need to be evaluated for their generality and application to a variety of atmospheric conditions. Data from field campaigns with appropriate forcing descriptors have been traditionally used by modelers for evaluating and improving parameterization schemes.

Prediction Errors but Not Sharpened Signals Simulate Multivoxel fMRI Patterns during Speech Perception

PubMed Central

Davis, Matthew H.

2016-01-01

Successful perception depends on combining sensory input with prior knowledge. However, the underlying mechanism by which these two sources of information are combined is unknown. In speech perception, as in other domains, two functionally distinct coding schemes have been proposed for how expectations influence representation of sensory evidence. Traditional models suggest that expected features of the speech input are enhanced or sharpened via interactive activation (Sharpened Signals). Conversely, Predictive Coding suggests that expected features are suppressed so that unexpected features of the speech input (Prediction Errors) are processed further. The present work is aimed at distinguishing between these two accounts of how prior knowledge influences speech perception. By combining behavioural, univariate, and multivariate fMRI measures of how sensory detail and prior expectations influence speech perception with computational modelling, we provide evidence in favour of Prediction Error computations. Increased sensory detail and informative expectations have additive behavioural and univariate neural effects because they both improve the accuracy of word report and reduce the BOLD signal in lateral temporal lobe regions. However, sensory detail and informative expectations have interacting effects on speech representations shown by multivariate fMRI in the posterior superior temporal sulcus. When prior knowledge was absent, increased sensory detail enhanced the amount of speech information measured in superior temporal multivoxel patterns, but with informative expectations, increased sensory detail reduced the amount of measured information. Computational simulations of Sharpened Signals and Prediction Errors during speech perception could both explain these behavioural and univariate fMRI observations. However, the multivariate fMRI observations were uniquely simulated by a Prediction Error and not a Sharpened Signal model. The interaction between prior expectation and sensory detail provides evidence for a Predictive Coding account of speech perception. Our work establishes methods that can be used to distinguish representations of Prediction Error and Sharpened Signals in other perceptual domains. PMID:27846209

Deep Supervised, but Not Unsupervised, Models May Explain IT Cortical Representation

PubMed Central

Khaligh-Razavi, Seyed-Mahdi; Kriegeskorte, Nikolaus

2014-01-01

Inferior temporal (IT) cortex in human and nonhuman primates serves visual object recognition. Computational object-vision models, although continually improving, do not yet reach human performance. It is unclear to what extent the internal representations of computational models can explain the IT representation. Here we investigate a wide range of computational model representations (37 in total), testing their categorization performance and their ability to account for the IT representational geometry. The models include well-known neuroscientific object-recognition models (e.g. HMAX, VisNet) along with several models from computer vision (e.g. SIFT, GIST, self-similarity features, and a deep convolutional neural network). We compared the representational dissimilarity matrices (RDMs) of the model representations with the RDMs obtained from human IT (measured with fMRI) and monkey IT (measured with cell recording) for the same set of stimuli (not used in training the models). Better performing models were more similar to IT in that they showed greater clustering of representational patterns by category. In addition, better performing models also more strongly resembled IT in terms of their within-category representational dissimilarities. Representational geometries were significantly correlated between IT and many of the models. However, the categorical clustering observed in IT was largely unexplained by the unsupervised models. The deep convolutional network, which was trained by supervision with over a million category-labeled images, reached the highest categorization performance and also best explained IT, although it did not fully explain the IT data. Combining the features of this model with appropriate weights and adding linear combinations that maximize the margin between animate and inanimate objects and between faces and other objects yielded a representation that fully explained our IT data. Overall, our results suggest that explaining IT requires computational features trained through supervised learning to emphasize the behaviorally important categorical divisions prominently reflected in IT. PMID:25375136

Human Frequency Following Response: Neural Representation of Envelope and Temporal Fine Structure in Listeners with Normal Hearing and Sensorineural Hearing Loss

PubMed Central

Ananthakrishnan, Saradha; Krishnan, Ananthanarayan; Bartlett, Edward

2015-01-01

Objective Listeners with sensorineural hearing loss (SNHL) typically experience reduced speech perception, which is not completely restored with amplification. This likely occurs because cochlear damage, in addition to elevating audiometric thresholds, alters the neural representation of speech transmitted to higher centers along the auditory neuroaxis. While the deleterious effects of SNHL on speech perception in humans have been well-documented using behavioral paradigms, our understanding of the neural correlates underlying these perceptual deficits remains limited. Using the scalp-recorded Frequency Following Response (FFR), the authors examine the effects of SNHL and aging on subcortical neural representation of acoustic features important for pitch and speech perception, namely the periodicity envelope (F0) and temporal fine structure (TFS) (formant structure), as reflected in the phase-locked neural activity generating the FFR. Design FFRs were obtained from 10 listeners with normal hearing (NH) and 9 listeners with mild-moderate SNHL in response to a steady-state English back vowel /u/ presented at multiple intensity levels. Use of multiple presentation levels facilitated comparisons at equal sound pressure level (SPL) and equal sensation level (SL). In a second follow-up experiment to address the effect of age on envelope and TFS representation, FFRs were obtained from 25 NH and 19 listeners with mild to moderately-severe SNHL to the same vowel stimulus presented at 80 dB SPL. Temporal waveforms, Fast Fourier Transform (FFT) and spectrograms were used to evaluate the magnitude of the phase-locked activity at F0 (periodicity envelope) and F1 (TFS). Results Neural representation of both envelope (F0) and TFS (F1) at equal SPLs was stronger in NH listeners compared to listeners with SNHL. Also, comparison of neural representation of F0 and F1 across stimulus levels expressed in SPL and SL (accounting for audibility) revealed that level-related changes in F0 and F1 magnitude were different for listeners with SNHL compared to listeners with normal hearing. Further, the degradation in subcortical neural representation was observed to persist in listeners with SNHL even when the effects of age were controlled for. Conclusions Overall, our results suggest a relatively greater degradation in the neural representation of TFS compared to periodicity envelope in individuals with SNHL. This degraded neural representation of TFS in SNHL, as reflected in the brainstem FFR, may reflect a disruption in the temporal pattern of phase-locked neural activity arising from altered tonotopic maps and/or wider filters causing poor frequency selectivity in these listeners. Lastly, while preliminary results indicate that the deleterious effects of SNHL may be greater than age-related degradation in subcortical neural representation, the lack of a balanced age-matched control group in this study does not permit us to completely rule out the effects of age on subcortical neural representation. PMID:26583482

Development of common neural representations for distinct numerical problems

PubMed Central

Chang, Ting-Ting; Rosenberg-Lee, Miriam; Metcalfe, Arron W. S.; Chen, Tianwen; Menon, Vinod

2015-01-01

How the brain develops representations for abstract cognitive problems is a major unaddressed question in neuroscience. Here we tackle this fundamental question using arithmetic problem solving, a cognitive domain important for the development of mathematical reasoning. We first examined whether adults demonstrate common neural representations for addition and subtraction problems, two complementary arithmetic operations that manipulate the same quantities. We then examined how the common neural representations for the two problem types change with development. Whole-brain multivoxel representational similarity (MRS) analysis was conducted to examine common coding of addition and subtraction problems in children and adults. We found that adults exhibited significant levels of MRS between the two problem types, not only in the intra-parietal sulcus (IPS) region of the posterior parietal cortex (PPC), but also in ventral temporal-occipital, anterior temporal and dorsolateral prefrontal cortices. Relative to adults, children showed significantly reduced levels of MRS in these same regions. In contrast, no brain areas showed significantly greater MRS between problem types in children. Our findings provide novel evidence that the emergence of arithmetic problem solving skills from childhood to adulthood is characterized by maturation of common neural representations between distinct numerical operations, and involve distributed brain regions important for representing and manipulating numerical quantity. More broadly, our findings demonstrate that representational analysis provides a powerful approach for uncovering fundamental mechanisms by which children develop proficiencies that are a hallmark of human cognition. PMID:26160287

Reading visually embodied meaning from the brain: Visually grounded computational models decode visual-object mental imagery induced by written text.

PubMed

Anderson, Andrew James; Bruni, Elia; Lopopolo, Alessandro; Poesio, Massimo; Baroni, Marco

2015-10-15

Embodiment theory predicts that mental imagery of object words recruits neural circuits involved in object perception. The degree of visual imagery present in routine thought and how it is encoded in the brain is largely unknown. We test whether fMRI activity patterns elicited by participants reading objects' names include embodied visual-object representations, and whether we can decode the representations using novel computational image-based semantic models. We first apply the image models in conjunction with text-based semantic models to test predictions of visual-specificity of semantic representations in different brain regions. Representational similarity analysis confirms that fMRI structure within ventral-temporal and lateral-occipital regions correlates most strongly with the image models and conversely text models correlate better with posterior-parietal/lateral-temporal/inferior-frontal regions. We use an unsupervised decoding algorithm that exploits commonalities in representational similarity structure found within both image model and brain data sets to classify embodied visual representations with high accuracy (8/10) and then extend it to exploit model combinations to robustly decode different brain regions in parallel. By capturing latent visual-semantic structure our models provide a route into analyzing neural representations derived from past perceptual experience rather than stimulus-driven brain activity. Our results also verify the benefit of combining multimodal data to model human-like semantic representations. Copyright © 2015 Elsevier Inc. All rights reserved.

The Representation and Execution of Articulatory Timing in First and Second Language Acquisition.

PubMed

Redford, Melissa A; Oh, Grace E

2017-07-01

The early acquisition of language-specific temporal patterns relative to the late development of speech motor control suggests a dissociation between the representation and execution of articulatory timing. The current study tested for such a dissociation in first and second language acquisition. American English-speaking children (5- and 8-year-olds) and Korean-speaking adult learners of English repeatedly produced real English words in a simple carrier sentence. The words were designed to elicit different language-specific vowel length contrasts. Measures of absolute duration and variability in single vowel productions were extracted to evaluate the realization of contrasts (representation) and to index speech motor abilities (execution). Results were mostly consistent with a dissociation. Native English-speaking children produced the same language-specific temporal patterns as native English-speaking adults, but their productions were more variable than the adults'. In contrast, Korean-speaking adult learners of English typically produced different temporal patterns than native English-speaking adults, but their productions were as stable as the native speakers'. Implications of the results are discussed with reference to different models of speech production.

Surveying Medieval Archaeology: a New Form for Harris Paradigm Linking Photogrammetry and Temporal Relations

NASA Astrophysics Data System (ADS)

Drap, P.; Papini, O.; Pruno, E.; Nucciotti, M.; Vannini, G.

2017-02-01

The paper presents some reflexions concerning an interdisciplinary project between Medieval Archaeologists from the University of Florence (Italy) and ICT researchers from CNRS LSIS of Marseille (France), aiming towards a connection between 3D spatial representation and archaeological knowledge. It is well known that Laser Scanner, Photogrammetry and Computer Vision are very attractive tools for archaeologists, although the integration of representation of space and representation of archaeological time has not yet found a methodological standard of reference. We try to develop an integrated system for archaeological 3D survey and all other types of archaeological data and knowledge through integrating observable (material) and non-graphic (interpretive) data. Survey plays a central role, since it is both a metric representation of the archaeological site and, to a wider extent, an interpretation of it (being also a common basis for communication between the 2 teams). More specifically 3D survey is crucial, allowing archaeologists to connect actual spatial assets to the stratigraphic formation processes (i.e. to the archaeological time) and to translate spatial observations into historical interpretation of the site. We propose a common formalism for describing photogrammetrical survey and archaeological knowledge stemming from ontologies: Indeed, ontologies are fully used to model and store 3D data and archaeological knowledge. Xe equip this formalism with a qualitative representation of time. Stratigraphic analyses (both of excavated deposits and of upstanding structures) are closely related to E. C. Harris theory of "Stratigraphic Unit" ("US" from now on). Every US is connected to the others by geometric, topological and, eventually, temporal links, and are recorded by the 3D photogrammetric survey. However, the limitations of the Harris Matrix approach lead to use another representation formalism for stratigraphic relationships, namely Qualitative Constraints Networks (QCN) successfully used in the domain of knowledge representation and reasoning in artificial intelligence for representing temporal relations.

Spatiotemporal dynamics of similarity-based neural representations of facial identity.

PubMed

Vida, Mark D; Nestor, Adrian; Plaut, David C; Behrmann, Marlene

2017-01-10

Humans' remarkable ability to quickly and accurately discriminate among thousands of highly similar complex objects demands rapid and precise neural computations. To elucidate the process by which this is achieved, we used magnetoencephalography to measure spatiotemporal patterns of neural activity with high temporal resolution during visual discrimination among a large and carefully controlled set of faces. We also compared these neural data to lower level "image-based" and higher level "identity-based" model-based representations of our stimuli and to behavioral similarity judgments of our stimuli. Between ∼50 and 400 ms after stimulus onset, face-selective sources in right lateral occipital cortex and right fusiform gyrus and sources in a control region (left V1) yielded successful classification of facial identity. In all regions, early responses were more similar to the image-based representation than to the identity-based representation. In the face-selective regions only, responses were more similar to the identity-based representation at several time points after 200 ms. Behavioral responses were more similar to the identity-based representation than to the image-based representation, and their structure was predicted by responses in the face-selective regions. These results provide a temporally precise description of the transformation from low- to high-level representations of facial identity in human face-selective cortex and demonstrate that face-selective cortical regions represent multiple distinct types of information about face identity at different times over the first 500 ms after stimulus onset. These results have important implications for understanding the rapid emergence of fine-grained, high-level representations of object identity, a computation essential to human visual expertise.

Can representational trajectory reveal the nature of an internal model of gravity?

PubMed

De Sá Teixeira, Nuno; Hecht, Heiko

2014-05-01

The memory for the vanishing location of a horizontally moving target is usually displaced forward in the direction of motion (representational momentum) and downward in the direction of gravity (representational gravity). Moreover, this downward displacement has been shown to increase with time (representational trajectory). However, the degree to which different kinematic events change the temporal profile of these displacements remains to be determined. The present article attempts to fill this gap. In the first experiment, we replicate the finding that representational momentum for downward-moving targets is bigger than for upward motions, showing, moreover, that it increases rapidly during the first 300 ms, stabilizing afterward. This temporal profile, but not the increased error for descending targets, is shown to be disrupted when eye movements are not allowed. In the second experiment, we show that the downward drift with time emerges even for static targets. Finally, in the third experiment, we report an increased error for upward-moving targets, as compared with downward movements, when the display is compatible with a downward ego-motion by including vection cues. Thus, the errors in the direction of gravity are compatible with the perceived event and do not merely reflect a retinotopic bias. Overall, these results provide further evidence for an internal model of gravity in the visual representational system.

An Improved STARFM with Help of an Unmixing-Based Method to Generate High Spatial and Temporal Resolution Remote Sensing Data in Complex Heterogeneous Regions.

PubMed

Xie, Dengfeng; Zhang, Jinshui; Zhu, Xiufang; Pan, Yaozhong; Liu, Hongli; Yuan, Zhoumiqi; Yun, Ya

2016-02-05

Remote sensing technology plays an important role in monitoring rapid changes of the Earth's surface. However, sensors that can simultaneously provide satellite images with both high temporal and spatial resolution haven't been designed yet. This paper proposes an improved spatial and temporal adaptive reflectance fusion model (STARFM) with the help of an Unmixing-based method (USTARFM) to generate the high spatial and temporal data needed for the study of heterogeneous areas. The results showed that the USTARFM had higher accuracy than STARFM methods in two aspects of analysis: individual bands and of heterogeneity analysis. Taking the predicted NIR band as an example, the correlation coefficients (r) for the USTARFM, STARFM and unmixing methods were 0.96, 0.95, 0.90, respectively (p-value < 0.001); Root Mean Square Error (RMSE) values were 0.0245, 0.0300, 0.0401, respectively; and ERGAS values were 0.5416, 0.6507, 0.8737, respectively. The USTARM showed consistently higher performance than STARM when the degree of heterogeneity ranged from 2 to 10, highlighting that the use of this method provides the capacity to solve the data fusion problems faced when using STARFM. Additionally, the USTARFM method could help researchers achieve better performance than STARFM at a smaller window size from its heterogeneous land surface quantitative representation.

Four decades of modeling methane cycling in terrestrial ecosystems: Where we are heading?

NASA Astrophysics Data System (ADS)

Xu, X.; Yuan, F.; Hanson, P. J.; Wullschleger, S. D.; Thornton, P. E.; Tian, H.; Riley, W. J.; Song, X.; Graham, D. E.; Song, C.

2015-12-01

A modeling approach to methane (CH4) is widely used to quantify the budget, investigate spatial and temporal variabilities, and understand the mechanistic processes and environmental controls on CH4 fluxes across spatial and temporal scales. Moreover, CH4 models are an important tool for integrating CH4 data from multiple sources, such as laboratory-based incubation and molecular analysis, field observational experiments, remote sensing, and aircraft-based measurements across a variety of terrestrial ecosystems. We reviewed 39 terrestrial CH4 models to characterize their strengths and weaknesses and to design a roadmap for future model improvement and application. We found that: (1) the focus of CH4 models have been shifted from theoretical to site- to regional-level application over the past four decades, expressed as dramatic increases in CH4 model development on regional budget quantification; (2) large discrepancies exist among models in terms of representing CH4 processes and their environmental controls; (3) significant data-model and model-model mismatches are partially attributed to different representations of wetland characterization and inundation dynamics. Three efforts should be paid special attention for future improvements and applications of fully mechanistic CH4 models: (1) CH4 models should be improved to represent the mechanisms underlying land-atmosphere CH4 exchange, with emphasis on improving and validating individual CH4 processes over depth and horizontal space; (2) models should be developed that are capable of simulating CH4 fluxes across space and time (particularly hot moments and hot spots); (3) efforts should be invested to develop model benchmarking frameworks that can easily be used for model improvement, evaluation, and integration with data from molecular to global scales. A newly developed microbial functional group-based CH4 model (CLM-Microbe) was further used to demonstrate the features of mechanistic representation and integration with multiple source of observational datasets.

"Transformation Tuesday": Temporal context and post valence influence the provision of social support on social media.

PubMed

Vogel, Erin A; Rose, Jason P; Crane, Chantal

2018-01-01

Social network sites (SNSs) such as Facebook have become integral in the development and maintenance of interpersonal relationships. Users of SNSs seek social support and validation, often using posts that illustrate how they have changed over time. The purpose of the present research is to examine how the valence and temporal context of an SNS post affect the likelihood of other users providing social support. Participants viewed hypothetical SNS posts and reported their intentions to provide social support to the users. Results revealed that participants were more likely to provide social support for posts that were positive and included temporal context (i.e., depicted improvement over time; Study 1). Furthermore, this research suggests that visual representations of change over time are needed to elicit social support (Study 2). Results are discussed in terms of their practical implications for SNS users and theoretical implications for the literature on social support and social media.

Lost time: Bindings do not represent temporal order information.

PubMed

Moeller, Birte; Frings, Christian

2018-06-04

Many accounts of human action control assume bindings between features of stimuli and responses of individual events. One widely accepted assumption about these bindings is that they do not contain temporal-order representations regarding the integrated elements. Even though several theories either explicitly or implicitly include it, this assumption has never been tested directly. One reason for this lack of evidence is likely that typical stimulus-response binding paradigms are inapt for such a test. Adapting a new paradigm of response-response binding to include order switches between response integration and retrieval, we were able to analyze possible representation of order information in bindings for the first time. Binding effects were identical for intact and switched response orders, indicating that bindings indeed include no temporal-order information.

The HTM Spatial Pooler-A Neocortical Algorithm for Online Sparse Distributed Coding.

PubMed

Cui, Yuwei; Ahmad, Subutai; Hawkins, Jeff

2017-01-01

Hierarchical temporal memory (HTM) provides a theoretical framework that models several key computational principles of the neocortex. In this paper, we analyze an important component of HTM, the HTM spatial pooler (SP). The SP models how neurons learn feedforward connections and form efficient representations of the input. It converts arbitrary binary input patterns into sparse distributed representations (SDRs) using a combination of competitive Hebbian learning rules and homeostatic excitability control. We describe a number of key properties of the SP, including fast adaptation to changing input statistics, improved noise robustness through learning, efficient use of cells, and robustness to cell death. In order to quantify these properties we develop a set of metrics that can be directly computed from the SP outputs. We show how the properties are met using these metrics and targeted artificial simulations. We then demonstrate the value of the SP in a complete end-to-end real-world HTM system. We discuss the relationship with neuroscience and previous studies of sparse coding. The HTM spatial pooler represents a neurally inspired algorithm for learning sparse representations from noisy data streams in an online fashion.

A framework for investigating animal consciousness.

PubMed

Droege, Paula; Braithwaite, Victoria A

2015-01-01

An assessment of consciousness in nonverbal animals requires a framework for research that extends testing methods beyond subjective report. This chapter proposes a working definition of consciousness in terms of temporal representation that provides the critical link between internal phenomenology and external behavior and neural structure. Our claim is that consciousness represents the present moment as distinct from the past and the future in order to flexibly respond to stimuli. We discuss behavioral and neural evidence that indicates the capacity for both flexible response and temporal representation, and we illustrate these capacities in fish, a taxonomic group that challenges human intuitions about consciousness.

Decoding representations of face identity that are tolerant to rotation.

PubMed

Anzellotti, Stefano; Fairhall, Scott L; Caramazza, Alfonso

2014-08-01

In order to recognize the identity of a face we need to distinguish very similar images (specificity) while also generalizing identity information across image transformations such as changes in orientation (tolerance). Recent studies investigated the representation of individual faces in the brain, but it remains unclear whether the human brain regions that were found encode representations of individual images (specificity) or face identity (specificity plus tolerance). In the present article, we use multivoxel pattern analysis in the human ventral stream to investigate the representation of face identity across rotations in depth, a kind of transformation in which no point in the face image remains unchanged. The results reveal representations of face identity that are tolerant to rotations in depth in occipitotemporal cortex and in anterior temporal cortex, even when the similarity between mirror symmetrical views cannot be used to achieve tolerance. Converging evidence from different analysis techniques shows that the right anterior temporal lobe encodes a comparable amount of identity information to occipitotemporal regions, but this information is encoded over a smaller extent of cortex. © The Author 2013. Published by Oxford University Press. All rights reserved. For Permissions, please e-mail: journals.permissions@oup.com.

The duality of temporal encoding – the intrinsic and extrinsic representation of time

PubMed Central

Golan, Ronen; Zakay, Dan

2015-01-01

While time is well acknowledged for having a fundamental part in our perception, questions on how it is represented are still matters of great debate. One of the main issues in question is whether time is represented intrinsically at the neural level, or is it represented within dedicated brain regions. We used an fMRI block design to test if we can impose covert encoding of temporal features of faces and natural scenes stimuli within category selective neural populations by exposing subjects to four types of temporal variance, ranging from 0% up to 50% variance. We found a gradual increase in neural activation associated with the gradual increase in temporal variance within category selective areas. A second level analysis showed the same pattern of activations within known brain regions associated with time representation, such as the Cerebellum, the Caudate, and the Thalamus. We concluded that temporal features are integral to perception and are simultaneously represented within category selective regions and globally within dedicated regions. Our second conclusion, drown from our covert procedure, is that time encoding, at its basic level, is an automated process that does not require attention allocated toward the temporal features nor does it require dedicated resources. PMID:26379604

DOE Office of Scientific and Technical Information (OSTI.GOV)

Ng, B

This survey gives an overview of popular generative models used in the modeling of stochastic temporal systems. In particular, this survey is organized into two parts. The first part discusses the discrete-time representations of dynamic Bayesian networks and dynamic relational probabilistic models, while the second part discusses the continuous-time representation of continuous-time Bayesian networks.

A novel framework for change detection in bi-temporal polarimetric SAR images

NASA Astrophysics Data System (ADS)

Pirrone, Davide; Bovolo, Francesca; Bruzzone, Lorenzo

2016-10-01

Last years have seen relevant increase of polarimetric Synthetic Aperture Radar (SAR) data availability, thanks to satellite sensors like Sentinel-1 or ALOS-2 PALSAR-2. The augmented information lying in the additional polarimetric channels represents a possibility for better discriminate different classes of changes in change detection (CD) applications. This work aims at proposing a framework for CD in multi-temporal multi-polarization SAR data. The framework includes both a tool for an effective visual representation of the change information and a method for extracting the multiple-change information. Both components are designed to effectively handle the multi-dimensionality of polarimetric data. In the novel representation, multi-temporal intensity SAR data are employed to compute a polarimetric log-ratio. The multitemporal information of the polarimetric log-ratio image is represented in a multi-dimensional features space, where changes are highlighted in terms of magnitude and direction. This representation is employed to design a novel unsupervised multi-class CD approach. This approach considers a sequential two-step analysis of the magnitude and the direction information for separating non-changed and changed samples. The proposed approach has been validated on a pair of Sentinel-1 data acquired before and after the flood in Tamil-Nadu in 2015. Preliminary results demonstrate that the representation tool is effective and that the use of polarimetric SAR data is promising in multi-class change detection applications.

Specialization along the left superior temporal sulcus for auditory categorization.

PubMed

Liebenthal, Einat; Desai, Rutvik; Ellingson, Michael M; Ramachandran, Brinda; Desai, Anjali; Binder, Jeffrey R

2010-12-01

The affinity and temporal course of functional fields in middle and posterior superior temporal cortex for the categorization of complex sounds was examined using functional magnetic resonance imaging (fMRI) and event-related potentials (ERPs) recorded simultaneously. Data were compared before and after subjects were trained to categorize a continuum of unfamiliar nonphonemic auditory patterns with speech-like properties (NP) and a continuum of familiar phonemic patterns (P). fMRI activation for NP increased after training in left posterior superior temporal sulcus (pSTS). The ERP P2 response to NP also increased with training, and its scalp topography was consistent with left posterior superior temporal generators. In contrast, the left middle superior temporal sulcus (mSTS) showed fMRI activation only for P, and this response was not affected by training. The P2 response to P was also independent of training, and its estimated source was more anterior in left superior temporal cortex. Results are consistent with a role for left pSTS in short-term representation of relevant sound features that provide the basis for identifying newly acquired sound categories. Categorization of highly familiar phonemic patterns is mediated by long-term representations in left mSTS. Results provide new insight regarding the function of ventral and dorsal auditory streams.

Progress in fast, accurate multi-scale climate simulations

DOE PAGES

Collins, W. D.; Johansen, H.; Evans, K. J.; ...

2015-06-01

We present a survey of physical and computational techniques that have the potential to contribute to the next generation of high-fidelity, multi-scale climate simulations. Examples of the climate science problems that can be investigated with more depth with these computational improvements include the capture of remote forcings of localized hydrological extreme events, an accurate representation of cloud features over a range of spatial and temporal scales, and parallel, large ensembles of simulations to more effectively explore model sensitivities and uncertainties. Numerical techniques, such as adaptive mesh refinement, implicit time integration, and separate treatment of fast physical time scales are enablingmore » improved accuracy and fidelity in simulation of dynamics and allowing more complete representations of climate features at the global scale. At the same time, partnerships with computer science teams have focused on taking advantage of evolving computer architectures such as many-core processors and GPUs. As a result, approaches which were previously considered prohibitively costly have become both more efficient and scalable. In combination, progress in these three critical areas is poised to transform climate modeling in the coming decades.« less

Representing agriculture in Earth System Models: Approaches and priorities for development

NASA Astrophysics Data System (ADS)

McDermid, S. S.; Mearns, L. O.; Ruane, A. C.

2017-09-01

Earth System Model (ESM) advances now enable improved representations of spatially and temporally varying anthropogenic climate forcings. One critical forcing is global agriculture, which is now extensive in land-use and intensive in management, owing to 20th century development trends. Agriculture and food systems now contribute nearly 30% of global greenhouse gas emissions and require copious inputs and resources, such as fertilizer, water, and land. Much uncertainty remains in quantifying important agriculture-climate interactions, including surface moisture and energy balances and biogeochemical cycling. Despite these externalities and uncertainties, agriculture is increasingly being leveraged to function as a net sink of anthropogenic carbon, and there is much emphasis on future sustainable intensification. Given its significance as a major environmental and climate forcing, there now exist a variety of approaches to represent agriculture in ESMs. These approaches are reviewed herein, and range from idealized representations of agricultural extent to the development of coupled climate-crop models that capture dynamic feedbacks. We highlight the robust agriculture-climate interactions and responses identified by these modeling efforts, as well as existing uncertainties and model limitations. To this end, coordinated and benchmarking assessments of land-use-climate feedbacks can be leveraged for further improvements in ESM's agricultural representations. We suggest key areas for continued model development, including incorporating irrigation and biogeochemical cycling in particular. Last, we pose several critical research questions to guide future work. Our review focuses on ESM representations of climate-surface interactions over managed agricultural lands, rather than on ESMs as an estimation tool for crop yields and productivity.

Object Representations in Human Visual Cortex Formed Through Temporal Integration of Dynamic Partial Shape Views.

PubMed

Orlov, Tanya; Zohary, Ehud

2018-01-17

We typically recognize visual objects using the spatial layout of their parts, which are present simultaneously on the retina. Therefore, shape extraction is based on integration of the relevant retinal information over space. The lateral occipital complex (LOC) can represent shape faithfully in such conditions. However, integration over time is sometimes required to determine object shape. To study shape extraction through temporal integration of successive partial shape views, we presented human participants (both men and women) with artificial shapes that moved behind a narrow vertical or horizontal slit. Only a tiny fraction of the shape was visible at any instant at the same retinal location. However, observers perceived a coherent whole shape instead of a jumbled pattern. Using fMRI and multivoxel pattern analysis, we searched for brain regions that encode temporally integrated shape identity. We further required that the representation of shape should be invariant to changes in the slit orientation. We show that slit-invariant shape information is most accurate in the LOC. Importantly, the slit-invariant shape representations matched the conventional whole-shape representations assessed during full-image runs. Moreover, when the same slit-dependent shape slivers were shuffled, thereby preventing their spatiotemporal integration, slit-invariant shape information was reduced dramatically. The slit-invariant representation of the various shapes also mirrored the structure of shape perceptual space as assessed by perceptual similarity judgment tests. Therefore, the LOC is likely to mediate temporal integration of slit-dependent shape views, generating a slit-invariant whole-shape percept. These findings provide strong evidence for a global encoding of shape in the LOC regardless of integration processes required to generate the shape percept. SIGNIFICANCE STATEMENT Visual objects are recognized through spatial integration of features available simultaneously on the retina. The lateral occipital complex (LOC) represents shape faithfully in such conditions even if the object is partially occluded. However, shape must sometimes be reconstructed over both space and time. Such is the case in anorthoscopic perception, when an object is moving behind a narrow slit. In this scenario, spatial information is limited at any moment so the whole-shape percept can only be inferred by integration of successive shape views over time. We find that LOC carries shape-specific information recovered using such temporal integration processes. The shape representation is invariant to slit orientation and is similar to that evoked by a fully viewed image. Existing models of object recognition lack such capabilities. Copyright © 2018 the authors 0270-6474/18/380659-20$15.00/0.

Haptic perception and body representation in lateral and medial occipito-temporal cortices.

PubMed

Costantini, Marcello; Urgesi, Cosimo; Galati, Gaspare; Romani, Gian Luca; Aglioti, Salvatore M

2011-04-01

Although vision is the primary sensory modality that humans and other primates use to identify objects in the environment, we can recognize crucial object features (e.g., shape, size) using the somatic modality. Previous studies have shown that the occipito-temporal areas dedicated to the visual processing of object forms, faces and bodies also show category-selective responses when the preferred stimuli are haptically explored out of view. Visual processing of human bodies engages specific areas in lateral (extrastriate body area, EBA) and medial (fusiform body area, FBA) occipito-temporal cortex. This study aimed at exploring the relative involvement of EBA and FBA in the haptic exploration of body parts. During fMRI scanning, participants were asked to haptically explore either real-size fake body parts or objects. We found a selective activation of right and left EBA, but not of right FBA, while participants haptically explored body parts as compared to real objects. This suggests that EBA may integrate visual body representations with somatosensory information regarding body parts and form a multimodal representation of the body. Furthermore, both left and right EBA showed a comparable level of body selectivity during haptic perception and visual imagery. However, right but not left EBA was more activated during haptic exploration than visual imagery of body parts, ruling out that the response to haptic body exploration was entirely due to the use of visual imagery. Overall, the results point to the existence of different multimodal body representations in the occipito-temporal cortex which are activated during perception and imagery of human body parts. Copyright © 2011 Elsevier Ltd. All rights reserved.

Sensorimotor Representations in Cerebellar Granule Cells in Larval Zebrafish Are Dense, Spatially Organized, and Non-temporally Patterned.

PubMed

Knogler, Laura D; Markov, Daniil A; Dragomir, Elena I; Štih, Vilim; Portugues, Ruben

2017-05-08

A fundamental question in neurobiology is how animals integrate external sensory information from their environment with self-generated motor and sensory signals in order to guide motor behavior and adaptation. The cerebellum is a vertebrate hindbrain region where all of these signals converge and that has been implicated in the acquisition, coordination, and calibration of motor activity. Theories of cerebellar function postulate that granule cells encode a variety of sensorimotor signals in the cerebellar input layer. These models suggest that representations should be high-dimensional, sparse, and temporally patterned. However, in vivo physiological recordings addressing these points have been limited and in particular have been unable to measure the spatiotemporal dynamics of population-wide activity. In this study, we use both calcium imaging and electrophysiology in the awake larval zebrafish to investigate how cerebellar granule cells encode three types of sensory stimuli as well as stimulus-evoked motor behaviors. We find that a large fraction of all granule cells are active in response to these stimuli, such that representations are not sparse at the population level. We find instead that most responses belong to only one of a small number of distinct activity profiles, which are temporally homogeneous and anatomically clustered. We furthermore identify granule cells that are active during swimming behaviors and others that are multimodal for sensory and motor variables. When we pharmacologically change the threshold of a stimulus-evoked behavior, we observe correlated changes in these representations. Finally, electrophysiological data show no evidence for temporal patterning in the coding of different stimulus durations. Copyright © 2017 The Author(s). Published by Elsevier Ltd.. All rights reserved.

Uncertainty management by relaxation of conflicting constraints in production process scheduling

NASA Technical Reports Server (NTRS)

Dorn, Juergen; Slany, Wolfgang; Stary, Christian

1992-01-01

Mathematical-analytical methods as used in Operations Research approaches are often insufficient for scheduling problems. This is due to three reasons: the combinatorial complexity of the search space, conflicting objectives for production optimization, and the uncertainty in the production process. Knowledge-based techniques, especially approximate reasoning and constraint relaxation, are promising ways to overcome these problems. A case study from an industrial CIM environment, namely high-grade steel production, is presented to demonstrate how knowledge-based scheduling with the desired capabilities could work. By using fuzzy set theory, the applied knowledge representation technique covers the uncertainty inherent in the problem domain. Based on this knowledge representation, a classification of jobs according to their importance is defined which is then used for the straightforward generation of a schedule. A control strategy which comprises organizational, spatial, temporal, and chemical constraints is introduced. The strategy supports the dynamic relaxation of conflicting constraints in order to improve tentative schedules.

Information content of contact-pattern representations and predictability of epidemic outbreaks

PubMed Central

Holme, Petter

2015-01-01

To understand the contact patterns of a population—who is in contact with whom, and when the contacts happen—is crucial for modeling outbreaks of infectious disease. Traditional theoretical epidemiology assumes that any individual can meet any with equal probability. A more modern approach, network epidemiology, assumes people are connected into a static network over which the disease spreads. Newer yet, temporal network epidemiology, includes the time in the contact representations. In this paper, we investigate the effect of these successive inclusions of more information. Using empirical proximity data, we study both outbreak sizes from unknown sources, and from known states of ongoing outbreaks. In the first case, there are large differences going from a fully mixed simulation to a network, and from a network to a temporal network. In the second case, differences are smaller. We interpret these observations in terms of the temporal network structure of the data sets. For example, a fast overturn of nodes and links seem to make the temporal information more important. PMID:26403504

Does movement influence representations of time and space?

PubMed Central

2017-01-01

Embodied cognition posits that abstract conceptual knowledge such as mental representations of time and space are at least partially grounded in sensorimotor experiences. If true, then the execution of whole-body movements should result in modulations of temporal and spatial reference frames. To scrutinize this hypothesis, in two experiments participants either walked forward, backward or stood on a treadmill and responded either to an ambiguous temporal question (Experiment 1) or an ambiguous spatial question (Experiment 2) at the end of the walking manipulation. Results confirmed the ambiguousness of the questions in the control condition. Nevertheless, despite large power, walking forward or backward did not influence the answers or response times to the temporal (Experiment 1) or spatial (Experiment 2) question. A follow-up Experiment 3 indicated that this is also true for walking actively (or passively) in free space (as opposed to a treadmill). We explore possible reasons for the null-finding as concerns the modulation of temporal and spatial reference frames by movements and we critically discuss the methodological and theoretical implications. PMID:28376130

Does movement influence representations of time and space?

PubMed

Loeffler, Jonna; Raab, Markus; Cañal-Bruland, Rouwen

2017-01-01

Embodied cognition posits that abstract conceptual knowledge such as mental representations of time and space are at least partially grounded in sensorimotor experiences. If true, then the execution of whole-body movements should result in modulations of temporal and spatial reference frames. To scrutinize this hypothesis, in two experiments participants either walked forward, backward or stood on a treadmill and responded either to an ambiguous temporal question (Experiment 1) or an ambiguous spatial question (Experiment 2) at the end of the walking manipulation. Results confirmed the ambiguousness of the questions in the control condition. Nevertheless, despite large power, walking forward or backward did not influence the answers or response times to the temporal (Experiment 1) or spatial (Experiment 2) question. A follow-up Experiment 3 indicated that this is also true for walking actively (or passively) in free space (as opposed to a treadmill). We explore possible reasons for the null-finding as concerns the modulation of temporal and spatial reference frames by movements and we critically discuss the methodological and theoretical implications.

Duration estimates within a modality are integrated sub-optimally

PubMed Central

Cai, Ming Bo; Eagleman, David M.

2015-01-01

Perceived duration can be influenced by various properties of sensory stimuli. For example, visual stimuli of higher temporal frequency are perceived to last longer than those of lower temporal frequency. How does the brain form a representation of duration when each of two simultaneously presented stimuli influences perceived duration in different way? To answer this question, we investigated the perceived duration of a pair of dynamic visual stimuli of different temporal frequencies in comparison to that of a single visual stimulus of either low or high temporal frequency. We found that the duration representation of simultaneously occurring visual stimuli is best described by weighting the estimates of duration based on each individual stimulus. However, the weighting performance deviates from the prediction of statistically optimal integration. In addition, we provided a Bayesian account to explain a difference in the apparent sensitivity of the psychometric curves introduced by the order in which the two stimuli are displayed in a two-alternative forced-choice task. PMID:26321965

Tensor-based Dictionary Learning for Dynamic Tomographic Reconstruction

PubMed Central

Tan, Shengqi; Zhang, Yanbo; Wang, Ge; Mou, Xuanqin; Cao, Guohua; Wu, Zhifang; Yu, Hengyong

2015-01-01

In dynamic computed tomography (CT) reconstruction, the data acquisition speed limits the spatio-temporal resolution. Recently, compressed sensing theory has been instrumental in improving CT reconstruction from far few-view projections. In this paper, we present an adaptive method to train a tensor-based spatio-temporal dictionary for sparse representation of an image sequence during the reconstruction process. The correlations among atoms and across phases are considered to capture the characteristics of an object. The reconstruction problem is solved by the alternating direction method of multipliers. To recover fine or sharp structures such as edges, the nonlocal total variation is incorporated into the algorithmic framework. Preclinical examples including a sheep lung perfusion study and a dynamic mouse cardiac imaging demonstrate that the proposed approach outperforms the vectorized dictionary-based CT reconstruction in the case of few-view reconstruction. PMID:25779991

Representational similarity analysis reveals commonalities and differences in the semantic processing of words and objects.

PubMed

Devereux, Barry J; Clarke, Alex; Marouchos, Andreas; Tyler, Lorraine K

2013-11-27

Understanding the meanings of words and objects requires the activation of underlying conceptual representations. Semantic representations are often assumed to be coded such that meaning is evoked regardless of the input modality. However, the extent to which meaning is coded in modality-independent or amodal systems remains controversial. We address this issue in a human fMRI study investigating the neural processing of concepts, presented separately as written words and pictures. Activation maps for each individual word and picture were used as input for searchlight-based multivoxel pattern analyses. Representational similarity analysis was used to identify regions correlating with low-level visual models of the words and objects and the semantic category structure common to both. Common semantic category effects for both modalities were found in a left-lateralized network, including left posterior middle temporal gyrus (LpMTG), left angular gyrus, and left intraparietal sulcus (LIPS), in addition to object- and word-specific semantic processing in ventral temporal cortex and more anterior MTG, respectively. To explore differences in representational content across regions and modalities, we developed novel data-driven analyses, based on k-means clustering of searchlight dissimilarity matrices and seeded correlation analysis. These revealed subtle differences in the representations in semantic-sensitive regions, with representations in LIPS being relatively invariant to stimulus modality and representations in LpMTG being uncorrelated across modality. These results suggest that, although both LpMTG and LIPS are involved in semantic processing, only the functional role of LIPS is the same regardless of the visual input, whereas the functional role of LpMTG differs for words and objects.

Spatiotemporal dynamics of similarity-based neural representations of facial identity

PubMed Central

Vida, Mark D.; Nestor, Adrian; Plaut, David C.; Behrmann, Marlene

2017-01-01

Humans’ remarkable ability to quickly and accurately discriminate among thousands of highly similar complex objects demands rapid and precise neural computations. To elucidate the process by which this is achieved, we used magnetoencephalography to measure spatiotemporal patterns of neural activity with high temporal resolution during visual discrimination among a large and carefully controlled set of faces. We also compared these neural data to lower level “image-based” and higher level “identity-based” model-based representations of our stimuli and to behavioral similarity judgments of our stimuli. Between ∼50 and 400 ms after stimulus onset, face-selective sources in right lateral occipital cortex and right fusiform gyrus and sources in a control region (left V1) yielded successful classification of facial identity. In all regions, early responses were more similar to the image-based representation than to the identity-based representation. In the face-selective regions only, responses were more similar to the identity-based representation at several time points after 200 ms. Behavioral responses were more similar to the identity-based representation than to the image-based representation, and their structure was predicted by responses in the face-selective regions. These results provide a temporally precise description of the transformation from low- to high-level representations of facial identity in human face-selective cortex and demonstrate that face-selective cortical regions represent multiple distinct types of information about face identity at different times over the first 500 ms after stimulus onset. These results have important implications for understanding the rapid emergence of fine-grained, high-level representations of object identity, a computation essential to human visual expertise. PMID:28028220

THEORETICAL REVIEW The Hippocampus, Time, and Memory Across Scales

PubMed Central

Howard, Marc W.; Eichenbaum, Howard

2014-01-01

A wealth of experimental studies with animals have offered insights about how neural networks within the hippocampus support the temporal organization of memories. These studies have revealed the existence of “time cells” that encode moments in time, much as the well-known “place cells” map locations in space. Another line of work inspired by human behavioral studies suggests that episodic memories are mediated by a state of temporal context that changes gradually over long time scales, up to at least a few thousand seconds. In this view, the “mental time travel” hypothesized to support the experience of episodic memory corresponds to a “jump back in time” in which a previous state of temporal context is recovered. We suggest that these 2 sets of findings could be different facets of a representation of temporal history that maintains a record at the last few thousand seconds of experience. The ability to represent long time scales comes at the cost of discarding precise information about when a stimulus was experienced—this uncertainty becomes greater for events further in the past. We review recent computational work that describes a mechanism that could construct such a scale-invariant representation. Taken as a whole, this suggests the hippocampus plays its role in multiple aspects of cognition by representing events embedded in a general spatiotemporal context. The representation of internal time can be useful across nonhippocampal memory systems. PMID:23915126

Correlation of individual differences in audiovisual asynchrony across stimuli and tasks: New constraints on temporal renormalization theory.

PubMed

Ipser, Alberta; Karlinski, Maayan; Freeman, Elliot D

2018-05-07

Sight and sound are out of synch in different people by different amounts for different tasks. But surprisingly, different concurrent measures of perceptual asynchrony correlate negatively (Freeman et al., 2013). Thus, if vision subjectively leads audition in one individual, the same individual might show a visual lag in other measures of audiovisual integration (e.g., McGurk illusion, Stream-Bounce illusion). This curious negative correlation was first observed between explicit temporal order judgments and implicit phoneme identification tasks, performed concurrently as a dual task, using incongruent McGurk stimuli. Here we used a new set of explicit and implicit tasks and congruent stimuli, to test whether this negative correlation persists across testing sessions, and whether it might be an artifact of using specific incongruent stimuli. None of these manipulations eliminated the negative correlation between explicit and implicit measures. This supports the generalizability and validity of the phenomenon, and offers new theoretical insights into its explanation. Our previously proposed "temporal renormalization" theory assumes that the timings of sensory events registered within the brain's different multimodal subnetworks are each perceived relative to a representation of the typical average timing of such events across the wider network. Our new data suggest that this representation is stable and generic, rather than dependent on specific stimuli or task contexts, and that it may be acquired through experience with a variety of simultaneous stimuli. Our results also add further evidence that speech comprehension may be improved in some individuals by artificially delaying voices relative to lip-movements. (PsycINFO Database Record (c) 2018 APA, all rights reserved).

Temporal Expectation in Focal Hand Dystonia

ERIC Educational Resources Information Center

Avanzino, Laura; Martino, Davide; Martino, Isadora; Pelosin, Elisa; Vicario, Carmelo M.; Bove, Marco; Defazio, Gianni; Abbruzzese, Giovanni

2013-01-01

Patients with writer's cramp present sensory and representational abnormalities relevant to motor control, such as impairment in the temporal discrimination between tactile stimuli and in pure motor imagery tasks, like the mental rotation of corporeal and inanimate objects. However, only limited information is available on the ability of patients…

Differential involvement of episodic and face representations in ERP repetition effects.

PubMed

Jemel, Boutheina; Calabria, Marco; Delvenne, Jean-François; Crommelinck, Marc; Bruyer, Raymond

2003-03-03

The purpose of this study was to disentangle the contribution of episodic-perceptual from pre-existing memory representations of faces to repetition effects. ERPs were recorded to first and second presentations of same and different photos of famous and unfamiliar faces, in an incidental task where occasional non-targets had to be detected. Repetition of same and different photos of famous faces resulted in an N400 amplitude decrement. No such N400 repetition-induced attenuation was observed for unfamiliar faces. In addition, repetition of same photos of faces, and not different ones, gave rise to an early ERP repetition effect (starting at approximately 350 ms) with an occipito-temporal scalp distribution. Together, these results suggest that repetition effects depend on two temporally and may be neuro-functionally distinct loci, episode-based representation and face recognition units stored in long-term memory.

Parallel, multi-stage processing of colors, faces and shapes in macaque inferior temporal cortex

PubMed Central

Lafer-Sousa, Rosa; Conway, Bevil R.

2014-01-01

Visual-object processing culminates in inferior temporal (IT) cortex. To assess the organization of IT, we measured fMRI responses in alert monkey to achromatic images (faces, fruit, bodies, places) and colored gratings. IT contained multiple color-biased regions, which were typically ventral to face patches and, remarkably, yoked to them, spaced regularly at four locations predicted by known anatomy. Color and face selectivity increased for more anterior regions, indicative of a broad hierarchical arrangement. Responses to non-face shapes were found across IT, but were stronger outside color-biased regions and face patches, consistent with multiple parallel streams. IT also contained multiple coarse eccentricity maps: face patches overlapped central representations; color-biased regions spanned mid-peripheral representations; and place-biased regions overlapped peripheral representations. These results suggest that IT comprises parallel, multi-stage processing networks subject to one organizing principle. PMID:24141314

Temporal and Rate Coding for Discrete Event Sequences in the Hippocampus.

PubMed

Terada, Satoshi; Sakurai, Yoshio; Nakahara, Hiroyuki; Fujisawa, Shigeyoshi

2017-06-21

Although the hippocampus is critical to episodic memory, neuronal representations supporting this role, especially relating to nonspatial information, remain elusive. Here, we investigated rate and temporal coding of hippocampal CA1 neurons in rats performing a cue-combination task that requires the integration of sequentially provided sound and odor cues. The majority of CA1 neurons displayed sensory cue-, combination-, or choice-specific (simply, "event"-specific) elevated discharge activities, which were sustained throughout the event period. These event cells underwent transient theta phase precession at event onset, followed by sustained phase locking to the early theta phases. As a result of this unique single neuron behavior, the theta sequences of CA1 cell assemblies of the event sequences had discrete representations. These results help to update the conceptual framework for space encoding toward a more general model of episodic event representations in the hippocampus. Copyright © 2017 Elsevier Inc. All rights reserved.

Unconstrained handwritten numeral recognition based on radial basis competitive and cooperative networks with spatio-temporal feature representation.

PubMed

Lee, S; Pan, J J

1996-01-01

This paper presents a new approach to representation and recognition of handwritten numerals. The approach first transforms a two-dimensional (2-D) spatial representation of a numeral into a three-dimensional (3-D) spatio-temporal representation by identifying the tracing sequence based on a set of heuristic rules acting as transformation operators. A multiresolution critical-point segmentation method is then proposed to extract local feature points, at varying degrees of scale and coarseness. A new neural network architecture, referred to as radial-basis competitive and cooperative network (RCCN), is presented especially for handwritten numeral recognition. RCCN is a globally competitive and locally cooperative network with the capability of self-organizing hidden units to progressively achieve desired network performance, and functions as a universal approximator of arbitrary input-output mappings. Three types of RCCNs are explored: input-space RCCN (IRCCN), output-space RCCN (ORCCN), and bidirectional RCCN (BRCCN). Experiments against handwritten zip code numerals acquired by the U.S. Postal Service indicated that the proposed method is robust in terms of variations, deformations, transformations, and corruption, achieving about 97% recognition rate.

Impoverished descriptions of familiar routes in three cases of hippocampal/medial temporal lobe amnesia.

PubMed

Herdman, Katherine A; Calarco, Navona; Moscovitch, Morris; Hirshhorn, Marnie; Rosenbaum, R Shayna

2015-10-01

Recent research has challenged classic theories of hippocampal function in spatial memory with findings that the hippocampus may be necessary for detailed representations of environments learned long ago, but not for remembering the gist or schematic aspects that are sufficient for navigating within those environments (Rosenbaum et al., 2000; Rosenbaum, Winocur, Binns, & Moscovitch, 2012). We aimed to probe further distinctions between detailed and schematic representations of familiar environments in three cases of hippocampal/medial temporal lobe (MTL) amnesia by testing them on a route description task and mental navigation tasks that assess the identity and location of landmarks, and distances and directions between them. The amnesic cases could describe basic directions along known, imagined routes, estimate distance and direction between well-known landmarks, and produce sketch maps with accurate layouts, suggestive of intact schematic representations. However, findings that their route descriptions lack richness of detail, along with impoverished sketch maps and poor landmark recognition, substantiates previous findings that detailed representations are hippocampus-dependent. Copyright © 2015 Elsevier Ltd. All rights reserved.

Insight into others' minds: spatio-temporal representations by intrinsic frame of reference.

PubMed

Sun, Yanlong; Wang, Hongbin

2014-01-01

Recent research has seen a growing interest in connections between domains of spatial and social cognition. Much evidence indicates that processes of representing space in distinct frames of reference (FOR) contribute to basic spatial abilities as well as sophisticated social abilities such as tracking other's intention and belief. Argument remains, however, that belief reasoning in social domain requires an innately dedicated system and cannot be reduced to low-level encoding of spatial relationships. Here we offer an integrated account advocating the critical roles of spatial representations in intrinsic frame of reference. By re-examining the results from a spatial task (Tamborello etal., 2012) and a false-belief task (Onishi and Baillargeon, 2005), we argue that spatial and social abilities share a common origin at the level of spatio-temporal association and predictive learning, where multiple FOR-based representations provide the basic building blocks for efficient and flexible partitioning of the environmental statistics. We also discuss neuroscience evidence supporting these mechanisms. We conclude that FOR-based representations may bridge the conceptual as well as the implementation gaps between the burgeoning fields of social and spatial cognition.

Representation and Use of Temporal Information in ONCOCIN

PubMed Central

Kahn, Michael G.; Ferguson, Jay C.; Shortliffe, Edward H.; Fagan, Lawrence M.

1985-01-01

The past medical history of a patient is a complex collection of events yet the understanding of these past events is critical for effective medical diagnostic and therapeutic decisions. Although computers can store vast quantities of patient data, diagnostic and therapeutic computer programs have had difficulty in accessing and analyzing collections of patient information that is clinically pertinent to a specific decision facing a particular patient at a given moment in his disease. Without some model of the patient's past, the computer cannot fully interpret the meaning of the available patient data. We present some of the difficulties that were encountered in ONCOCIN, a cancer chemotherapy planning program. This program must be able to reason about the patient's past treatment history in order to generate a therapy plan that is responsive to the problems he or she may have encountered in the past. A design is presented that supports a more intuitive approach to capture and analyze important temporal relationships in a patient's computer record. In order to represent the time course of a patient, we have implemented a structure called the temporal network and a temporal syntax for data storage and retrieval. Using this system, ONCOCIN is able to quickly obtain data that is patient-specific and context-sensitive. Adding the temporal network to the ONCOCIN system has markedly improved the program's handling of complex temporal issues.

Dynamical genetic programming in XCSF.

PubMed

Preen, Richard J; Bull, Larry

2013-01-01

A number of representation schemes have been presented for use within learning classifier systems, ranging from binary encodings to artificial neural networks. This paper presents results from an investigation into using a temporally dynamic symbolic representation within the XCSF learning classifier system. In particular, dynamical arithmetic networks are used to represent the traditional condition-action production system rules to solve continuous-valued reinforcement learning problems and to perform symbolic regression, finding competitive performance with traditional genetic programming on a number of composite polynomial tasks. In addition, the network outputs are later repeatedly sampled at varying temporal intervals to perform multistep-ahead predictions of a financial time series.

Deep recurrent neural network reveals a hierarchy of process memory during dynamic natural vision.

PubMed

Shi, Junxing; Wen, Haiguang; Zhang, Yizhen; Han, Kuan; Liu, Zhongming

2018-05-01

The human visual cortex extracts both spatial and temporal visual features to support perception and guide behavior. Deep convolutional neural networks (CNNs) provide a computational framework to model cortical representation and organization for spatial visual processing, but unable to explain how the brain processes temporal information. To overcome this limitation, we extended a CNN by adding recurrent connections to different layers of the CNN to allow spatial representations to be remembered and accumulated over time. The extended model, or the recurrent neural network (RNN), embodied a hierarchical and distributed model of process memory as an integral part of visual processing. Unlike the CNN, the RNN learned spatiotemporal features from videos to enable action recognition. The RNN better predicted cortical responses to natural movie stimuli than the CNN, at all visual areas, especially those along the dorsal stream. As a fully observable model of visual processing, the RNN also revealed a cortical hierarchy of temporal receptive window, dynamics of process memory, and spatiotemporal representations. These results support the hypothesis of process memory, and demonstrate the potential of using the RNN for in-depth computational understanding of dynamic natural vision. © 2018 Wiley Periodicals, Inc.

Assessment of the impacts of aromatic VOC emissions and yields of SOA on SOA concentrations with the air quality model RAMS-CMAQ

NASA Astrophysics Data System (ADS)

Li, Jialin; Zhang, Meigen; Wu, Fangkun; Sun, Yele; Tang, Guiqian

2017-06-01

The secondary organic aerosol (SOA) concentration is generally underestimated by models. Recent studies suggest that the underprediction is related to underestimations of aromatic volatile organic compound (VOC) emissions and SOA yields in current models. Here, the impacts of these two factors in China were investigated with the regional air quality modeling system RAMS-CMAQ, referring to field observations during the episode from October 14 to November 14, 2014. Comparisons between the observed and modeled SOA of four sensitivity simulation cases indicated the significant impacts of the two underestimated factors on the SOA output. By considering these two aspects, the simulated mean SOA concentrations significantly increased by nearly 4 times with a good representation of the intensively temporal variations of concentrations, which were largely controlled by photochemical processes rather than meteorological conditions. The improvement in SOA compensated for the underestimations by approximately 23.5% and contributed to the mean fraction of SOA to organic aerosol (OA) by increasing the fraction from less than 7% to more than 25%, which was closer to the observed result. These results suggested a more reasonable and more realistic representation of SOA formation in the model after allowing for the two factors. Due to the better simulation of SOA, predictions of OA were correspondingly improved when the correlation coefficient increased from 0.57 to 0.73 and other bias parameters were reduced, which indicated the improved ability of our model to trace the temporal variations of OA. Based on the improved simulation throughout the episode, the mean SOA concentration was obviously higher in eastern China than in the west. The highest concentration appeared in the Sichuan Basin and Pearl River Delta (PRD) areas, with values of 6-11 μg/m3 and 8-17 μg/m3, respectively. Over the wide regions of central and eastern China, the dominant component in SOA was formed from anthropogenic sources (ASOA), generally accounting for more than 60%.

A Mechanism for Reducing Delay Discounting by Altering Temporal Attention

PubMed Central

Radu, Peter T; Yi, Richard; Bickel, Warren K; Gross, James J; McClure, Samuel M

2011-01-01

Rewards that are not immediately available are discounted compared to rewards that are immediately available. The more a person discounts a delayed reward, the more likely that person is to have a range of behavioral problems, including clinical disorders. This latter observation has motivated the search for interventions that reduce discounting. One surprisingly simple method to reduce discounting is an “explicit-zero” reframing that states default or null outcomes. Reframing a classical discounting choice as “something now but nothing later” versus “nothing now but more later” decreases discount rates. However, it is not clear how this “explicit-zero” framing intervention works. The present studies delineate and test two possible mechanisms to explain the phenomenon. One mechanism proposes that the explicit-zero framing creates the impression of an improving sequence, thereby enhancing the present value of the delayed reward. A second possible mechanism posits an increase in attention allocation to temporally distant reward representations. In four experiments, we distinguish between these two hypothesized mechanisms and conclude that the temporal attention hypothesis is superior for explaining our results. We propose a model of temporal attention whereby framing affects intertemporal preferences by modifying present bias. PMID:22084496

Searches over graphs representing geospatial-temporal remote sensing data

DOEpatents

Brost, Randolph; Perkins, David Nikolaus

2018-03-06

Various technologies pertaining to identifying objects of interest in remote sensing images by searching over geospatial-temporal graph representations are described herein. Graphs are constructed by representing objects in remote sensing images as nodes, and connecting nodes with undirected edges representing either distance or adjacency relationships between objects and directed edges representing changes in time. Geospatial-temporal graph searches are made computationally efficient by taking advantage of characteristics of geospatial-temporal data in remote sensing images through the application of various graph search techniques.

Moments of Teaching and Learning in a Children's Hospital: Affects, Textures, and Temporalities

ERIC Educational Resources Information Center

Ehret, Christian

2018-01-01

Although nonrepresentational theory has enriched anthropologists' understanding of affect in social and cultural life, it has a short history in education research, where representational paradigms dominate. This article develops nonrepresentational theories of moments, temporal textures, and affective pedagogies in order to evoke affects of…

Temporal compressive sensing systems

DOEpatents

Reed, Bryan W.

2017-12-12

Methods and systems for temporal compressive sensing are disclosed, where within each of one or more sensor array data acquisition periods, one or more sensor array measurement datasets comprising distinct linear combinations of time slice data are acquired, and where mathematical reconstruction allows for calculation of accurate representations of the individual time slice datasets.

Temporal abstraction and temporal Bayesian networks in clinical domains: a survey.

PubMed

Orphanou, Kalia; Stassopoulou, Athena; Keravnou, Elpida

2014-03-01

Temporal abstraction (TA) of clinical data aims to abstract and interpret clinical data into meaningful higher-level interval concepts. Abstracted concepts are used for diagnostic, prediction and therapy planning purposes. On the other hand, temporal Bayesian networks (TBNs) are temporal extensions of the known probabilistic graphical models, Bayesian networks. TBNs can represent temporal relationships between events and their state changes, or the evolution of a process, through time. This paper offers a survey on techniques/methods from these two areas that were used independently in many clinical domains (e.g. diabetes, hepatitis, cancer) for various clinical tasks (e.g. diagnosis, prognosis). A main objective of this survey, in addition to presenting the key aspects of TA and TBNs, is to point out important benefits from a potential integration of TA and TBNs in medical domains and tasks. The motivation for integrating these two areas is their complementary function: TA provides clinicians with high level views of data while TBNs serve as a knowledge representation and reasoning tool under uncertainty, which is inherent in all clinical tasks. Key publications from these two areas of relevance to clinical systems, mainly circumscribed to the latest two decades, are reviewed and classified. TA techniques are compared on the basis of: (a) knowledge acquisition and representation for deriving TA concepts and (b) methodology for deriving basic and complex temporal abstractions. TBNs are compared on the basis of: (a) representation of time, (b) knowledge representation and acquisition, (c) inference methods and the computational demands of the network, and (d) their applications in medicine. The survey performs an extensive comparative analysis to illustrate the separate merits and limitations of various TA and TBN techniques used in clinical systems with the purpose of anticipating potential gains through an integration of the two techniques, thus leading to a unified methodology for clinical systems. The surveyed contributions are evaluated using frameworks of respective key features. In addition, for the evaluation of TBN methods, a unifying clinical domain (diabetes) is used. The main conclusion transpiring from this review is that techniques/methods from these two areas, that so far are being largely used independently of each other in clinical domains, could be effectively integrated in the context of medical decision-support systems. The anticipated key benefits of the perceived integration are: (a) during problem solving, the reasoning can be directed at different levels of temporal and/or conceptual abstractions since the nodes of the TBNs can be complex entities, temporally and structurally and (b) during model building, knowledge generated in the form of basic and/or complex abstractions, can be deployed in a TBN. Copyright © 2014 Elsevier B.V. All rights reserved.

Semantic representations in the temporal pole predict false memories

PubMed Central

Chadwick, Martin J.; Anjum, Raeesa S.; Kumaran, Dharshan; Schacter, Daniel L.; Spiers, Hugo J.; Hassabis, Demis

2016-01-01

Recent advances in neuroscience have given us unprecedented insight into the neural mechanisms of false memory, showing that artificial memories can be inserted into the memory cells of the hippocampus in a way that is indistinguishable from true memories. However, this alone is not enough to explain how false memories can arise naturally in the course of our daily lives. Cognitive psychology has demonstrated that many instances of false memory, both in the laboratory and the real world, can be attributed to semantic interference. Whereas previous studies have found that a diverse set of regions show some involvement in semantic false memory, none have revealed the nature of the semantic representations underpinning the phenomenon. Here we use fMRI with representational similarity analysis to search for a neural code consistent with semantic false memory. We find clear evidence that false memories emerge from a similarity-based neural code in the temporal pole, a region that has been called the “semantic hub” of the brain. We further show that each individual has a partially unique semantic code within the temporal pole, and this unique code can predict idiosyncratic patterns of memory errors. Finally, we show that the same neural code can also predict variation in true-memory performance, consistent with an adaptive perspective on false memory. Taken together, our findings reveal the underlying structure of neural representations of semantic knowledge, and how this semantic structure can both enhance and distort our memories. PMID:27551087

Semantic representations in the temporal pole predict false memories.

PubMed

Chadwick, Martin J; Anjum, Raeesa S; Kumaran, Dharshan; Schacter, Daniel L; Spiers, Hugo J; Hassabis, Demis

2016-09-06

Recent advances in neuroscience have given us unprecedented insight into the neural mechanisms of false memory, showing that artificial memories can be inserted into the memory cells of the hippocampus in a way that is indistinguishable from true memories. However, this alone is not enough to explain how false memories can arise naturally in the course of our daily lives. Cognitive psychology has demonstrated that many instances of false memory, both in the laboratory and the real world, can be attributed to semantic interference. Whereas previous studies have found that a diverse set of regions show some involvement in semantic false memory, none have revealed the nature of the semantic representations underpinning the phenomenon. Here we use fMRI with representational similarity analysis to search for a neural code consistent with semantic false memory. We find clear evidence that false memories emerge from a similarity-based neural code in the temporal pole, a region that has been called the "semantic hub" of the brain. We further show that each individual has a partially unique semantic code within the temporal pole, and this unique code can predict idiosyncratic patterns of memory errors. Finally, we show that the same neural code can also predict variation in true-memory performance, consistent with an adaptive perspective on false memory. Taken together, our findings reveal the underlying structure of neural representations of semantic knowledge, and how this semantic structure can both enhance and distort our memories.

Temporal context processing within hippocampal subfields.

PubMed

Wang, Fang; Diana, Rachel A

2016-07-01

The episodic memory system can differentiate similar events based on the temporal information associated with the events. Temporal context, which is at least partially determined by the events that precede or follow the critical event, may be a cue to differentiate events. The purpose of the present study is to investigate whether the hippocampal dentate gyrus (DG)/CA3 and CA1 subfields are sensitive to changes in temporal context and, if so, whether the subregions show a linear or threshold-like response to similar temporal contexts. Participants incidentally encoded a series of object picture triplets and 20 of them were included in final analyses. The third picture in each triplet was operationally defined as the target and the first two pictures served as temporal context for the target picture. Each target picture was presented twice with temporal context manipulated to be either repeated, high similarity, low similarity, or new on the second presentation. We extracted beta parameters for the repeated target as a function of the type of temporal context. We expected to see repetition suppression, a reduction in the beta values, in response to repetition of the target. If temporal context information is included in the representation of the target within a given region, this repetition suppression should be greater for target images that were preceded by their original context than for target images preceded by a new context. Neuroimaging results showed that CA1, but not DG/CA3, modifies the target's representation based on its temporal context. Right CA1 did not distinguish high similarity temporal context from repeated context but did distinguish low similarity temporal context from repeated context. These results indicate that CA1 is sensitive to temporal context and suggest that it does not differentiate between a substantially similar temporal context and an identical temporal context. In contrast, DG/CA3 does not appear to process temporal context as defined in the current experiment. Copyright © 2016 Elsevier Inc. All rights reserved.

High-resolution Temporal Representations of Alcohol and Tobacco Behaviors from Social Media Data.

PubMed

Huang, Tom; Elghafari, Anas; Relia, Kunal; Chunara, Rumi

2017-11-01

Understanding tobacco- and alcohol-related behavioral patterns is critical for uncovering risk factors and potentially designing targeted social computing intervention systems. Given that we make choices multiple times per day, hourly and daily patterns are critical for better understanding behaviors. Here, we combine natural language processing, machine learning and time series analyses to assess Twitter activity specifically related to alcohol and tobacco consumption and their sub-daily, daily and weekly cycles. Twitter self-reports of alcohol and tobacco use are compared to other data streams available at similar temporal resolution. We assess if discussion of drinking by inferred underage versus legal age people or discussion of use of different types of tobacco products can be differentiated using these temporal patterns. We find that time and frequency domain representations of behaviors on social media can provide meaningful and unique insights, and we discuss the types of behaviors for which the approach may be most useful.

Behaviorally Relevant Abstract Object Identity Representation in the Human Parietal Cortex

PubMed Central

Jeong, Su Keun

2016-01-01

The representation of object identity is fundamental to human vision. Using fMRI and multivoxel pattern analysis, here we report the representation of highly abstract object identity information in human parietal cortex. Specifically, in superior intraparietal sulcus (IPS), a region previously shown to track visual short-term memory capacity, we found object identity representations for famous faces varying freely in viewpoint, hairstyle, facial expression, and age; and for well known cars embedded in different scenes, and shown from different viewpoints and sizes. Critically, these parietal identity representations were behaviorally relevant as they closely tracked the perceived face-identity similarity obtained in a behavioral task. Meanwhile, the task-activated regions in prefrontal and parietal cortices (excluding superior IPS) did not exhibit such abstract object identity representations. Unlike previous studies, we also failed to observe identity representations in posterior ventral and lateral visual object-processing regions, likely due to the greater amount of identity abstraction demanded by our stimulus manipulation here. Our MRI slice coverage precluded us from examining identity representation in anterior temporal lobe, a likely region for the computing of identity information in the ventral region. Overall, we show that human parietal cortex, part of the dorsal visual processing pathway, is capable of holding abstract and complex visual representations that are behaviorally relevant. These results argue against a “content-poor” view of the role of parietal cortex in attention. Instead, the human parietal cortex seems to be “content rich” and capable of directly participating in goal-driven visual information representation in the brain. SIGNIFICANCE STATEMENT The representation of object identity (including faces) is fundamental to human vision and shapes how we interact with the world. Although object representation has traditionally been associated with human occipital and temporal cortices, here we show, by measuring fMRI response patterns, that a region in the human parietal cortex can robustly represent task-relevant object identities. These representations are invariant to changes in a host of visual features, such as viewpoint, and reflect an abstract level of representation that has not previously been reported in the human parietal cortex. Critically, these neural representations are behaviorally relevant as they closely track the perceived object identities. Human parietal cortex thus participates in the moment-to-moment goal-directed visual information representation in the brain. PMID:26843642

Representational Similarity Analysis Reveals Commonalities and Differences in the Semantic Processing of Words and Objects

PubMed Central

Devereux, Barry J.; Clarke, Alex; Marouchos, Andreas; Tyler, Lorraine K.

2013-01-01

Understanding the meanings of words and objects requires the activation of underlying conceptual representations. Semantic representations are often assumed to be coded such that meaning is evoked regardless of the input modality. However, the extent to which meaning is coded in modality-independent or amodal systems remains controversial. We address this issue in a human fMRI study investigating the neural processing of concepts, presented separately as written words and pictures. Activation maps for each individual word and picture were used as input for searchlight-based multivoxel pattern analyses. Representational similarity analysis was used to identify regions correlating with low-level visual models of the words and objects and the semantic category structure common to both. Common semantic category effects for both modalities were found in a left-lateralized network, including left posterior middle temporal gyrus (LpMTG), left angular gyrus, and left intraparietal sulcus (LIPS), in addition to object- and word-specific semantic processing in ventral temporal cortex and more anterior MTG, respectively. To explore differences in representational content across regions and modalities, we developed novel data-driven analyses, based on k-means clustering of searchlight dissimilarity matrices and seeded correlation analysis. These revealed subtle differences in the representations in semantic-sensitive regions, with representations in LIPS being relatively invariant to stimulus modality and representations in LpMTG being uncorrelated across modality. These results suggest that, although both LpMTG and LIPS are involved in semantic processing, only the functional role of LIPS is the same regardless of the visual input, whereas the functional role of LpMTG differs for words and objects. PMID:24285896

Emerging Object Representations in the Visual System Predict Reaction Times for Categorization

PubMed Central

Ritchie, J. Brendan; Tovar, David A.; Carlson, Thomas A.

2015-01-01

Recognizing an object takes just a fraction of a second, less than the blink of an eye. Applying multivariate pattern analysis, or “brain decoding”, methods to magnetoencephalography (MEG) data has allowed researchers to characterize, in high temporal resolution, the emerging representation of object categories that underlie our capacity for rapid recognition. Shortly after stimulus onset, object exemplars cluster by category in a high-dimensional activation space in the brain. In this emerging activation space, the decodability of exemplar category varies over time, reflecting the brain’s transformation of visual inputs into coherent category representations. How do these emerging representations relate to categorization behavior? Recently it has been proposed that the distance of an exemplar representation from a categorical boundary in an activation space is critical for perceptual decision-making, and that reaction times should therefore correlate with distance from the boundary. The predictions of this distance hypothesis have been born out in human inferior temporal cortex (IT), an area of the brain crucial for the representation of object categories. When viewed in the context of a time varying neural signal, the optimal time to “read out” category information is when category representations in the brain are most decodable. Here, we show that the distance from a decision boundary through activation space, as measured using MEG decoding methods, correlates with reaction times for visual categorization during the period of peak decodability. Our results suggest that the brain begins to read out information about exemplar category at the optimal time for use in choice behaviour, and support the hypothesis that the structure of the representation for objects in the visual system is partially constitutive of the decision process in recognition. PMID:26107634

The role of multisensory interplay in enabling temporal expectations.

PubMed

Ball, Felix; Michels, Lara E; Thiele, Carsten; Noesselt, Toemme

2018-01-01

Temporal regularities can guide our attention to focus on a particular moment in time and to be especially vigilant just then. Previous research provided evidence for the influence of temporal expectation on perceptual processing in unisensory auditory, visual, and tactile contexts. However, in real life we are often exposed to a complex and continuous stream of multisensory events. Here we tested - in a series of experiments - whether temporal expectations can enhance perception in multisensory contexts and whether this enhancement differs from enhancements in unisensory contexts. Our discrimination paradigm contained near-threshold targets (subject-specific 75% discrimination accuracy) embedded in a sequence of distractors. The likelihood of target occurrence (early or late) was manipulated block-wise. Furthermore, we tested whether spatial and modality-specific target uncertainty (i.e. predictable vs. unpredictable target position or modality) would affect temporal expectation (TE) measured with perceptual sensitivity (d ' ) and response times (RT). In all our experiments, hidden temporal regularities improved performance for expected multisensory targets. Moreover, multisensory performance was unaffected by spatial and modality-specific uncertainty, whereas unisensory TE effects on d ' but not RT were modulated by spatial and modality-specific uncertainty. Additionally, the size of the temporal expectation effect, i.e. the increase in perceptual sensitivity and decrease of RT, scaled linearly with the likelihood of expected targets. Finally, temporal expectation effects were unaffected by varying target position within the stream. Together, our results strongly suggest that participants quickly adapt to novel temporal contexts, that they benefit from multisensory (relative to unisensory) stimulation and that multisensory benefits are maximal if the stimulus-driven uncertainty is highest. We propose that enhanced informational content (i.e. multisensory stimulation) enables the robust extraction of temporal regularities which in turn boost (uni-)sensory representations. Copyright © 2017 Elsevier B.V. All rights reserved.

Negative Numbers in the 18th and 19th Centuries: Phenomenology and Representations

ERIC Educational Resources Information Center

Maz-Machado, Alexander; Rico-Romero, Luis

2009-01-01

This article presents a categorization of the phenomena and representations used to introduce negative numbers in mathematics books published in Spain during the 18th and 19th centuries. Through a content analysis of fourteen texts which were selected for the study, we distinguished four phenomena typologies: physical, accounting, temporal and…

Tongue Motion Averaging from Contour Sequences

ERIC Educational Resources Information Center

Li, Min; Kambhamettu, Chandra; Stone, Maureen

2005-01-01

In this paper, a method to get the best representation of a speech motion from several repetitions is presented. Each repetition is a representation of the same speech captured at different times by sequence of ultrasound images and is composed of a set of 2D spatio-temporal contours. These 2D contours in different repetitions are time aligned…

Neural correlates of face gender discrimination learning.

PubMed

Su, Junzhu; Tan, Qingleng; Fang, Fang

2013-04-01

Using combined psychophysics and event-related potentials (ERPs), we investigated the effect of perceptual learning on face gender discrimination and probe the neural correlates of the learning effect. Human subjects were trained to perform a gender discrimination task with male or female faces. Before and after training, they were tested with the trained faces and other faces with the same and opposite genders. ERPs responding to these faces were recorded. Psychophysical results showed that training significantly improved subjects' discrimination performance and the improvement was specific to the trained gender, as well as to the trained identities. The training effect indicates that learning occurs at two levels-the category level (gender) and the exemplar level (identity). ERP analyses showed that the gender and identity learning was associated with the N170 latency reduction at the left occipital-temporal area and the N170 amplitude reduction at the right occipital-temporal area, respectively. These findings provide evidence for the facilitation model and the sharpening model on neuronal plasticity from visual experience, suggesting a faster processing speed and a sparser representation of face induced by perceptual learning.

Turbulence and Solar p-Mode Oscillations

NASA Astrophysics Data System (ADS)

Bi, S. L.; Xu, H. Y.

The discrepancy between observed and theoretical mode frequencies can be used to examine the reliability of the standard solar model as a faithful representation of solar real situation. With the help of an improved time-dependent convective model that takes into account contribution of the full spatial and temporal turbulent energy spectrum, we study the influence of turbulent pressure on structure and solar p-mode frequencies. For the radial modes we find that the Reynolds stress produces signification modifications in structure and p-mode spectrum. Compared with an adiabatic approximation, the discrepancy is largely removed by the turbulent correction.

Visual search of cyclic spatio-temporal events

NASA Astrophysics Data System (ADS)

Gautier, Jacques; Davoine, Paule-Annick; Cunty, Claire

2018-05-01

The analysis of spatio-temporal events, and especially of relationships between their different dimensions (space-time-thematic attributes), can be done with geovisualization interfaces. But few geovisualization tools integrate the cyclic dimension of spatio-temporal event series (natural events or social events). Time Coil and Time Wave diagrams represent both the linear time and the cyclic time. By introducing a cyclic temporal scale, these diagrams may highlight the cyclic characteristics of spatio-temporal events. However, the settable cyclic temporal scales are limited to usual durations like days or months. Because of that, these diagrams cannot be used to visualize cyclic events, which reappear with an unusual period, and don't allow to make a visual search of cyclic events. Also, they don't give the possibility to identify the relationships between the cyclic behavior of the events and their spatial features, and more especially to identify localised cyclic events. The lack of possibilities to represent the cyclic time, outside of the temporal diagram of multi-view geovisualization interfaces, limits the analysis of relationships between the cyclic reappearance of events and their other dimensions. In this paper, we propose a method and a geovisualization tool, based on the extension of Time Coil and Time Wave, to provide a visual search of cyclic events, by allowing to set any possible duration to the diagram's cyclic temporal scale. We also propose a symbology approach to push the representation of the cyclic time into the map, in order to improve the analysis of relationships between space and the cyclic behavior of events.

Modulation of Temporal Precision in Thalamic Population Responses to Natural Visual Stimuli

PubMed Central

Desbordes, Gaëlle; Jin, Jianzhong; Alonso, Jose-Manuel; Stanley, Garrett B.

2010-01-01

Natural visual stimuli have highly structured spatial and temporal properties which influence the way visual information is encoded in the visual pathway. In response to natural scene stimuli, neurons in the lateral geniculate nucleus (LGN) are temporally precise – on a time scale of 10–25 ms – both within single cells and across cells within a population. This time scale, established by non stimulus-driven elements of neuronal firing, is significantly shorter than that of natural scenes, yet is critical for the neural representation of the spatial and temporal structure of the scene. Here, a generalized linear model (GLM) that combines stimulus-driven elements with spike-history dependence associated with intrinsic cellular dynamics is shown to predict the fine timing precision of LGN responses to natural scene stimuli, the corresponding correlation structure across nearby neurons in the population, and the continuous modulation of spike timing precision and latency across neurons. A single model captured the experimentally observed neural response, across different levels of contrasts and different classes of visual stimuli, through interactions between the stimulus correlation structure and the nonlinearity in spike generation and spike history dependence. Given the sensitivity of the thalamocortical synapse to closely timed spikes and the importance of fine timing precision for the faithful representation of natural scenes, the modulation of thalamic population timing over these time scales is likely important for cortical representations of the dynamic natural visual environment. PMID:21151356

Surface errors without semantic impairment in acquired dyslexia: a voxel-based lesion–symptom mapping study

PubMed Central

Pillay, Sara B.; Humphries, Colin J.; Gross, William L.; Graves, William W.; Book, Diane S.

2016-01-01

Patients with surface dyslexia have disproportionate difficulty pronouncing irregularly spelled words (e.g. pint), suggesting impaired use of lexical-semantic information to mediate phonological retrieval. Patients with this deficit also make characteristic ‘regularization’ errors, in which an irregularly spelled word is mispronounced by incorrect application of regular spelling-sound correspondences (e.g. reading plaid as ‘played’), indicating over-reliance on sublexical grapheme–phoneme correspondences. We examined the neuroanatomical correlates of this specific error type in 45 patients with left hemisphere chronic stroke. Voxel-based lesion–symptom mapping showed a strong positive relationship between the rate of regularization errors and damage to the posterior half of the left middle temporal gyrus. Semantic deficits on tests of single-word comprehension were generally mild, and these deficits were not correlated with the rate of regularization errors. Furthermore, the deep occipital-temporal white matter locus associated with these mild semantic deficits was distinct from the lesion site associated with regularization errors. Thus, in contrast to patients with surface dyslexia and semantic impairment from anterior temporal lobe degeneration, surface errors in our patients were not related to a semantic deficit. We propose that these patients have an inability to link intact semantic representations with phonological representations. The data provide novel evidence for a post-semantic mechanism mediating the production of surface errors, and suggest that the posterior middle temporal gyrus may compute an intermediate representation linking semantics with phonology. PMID:26966139

Medial Temporal Lobe Structures Contribute to On-Line Processing

ERIC Educational Resources Information Center

Warren, David

2009-01-01

For the last five decades, the medial temporal lobes have been generally understood to facilitate enduring representation of certain kinds of information. In particular, knowledge about the relations among items and concepts appears to rely on that region of the brain. Recent results suggest that those same structures also play a subtle role in…

Video Vectorization via Tetrahedral Remeshing.

PubMed

Wang, Chuan; Zhu, Jie; Guo, Yanwen; Wang, Wenping

2017-02-09

We present a video vectorization method that generates a video in vector representation from an input video in raster representation. A vector-based video representation offers the benefits of vector graphics, such as compactness and scalability. The vector video we generate is represented by a simplified tetrahedral control mesh over the spatial-temporal video volume, with color attributes defined at the mesh vertices. We present novel techniques for simplification and subdivision of a tetrahedral mesh to achieve high simplification ratio while preserving features and ensuring color fidelity. From an input raster video, our method is capable of generating a compact video in vector representation that allows a faithful reconstruction with low reconstruction errors.

Classification and Weakly Supervised Pain Localization using Multiple Segment Representation.

PubMed

Sikka, Karan; Dhall, Abhinav; Bartlett, Marian Stewart

2014-10-01

Automatic pain recognition from videos is a vital clinical application and, owing to its spontaneous nature, poses interesting challenges to automatic facial expression recognition (AFER) research. Previous pain vs no-pain systems have highlighted two major challenges: (1) ground truth is provided for the sequence, but the presence or absence of the target expression for a given frame is unknown, and (2) the time point and the duration of the pain expression event(s) in each video are unknown. To address these issues we propose a novel framework (referred to as MS-MIL) where each sequence is represented as a bag containing multiple segments, and multiple instance learning (MIL) is employed to handle this weakly labeled data in the form of sequence level ground-truth. These segments are generated via multiple clustering of a sequence or running a multi-scale temporal scanning window, and are represented using a state-of-the-art Bag of Words (BoW) representation. This work extends the idea of detecting facial expressions through 'concept frames' to 'concept segments' and argues through extensive experiments that algorithms such as MIL are needed to reap the benefits of such representation. The key advantages of our approach are: (1) joint detection and localization of painful frames using only sequence-level ground-truth, (2) incorporation of temporal dynamics by representing the data not as individual frames but as segments, and (3) extraction of multiple segments, which is well suited to signals with uncertain temporal location and duration in the video. Extensive experiments on UNBC-McMaster Shoulder Pain dataset highlight the effectiveness of the approach by achieving competitive results on both tasks of pain classification and localization in videos. We also empirically evaluate the contributions of different components of MS-MIL. The paper also includes the visualization of discriminative facial patches, important for pain detection, as discovered by our algorithm and relates them to Action Units that have been associated with pain expression. We conclude the paper by demonstrating that MS-MIL yields a significant improvement on another spontaneous facial expression dataset, the FEEDTUM dataset.

Three dimensional simulation of spatial and temporal variability of stratospheric hydrogen chloride

NASA Technical Reports Server (NTRS)

Kaye, Jack A.; Rood, Richard B.; Jackman, Charles H.; Allen, Dale J.; Larson, Edmund M.

1989-01-01

Spatial and temporal variability of atmospheric HCl columns are calculated for January 1979 using a three-dimensional chemistry-transport model designed to provide the best possible representation of stratospheric transport. Large spatial and temporal variability of the HCl columns is shown to be correlated with lower stratospheric potential vorticity and thus to be of dynamical origin. Systematic longitudinal structure is correlated with planetary wave structure. These results can help place spatially and temporally isolated column and profile measurements in a regional and/or global perspective.

Temporally Scalable Visual SLAM using a Reduced Pose Graph

DTIC Science & Technology

2012-05-25

m b r i d g e , m a 0 213 9 u s a — w w w. c s a i l . m i t . e d u MIT-CSAIL-TR-2012-013 May 25, 2012 Temporally Scalable Visual SLAM using a...00-00-2012 4. TITLE AND SUBTITLE Temporally Scalable Visual SLAM using a Reduced Pose Graph 5a. CONTRACT NUMBER 5b. GRANT NUMBER 5c. PROGRAM...demonstrate a system for temporally scalable visual SLAM using a reduced pose graph representation. Unlike previous visual SLAM approaches that use

Combining glass box and black box evaluations in the identification of heart disease risk factors and their temporal relations from clinical records.

PubMed

Grouin, Cyril; Moriceau, Véronique; Zweigenbaum, Pierre

2015-12-01

The determination of risk factors and their temporal relations in natural language patient records is a complex task which has been addressed in the i2b2/UTHealth 2014 shared task. In this context, in most systems it was broadly decomposed into two sub-tasks implemented by two components: entity detection, and temporal relation determination. Task-level ("black box") evaluation is relevant for the final clinical application, whereas component-level evaluation ("glass box") is important for system development and progress monitoring. Unfortunately, because of the interaction between entity representation and temporal relation representation, glass box and black box evaluation cannot be managed straightforwardly at the same time in the setting of the i2b2/UTHealth 2014 task, making it difficult to assess reliably the relative performance and contribution of the individual components to the overall task. To identify obstacles and propose methods to cope with this difficulty, and illustrate them through experiments on the i2b2/UTHealth 2014 dataset. We outline several solutions to this problem and examine their requirements in terms of adequacy for component-level and task-level evaluation and of changes to the task framework. We select the solution which requires the least modifications to the i2b2 evaluation framework and illustrate it with our system. This system identifies risk factor mentions with a CRF system complemented by hand-designed patterns, identifies and normalizes temporal expressions through a tailored version of the Heideltime tool, and determines temporal relations of each risk factor with a One Rule classifier. Giving a fixed value to the temporal attribute in risk factor identification proved to be the simplest way to evaluate the risk factor detection component independently. This evaluation method enabled us to identify the risk factor detection component as most contributing to the false negatives and false positives of the global system. This led us to redirect further effort to this component, focusing on medication detection, with gains of 7 to 20 recall points and of 3 to 6 F-measure points depending on the corpus and evaluation. We proposed a method to achieve a clearer glass box evaluation of risk factor detection and temporal relation detection in clinical texts, which can provide an example to help system development in similar tasks. This glass box evaluation was instrumental in refocusing our efforts and obtaining substantial improvements in risk factor detection. Copyright © 2015 Elsevier Inc. All rights reserved.

Putting Short-Term Memory into Context: Reply to Usher, Davelaar, Haarmann, and Goshen-Gottstein (2008)

ERIC Educational Resources Information Center

Kahana, Michael J.; Sederberg, Per B.; Howard, Marc W.

2008-01-01

The temporal context model posits that search through episodic memory is driven by associations between the multiattribute representations of items and context. Context, in turn, is a recency weighted sum of previous experiences or memories. Because recently processed items are most similar to the current representation of context, M. Usher, E. J.…

"I Used To Get Mad at My School": Representations of Schooling in Rock and Pop Music.

ERIC Educational Resources Information Center

Brehony, Kevin J.

1998-01-01

Uses theories from a wide range of disciplines to analyze representations of schooling in rock and pop songs. Examines songs from the 1950s to Britpop and the present. Declares that schooling is overwhelmingly represented as the antithesis of leisure. Addresses other relationships between schooling and music, such as temporality and violence. (CMK)

Comprehending Narratives Containing Flashbacks: Evidence for Temporally Organized Representations

ERIC Educational Resources Information Center

Claus, Berry; Kelter, Stephanie

2006-01-01

This study investigated the representations that readers construct for narratives describing a sequence of events. Participants read narratives describing 4 successive events in chronological order (Event 1, Event 2, Event 3, Event 4 [E1, E2, E3, E4] Experiment 1) or in nonchronological order with E1 being mentioned in a flashback (E2, E3, E1,…

Inferring segmented dense motion layers using 5D tensor voting.

PubMed

Min, Changki; Medioni, Gérard

2008-09-01

We present a novel local spatiotemporal approach to produce motion segmentation and dense temporal trajectories from an image sequence. A common representation of image sequences is a 3D spatiotemporal volume, (x,y,t), and its corresponding mathematical formalism is the fiber bundle. However, directly enforcing the spatiotemporal smoothness constraint is difficult in the fiber bundle representation. Thus, we convert the representation into a new 5D space (x,y,t,vx,vy) with an additional velocity domain, where each moving object produces a separate 3D smooth layer. The smoothness constraint is now enforced by extracting 3D layers using the tensor voting framework in a single step that solves both correspondence and segmentation simultaneously. Motion segmentation is achieved by identifying those layers, and the dense temporal trajectories are obtained by converting the layers back into the fiber bundle representation. We proceed to address three applications (tracking, mosaic, and 3D reconstruction) that are hard to solve from the video stream directly because of the segmentation and dense matching steps, but become straightforward with our framework. The approach does not make restrictive assumptions about the observed scene or camera motion and is therefore generally applicable. We present results on a number of data sets.

An ultra-sparse code underliesthe generation of neural sequences in a songbird

NASA Astrophysics Data System (ADS)

Hahnloser, Richard H. R.; Kozhevnikov, Alexay A.; Fee, Michale S.

2002-09-01

Sequences of motor activity are encoded in many vertebrate brains by complex spatio-temporal patterns of neural activity; however, the neural circuit mechanisms underlying the generation of these pre-motor patterns are poorly understood. In songbirds, one prominent site of pre-motor activity is the forebrain robust nucleus of the archistriatum (RA), which generates stereotyped sequences of spike bursts during song and recapitulates these sequences during sleep. We show that the stereotyped sequences in RA are driven from nucleus HVC (high vocal centre), the principal pre-motor input to RA. Recordings of identified HVC neurons in sleeping and singing birds show that individual HVC neurons projecting onto RA neurons produce bursts sparsely, at a single, precise time during the RA sequence. These HVC neurons burst sequentially with respect to one another. We suggest that at each time in the RA sequence, the ensemble of active RA neurons is driven by a subpopulation of RA-projecting HVC neurons that is active only at that time. As a population, these HVC neurons may form an explicit representation of time in the sequence. Such a sparse representation, a temporal analogue of the `grandmother cell' concept for object recognition, eliminates the problem of temporal interference during sequence generation and learning attributed to more distributed representations.

Physics instruction induces changes in neural knowledge representation during successive stages of learning.

PubMed

Mason, Robert A; Just, Marcel Adam

2015-05-01

Incremental instruction on the workings of a set of mechanical systems induced a progression of changes in the neural representations of the systems. The neural representations of four mechanical systems were assessed before, during, and after three phases of incremental instruction (which first provided information about the system components, then provided partial causal information, and finally provided full functional information). In 14 participants, the neural representations of four systems (a bathroom scale, a fire extinguisher, an automobile braking system, and a trumpet) were assessed using three recently developed techniques: (1) machine learning and classification of multi-voxel patterns; (2) localization of consistently responding voxels; and (3) representational similarity analysis (RSA). The neural representations of the systems progressed through four stages, or states, involving spatially and temporally distinct multi-voxel patterns: (1) initially, the representation was primarily visual (occipital cortex); (2) it subsequently included a large parietal component; (3) it eventually became cortically diverse (frontal, parietal, temporal, and medial frontal regions); and (4) at the end, it demonstrated a strong frontal cortex weighting (frontal and motor regions). At each stage of knowledge, it was possible for a classifier to identify which one of four mechanical systems a participant was thinking about, based on their brain activation patterns. The progression of representational states was suggestive of progressive stages of learning: (1) encoding information from the display; (2) mental animation, possibly involving imagining the components moving; (3) generating causal hypotheses associated with mental animation; and finally (4) determining how a person (probably oneself) would interact with the system. This interpretation yields an initial, cortically-grounded, theory of learning of physical systems that potentially can be related to cognitive learning theories by suggesting links between cortical representations, stages of learning, and the understanding of simple systems. Copyright © 2015 Elsevier Inc. All rights reserved.

Multivoxel pattern similarity suggests the integration of temporal duration in hippocampal event sequence representations.

PubMed

Thavabalasingam, Sathesan; O'Neil, Edward B; Lee, Andy C H

2018-05-22

Recent rodent work suggests the hippocampus may provide a temporal representation of event sequences, in which the order of events and the interval durations between them are encoded. There is, however, limited human evidence for the latter, in particular whether the hippocampus processes duration information pertaining to the passage of time rather than qualitative or quantitative changes in event content. We scanned participants while they made match-mismatch judgements on each trial between a study sequence of events and a subsequent test sequence. Participants explicitly remembered event order or interval duration information (Experiment 1), or monitored order only, with duration being manipulated implicitly (Experiment 2). Hippocampal study-test pattern similarity was significantly reduced by changes to order or duration in mismatch trials, even when duration was processed implicitly. Our findings suggest the human hippocampus processes short intervals within sequences and support the idea that duration information is integrated into hippocampal mnemonic representations. Copyright © 2018 Elsevier Inc. All rights reserved.

Distributed Representation of Visual Objects by Single Neurons in the Human Brain

PubMed Central

Valdez, André B.; Papesh, Megan H.; Treiman, David M.; Smith, Kris A.; Goldinger, Stephen D.

2015-01-01

It remains unclear how single neurons in the human brain represent whole-object visual stimuli. While recordings in both human and nonhuman primates have shown distributed representations of objects (many neurons encoding multiple objects), recordings of single neurons in the human medial temporal lobe, taken as subjects' discriminated objects during multiple presentations, have shown gnostic representations (single neurons encoding one object). Because some studies suggest that repeated viewing may enhance neural selectivity for objects, we had human subjects discriminate objects in a single, more naturalistic viewing session. We found that, across 432 well isolated neurons recorded in the hippocampus and amygdala, the average fraction of objects encoded was 26%. We also found that more neurons encoded several objects versus only one object in the hippocampus (28 vs 18%, p < 0.001) and in the amygdala (30 vs 19%, p < 0.001). Thus, during realistic viewing experiences, typical neurons in the human medial temporal lobe code for a considerable range of objects, across multiple semantic categories. PMID:25834044

Attention during natural vision warps semantic representation across the human brain.

PubMed

Çukur, Tolga; Nishimoto, Shinji; Huth, Alexander G; Gallant, Jack L

2013-06-01

Little is known about how attention changes the cortical representation of sensory information in humans. On the basis of neurophysiological evidence, we hypothesized that attention causes tuning changes to expand the representation of attended stimuli at the cost of unattended stimuli. To investigate this issue, we used functional magnetic resonance imaging to measure how semantic representation changed during visual search for different object categories in natural movies. We found that many voxels across occipito-temporal and fronto-parietal cortex shifted their tuning toward the attended category. These tuning shifts expanded the representation of the attended category and of semantically related, but unattended, categories, and compressed the representation of categories that were semantically dissimilar to the target. Attentional warping of semantic representation occurred even when the attended category was not present in the movie; thus, the effect was not a target-detection artifact. These results suggest that attention dynamically alters visual representation to optimize processing of behaviorally relevant objects during natural vision.

Attention During Natural Vision Warps Semantic Representation Across the Human Brain

PubMed Central

Çukur, Tolga; Nishimoto, Shinji; Huth, Alexander G.; Gallant, Jack L.

2013-01-01

Little is known about how attention changes the cortical representation of sensory information in humans. Based on neurophysiological evidence, we hypothesized that attention causes tuning changes to expand the representation of attended stimuli at the cost of unattended stimuli. To investigate this issue we used functional MRI (fMRI) to measure how semantic representation changes when searching for different object categories in natural movies. We find that many voxels across occipito-temporal and fronto-parietal cortex shift their tuning toward the attended category. These tuning shifts expand the representation of the attended category and of semantically-related but unattended categories, and compress the representation of categories semantically-dissimilar to the target. Attentional warping of semantic representation occurs even when the attended category is not present in the movie, thus the effect is not a target-detection artifact. These results suggest that attention dynamically alters visual representation to optimize processing of behaviorally relevant objects during natural vision. PMID:23603707

Managing temporal relations

NASA Technical Reports Server (NTRS)

Britt, Daniel L.; Geoffroy, Amy L.; Gohring, John R.

1990-01-01

Various temporal constraints on the execution of activities are described, and their representation in the scheduling system MAESTRO is discussed. Initial examples are presented using a sample activity described. Those examples are expanded to include a second activity, and the types of temporal constraints that can obtain between two activities are explored. Soft constraints, or preferences, in activity placement are discussed. Multiple performances of activities are considered, with respect to both hard and soft constraints. The primary methods used in MAESTRO to handle temporal constraints are described as are certain aspects of contingency handling with respect to temporal constraints. A discussion of the overall approach, with indications of future directions for this research, concludes the study.

The Rhythm Aftereffect: Support for Time Sensitive Neurons with Broad Overlapping Tuning Curves

ERIC Educational Resources Information Center

Becker, Mark W.; Rasmussen, Ian P.

2007-01-01

Ivry [Ivry, R. B. (1996). The representation of temporal information in perception and motor control. Current Opinion in Neurobiology, 6, 851-857.] proposed that explicit coding of brief time intervals is accomplished by neurons that are tuned to a preferred temporal interval and have broad overlapping tuning curves. This proposal is analogous to…

The Representation of Information about Faces in the Temporal and Frontal Lobes

ERIC Educational Resources Information Center

Rolls, Edmund T.

2007-01-01

Neurophysiological evidence is described showing that some neurons in the macaque inferior temporal visual cortex have responses that are invariant with respect to the position, size and view of faces and objects, and that these neurons show rapid processing and rapid learning. Which face or object is present is encoded using a distributed…

Arrows of Time in Infancy: The Representation of Temporal-Causal Invariances

ERIC Educational Resources Information Center

Friedman, William J.

2002-01-01

Many transformations that take place over time can only occur in one temporal direction, and adults are highly sensitive to the differences between forward and backward presentations of such events. In seven experiments using two selective-looking paradigms, 4- and 8-month-olds were shown forward and backward videotapes of events involving the…

An Effect of Spatial-Temporal Association of Response Codes: Understanding the Cognitive Representations of Time

ERIC Educational Resources Information Center

Vallesi, Antonino; Binns, Malcolm A.; Shallice, Tim

2008-01-01

The present study addresses the question of how such an abstract concept as time is represented by our cognitive system. Specifically, the aim was to assess whether temporal information is cognitively represented through left-to-right spatial coordinates, as already shown for other ordered sequences (e.g., numbers). In Experiment 1, the…

"My Future Doesn't Know ME": Time and Subjectivity in Poetry by Young People

ERIC Educational Resources Information Center

Conrad, Rachel

2012-01-01

This article explores children's imaginative representations of time in relation to self-experience. Poems published in a young poets' anthology edited by Naomi Shihab Nye are analyzed in order to discern models of temporality and subjectivity imagined by young writers. A "dynamic temporality" is seen in a subset of poems which manipulate time…

Perceptual Learning of Intonation Contour Categories in Adults and 9- to 11-Year-Old Children: Adults Are More Narrow-Minded

ERIC Educational Resources Information Center

Kapatsinski, Vsevolod; Olejarczuk, Paul; Redford, Melissa A.

2017-01-01

We report on rapid perceptual learning of intonation contour categories in adults and 9- to 11-year-old children. Intonation contours are temporally extended patterns, whose perception requires temporal integration and therefore poses significant working memory challenges. Both children and adults form relatively abstract representations of…

Development of a MODIS-Derived Surface Albedo Data Set: An Improved Model Input for Processing the NSRDB

DOE Office of Scientific and Technical Information (OSTI.GOV)

Maclaurin, Galen; Sengupta, Manajit; Xie, Yu

A significant source of bias in the transposition of global horizontal irradiance to plane-of-array (POA) irradiance arises from inaccurate estimations of surface albedo. The current physics-based model used to produce the National Solar Radiation Database (NSRDB) relies on model estimations of surface albedo from a reanalysis climatalogy produced at relatively coarse spatial resolution compared to that of the NSRDB. As an input to spectral decomposition and transposition models, more accurate surface albedo data from remotely sensed imagery at finer spatial resolutions would improve accuracy in the final product. The National Renewable Energy Laboratory (NREL) developed an improved white-sky (bi-hemispherical reflectance)more » broadband (0.3-5.0 ..mu..m) surface albedo data set for processing the NSRDB from two existing data sets: a gap-filled albedo product and a daily snow cover product. The Moderate Resolution Imaging Spectroradiometer (MODIS) sensors onboard the Terra and Aqua satellites have provided high-quality measurements of surface albedo at 30 arc-second spatial resolution and 8-day temporal resolution since 2001. The high spatial and temporal resolutions and the temporal coverage of the MODIS sensor will allow for improved modeling of POA irradiance in the NSRDB. However, cloud and snow cover interfere with MODIS observations of ground surface albedo, and thus they require post-processing. The MODIS production team applied a gap-filling methodology to interpolate observations obscured by clouds or ephemeral snow. This approach filled pixels with ephemeral snow cover because the 8-day temporal resolution is too coarse to accurately capture the variability of snow cover and its impact on albedo estimates. However, for this project, accurate representation of daily snow cover change is important in producing the NSRDB. Therefore, NREL also used the Integrated Multisensor Snow and Ice Mapping System data set, which provides daily snow cover observations of the Northern Hemisphere for the temporal extent of the NSRDB (1998-2015). We provide a review of validation studies conducted on these two products and describe the methodology developed by NREL to remap the data products to the NSRDB grid and integrate them into a seamless daily data set.« less

Temporal context and the organisational impairment of memory search in schizophrenia.

PubMed

Polyn, Sean M; McCluey, Joshua D; Morton, Neal W; Woolard, Austin A; Luksik, Andrew S; Heckers, Stephan

2015-01-01

An influential theory of schizophrenic deficits in executive function suggests that patients have difficulty maintaining and utilising an internal contextual representation, whose function is to ensure that stimuli are processed in a task-appropriate manner. In basic research on episodic memory, retrieved-context theories propose that an internal contextual representation is critically involved in memory search, facilitating the retrieval of task-appropriate memories. This contextual machinery is thought to give rise to temporal organisation during free recall: the tendency for successive recall responses to correspond to items from nearby positions on the study list. If patients with schizophrenia have a generalised contextual deficit, then this leads to the prediction that these patients will exhibit reduced temporal organisation in free recall. Using a combination of classic and recently developed organisational measures, we characterised recall organisation in 75 patients with schizophrenia and 72 nondisordered control participants performing a multi-trial free-recall task. Patients with schizophrenia showed diminished temporal organisation, as well as diminished subjective organisation of their recall sequences relative to control participants. The two groups showed similar amounts of semantic organisation during recall. The observation of reduced temporal organisation in the patient group is consistent with the proposal that the memory deficit in schizophrenia can be characterised as a deficit in contextual processing.

Investigation on the dominant factors controlling the spatio-temporal distribution of soil moisture in experimental grasslands

NASA Astrophysics Data System (ADS)

Schwichtenberg, G.; Hildebrandt, A.; Samaniego-Eguiguren, L.; Kreutziger, Y.; Attinger, S.

2009-04-01

The spatio-temporal distribution of soil moisture in the unsaturated zone influences the vegetation growth, governs the runoff generation processes as well as the energy balance at the interface between biosphere and the atmosphere, by influencing evapotranspiration. A better understanding of the spatio-temporal variability and dependence of soil moisture on living versus abiotic environment would lead to an improved representation of the soil-vegetation-atmosphere processes in hydrological and climate models. The Jena Experiment site (Germany) was established October 2001 in order to analyse the interaction between plant diversity and ecosystem processes. The main experiment covers 92 plots of 20 x 20 m arranged into a grid, on which a mixture of up to 60 grassland species and of one to four plant functional groups have been seeded. Each of these plots is equipped with at least one measurement tube for soil moisture. Measurements have been conducted weekly for four growing seasons (SSF). Here, we use geostatistical methods, like variograms and multivariate regressions, to investigate in how far abiotic environment and ecosystem explain the spatial and temporal variation of soil moisture at the Jena Experiment site. We test the influence of the soil environment, biodiversity, leaf area index and groundwater table. The poster will present the results of this analysis.

Context aware decision support in neurosurgical oncology based on an efficient classification of endomicroscopic data.

PubMed

Li, Yachun; Charalampaki, Patra; Liu, Yong; Yang, Guang-Zhong; Giannarou, Stamatia

2018-06-13

Probe-based confocal laser endomicroscopy (pCLE) enables in vivo, in situ tissue characterisation without changes in the surgical setting and simplifies the oncological surgical workflow. The potential of this technique in identifying residual cancer tissue and improving resection rates of brain tumours has been recently verified in pilot studies. The interpretation of endomicroscopic information is challenging, particularly for surgeons who do not themselves routinely review histopathology. Also, the diagnosis can be examiner-dependent, leading to considerable inter-observer variability. Therefore, automatic tissue characterisation with pCLE would support the surgeon in establishing diagnosis as well as guide robot-assisted intervention procedures. The aim of this work is to propose a deep learning-based framework for brain tissue characterisation for context aware diagnosis support in neurosurgical oncology. An efficient representation of the context information of pCLE data is presented by exploring state-of-the-art CNN models with different tuning configurations. A novel video classification framework based on the combination of convolutional layers with long-range temporal recursion has been proposed to estimate the probability of each tumour class. The video classification accuracy is compared for different network architectures and data representation and video segmentation methods. We demonstrate the application of the proposed deep learning framework to classify Glioblastoma and Meningioma brain tumours based on endomicroscopic data. Results show significant improvement of our proposed image classification framework over state-of-the-art feature-based methods. The use of video data further improves the classification performance, achieving accuracy equal to 99.49%. This work demonstrates that deep learning can provide an efficient representation of pCLE data and accurately classify Glioblastoma and Meningioma tumours. The performance evaluation analysis shows the potential clinical value of the technique.

Temporalization of Electric Generation Emissions for Improved Representation of Peak Air Quality Episodes

NASA Astrophysics Data System (ADS)

Farkas, C. M.; Moeller, M.; Carlton, A. G.

2013-12-01

Photochemical transport models routinely under predict peak air quality events. This deficiency may be due, in part, to inadequate temporalization of emissions from the electric generating sector. The National Emissions Inventory (NEI) reports emissions from Electric Generating Units (EGUs) by either Continuous Emission Monitors (CEMs) that report hourly values or as an annual total. The Sparse Matrix Operator Kernel Emissions preprocessor (SMOKE), used to prepare emissions data for modeling with the CMAQ air quality model, allocates annual emission totals throughout the year using specific monthly, weekly, and hourly weights according to standard classification code (SCC) and location. This approach represents average diurnal and seasonal patterns of electricity generation but does not capture spikes in emissions due to episodic use as with peaking units or due to extreme weather events. In this project we use a combination of state air quality permits, CEM data, and EPA emission factors to more accurately temporalize emissions of NOx, SO2 and particulate matter (PM) during the extensive heat wave of July and August 2006. Two CMAQ simulations are conducted; the first with the base NEI emissions and the second with improved temporalization, more representative of actual emissions during the heat wave. Predictions from both simulations are evaluated with O3 and PM measurement data from EPA's National Air Monitoring Stations (NAMS) and State and Local Air Monitoring Stations (SLAMS) during the heat wave, for which ambient concentrations of criteria pollutants were often above NAAQS. During periods of increased photochemistry and high pollutant concentrations, it is critical that emissions are most accurately represented in air quality models.

Learning viewpoint invariant perceptual representations from cluttered images.

PubMed

Spratling, Michael W

2005-05-01

In order to perform object recognition, it is necessary to form perceptual representations that are sufficiently specific to distinguish between objects, but that are also sufficiently flexible to generalize across changes in location, rotation, and scale. A standard method for learning perceptual representations that are invariant to viewpoint is to form temporal associations across image sequences showing object transformations. However, this method requires that individual stimuli be presented in isolation and is therefore unlikely to succeed in real-world applications where multiple objects can co-occur in the visual input. This paper proposes a simple modification to the learning method that can overcome this limitation and results in more robust learning of invariant representations.

Neural correlates of auditory scene analysis and perception

PubMed Central

Cohen, Yale E.

2014-01-01

The auditory system is designed to transform acoustic information from low-level sensory representations into perceptual representations. These perceptual representations are the computational result of the auditory system's ability to group and segregate spectral, spatial and temporal regularities in the acoustic environment into stable perceptual units (i.e., sounds or auditory objects). Current evidence suggests that the cortex--specifically, the ventral auditory pathway--is responsible for the computations most closely related to perceptual representations. Here, we discuss how the transformations along the ventral auditory pathway relate to auditory percepts, with special attention paid to the processing of vocalizations and categorization, and explore recent models of how these areas may carry out these computations. PMID:24681354

Fractals, Fuzzy Sets And Image Representation

NASA Astrophysics Data System (ADS)

Dodds, D. R.

1988-10-01

This paper addresses some uses of fractals, fuzzy sets and image representation as it pertains to robotic grip planning and autonomous vehicle navigation AVN. The robot/vehicle is assumed to be equipped with multimodal sensors including ultrashort pulse imaging laser rangefinder. With a temporal resolution of 50 femtoseconds a time of flight laser rangefinder can resolve distances within approximately half an inch or 1.25 centimeters. (Fujimoto88)

The Long and the Short of It: On the Nature and Origin of Functional Overlap between Representations of Space and Time

ERIC Educational Resources Information Center

Srinivasan, Mahesh; Carey, Susan

2010-01-01

When we describe time, we often use the language of space ("The movie was long"; "The deadline is approaching"). Experiments 1-3 asked whether--as patterns in language suggest--a structural similarity between representations of spatial length and temporal duration is easier to access than one between length and other dimensions of experience, such…

Only time will tell - why temporal information is essential for our neuroscientific understanding of semantics.

PubMed

Hauk, Olaf

2016-08-01

Theoretical developments about the nature of semantic representations and processes should be accompanied by a discussion of how these theories can be validated on the basis of empirical data. Here, I elaborate on the link between theory and empirical research, highlighting the need for temporal information in order to distinguish fundamental aspects of semantics. The generic point that fast cognitive processes demand fast measurement techniques has been made many times before, although arguably more often in the psychophysiological community than in the metabolic neuroimaging community. Many reviews on the neuroscience of semantics mostly or even exclusively focus on metabolic neuroimaging data. Following an analysis of semantics in terms of the representations and processes involved, I argue that fundamental theoretical debates about the neuroscience of semantics can only be concluded on the basis of data with sufficient temporal resolution. Any "semantic effect" may result from a conflation of long-term memory representations, retrieval and working memory processes, mental imagery, and episodic memory. This poses challenges for all neuroimaging modalities, but especially for those with low temporal resolution. It also throws doubt on the usefulness of contrasts between meaningful and meaningless stimuli, which may differ on a number of semantic and non-semantic dimensions. I will discuss the consequences of this analysis for research on the role of convergence zones or hubs and distributed modal brain networks, top-down modulation of task and context as well as interactivity between levels of the processing hierarchy, for example in the framework of predictive coding.

Spatio-temporal dynamics of processing non-symbolic number: An ERP source localization study

PubMed Central

Hyde, Daniel C.; Spelke, Elizabeth S.

2013-01-01

Coordinated studies with adults, infants, and nonhuman animals provide evidence for two distinct systems of non-verbal number representation. The ‘parallel individuation’ system selects and retains information about 1–3 individual entities and the ‘numerical magnitude’ system establishes representations of the approximate cardinal value of a group. Recent ERP work has demonstrated that these systems reliably evoke functionally and temporally distinct patterns of brain response that correspond to established behavioral signatures. However, relatively little is known about the neural generators of these ERP signatures. To address this question, we targeted known ERP signatures of these systems, by contrasting processing of small versus large non-symbolic numbers, and used a source localization algorithm (LORETA) to identify their cortical origins. Early processing of small numbers, showing the signature effects of parallel individuation on the N1 (∼150 ms), was localized primarily to extrastriate visual regions. In contrast, qualitatively and temporally distinct processing of large numbers, showing the signatures of approximate number representation on the mid-latency P2p (∼200–250 ms), was localized primarily to right intraparietal regions. In comparison, mid-latency small number processing was localized to the right temporal-parietal junction and left-lateralized intraparietal regions. These results add spatial information to the emerging ERP literature documenting the process by which we represent number. Furthermore, these results substantiate recent claims that early attentional processes determine whether a collection of objects will be represented through parallel individuation or as an approximate numerical magnitude by providing evidence that downstream processing diverges to distinct cortical regions. PMID:21830257

Brain reflections: A circuit-based framework for understanding information processing and cognitive control.

PubMed

Gratton, Gabriele

2018-03-01

Here, I propose a view of the architecture of the human information processing system, and of how it can be adapted to changing task demands (which is the hallmark of cognitive control). This view is informed by an interpretation of brain activity as reflecting the excitability level of neural representations, encoding not only stimuli and temporal contexts, but also action plans and task goals. The proposed cognitive architecture includes three types of circuits: open circuits, involved in feed-forward processing such as that connecting stimuli with responses and characterized by brief, transient brain activity; and two types of closed circuits, positive feedback circuits (characterized by sustained, high-frequency oscillatory activity), which help select and maintain representations, and negative feedback circuits (characterized by brief, low-frequency oscillatory bursts), which are instead associated with changes in representations. Feed-forward activity is primarily responsible for the spread of activation along the information processing system. Oscillatory activity, instead, controls this spread. Sustained oscillatory activity due to both local cortical circuits (gamma) and longer corticothalamic circuits (alpha and beta) allows for the selection of individuated representations. Through the interaction of these circuits, it also allows for the preservation of representations across different temporal spans (sensory and working memory) and their spread across the brain. In contrast, brief bursts of oscillatory activity, generated by novel and/or conflicting information, lead to the interruption of sustained oscillatory activity and promote the generation of new representations. I discuss how this framework can account for a number of psychological and behavioral phenomena. © 2017 Society for Psychophysiological Research.

Innovations in individual feature history management - The significance of feature-based temporal model

USGS Publications Warehouse

Choi, J.; Seong, J.C.; Kim, B.; Usery, E.L.

2008-01-01

A feature relies on three dimensions (space, theme, and time) for its representation. Even though spatiotemporal models have been proposed, they have principally focused on the spatial changes of a feature. In this paper, a feature-based temporal model is proposed to represent the changes of both space and theme independently. The proposed model modifies the ISO's temporal schema and adds new explicit temporal relationship structure that stores temporal topological relationship with the ISO's temporal primitives of a feature in order to keep track feature history. The explicit temporal relationship can enhance query performance on feature history by removing topological comparison during query process. Further, a prototype system has been developed to test a proposed feature-based temporal model by querying land parcel history in Athens, Georgia. The result of temporal query on individual feature history shows the efficiency of the explicit temporal relationship structure. ?? Springer Science+Business Media, LLC 2007.

Temporal resolution for the perception of features and conjunctions.

PubMed

Bodelón, Clara; Fallah, Mazyar; Reynolds, John H

2007-01-24

The visual system decomposes stimuli into their constituent features, represented by neurons with different feature selectivities. How the signals carried by these feature-selective neurons are integrated into coherent object representations is unknown. To constrain the set of possible integrative mechanisms, we quantified the temporal resolution of perception for color, orientation, and conjunctions of these two features. We find that temporal resolution is measurably higher for each feature than for their conjunction, indicating that time is required to integrate features into a perceptual whole. This finding places temporal limits on the mechanisms that could mediate this form of perceptual integration.

An event map of memory space in the hippocampus

PubMed Central

Deuker, Lorena; Bellmund, Jacob LS; Navarro Schröder, Tobias; Doeller, Christian F

2016-01-01

The hippocampus has long been implicated in both episodic and spatial memory, however these mnemonic functions have been traditionally investigated in separate research strands. Theoretical accounts and rodent data suggest a common mechanism for spatial and episodic memory in the hippocampus by providing an abstract and flexible representation of the external world. Here, we monitor the de novo formation of such a representation of space and time in humans using fMRI. After learning spatio-temporal trajectories in a large-scale virtual city, subject-specific neural similarity in the hippocampus scaled with the remembered proximity of events in space and time. Crucially, the structure of the entire spatio-temporal network was reflected in neural patterns. Our results provide evidence for a common coding mechanism underlying spatial and temporal aspects of episodic memory in the hippocampus and shed new light on its role in interleaving multiple episodes in a neural event map of memory space. DOI: http://dx.doi.org/10.7554/eLife.16534.001 PMID:27710766

Time-Frequency Approach for Stochastic Signal Detection

DOE Office of Scientific and Technical Information (OSTI.GOV)

Ghosh, Ripul; Akula, Aparna; Kumar, Satish

2011-10-20

The detection of events in a stochastic signal has been a subject of great interest. One of the oldest signal processing technique, Fourier Transform of a signal contains information regarding frequency content, but it cannot resolve the exact onset of changes in the frequency, all temporal information is contained in the phase of the transform. On the other hand, Spectrogram is better able to resolve temporal evolution of frequency content, but has a trade-off in time resolution versus frequency resolution in accordance with the uncertainty principle. Therefore, time-frequency representations are considered for energetic characterisation of the non-stationary signals. Wigner Villemore » Distribution (WVD) is the most prominent quadratic time-frequency signal representation and used for analysing frequency variations in signals.WVD allows for instantaneous frequency estimation at each data point, for a typical temporal resolution of fractions of a second. This paper through simulations describes the way time frequency models are applied for the detection of event in a stochastic signal.« less

Time-Frequency Approach for Stochastic Signal Detection

NASA Astrophysics Data System (ADS)

Ghosh, Ripul; Akula, Aparna; Kumar, Satish; Sardana, H. K.

2011-10-01

The detection of events in a stochastic signal has been a subject of great interest. One of the oldest signal processing technique, Fourier Transform of a signal contains information regarding frequency content, but it cannot resolve the exact onset of changes in the frequency, all temporal information is contained in the phase of the transform. On the other hand, Spectrogram is better able to resolve temporal evolution of frequency content, but has a trade-off in time resolution versus frequency resolution in accordance with the uncertainty principle. Therefore, time-frequency representations are considered for energetic characterisation of the non-stationary signals. Wigner Ville Distribution (WVD) is the most prominent quadratic time-frequency signal representation and used for analysing frequency variations in signals.WVD allows for instantaneous frequency estimation at each data point, for a typical temporal resolution of fractions of a second. This paper through simulations describes the way time frequency models are applied for the detection of event in a stochastic signal.

Emergence of an abstract categorical code enabling the discrimination of temporally structured tactile stimuli

PubMed Central

Rossi-Pool, Román; Salinas, Emilio; Zainos, Antonio; Alvarez, Manuel; Vergara, José; Parga, Néstor; Romo, Ranulfo

2016-01-01

The problem of neural coding in perceptual decision making revolves around two fundamental questions: (i) How are the neural representations of sensory stimuli related to perception, and (ii) what attributes of these neural responses are relevant for downstream networks, and how do they influence decision making? We studied these two questions by recording neurons in primary somatosensory (S1) and dorsal premotor (DPC) cortex while trained monkeys reported whether the temporal pattern structure of two sequential vibrotactile stimuli (of equal mean frequency) was the same or different. We found that S1 neurons coded the temporal patterns in a literal way and only during the stimulation periods and did not reflect the monkeys’ decisions. In contrast, DPC neurons coded the stimulus patterns as broader categories and signaled them during the working memory, comparison, and decision periods. These results show that the initial sensory representation is transformed into an intermediate, more abstract categorical code that combines past and present information to ultimately generate a perceptually informed choice. PMID:27872293

Associative-memory representations emerge as shared spatial patterns of theta activity spanning the primate temporal cortex

PubMed Central

Nakahara, Kiyoshi; Adachi, Ken; Kawasaki, Keisuke; Matsuo, Takeshi; Sawahata, Hirohito; Majima, Kei; Takeda, Masaki; Sugiyama, Sayaka; Nakata, Ryota; Iijima, Atsuhiko; Tanigawa, Hisashi; Suzuki, Takafumi; Kamitani, Yukiyasu; Hasegawa, Isao

2016-01-01

Highly localized neuronal spikes in primate temporal cortex can encode associative memory; however, whether memory formation involves area-wide reorganization of ensemble activity, which often accompanies rhythmicity, or just local microcircuit-level plasticity, remains elusive. Using high-density electrocorticography, we capture local-field potentials spanning the monkey temporal lobes, and show that the visual pair-association (PA) memory is encoded in spatial patterns of theta activity in areas TE, 36, and, partially, in the parahippocampal cortex, but not in the entorhinal cortex. The theta patterns elicited by learned paired associates are distinct between pairs, but similar within pairs. This pattern similarity, emerging through novel PA learning, allows a machine-learning decoder trained on theta patterns elicited by a particular visual item to correctly predict the identity of those elicited by its paired associate. Our results suggest that the formation and sharing of widespread cortical theta patterns via learning-induced reorganization are involved in the mechanisms of associative memory representation. PMID:27282247

Contributions of local speech encoding and functional connectivity to audio-visual speech perception

PubMed Central

Giordano, Bruno L; Ince, Robin A A; Gross, Joachim; Schyns, Philippe G; Panzeri, Stefano; Kayser, Christoph

2017-01-01

Seeing a speaker’s face enhances speech intelligibility in adverse environments. We investigated the underlying network mechanisms by quantifying local speech representations and directed connectivity in MEG data obtained while human participants listened to speech of varying acoustic SNR and visual context. During high acoustic SNR speech encoding by temporally entrained brain activity was strong in temporal and inferior frontal cortex, while during low SNR strong entrainment emerged in premotor and superior frontal cortex. These changes in local encoding were accompanied by changes in directed connectivity along the ventral stream and the auditory-premotor axis. Importantly, the behavioral benefit arising from seeing the speaker’s face was not predicted by changes in local encoding but rather by enhanced functional connectivity between temporal and inferior frontal cortex. Our results demonstrate a role of auditory-frontal interactions in visual speech representations and suggest that functional connectivity along the ventral pathway facilitates speech comprehension in multisensory environments. DOI: http://dx.doi.org/10.7554/eLife.24763.001 PMID:28590903

High-resolution Temporal Representations of Alcohol and Tobacco Behaviors from Social Media Data

PubMed Central

Huang, Tom; Elghafari, Anas; Relia, Kunal; Chunara, Rumi

2017-01-01

Understanding tobacco- and alcohol-related behavioral patterns is critical for uncovering risk factors and potentially designing targeted social computing intervention systems. Given that we make choices multiple times per day, hourly and daily patterns are critical for better understanding behaviors. Here, we combine natural language processing, machine learning and time series analyses to assess Twitter activity specifically related to alcohol and tobacco consumption and their sub-daily, daily and weekly cycles. Twitter self-reports of alcohol and tobacco use are compared to other data streams available at similar temporal resolution. We assess if discussion of drinking by inferred underage versus legal age people or discussion of use of different types of tobacco products can be differentiated using these temporal patterns. We find that time and frequency domain representations of behaviors on social media can provide meaningful and unique insights, and we discuss the types of behaviors for which the approach may be most useful. PMID:29264592

Low-Dose Dynamic Cerebral Perfusion Computed Tomography Reconstruction via Kronecker-Basis Representation Tensor Sparsity Regularization

PubMed Central

Zeng, Dong; Xie, Qi; Cao, Wenfei; Lin, Jiahui; Zhang, Hao; Zhang, Shanli; Huang, Jing; Bian, Zhaoying; Meng, Deyu; Xu, Zongben; Liang, Zhengrong; Chen, Wufan

2017-01-01

Dynamic cerebral perfusion computed tomography (DCPCT) has the ability to evaluate the hemodynamic information throughout the brain. However, due to multiple 3-D image volume acquisitions protocol, DCPCT scanning imposes high radiation dose on the patients with growing concerns. To address this issue, in this paper, based on the robust principal component analysis (RPCA, or equivalently the low-rank and sparsity decomposition) model and the DCPCT imaging procedure, we propose a new DCPCT image reconstruction algorithm to improve low dose DCPCT and perfusion maps quality via using a powerful measure, called Kronecker-basis-representation tensor sparsity regularization, for measuring low-rankness extent of a tensor. For simplicity, the first proposed model is termed tensor-based RPCA (T-RPCA). Specifically, the T-RPCA model views the DCPCT sequential images as a mixture of low-rank, sparse, and noise components to describe the maximum temporal coherence of spatial structure among phases in a tensor framework intrinsically. Moreover, the low-rank component corresponds to the “background” part with spatial–temporal correlations, e.g., static anatomical contribution, which is stationary over time about structure, and the sparse component represents the time-varying component with spatial–temporal continuity, e.g., dynamic perfusion enhanced information, which is approximately sparse over time. Furthermore, an improved nonlocal patch-based T-RPCA (NL-T-RPCA) model which describes the 3-D block groups of the “background” in a tensor is also proposed. The NL-T-RPCA model utilizes the intrinsic characteristics underlying the DCPCT images, i.e., nonlocal self-similarity and global correlation. Two efficient algorithms using alternating direction method of multipliers are developed to solve the proposed T-RPCA and NL-T-RPCA models, respectively. Extensive experiments with a digital brain perfusion phantom, preclinical monkey data, and clinical patient data clearly demonstrate that the two proposed models can achieve more gains than the existing popular algorithms in terms of both quantitative and visual quality evaluations from low-dose acquisitions, especially as low as 20 mAs. PMID:28880164

The Effect of 3D Virtual Reality on Sequential Time Perception among Deaf and Hard-of-Hearing Children

ERIC Educational Resources Information Center

Eden, Sigal

2008-01-01

Over the years deaf and hard-of-hearing children have been reported as having difficulty with time conception and, in particular, the proper arrangement of events in a logical, temporal order. The research examined whether deaf and hard-of-hearing children perceive a temporal sequence differently under different representational modes. We compared…

The timing of anterior temporal lobe involvement in semantic processing.

PubMed

Jackson, Rebecca L; Lambon Ralph, Matthew A; Pobric, Gorana

2015-07-01

Despite indications that regions within the anterior temporal lobe (ATL) might make a crucial contribution to pan-modal semantic representation, to date there have been no investigations of when during semantic processing the ATL plays a critical role. To test the timing of the ATL involvement in semantic processing, we studied the effect of double-pulse TMS on behavioral responses in semantic and difficulty-matched control tasks. Chronometric TMS was delivered over the left ATL (10 mm from the tip of the temporal pole along the middle temporal gyrus). During each trial, two pulses of TMS (40 msec apart) were delivered either at baseline (before stimulus presentation) or at one of the experimental time points 100, 250, 400, and 800 msec poststimulus onset. A significant disruption to performance was identified from 400 msec on the semantic task but not on the control assessment. Our results not only reinforce the key role of the left ATL in semantic representation but also indicate that its contribution is especially important around 400 msec poststimulus onset. Together, these facts suggest that the ATL may be one of the neural sources of the N400 ERP component.

Processing of spectral and amplitude envelope of animal vocalizations in the human auditory cortex.

PubMed

Altmann, Christian F; Gomes de Oliveira Júnior, Cícero; Heinemann, Linda; Kaiser, Jochen

2010-08-01

In daily life, we usually identify sounds effortlessly and efficiently. Two properties are particularly salient and of importance for sound identification: the sound's overall spectral envelope and its temporal amplitude envelope. In this study, we aimed at investigating the representation of these two features in the human auditory cortex by using a functional magnetic resonance imaging adaptation paradigm. We presented pairs of sound stimuli derived from animal vocalizations that preserved the time-averaged frequency spectrum of the animal vocalizations and the amplitude envelope. We presented the pairs in four different conditions: (a) pairs with the same amplitude envelope and mean spectral envelope, (b) same amplitude envelope, but different mean spectral envelope, (c) different amplitude envelope, but same mean spectral envelope and (d) both different amplitude envelope and mean spectral envelope. We found fMRI adaptation effects for both the mean spectral envelope and the amplitude envelope of animal vocalizations in overlapping cortical areas in the bilateral superior temporal gyrus posterior to Heschl's gyrus. Areas sensitive to the amplitude envelope extended further anteriorly along the lateral superior temporal gyrus in the left hemisphere, while areas sensitive to the spectral envelope extended further anteriorly along the right lateral superior temporal gyrus. Posterior tonotopic areas within the left superior temporal lobe displayed sensitivity for the mean spectrum. Our findings suggest involvement of primary auditory areas in the representation of spectral cues and encoding of general spectro-temporal features of natural sounds in non-primary posterior and lateral superior temporal cortex. Copyright (c) 2010 Elsevier Ltd. All rights reserved.

How Fast Do Objects Fall in Visual Memory? Uncovering the Temporal and Spatial Features of Representational Gravity

PubMed Central

De Sá Teixeira, Nuno

2016-01-01

Visual memory for the spatial location where a moving target vanishes has been found to be systematically displaced downward in the direction of gravity. Moreover, it was recently reported that the magnitude of the downward error increases steadily with increasing retention intervals imposed after object’s offset and before observers are allowed to perform the spatial localization task, in a pattern where the remembered vanishing location drifts downward as if following a falling trajectory. This outcome was taken to reflect the dynamics of a representational model of earth’s gravity. The present study aims to establish the spatial and temporal features of this downward drift by taking into account the dynamics of the motor response. The obtained results show that the memory for the last location of the target drifts downward with time, thus replicating previous results. Moreover, the time taken for completion of the behavioural localization movements seems to add to the imposed retention intervals in determining the temporal frame during which the visual memory is updated. Overall, it is reported that the representation of spatial location drifts downward by about 3 pixels for each two-fold increase of time until response. The outcomes are discussed in relation to a predictive internal model of gravity which outputs an on-line spatial update of remembered objects’ location. PMID:26910260

Combinatorial semantics strengthens angular-anterior temporal coupling.

PubMed

Molinaro, Nicola; Paz-Alonso, Pedro M; Duñabeitia, Jon Andoni; Carreiras, Manuel

2015-04-01

The human semantic combinatorial system allows us to create a wide number of new meanings from a finite number of existing representations. The present study investigates the neural dynamics underlying the semantic processing of different conceptual constructions based on predictions from previous neuroanatomical models of the semantic processing network. In two experiments, participants read sentences for comprehension containing noun-adjective pairs in three different conditions: prototypical (Redundant), nonsense (Anomalous) and low-typical but composable (Contrastive). In Experiment 1 we examined the processing costs associated to reading these sentences and found a processing dissociation between Anomalous and Contrastive word pairs, compared to prototypical (Redundant) stimuli. In Experiment 2, functional connectivity results showed strong co-activation across conditions between inferior frontal gyrus (IFG) and posterior middle temporal gyrus (MTG), as well as between these two regions and middle frontal gyrus (MFG), anterior temporal cortex (ATC) and fusiform gyrus (FG), consistent with previous neuroanatomical models. Importantly, processing of low-typical (but composable) meanings relative to prototypical and anomalous constructions was associated with a stronger positive coupling between ATC and angular gyrus (AG). Our results underscore the critical role of IFG-MTG co-activation during semantic processing and how other relevant nodes within the semantic processing network come into play to handle visual-orthographic information, to maintain multiple lexical-semantic representations in working memory and to combine existing representations while creatively constructing meaning. Copyright © 2015 Elsevier Ltd. All rights reserved.

How Fast Do Objects Fall in Visual Memory? Uncovering the Temporal and Spatial Features of Representational Gravity.

PubMed

De Sá Teixeira, Nuno

2016-01-01

Visual memory for the spatial location where a moving target vanishes has been found to be systematically displaced downward in the direction of gravity. Moreover, it was recently reported that the magnitude of the downward error increases steadily with increasing retention intervals imposed after object's offset and before observers are allowed to perform the spatial localization task, in a pattern where the remembered vanishing location drifts downward as if following a falling trajectory. This outcome was taken to reflect the dynamics of a representational model of earth's gravity. The present study aims to establish the spatial and temporal features of this downward drift by taking into account the dynamics of the motor response. The obtained results show that the memory for the last location of the target drifts downward with time, thus replicating previous results. Moreover, the time taken for completion of the behavioural localization movements seems to add to the imposed retention intervals in determining the temporal frame during which the visual memory is updated. Overall, it is reported that the representation of spatial location drifts downward by about 3 pixels for each two-fold increase of time until response. The outcomes are discussed in relation to a predictive internal model of gravity which outputs an on-line spatial update of remembered objects' location.

Simple determinant representation for rogue waves of the nonlinear Schrödinger equation.

PubMed

Ling, Liming; Zhao, Li-Chen

2013-10-01

We present a simple representation for arbitrary-order rogue wave solution and a study on the trajectories of them explicitly. We find that the trajectories of two valleys on whole temporal-spatial distribution all look "X" -shaped for rogue waves. Additionally, we present different types of high-order rogue wave structures, which could be helpful towards realizing the complex dynamics of rogue waves.

Mapping the unconscious maintenance of a lost first language.

PubMed

Pierce, Lara J; Klein, Denise; Chen, Jen-Kai; Delcenserie, Audrey; Genesee, Fred

2014-12-02

Optimal periods during early development facilitate the formation of perceptual representations, laying the framework for future learning. A crucial question is whether such early representations are maintained in the brain over time without continued input. Using functional MRI, we show that internationally adopted (IA) children from China, exposed exclusively to French since adoption (mean age of adoption, 12.8 mo), maintained neural representations of their birth language despite functionally losing that language and having no conscious recollection of it. Their neural patterns during a Chinese lexical tone discrimination task matched those observed in Chinese/French bilinguals who have had continual exposure to Chinese since birth and differed from monolingual French speakers who had never been exposed to Chinese. They processed lexical tone as linguistically relevant, despite having no Chinese exposure for 12.6 y, on average, and no conscious recollection of that language. More specifically, IA participants recruited left superior temporal gyrus/planum temporale, matching the pattern observed in Chinese/French bilinguals. In contrast, French speakers who had never been exposed to Chinese did not recruit this region and instead activated right superior temporal gyrus. We show that neural representations are not overwritten and suggest a special status for language input obtained during the first year of development.

Progressive Dictionary Learning with Hierarchical Predictive Structure for Scalable Video Coding.

PubMed

Dai, Wenrui; Shen, Yangmei; Xiong, Hongkai; Jiang, Xiaoqian; Zou, Junni; Taubman, David

2017-04-12

Dictionary learning has emerged as a promising alternative to the conventional hybrid coding framework. However, the rigid structure of sequential training and prediction degrades its performance in scalable video coding. This paper proposes a progressive dictionary learning framework with hierarchical predictive structure for scalable video coding, especially in low bitrate region. For pyramidal layers, sparse representation based on spatio-temporal dictionary is adopted to improve the coding efficiency of enhancement layers (ELs) with a guarantee of reconstruction performance. The overcomplete dictionary is trained to adaptively capture local structures along motion trajectories as well as exploit the correlations between neighboring layers of resolutions. Furthermore, progressive dictionary learning is developed to enable the scalability in temporal domain and restrict the error propagation in a close-loop predictor. Under the hierarchical predictive structure, online learning is leveraged to guarantee the training and prediction performance with an improved convergence rate. To accommodate with the stateof- the-art scalable extension of H.264/AVC and latest HEVC, standardized codec cores are utilized to encode the base and enhancement layers. Experimental results show that the proposed method outperforms the latest SHVC and HEVC simulcast over extensive test sequences with various resolutions.

Oligomer formation in the troposphere: from experimental knowledge to 3-D modeling

NASA Astrophysics Data System (ADS)

Lemaire, V.; Coll, I.; Couvidat, F.; Mouchel-Vallon, C.; Seigneur, C.; Siour, G.

2015-10-01

The organic fraction of atmospheric aerosols has proven to be a critical element of air quality and climate issues. However, its composition and the aging processes it undergoes remain insufficiently understood. This work builds on laboratory knowledge to simulate the formation of oligomers from biogenic secondary organic aerosol (BSOA) in the troposphere at the continental scale. We compare the results of two different modeling approaches, a 1st-order kinetic process and a pH-dependent parameterization, both implemented in the CHIMERE air quality model (AQM), to simulate the spatial and temporal distribution of oligomerized SOA over western Europe. Our results show that there is a strong dependence of the results on the selected modeling approach: while the irreversible kinetic process leads to the oligomerization of about 50 % of the total BSOA mass, the pH-dependent approach shows a broader range of impacts, with a strong dependency on environmental parameters (pH and nature of aerosol) and the possibility for the process to be reversible. In parallel, we investigated the sensitivity of each modeling approach to the representation of SOA precursor solubility (Henry's law constant values). Finally, the pros and cons of each approach for the representation of SOA aging are discussed and recommendations are provided to improve current representations of oligomer formation in AQMs.

First-pass selectivity for semantic categories in human anteroventral temporal lobe

PubMed Central

Chan, Alexander M.; Baker, Janet M.; Eskandar, Emad; Schomer, Donald; Ulbert, Istvan; Marinkovic, Ksenija; Cash, Sydney S.; Halgren, Eric

2012-01-01

How the brain encodes the semantic concepts represented by words is a fundamental question in cognitive neuroscience. Hemodynamic neuroimaging studies have robustly shown that different areas of posteroventral temporal lobe are selectively activated by images of animals versus manmade objects. Selective responses in these areas to words representing animals versus objects are sometimes also seen, but they are task-dependent, suggesting that posteroventral temporal cortex may encode visual categories, while more anterior areas encode semantic categories. Here, using the spatiotemporal resolution provided by intracranial macroelectrode and microelectrode arrays, we report category-selective responses to words representing animals and objects in human anteroventral temporal areas including inferotemporal, perirhinal and entorhinal cortices. This selectivity generalizes across tasks and sensory modalities, suggesting that it represents abstract lexico-semantic categories. Significant category-specific responses are found in measures sensitive to synaptic activity (local field potentials, high gamma power, current sources and sinks) and unit-firing (multi- and single-unit activity). Category-selective responses can occur at short latency, as early as 130ms, in middle cortical layers and thus are extracted in the first-pass of activity through the anteroventral temporal lobe. This activation may provide input to posterior areas for iconic representations when required by the task, as well as to the hippocampal formation for categorical encoding and retrieval of memories, and to the amygdala for emotional associations. More generally, these results support models in which the anteroventral temporal lobe plays a primary role in the semantic representation of words. PMID:22159123

Eye movement-invariant representations in the human visual system.

PubMed

Nishimoto, Shinji; Huth, Alexander G; Bilenko, Natalia Y; Gallant, Jack L

2017-01-01

During natural vision, humans make frequent eye movements but perceive a stable visual world. It is therefore likely that the human visual system contains representations of the visual world that are invariant to eye movements. Here we present an experiment designed to identify visual areas that might contain eye-movement-invariant representations. We used functional MRI to record brain activity from four human subjects who watched natural movies. In one condition subjects were required to fixate steadily, and in the other they were allowed to freely make voluntary eye movements. The movies used in each condition were identical. We reasoned that the brain activity recorded in a visual area that is invariant to eye movement should be similar under fixation and free viewing conditions. In contrast, activity in a visual area that is sensitive to eye movement should differ between fixation and free viewing. We therefore measured the similarity of brain activity across repeated presentations of the same movie within the fixation condition, and separately between the fixation and free viewing conditions. The ratio of these measures was used to determine which brain areas are most likely to contain eye movement-invariant representations. We found that voxels located in early visual areas are strongly affected by eye movements, while voxels in ventral temporal areas are only weakly affected by eye movements. These results suggest that the ventral temporal visual areas contain a stable representation of the visual world that is invariant to eye movements made during natural vision.

Temporal cognition: Connecting subjective time to perception, attention, and memory.

PubMed

Matthews, William J; Meck, Warren H

2016-08-01

Time is a universal psychological dimension, but time perception has often been studied and discussed in relative isolation. Increasingly, researchers are searching for unifying principles and integrated models that link time perception to other domains. In this review, we survey the links between temporal cognition and other psychological processes. Specifically, we describe how subjective duration is affected by nontemporal stimulus properties (perception), the allocation of processing resources (attention), and past experience with the stimulus (memory). We show that many of these connections instantiate a "processing principle," according to which perceived time is positively related to perceptual vividity and the ease of extracting information from the stimulus. This empirical generalization generates testable predictions and provides a starting-point for integrated theoretical frameworks. By outlining some of the links between temporal cognition and other domains, and by providing a unifying principle for understanding these effects, we hope to encourage time-perception researchers to situate their work within broader theoretical frameworks, and that researchers from other fields will be inspired to apply their insights, techniques, and theorizing to improve our understanding of the representation and judgment of time. (PsycINFO Database Record (c) 2016 APA, all rights reserved).

Climatology of convective showers dynamics in a convection-permitting model

NASA Astrophysics Data System (ADS)

Brisson, Erwan; Brendel, Christoph; Ahrens, Bodo

2017-04-01

Convection-permitting simulations have proven their usefulness in improving both the representation of convective rain and the uncertainty range of climate projections. However, most studies have focused on temporal scales greater or equal to convection cell lifetime. A large knowledge gap remains on the model's performance in representing the temporal dynamic of convective showers and how could this temporal dynamic be altered in a warmer climate. In this study, we proposed to fill this gap by analyzing 5-minute convection-permitting model (CPM) outputs. In total, more than 1200 one-day cases are simulated at the resolution of 0.01° using the regional climate model COSMO-CLM over central Europe. The analysis follows a Lagrangian approach and consists of tracking showers characterized by five-minute intensities greater than 20 mm/hour. The different features of these showers (e.g., temporal evolution, horizontal speed, lifetime) are investigated. These features as modeled by an ERA-Interim forced simulation are evaluated using a radar dataset for the period 2004-2010. The model shows good performance in representing most features observed in the radar dataset. Besides, the observed relation between the temporal evolution of precipitation and temperature are well reproduced by the CPM. In a second modeling experiment, the impact of climate change on convective cell features are analyzed based on an EC-Earth RCP8.5 forced simulation for the period 2071-2100. First results show only minor changes in the temporal structure and size of showers. The increase in convective precipitation found in previous studies seems to be mainly due to an increase in the number of convective cells.

Anterior temporal lobes mediate semantic representation: Mimicking semantic dementia by using rTMS in normal participants

PubMed Central

Pobric, Gorana; Jefferies, Elizabeth; Ralph, Matthew A. Lambon

2007-01-01

Studies of semantic dementia and PET neuroimaging investigations suggest that the anterior temporal lobes (ATL) are a critical substrate for semantic representation. In stark contrast, classical neurological models of comprehension do not include ATL, and likewise functional MRI studies often fail to show activations in the ATL, reinforcing the classical view. Using a novel application of low-frequency, repetitive transcranial magnetic stimulation (rTMS) over the ATL, we demonstrate that the behavioral pattern of semantic dementia can be mirrored in neurologically intact participants: Specifically, we show that temporary disruption to neural processing in the ATL produces a selective semantic impairment leading to significant slowing in both picture naming and word comprehension but not to other equally demanding, nonsemantic cognitive tasks. PMID:18056637

Complex-valued time-series correlation increases sensitivity in FMRI analysis.

PubMed

Kociuba, Mary C; Rowe, Daniel B

2016-07-01

To develop a linear matrix representation of correlation between complex-valued (CV) time-series in the temporal Fourier frequency domain, and demonstrate its increased sensitivity over correlation between magnitude-only (MO) time-series in functional MRI (fMRI) analysis. The standard in fMRI is to discard the phase before the statistical analysis of the data, despite evidence of task related change in the phase time-series. With a real-valued isomorphism representation of Fourier reconstruction, correlation is computed in the temporal frequency domain with CV time-series data, rather than with the standard of MO data. A MATLAB simulation compares the Fisher-z transform of MO and CV correlations for varying degrees of task related magnitude and phase amplitude change in the time-series. The increased sensitivity of the complex-valued Fourier representation of correlation is also demonstrated with experimental human data. Since the correlation description in the temporal frequency domain is represented as a summation of second order temporal frequencies, the correlation is easily divided into experimentally relevant frequency bands for each voxel's temporal frequency spectrum. The MO and CV correlations for the experimental human data are analyzed for four voxels of interest (VOIs) to show the framework with high and low contrast-to-noise ratios in the motor cortex and the supplementary motor cortex. The simulation demonstrates the increased strength of CV correlations over MO correlations for low magnitude contrast-to-noise time-series. In the experimental human data, the MO correlation maps are noisier than the CV maps, and it is more difficult to distinguish the motor cortex in the MO correlation maps after spatial processing. Including both magnitude and phase in the spatial correlation computations more accurately defines the correlated left and right motor cortices. Sensitivity in correlation analysis is important to preserve the signal of interest in fMRI data sets with high noise variance, and avoid excessive processing induced correlation. Copyright © 2016 Elsevier Inc. All rights reserved.

Hydrological Validation of The Lpj Dynamic Global Vegetation Model - First Results and Required Actions

NASA Astrophysics Data System (ADS)

Haberlandt, U.; Gerten, D.; Schaphoff, S.; Lucht, W.

Dynamic global vegetation models are developed with the main purpose to describe the spatio-temporal dynamics of vegetation at the global scale. Increasing concern about climate change impacts has put the focus of recent applications on the sim- ulation of the global carbon cycle. Water is a prime driver of biogeochemical and biophysical processes, thus an appropriate representation of the water cycle is crucial for their proper simulation. However, these models usually lack thorough validation of the water balance they produce. Here we present a hydrological validation of the current version of the LPJ (Lund- Potsdam-Jena) model, a dynamic global vegetation model operating at daily time steps. Long-term simulated runoff and evapotranspiration are compared to literature values, results from three global hydrological models, and discharge observations from various macroscale river basins. It was found that the seasonal and spatial patterns of the LPJ-simulated average values correspond well both with the measurements and the results from the stand-alone hy- drological models. However, a general underestimation of runoff occurs, which may be attributable to the low input dynamics of precipitation (equal distribution within a month), to the simulated vegetation pattern (potential vegetation without anthro- pogenic influence), and to some generalizations of the hydrological components in LPJ. Future research will focus on a better representation of the temporal variability of climate forcing, improved description of hydrological processes, and on the consider- ation of anthropogenic land use.

Spatiotemporal information during unsupervised learning enhances viewpoint invariant object recognition

PubMed Central

Tian, Moqian; Grill-Spector, Kalanit

2015-01-01

Recognizing objects is difficult because it requires both linking views of an object that can be different and distinguishing objects with similar appearance. Interestingly, people can learn to recognize objects across views in an unsupervised way, without feedback, just from the natural viewing statistics. However, there is intense debate regarding what information during unsupervised learning is used to link among object views. Specifically, researchers argue whether temporal proximity, motion, or spatiotemporal continuity among object views during unsupervised learning is beneficial. Here, we untangled the role of each of these factors in unsupervised learning of novel three-dimensional (3-D) objects. We found that after unsupervised training with 24 object views spanning a 180° view space, participants showed significant improvement in their ability to recognize 3-D objects across rotation. Surprisingly, there was no advantage to unsupervised learning with spatiotemporal continuity or motion information than training with temporal proximity. However, we discovered that when participants were trained with just a third of the views spanning the same view space, unsupervised learning via spatiotemporal continuity yielded significantly better recognition performance on novel views than learning via temporal proximity. These results suggest that while it is possible to obtain view-invariant recognition just from observing many views of an object presented in temporal proximity, spatiotemporal information enhances performance by producing representations with broader view tuning than learning via temporal association. Our findings have important implications for theories of object recognition and for the development of computational algorithms that learn from examples. PMID:26024454

The role of the anterior temporal lobes in the comprehension of concrete and abstract words: rTMS evidence

PubMed Central

Pobric, Gorana; Lambon Ralph, Matthew A.; Jefferies, Elizabeth

2009-01-01

Conceptual knowledge allows us to bring meaning to our world. Studies of semantic dementia (SD) patients and some functional neuroimaging studies indicate that the anterior temporal lobes, bilaterally, are a core neural substrate for the formation of conceptual representations. The majority of SD patients (who have circumscribed atrophy of the anterior temporal lobes) have better comprehension of concrete than abstract words. However, this finding remains controversial, as some individual SD patients have exhibited reverse imageability effects, i.e., relative preservation of abstract knowledge. This would imply that the anterior temporal lobes are particularly crucial for processing sensory aspects of semantic knowledge, which are an important part of concrete but not abstract concepts. To adjudicate on this debate, we used offline, low-frequency, repetitive transcranial magnetic stimulation to disrupt neural processing temporarily in the left or right temporal poles (TPs). We examined this effect using a synonym judgement task, comprising high, medium and low imageability items, which we have previously employed with a case-series of SD patients. The time required to make semantic decisions was slowed considerably, particularly for low imageability items, consistent with the pattern we observed in SD. These results confirm that both TPs make a critical contribution to semantic processing, even for abstract concepts that do not have strong sensory representations. PMID:19303592

Refinement of learned skilled movement representation in motor cortex deep output layer

PubMed Central

Li, Qian; Ko, Ho; Qian, Zhong-Ming; Yan, Leo Y. C.; Chan, Danny C. W.; Arbuthnott, Gordon; Ke, Ya; Yung, Wing-Ho

2017-01-01

The mechanisms underlying the emergence of learned motor skill representation in primary motor cortex (M1) are not well understood. Specifically, how motor representation in the deep output layer 5b (L5b) is shaped by motor learning remains virtually unknown. In rats undergoing motor skill training, we detect a subpopulation of task-recruited L5b neurons that not only become more movement-encoding, but their activities are also more structured and temporally aligned to motor execution with a timescale of refinement in tens-of-milliseconds. Field potentials evoked at L5b in vivo exhibit persistent long-term potentiation (LTP) that parallels motor performance. Intracortical dopamine denervation impairs motor learning, and disrupts the LTP profile as well as the emergent neurodynamical properties of task-recruited L5b neurons. Thus, dopamine-dependent recruitment of L5b neuronal ensembles via synaptic reorganization may allow the motor cortex to generate more temporally structured, movement-encoding output signal from M1 to downstream circuitry that drives increased uniformity and precision of movement during motor learning. PMID:28598433

Intrusive Images in Psychological Disorders

PubMed Central

Brewin, Chris R.; Gregory, James D.; Lipton, Michelle; Burgess, Neil

2010-01-01

Involuntary images and visual memories are prominent in many types of psychopathology. Patients with posttraumatic stress disorder, other anxiety disorders, depression, eating disorders, and psychosis frequently report repeated visual intrusions corresponding to a small number of real or imaginary events, usually extremely vivid, detailed, and with highly distressing content. Both memory and imagery appear to rely on common networks involving medial prefrontal regions, posterior regions in the medial and lateral parietal cortices, the lateral temporal cortex, and the medial temporal lobe. Evidence from cognitive psychology and neuroscience implies distinct neural bases to abstract, flexible, contextualized representations (C-reps) and to inflexible, sensory-bound representations (S-reps). We revise our previous dual representation theory of posttraumatic stress disorder to place it within a neural systems model of healthy memory and imagery. The revised model is used to explain how the different types of distressing visual intrusions associated with clinical disorders arise, in terms of the need for correct interaction between the neural systems supporting S-reps and C-reps via visuospatial working memory. Finally, we discuss the treatment implications of the new model and relate it to existing forms of psychological therapy. PMID:20063969

Distributed representation of visual objects by single neurons in the human brain.

PubMed

Valdez, André B; Papesh, Megan H; Treiman, David M; Smith, Kris A; Goldinger, Stephen D; Steinmetz, Peter N

2015-04-01

It remains unclear how single neurons in the human brain represent whole-object visual stimuli. While recordings in both human and nonhuman primates have shown distributed representations of objects (many neurons encoding multiple objects), recordings of single neurons in the human medial temporal lobe, taken as subjects' discriminated objects during multiple presentations, have shown gnostic representations (single neurons encoding one object). Because some studies suggest that repeated viewing may enhance neural selectivity for objects, we had human subjects discriminate objects in a single, more naturalistic viewing session. We found that, across 432 well isolated neurons recorded in the hippocampus and amygdala, the average fraction of objects encoded was 26%. We also found that more neurons encoded several objects versus only one object in the hippocampus (28 vs 18%, p < 0.001) and in the amygdala (30 vs 19%, p < 0.001). Thus, during realistic viewing experiences, typical neurons in the human medial temporal lobe code for a considerable range of objects, across multiple semantic categories. Copyright © 2015 the authors 0270-6474/15/355180-07$15.00/0.

Treatment for Alexia with Agraphia Following Left Ventral Occipito-Temporal Damage: Strengthening Orthographic Representations Common to Reading and Spelling

ERIC Educational Resources Information Center

Kim, Esther S.; Rising, Kindle; Rapcsak, Steven Z.; Beeson, Pélagie M.

2015-01-01

Purpose: Damage to left ventral occipito-temporal cortex can give rise to written language impairment characterized by pure alexia/letter-by-letter (LBL) reading, as well as surface alexia and agraphia. The purpose of this study was to examine the therapeutic effects of a combined treatment approach to address concurrent LBL reading with surface…

Relearning in Semantic Dementia Reflects Contributions from Both Medial Temporal Lobe Episodic and Degraded Neocortical Semantic Systems: Evidence in Support of the Complementary Learning Systems Theory

ERIC Educational Resources Information Center

Mayberry, Emily J.; Sage, Karen; Ehsan, Sheeba; Ralph, Matthew A. Lambon

2011-01-01

When relearning words, patients with semantic dementia (SD) exhibit a characteristic rigidity, including a failure to generalise names to untrained exemplars of trained concepts. This has been attributed to an over-reliance on the medial temporal region which captures information in sparse, non-overlapping and therefore rigid representations. The…

Specialization of the left supramarginal gyrus for hand-independent praxis representation is not related to hand dominance.

PubMed

Króliczak, Gregory; Piper, Brian J; Frey, Scott H

2016-12-01

Data from focal brain injury and functional neuroimaging studies implicate a distributed network of parieto-fronto-temporal areas in the human left cerebral hemisphere as playing distinct roles in the representation of meaningful actions (praxis). Because these data come primarily from right-handed individuals, the relationship between left cerebral specialization for praxis representation and hand dominance remains unclear. We used functional magnetic resonance imaging (fMRI) to evaluate the hypothesis that strongly left-handed (right hemisphere motor dominant) adults also exhibit this left cerebral specialization. Participants planned familiar actions for subsequent performance with the left or right hand in response to transitive (e.g., "pounding") or intransitive (e.g. "waving") action words. In linguistic control trials, cues denoted non-physical actions (e.g., "believing"). Action planning was associated with significant, exclusively left-lateralized and extensive increases of activity in the supramarginal gyrus (SMg), and more focal modulations in the left caudal middle temporal gyrus (cMTg). This activity was hand- and gesture-independent, i.e., unaffected by the hand involved in subsequent action performance, and the type of gesture (i.e., transitive or intransitive). Compared directly with right-handers, left-handers exhibited greater involvement of the right angular gyrus (ANg) and dorsal premotor cortex (dPMC), which is indicative of a less asymmetric functional architecture for praxis representation. We therefore conclude that the organization of mechanisms involved in planning familiar actions is influenced by one's motor dominance. However, independent of hand dominance, the left SMg and cMTg are specialized for ideomotor transformations-the integration of conceptual knowledge and motor representations into meaningful actions. These findings support the view that higher-order praxis representation and lower-level motor dominance rely on dissociable mechanisms. Copyright © 2016 Elsevier Ltd. All rights reserved.

Specialization of the left supramarginal gyrus for hand-independent praxis representation is not related to hand dominance

PubMed Central

Króliczak, Gregory; Piper, Brian J.; Frey, Scott H.

2016-01-01

Data from focal brain injury and functional neuroimaging studies implicate a distributed network of parieto-fronto-temporal areas in the human left cerebral hemisphere as playing distinct roles in the representation of meaningful actions (praxis). Because these data come primarily from right-handed individuals, the relationship between left cerebral specialization for praxis representation and hand dominance remains unclear. We used functional magnetic resonance imaging (fMRI) to evaluate the hypothesis that strongly left-handed (right hemisphere motor dominant) adults also exhibit this left cerebral specialization. Participants planned familiar actions for subsequent performance with the left or right hand in response to transitive (e.g., “pounding”) or intransitive (e.g. “waving”) action words. In linguistic control trials, cues denoted non-physical actions (e.g., “believing”). Action planning was associated with significant, exclusively left-lateralized and extensive increases of activity in the supramarginal gyrus (SMg), and more focal modulations in the left caudal middle temporal gyrus (cMTg). This activity was hand- and gesture-independent, i.e., unaffected by the hand involved in subsequent action performance, and the type of gesture (i.e., transitive or intransitive). Compared directly with right-handers, left-handers exhibited greater involvement of the right angular gyrus (ANg) and dorsal premotor cortex (dPMC), which is indicative of a less asymmetric functional architecture for praxis representation. We therefore conclude that the organization of mechanisms involved in planning familiar actions is influenced by one’s motor dominance. However, independent of hand dominance, the left SMg and cMTg are specialized for ideomotor transformations—the integration of conceptual knowledge and motor representations into meaningful actions. These findings support the view that higher-order praxis representation and lower-level motor dominance rely on dissociable mechanisms. PMID:27020138

The Voronoi spatio-temporal data structure

NASA Astrophysics Data System (ADS)

Mioc, Darka

2002-04-01

Current GIS models cannot integrate the temporal dimension of spatial data easily. Indeed, current GISs do not support incremental (local) addition and deletion of spatial objects, and they can not support the temporal evolution of spatial data. Spatio-temporal facilities would be very useful in many GIS applications: harvesting and forest planning, cadastre, urban and regional planning, and emergency planning. The spatio-temporal model that can overcome these problems is based on a topological model---the Voronoi data structure. Voronoi diagrams are irregular tessellations of space, that adapt to spatial objects and therefore they are a synthesis of raster and vector spatial data models. The main advantage of the Voronoi data structure is its local and sequential map updates, which allows us to automatically record each event and performed map updates within the system. These map updates are executed through map construction commands that are composed of atomic actions (geometric algorithms for addition, deletion, and motion of spatial objects) on the dynamic Voronoi data structure. The formalization of map commands led to the development of a spatial language comprising a set of atomic operations or constructs on spatial primitives (points and lines), powerful enough to define the complex operations. This resulted in a new formal model for spatio-temporal change representation, where each update is uniquely characterized by the numbers of newly created and inactivated Voronoi regions. This is used for the extension of the model towards the hierarchical Voronoi data structure. In this model, spatio-temporal changes induced by map updates are preserved in a hierarchical data structure that combines events and corresponding changes in topology. This hierarchical Voronoi data structure has an implicit time ordering of events visible through changes in topology, and it is equivalent to an event structure that can support temporal data without precise temporal information. This formal model of spatio-temporal change representation is currently applied to retroactive map updates and visualization of map evolution. It offers new possibilities in the domains of temporal GIS, transaction processing, spatio-temporal queries, spatio-temporal analysis, map animation and map visualization.

System Architecture for Temporal Information Extraction, Representation and Reasoning in Clinical Narrative Reports

PubMed Central

Zhou, Li; Friedman, Carol; Parsons, Simon; Hripcsak, George

2005-01-01

Exploring temporal information in narrative Electronic Medical Records (EMRs) is essential and challenging. We propose an architecture for an integrated approach to process temporal information in clinical narrative reports. The goal is to initiate and build a foundation that supports applications which assist healthcare practice and research by including the ability to determine the time of clinical events (e.g., past vs. present). Key components include: (1) a temporal constraint structure for temporal expressions and the development of an associated tagger; (2) a Natural Language Processing (NLP) system for encoding and extracting medical events and associating them with formalized temporal data; (3) a post-processor, with a knowledge-based subsystem to help discover implicit information, that resolves temporal expressions and deals with issues such as granularity and vagueness; and (4) a reasoning mechanism which models clinical reports as Simple Temporal Problems (STPs). PMID:16779164

Representation of activity in images using geospatial temporal graphs

DOE Office of Scientific and Technical Information (OSTI.GOV)

Brost, Randolph; McLendon, III, William C.; Parekh, Ojas D.

Various technologies pertaining to modeling patterns of activity observed in remote sensing images using geospatial-temporal graphs are described herein. Graphs are constructed by representing objects in remote sensing images as nodes, and connecting nodes with undirected edges representing either distance or adjacency relationships between objects and directed edges representing changes in time. Activity patterns may be discerned from the graphs by coding nodes representing persistent objects like buildings differently from nodes representing ephemeral objects like vehicles, and examining the geospatial-temporal relationships of ephemeral nodes within the graph.

Astronomical Symbolism in Bronze-Age and Iron-Age Rock Art

NASA Astrophysics Data System (ADS)

García Quintela, Marco V.; Santos-Estévez, Manuel

The best-known rock art from Late Prehistory is found in Scandinavia, the Alps, and Galicia, North West Spain. In this chapter, we explore its association with astronomical symbolism from three perspectives: the representation of heavenly bodies, the visibility conditions of the carvings, and their position on astronomical alignments. We also consider temporal variables and the impact of aspects of Indo-European ideology on the construction of the representations in their astronomical relationships.

Leak detection utilizing analog binaural (VLSI) techniques

NASA Technical Reports Server (NTRS)

Hartley, Frank T. (Inventor)

1995-01-01

A detection method and system utilizing silicon models of the traveling wave structure of the human cochlea to spatially and temporally locate a specific sound source in the presence of high noise pandemonium. The detection system combines two-dimensional stereausis representations, which are output by at least three VLSI binaural hearing chips, to generate a three-dimensional stereausis representation including both binaural and spectral information which is then used to locate the sound source.

Evidence for multiple, distinct representations of the human body.

PubMed

Schwoebel, John; Coslett, H Branch

2005-04-01

Previous data from single-case and small group studies have suggested distinctions among structural, conceptual, and online sensorimotor representations of the human body. We developed a battery of tasks to further examine the prevalence and anatomic substrates of these body representations. The battery was administered to 70 stroke patients. Fifty-one percent of the patients were impaired relative to controls on at least one body representation measure. Further, principal components analysis of the patient data as well as direct comparisons of patient and control performance suggested a triple dissociation between measures of the 3 putative body representations. Consistent with previous distinctions between the "what" and "how" pathways, lesions of the left temporal lobe were most consistently associated with impaired performance on tasks assessing knowledge of the shape or lexical-semantic information about the body, whereas lesions of the dorsolateral frontal and parietal regions resulted in impaired performance on tasks requiring on-line coding of body posture.

Striatal action-value neurons reconsidered.

PubMed

Elber-Dorozko, Lotem; Loewenstein, Yonatan

2018-05-31

It is generally believed that during economic decisions, striatal neurons represent the values associated with different actions. This hypothesis is based on studies, in which the activity of striatal neurons was measured while the subject was learning to prefer the more rewarding action. Here we show that these publications are subject to at least one of two critical confounds. First, we show that even weak temporal correlations in the neuronal data may result in an erroneous identification of action-value representations. Second, we show that experiments and analyses designed to dissociate action-value representation from the representation of other decision variables cannot do so. We suggest solutions to identifying action-value representation that are not subject to these confounds. Applying one solution to previously identified action-value neurons in the basal ganglia we fail to detect action-value representations. We conclude that the claim that striatal neurons encode action-values must await new experiments and analyses. © 2018, Elber-Dorozko et al.

Visual memory transformations in dyslexia.

PubMed

Barnes, James; Hinkley, Lisa; Masters, Stuart; Boubert, Laura

2007-06-01

Representational Momentum refers to observers' distortion of recognition memory for pictures that imply motion because of an automatic mental process which extrapolates along the implied trajectory of the picture. Neuroimaging evidence suggests that activity in the magnocellular visual pathway is necessary for representational momentum to occur. It has been proposed that individuals with dyslexia have a magnocellular deficit, so it was hypothesised that these individuals would show reduced or absent representational momentum. In this study, 30 adults with dyslexia and 30 age-matched controls were compared on two tasks, one linear and one rotation, which had previously elicited the representational momentum effect. Analysis indicated significant differences in the performance of the two groups, with the dyslexia group having a reduced susceptibility to representational momentum in both linear and rotational directions. The findings highlight that deficits in temporal spatial processing may contribute to the perceptual profile of dyslexia.

An event-version-based spatio-temporal modeling approach and its application in the cadastral management

NASA Astrophysics Data System (ADS)

Li, Yangdong; Han, Zhen; Liao, Zhongping

2009-10-01

Spatiality, temporality, legality, accuracy and continuality are characteristic of cadastral information, and the cadastral management demands that the cadastral data should be accurate, integrated and updated timely. It's a good idea to build an effective GIS management system to manage the cadastral data which are characterized by spatiality and temporality. Because no sound spatio-temporal data models have been adopted, however, the spatio-temporal characteristics of cadastral data are not well expressed in the existing cadastral management systems. An event-version-based spatio-temporal modeling approach is first proposed from the angle of event and version. Then with the help of it, an event-version-based spatio-temporal cadastral data model is built to represent spatio-temporal cadastral data. At last, the previous model is used in the design and implementation of a spatio-temporal cadastral management system. The result of the application of the system shows that the event-version-based spatio-temporal data model is very suitable for the representation and organization of cadastral data.

Spatial and temporal coherence in perceptual binding

PubMed Central

Blake, Randolph; Yang, Yuede

1997-01-01

Component visual features of objects are registered by distributed patterns of activity among neurons comprising multiple pathways and visual areas. How these distributed patterns of activity give rise to unified representations of objects remains unresolved, although one recent, controversial view posits temporal coherence of neural activity as a binding agent. Motivated by the possible role of temporal coherence in feature binding, we devised a novel psychophysical task that requires the detection of temporal coherence among features comprising complex visual images. Results show that human observers can more easily detect synchronized patterns of temporal contrast modulation within hybrid visual images composed of two components when those components are drawn from the same original picture. Evidently, time-varying changes within spatially coherent features produce more salient neural signals. PMID:9192701

Spatial frequency supports the emergence of categorical representations in visual cortex during natural scene perception.

PubMed

Dima, Diana C; Perry, Gavin; Singh, Krish D

2018-06-11

In navigating our environment, we rapidly process and extract meaning from visual cues. However, the relationship between visual features and categorical representations in natural scene perception is still not well understood. Here, we used natural scene stimuli from different categories and filtered at different spatial frequencies to address this question in a passive viewing paradigm. Using representational similarity analysis (RSA) and cross-decoding of magnetoencephalography (MEG) data, we show that categorical representations emerge in human visual cortex at ∼180 ms and are linked to spatial frequency processing. Furthermore, dorsal and ventral stream areas reveal temporally and spatially overlapping representations of low and high-level layer activations extracted from a feedforward neural network. Our results suggest that neural patterns from extrastriate visual cortex switch from low-level to categorical representations within 200 ms, highlighting the rapid cascade of processing stages essential in human visual perception. Copyright © 2018 The Authors. Published by Elsevier Inc. All rights reserved.

Impact of GPS-Integrated Water Vapour assimilation on Regional Climate Model simulations of heavy precipitation events in the western Mediterranean

NASA Astrophysics Data System (ADS)

Caldas-Alvarez, Alberto; Khodayar, Samiro

2017-04-01

An accurate representation of the devastating heavy precipitation events, that typically strike the western Mediterranean regions by autumn, is still a challenge for current weather prediction models. The misrepresentation of the atmospheric moisture distribution and the convective processes where it plays a role have been pointed out as sources of error in their prediction. Provided the fast variability of water vapour in the atmosphere, an improved representation of its distribution is expected from the Data Assimilation (DA) of very frequent measurements, such is the case of Global Positioning System derived Integrated Water Vapour (GPS-IWV). Moreover, an improved representation of the model physics is expected from the application of the DA on fine-scale model grids. The presented research work aims at assessing the impact of the selective assimilation of GPS-IWV retrievals on the representation of the atmospheric moisture distribution in relation to heavy precipitation in seasonal simulations over the western Mediterranean. COSMO simulations in CLimate Mode (CCLM) are run with two different horizontal resolutions (2.8 km and 7 km) to reproduce the period September 2012 to March 2013, encompassing the Special Observation Period 1 (SOP1) of the Hydrological Cycle in the Mediterranean Experiment (HyMeX). A state-of-art GPS-IWV data set, specially homogenized for the western Mediterranean countries spanning the aforementioned seven month period is selectively assimilated into the model runs with a high frequency (10 minutes). The impact of such assimilation combined with the grid refinement of the model is assessed in the representation of the atmospheric moisture distribution and its influence in the processes leading to deep moist convection and heavy rain. Observational data sets of precipitation obtained with the Climate Prediction Centre MORPHing technique (CMORPH), from the HyMeX rain gauge network as well as the GPS-IWV retrievals are employed to validate our model results and support the process studies. Results show remarkable discrepancies in the representation of the temporal evolution of IWV by CCLM well corrected by the assimilation. This rectification of the amount of water vapour in the atmosphere influences the intensity and location of extreme precipitation, albeit the sign and extent of this influence was shown to be event-dependent.

Pre-operative simulation of pediatric mastoid surgery with 3D-printed temporal bone models.

PubMed

Rose, Austin S; Webster, Caroline E; Harrysson, Ola L A; Formeister, Eric J; Rawal, Rounak B; Iseli, Claire E

2015-05-01

As the process of additive manufacturing, or three-dimensional (3D) printing, has become more practical and affordable, a number of applications for the technology in the field of pediatric otolaryngology have been considered. One area of promise is temporal bone surgical simulation. Having previously developed a model for temporal bone surgical training using 3D printing, we sought to produce a patient-specific model for pre-operative simulation in pediatric otologic surgery. Our hypothesis was that the creation and pre-operative dissection of such a model was possible, and would demonstrate potential benefits in cases of abnormal temporal bone anatomy. In the case presented, an 11-year-old boy underwent a planned canal-wall-down (CWD) tympano-mastoidectomy for recurrent cholesteatoma preceded by a pre-operative surgical simulation using 3D-printed models of the temporal bone. The models were based on the child's pre-operative clinical CT scan and printed using multiple materials to simulate both bone and soft tissue structures. To help confirm the models as accurate representations of the child's anatomy, distances between various anatomic landmarks were measured and compared to the temporal bone CT scan and the 3D model. The simulation allowed the surgical team to appreciate the child's unusual temporal bone anatomy as well as any challenges that might arise in the safety of the temporal bone laboratory, prior to actual surgery in the operating room (OR). There was minimal variability, in terms of absolute distance (mm) and relative distance (%), in measurements between anatomic landmarks obtained from the patient intra-operatively, the pre-operative CT scan and the 3D-printed models. Accurate 3D temporal bone models can be rapidly produced based on clinical CT scans for pre-operative simulation of specific challenging otologic cases in children, potentially reducing medical errors and improving patient safety. Copyright © 2015 Elsevier Ireland Ltd. All rights reserved.

Knowledge Representation and Management. From Ontology to Annotation. Findings from the Yearbook 2015 Section on Knowledge Representation and Management.

PubMed

Charlet, J; Darmoni, S J

2015-08-13

To summarize the best papers in the field of Knowledge Representation and Management (KRM). A comprehensive review of medical informatics literature was performed to select some of the most interesting papers of KRM published in 2014. Four articles were selected, two focused on annotation and information retrieval using an ontology. The two others focused mainly on ontologies, one dealing with the usage of a temporal ontology in order to analyze the content of narrative document, one describing a methodology for building multilingual ontologies. Semantic models began to show their efficiency, coupled with annotation tools.

Sentiments analysis at conceptual level making use of the Narrative Knowledge Representation Language.

PubMed

Zarri, Gian Piero

2014-10-01

This paper illustrates some of the knowledge representation structures and inference procedures proper to a high-level, fully implemented conceptual language, NKRL (Narrative Knowledge Representation Language). The aim is to show how these tools can be used to deal, in a sentiment analysis/opinion mining context, with some common types of human (and non-human) "behaviors". These behaviors correspond, in particular, to the concrete, mutual relationships among human and non-human characters that can be expressed under the form of non-fictional and real-time "narratives" (i.e., as logically and temporally structured sequences of "elementary events"). Copyright © 2014 Elsevier Ltd. All rights reserved.

Beyond sensory images: Object-based representation in the human ventral pathway

PubMed Central

Pietrini, Pietro; Furey, Maura L.; Ricciardi, Emiliano; Gobbini, M. Ida; Wu, W.-H. Carolyn; Cohen, Leonardo; Guazzelli, Mario; Haxby, James V.

2004-01-01

We investigated whether the topographically organized, category-related patterns of neural response in the ventral visual pathway are a representation of sensory images or a more abstract representation of object form that is not dependent on sensory modality. We used functional MRI to measure patterns of response evoked during visual and tactile recognition of faces and manmade objects in sighted subjects and during tactile recognition in blind subjects. Results showed that visual and tactile recognition evoked category-related patterns of response in a ventral extrastriate visual area in the inferior temporal gyrus that were correlated across modality for manmade objects. Blind subjects also demonstrated category-related patterns of response in this “visual” area, and in more ventral cortical regions in the fusiform gyrus, indicating that these patterns are not due to visual imagery and, furthermore, that visual experience is not necessary for category-related representations to develop in these cortices. These results demonstrate that the representation of objects in the ventral visual pathway is not simply a representation of visual images but, rather, is a representation of more abstract features of object form. PMID:15064396

When Does Changing Representation Improve Problem-Solving Performance?

NASA Technical Reports Server (NTRS)

Holte, Robert; Zimmer, Robert; MacDonald, Alan

1992-01-01

The aim of changing representation is the improvement of problem-solving efficiency. For the most widely studied family of methods of change of representation it is shown that the value of a single parameter, called the expulsion factor, is critical in determining (1) whether the change of representation will improve or degrade problem-solving efficiency and (2) whether the solutions produced using the change of representation will or will not be exponentially longer than the shortest solution. A method of computing the expansion factor for a given change of representation is sketched in general and described in detail for homomorphic changes of representation. The results are illustrated with homomorphic decompositions of the Towers of Hanoi problem.

Development and neurophysiology of mentalizing.

PubMed Central

Frith, Uta; Frith, Christopher D

2003-01-01

The mentalizing (theory of mind) system of the brain is probably in operation from ca. 18 months of age, allowing implicit attribution of intentions and other mental states. Between the ages of 4 and 6 years explicit mentalizing becomes possible, and from this age children are able to explain the misleading reasons that have given rise to a false belief. Neuroimaging studies of mentalizing have so far only been carried out in adults. They reveal a system with three components consistently activated during both implicit and explicit mentalizing tasks: medial prefrontal cortex (MPFC), temporal poles and posterior superior temporal sulcus (STS). The functions of these components can be elucidated, to some extent, from their role in other tasks used in neuroimaging studies. Thus, the MPFC region is probably the basis of the decoupling mechanism that distinguishes mental state representations from physical state representations; the STS region is probably the basis of the detection of agency, and the temporal poles might be involved in access to social knowledge in the form of scripts. The activation of these components in concert appears to be critical to mentalizing. PMID:12689373

Representation of time interval entrained by periodic stimuli in the visual thalamus of pigeons

PubMed Central

Wang, Shu-Rong

2017-01-01

Animals use the temporal information from previously experienced periodic events to instruct their future behaviors. The retina and cortex are involved in such behavior, but it remains largely unknown how the thalamus, transferring visual information from the retina to the cortex, processes the periodic temporal patterns. Here we report that the luminance cells in the nucleus dorsolateralis anterior thalami (DLA) of pigeons exhibited oscillatory activities in a temporal pattern identical to the rhythmic luminance changes of repetitive light/dark (LD) stimuli with durations in the seconds-to-minutes range. Particularly, after LD stimulation, the DLA cells retained the entrained oscillatory activities with an interval closely matching the duration of the LD cycle. Furthermore, the post-stimulus oscillatory activities of the DLA cells were sustained without feedback inputs from the pallium (equivalent to the mammalian cortex). Our study suggests that the experience-dependent representation of time interval in the brain might not be confined to the pallial/cortical level, but may occur as early as at the thalamic level. PMID:29284554

Application of Information Visualization Techniques in Representing Patients' Temporal Personal History Data

NASA Astrophysics Data System (ADS)

Noah, Shahrul Azman; Yaakob, Suraya; Shahar, Suzana

The anthropometries and nutrients records of patients are usually vast in quantity, complex and exhibit temporal features. Therefore, the information acceptance among users will become blur and give cognitive burden if such data is not displayed using effective techniques. The aim of this study is to apply, use and evaluate Information Visualization (IV) techniques for displaying the Personal History Data (PHD) of patients for dietitians during counseling sessions. Since PHD values change consistently with the counseling session, our implementation mainly focused on quantitative temporal data such as Body Mass Index (BMI), blood pressure and blood glucose readings. This data is mapped into orientation circle type of visual representation, whereas data about medicinal and supplement intake are mapped into timeline segment which is based on the thickness of lines as well as the colors. A usability testing has been conducted among dietitians at Faculty of Allied Health Sciences, UKM. The result of the testing has shown that the use of visual representations capable of summarising complex data which ease the dietitian task of checking the PHD.

Temporal logics meet telerobotics

NASA Technical Reports Server (NTRS)

Rutten, Eric; Marce, Lionel

1989-01-01

The specificity of telerobotics being the presence of a human operator, decision assistance tools are necessary for the operator, especially in hostile environments. In order to reduce execution hazards due to a degraded ability for quick and efficient recovery of unexpected dangerous situations, it is of importance to have the opportunity, amongst others, to simulate the possible consequences of a plan before its actual execution, in order to detect these problematic situations. Hence the idea of providing the operator with a simulator enabling him to verify the temporal and logical coherence of his plans. Therefore, the power of logical formalisms is used for representation and deduction purposes. Starting from the class of situations that are represented, a STRIPS (the STanford Research Institute Problem Solver)-like formalism and its underlying logic are adapted to the simulation of plans of actions in time. The choice of a temporal logic enables to build a world representation, on which the effects of plans, grouping actions into control structures, will be transcribed by the simulation, resulting in a verdict and information about the plan's coherence.

Decoding the time-course of object recognition in the human brain: From visual features to categorical decisions.

PubMed

Contini, Erika W; Wardle, Susan G; Carlson, Thomas A

2017-10-01

Visual object recognition is a complex, dynamic process. Multivariate pattern analysis methods, such as decoding, have begun to reveal how the brain processes complex visual information. Recently, temporal decoding methods for EEG and MEG have offered the potential to evaluate the temporal dynamics of object recognition. Here we review the contribution of M/EEG time-series decoding methods to understanding visual object recognition in the human brain. Consistent with the current understanding of the visual processing hierarchy, low-level visual features dominate decodable object representations early in the time-course, with more abstract representations related to object category emerging later. A key finding is that the time-course of object processing is highly dynamic and rapidly evolving, with limited temporal generalisation of decodable information. Several studies have examined the emergence of object category structure, and we consider to what degree category decoding can be explained by sensitivity to low-level visual features. Finally, we evaluate recent work attempting to link human behaviour to the neural time-course of object processing. Copyright © 2017 Elsevier Ltd. All rights reserved.

Mental traveling along psychological distances: The effects of cultural syndromes, perspective flexibility, and construal level.

PubMed

Wong, Vincent Chi; Wyer, Robert S

2016-07-01

Individuals' psychological distance from the stimuli they encounter in daily life can influence the abstractness or generality of the mental representations they form of these stimuli. However, these representations can also depend on the perspective from which the stimuli are construed. When individuals have either an individualistic social orientation or a short-term temporal orientation, they construe psychologically distal events more globally than they construe proximal ones, as implied by construal level theory (Trope & Liberman, 2010). When they have either a collectivistic social orientation or a long-term temporal orientation, however, they not only construe the implications of distal events more concretely than individuals with an egocentric perspective but also construe the implications of proximal events in more abstract terms. These effects are mediated by the flexibility of the perspectives that people take when they make judgments. Differences in perspective flexibility account for the impact of both situationally induced differences in social and temporal orientation and more chronic cultural differences in these orientations. (PsycINFO Database Record (c) 2016 APA, all rights reserved).

Prismatic Adaptation Induces Plastic Changes onto Spatial and Temporal Domains in Near and Far Space.

PubMed

Patané, Ivan; Farnè, Alessandro; Frassinetti, Francesca

2016-01-01

A large literature has documented interactions between space and time suggesting that the two experiential domains may share a common format in a generalized magnitude system (ATOM theory). To further explore this hypothesis, here we measured the extent to which time and space are sensitive to the same sensorimotor plasticity processes, as induced by classical prismatic adaptation procedures (PA). We also exanimated whether spatial-attention shifts on time and space processing, produced through PA, extend to stimuli presented beyond the immediate near space. Results indicated that PA affected both temporal and spatial representations not only in the near space (i.e., the region within which the adaptation occurred), but also in the far space. In addition, both rightward and leftward PA directions caused opposite and symmetrical modulations on time processing, whereas only leftward PA biased space processing rightward. We discuss these findings within the ATOM framework and models that account for PA effects on space and time processing. We propose that the differential and asymmetrical effects following PA may suggest that temporal and spatial representations are not perfectly aligned.

A logical foundation for representation of clinical data.

PubMed Central

Campbell, K E; Das, A K; Musen, M A

1994-01-01

OBJECTIVE: A general framework for representation of clinical data that provides a declarative semantics of terms and that allows developers to define explicitly the relationships among both terms and combinations of terms. DESIGN: Use of conceptual graphs as a standard representation of logic and of an existing standardized vocabulary, the Systematized Nomenclature of Medicine (SNOMED International), for lexical elements. Concepts such as time, anatomy, and uncertainty must be modeled explicitly in a way that allows relation of these foundational concepts to surface-level clinical descriptions in a uniform manner. RESULTS: The proposed framework was used to model a simple radiology report, which included temporal references. CONCLUSION: Formal logic provides a framework for formalizing the representation of medical concepts. Actual implementations will be required to evaluate the practicality of this approach. PMID:7719805

Calibrating a numerical model's morphology using high-resolution spatial and temporal datasets from multithread channel flume experiments.

NASA Astrophysics Data System (ADS)

Javernick, L.; Bertoldi, W.; Redolfi, M.

2017-12-01

Accessing or acquiring high quality, low-cost topographic data has never been easier due to recent developments of the photogrammetric techniques of Structure-from-Motion (SfM). Researchers can acquire the necessary SfM imagery with various platforms, with the ability to capture millimetre resolution and accuracy, or large-scale areas with the help of unmanned platforms. Such datasets in combination with numerical modelling have opened up new opportunities to study river environments physical and ecological relationships. While numerical models overall predictive accuracy is most influenced by topography, proper model calibration requires hydraulic data and morphological data; however, rich hydraulic and morphological datasets remain scarce. This lack in field and laboratory data has limited model advancement through the inability to properly calibrate, assess sensitivity, and validate the models performance. However, new time-lapse imagery techniques have shown success in identifying instantaneous sediment transport in flume experiments and their ability to improve hydraulic model calibration. With new capabilities to capture high resolution spatial and temporal datasets of flume experiments, there is a need to further assess model performance. To address this demand, this research used braided river flume experiments and captured time-lapse observed sediment transport and repeat SfM elevation surveys to provide unprecedented spatial and temporal datasets. Through newly created metrics that quantified observed and modeled activation, deactivation, and bank erosion rates, the numerical model Delft3d was calibrated. This increased temporal data of both high-resolution time series and long-term temporal coverage provided significantly improved calibration routines that refined calibration parameterization. Model results show that there is a trade-off between achieving quantitative statistical and qualitative morphological representations. Specifically, statistical agreement simulations suffered to represent braiding planforms (evolving toward meandering), and parameterization that ensured braided produced exaggerated activation and bank erosion rates. Marie Sklodowska-Curie Individual Fellowship: River-HMV, 656917

Differential processing of part-to-whole and part-to-part face priming: an ERP study.

PubMed

Jemel, B; George, N; Chaby, L; Fiori, N; Renault, B

1999-04-06

We provide electrophysiological evidence supporting the hypothesis that part and whole face processing involve distinct functional mechanisms. We used a congruency judgment task and studied part-to-whole and part-to-part priming effects. Neither part-to-whole nor part-to-part conditions elicited early congruency effects on face-specific ERP components, suggesting that activation of the internal representations should occur later on. However, these components showed differential responsiveness to whole faces and isolated eyes. In addition, although late ERP components were affected when the eye targets were not associated with the prime in both conditions, their temporal and topographical features depended on the latter. These differential effects suggest the existence of distributed neural networks in the inferior temporal cortex where part and whole facial representations may be stored.

Time-frequency representation of autoionization dynamics in helium

NASA Astrophysics Data System (ADS)

Busto, D.; Barreau, L.; Isinger, M.; Turconi, M.; Alexandridi, C.; Harth, A.; Zhong, S.; Squibb, R. J.; Kroon, D.; Plogmaker, S.; Miranda, M.; Jiménez-Galán, Á.; Argenti, L.; Arnold, C. L.; Feifel, R.; Martín, F.; Gisselbrecht, M.; L'Huillier, A.; Salières, P.

2018-02-01

Autoionization, which results from the interference between direct photoionization and photoexcitation to a discrete state decaying to the continuum by configuration interaction, is a well known example of the important role of electron correlation in light-matter interaction. Information on this process can be obtained by studying the spectral, or equivalently, temporal complex amplitude of the ionized electron wave packet. Using an energy-resolved interferometric technique, we measure the spectral amplitude and phase of autoionized wave packets emitted via the sp2+ and sp3+ resonances in helium. These measurements allow us to reconstruct the corresponding temporal profiles by Fourier transform. In addition, applying various time-frequency representations, we observe the build-up of the wave packets in the continuum, monitor the instantaneous frequencies emitted at any time and disentangle the dynamics of the direct and resonant ionization channels.

Centrality in earthquake multiplex networks

NASA Astrophysics Data System (ADS)

Lotfi, Nastaran; Darooneh, Amir Hossein; Rodrigues, Francisco A.

2018-06-01

Seismic time series has been mapped as a complex network, where a geographical region is divided into square cells that represent the nodes and connections are defined according to the sequence of earthquakes. In this paper, we map a seismic time series to a temporal network, described by a multiplex network, and characterize the evolution of the network structure in terms of the eigenvector centrality measure. We generalize previous works that considered the single layer representation of earthquake networks. Our results suggest that the multiplex representation captures better earthquake activity than methods based on single layer networks. We also verify that the regions with highest seismological activities in Iran and California can be identified from the network centrality analysis. The temporal modeling of seismic data provided here may open new possibilities for a better comprehension of the physics of earthquakes.

Accelerated dynamic EPR imaging using fast acquisition and compressive recovery

NASA Astrophysics Data System (ADS)

Ahmad, Rizwan; Samouilov, Alexandre; Zweier, Jay L.

2016-12-01

Electron paramagnetic resonance (EPR) allows quantitative imaging of tissue redox status, which provides important information about ischemic syndromes, cancer and other pathologies. For continuous wave EPR imaging, however, poor signal-to-noise ratio and low acquisition efficiency limit its ability to image dynamic processes in vivo including tissue redox, where conditions can change rapidly. Here, we present a data acquisition and processing framework that couples fast acquisition with compressive sensing-inspired image recovery to enable EPR-based redox imaging with high spatial and temporal resolutions. The fast acquisition (FA) allows collecting more, albeit noisier, projections in a given scan time. The composite regularization based processing method, called spatio-temporal adaptive recovery (STAR), not only exploits sparsity in multiple representations of the spatio-temporal image but also adaptively adjusts the regularization strength for each representation based on its inherent level of the sparsity. As a result, STAR adjusts to the disparity in the level of sparsity across multiple representations, without introducing any tuning parameter. Our simulation and phantom imaging studies indicate that a combination of fast acquisition and STAR (FASTAR) enables high-fidelity recovery of volumetric image series, with each volumetric image employing less than 10 s of scan. In addition to image fidelity, the time constants derived from FASTAR also match closely to the ground truth even when a small number of projections are used for recovery. This development will enhance the capability of EPR to study fast dynamic processes that cannot be investigated using existing EPR imaging techniques.

Space-by-time manifold representation of dynamic facial expressions for emotion categorization

PubMed Central

Delis, Ioannis; Chen, Chaona; Jack, Rachael E.; Garrod, Oliver G. B.; Panzeri, Stefano; Schyns, Philippe G.

2016-01-01

Visual categorization is the brain computation that reduces high-dimensional information in the visual environment into a smaller set of meaningful categories. An important problem in visual neuroscience is to identify the visual information that the brain must represent and then use to categorize visual inputs. Here we introduce a new mathematical formalism—termed space-by-time manifold decomposition—that describes this information as a low-dimensional manifold separable in space and time. We use this decomposition to characterize the representations used by observers to categorize the six classic facial expressions of emotion (happy, surprise, fear, disgust, anger, and sad). By means of a Generative Face Grammar, we presented random dynamic facial movements on each experimental trial and used subjective human perception to identify the facial movements that correlate with each emotion category. When the random movements projected onto the categorization manifold region corresponding to one of the emotion categories, observers categorized the stimulus accordingly; otherwise they selected “other.” Using this information, we determined both the Action Unit and temporal components whose linear combinations lead to reliable categorization of each emotion. In a validation experiment, we confirmed the psychological validity of the resulting space-by-time manifold representation. Finally, we demonstrated the importance of temporal sequencing for accurate emotion categorization and identified the temporal dynamics of Action Unit components that cause typical confusions between specific emotions (e.g., fear and surprise) as well as those resolving these confusions. PMID:27305521

Animacy and real-world size shape object representations in the human medial temporal lobes.

PubMed

Blumenthal, Anna; Stojanoski, Bobby; Martin, Chris B; Cusack, Rhodri; Köhler, Stefan

2018-06-26

Identifying what an object is, and whether an object has been encountered before, is a crucial aspect of human behavior. Despite this importance, we do not yet have a complete understanding of the neural basis of these abilities. Investigations into the neural organization of human object representations have revealed category specific organization in the ventral visual stream in perceptual tasks. Interestingly, these categories fall within broader domains of organization, with reported distinctions between animate, inanimate large, and inanimate small objects. While there is some evidence for category specific effects in the medial temporal lobe (MTL), in particular in perirhinal and parahippocampal cortex, it is currently unclear whether domain level organization is also present across these structures. To this end, we used fMRI with a continuous recognition memory task. Stimuli were images of objects from several different categories, which were either animate or inanimate, or large or small within the inanimate domain. We employed representational similarity analysis (RSA) to test the hypothesis that object-evoked responses in MTL structures during recognition-memory judgments also show evidence for domain-level organization along both dimensions. Our data support this hypothesis. Specifically, object representations were shaped by either animacy, real-world size, or both, in perirhinal and parahippocampal cortex, and the hippocampus. While sensitivity to these dimensions differed across structures when probed individually, hinting at interesting links to functional differentiation, similarities in organization across MTL structures were more prominent overall. These results argue for continuity in the organization of object representations in the ventral visual stream and the MTL. © 2018 Wiley Periodicals, Inc.

The Retinotopic Organization of Macaque Occipitotemporal Cortex Anterior to V4 and Caudoventral to the Middle Temporal (MT) Cluster

PubMed Central

Janssens, Thomas; Orban, Guy A.

2014-01-01

The retinotopic organization of macaque occipitotemporal cortex rostral to area V4 and caudorostral to the recently described middle temporal (MT) cluster of the monkey (Kolster et al., 2009) is not well established. The proposed number of areas within this region varies from one to four, underscoring the ambiguity concerning the functional organization in this region of extrastriate cortex. We used phase-encoded retinotopic functional MRI mapping methods to reveal the functional topography of this cortical domain. Polar-angle maps showed one complete hemifield representation bordering area V4 anteriorly, split into dorsal and ventral counterparts corresponding to the lower and upper visual field quadrants, respectively. The location of this hemifield representation corresponds to area V4A. More rostroventrally, we identified three other complete hemifield representations. Two of these correspond to the dorsal and the ventral posterior inferotemporal areas (PITd and PITv, respectively) as identified in the Felleman and Van Essen (1991) scheme. The third representation has been tentatively named dorsal occipitotemporal area (OTd). Areas V4A, PITd, PITv, and OTd share a central visual field representation, similar to the areas constituting the MT cluster. Furthermore, they vary widely in size and represent the complete contralateral visual field. Functionally, these four areas show little motion sensitivity, unlike those of the MT cluster, and two of them, OTd and PITd, displayed pronounced two-dimensional shape sensitivity. In general, these results suggest that retinotopically organized tissue extends farther into rostral occipitotemporal cortex of the monkey than generally assumed. PMID:25080580

Two takes on the social brain: a comparison of theory of mind tasks.

PubMed

Gobbini, Maria Ida; Koralek, Aaron C; Bryan, Ronald E; Montgomery, Kimberly J; Haxby, James V

2007-11-01

We compared two tasks that are widely used in research on mentalizing--false belief stories and animations of rigid geometric shapes that depict social interactions--to investigate whether the neural systems that mediate the representation of others' mental states are consistent across these tasks. Whereas false belief stories activated primarily the anterior paracingulate cortex (APC), the posterior cingulate cortex/precuneus (PCC/PC), and the temporo-parietal junction (TPJ)--components of the distributed neural system for theory of mind (ToM)--the social animations activated an extensive region along nearly the full extent of the superior temporal sulcus, including a locus in the posterior superior temporal sulcus (pSTS), as well as the frontal operculum and inferior parietal lobule (IPL)--components of the distributed neural system for action understanding--and the fusiform gyrus. These results suggest that the representation of covert mental states that may predict behavior and the representation of intentions that are implied by perceived actions involve distinct neural systems. These results show that the TPJ and the pSTS play dissociable roles in mentalizing and are parts of different distributed neural systems. Because the social animations do not depict articulated body movements, these results also highlight that the perception of the kinematics of actions is not necessary to activate the mirror neuron system, suggesting that this system plays a general role in the representation of intentions and goals of actions. Furthermore, these results suggest that the fusiform gyrus plays a general role in the representation of visual stimuli that signify agency, independent of visual form.

Apples are not the only fruit: the effects of concept typicality on semantic representation in the anterior temporal lobe

PubMed Central

Woollams, Anna M.

2012-01-01

Intuitively, an apple seems a fairly good example of a fruit, whereas an avocado seems less so. The extent to which an exemplar is representative of its category, referred to here as concept typicality, has long been thought to be a key dimension determining semantic representation. Concept typicality is, however, correlated with a number of other variables, in particular age of acquisition (AoA) and name frequency. Consideration of picture naming accuracy from a large case-series of semantic dementia (SD) patients demonstrated strong effects of concept typicality that were maximal in the moderately impaired patients, over and above the impact of AoA and name frequency. Induction of a temporary virtual lesion to the left anterior temporal lobe, the region most commonly affected in SD, via repetitive Transcranial Magnetic Stimulation produced an enhanced effect of concept typicality in the picture naming of normal participants, but did not affect the magnitude of the AoA or name frequency effects. These results indicate that concept typicality exerts its influence on semantic representations themselves, as opposed to the strength of connections outside the semantic system. To date, there has been little direct exploration of the dimension of concept typicality within connectionist models of intact and impaired conceptual representation, and these findings provide a target for future computational simulation. PMID:22529789

DOE Office of Scientific and Technical Information (OSTI.GOV)

Collins, William D; Johansen, Hans; Evans, Katherine J

We present a survey of physical and computational techniques that have the potential to con- tribute to the next generation of high-fidelity, multi-scale climate simulations. Examples of the climate science problems that can be investigated with more depth include the capture of remote forcings of localized hydrological extreme events, an accurate representation of cloud features over a range of spatial and temporal scales, and parallel, large ensembles of simulations to more effectively explore model sensitivities and uncertainties. Numerical techniques, such as adaptive mesh refinement, implicit time integration, and separate treatment of fast physical time scales are enabling improved accuracy andmore » fidelity in simulation of dynamics and allow more complete representations of climate features at the global scale. At the same time, part- nerships with computer science teams have focused on taking advantage of evolving computer architectures, such as many-core processors and GPUs, so that these approaches which were previously considered prohibitively costly have become both more efficient and scalable. In combination, progress in these three critical areas is poised to transform climate modeling in the coming decades.« less

Predit: A temporal predictive framework for scheduling systems

NASA Technical Reports Server (NTRS)

Paolucci, E.; Patriarca, E.; Sem, M.; Gini, G.

1992-01-01

Scheduling can be formalized as a Constraint Satisfaction Problem (CSP). Within this framework activities belonging to a plan are interconnected via temporal constraints that account for slack among them. Temporal representation must include methods for constraints propagation and provide a logic for symbolic and numerical deductions. In this paper we describe a support framework for opportunistic reasoning in constraint directed scheduling. In order to focus the attention of an incremental scheduler on critical problem aspects, some discrete temporal indexes are presented. They are also useful for the prediction of the degree of resources contention. The predictive method expressed through our indexes can be seen as a Knowledge Source for an opportunistic scheduler with a blackboard architecture.

Unaware Processing of Tools in the Neural System for Object-Directed Action Representation.

PubMed

Tettamanti, Marco; Conca, Francesca; Falini, Andrea; Perani, Daniela

2017-11-01

The hypothesis that the brain constitutively encodes observed manipulable objects for the actions they afford is still debated. Yet, crucial evidence demonstrating that, even in the absence of perceptual awareness, the mere visual appearance of a manipulable object triggers a visuomotor coding in the action representation system including the premotor cortex, has hitherto not been provided. In this fMRI study, we instantiated reliable unaware visual perception conditions by means of continuous flash suppression, and we tested in 24 healthy human participants (13 females) whether the visuomotor object-directed action representation system that includes left-hemispheric premotor, parietal, and posterior temporal cortices is activated even under subliminal perceptual conditions. We found consistent activation in the target visuomotor cortices, both with and without perceptual awareness, specifically for pictures of manipulable versus non-manipulable objects. By means of a multivariate searchlight analysis, we also found that the brain activation patterns in this visuomotor network enabled the decoding of manipulable versus non-manipulable object picture processing, both with and without awareness. These findings demonstrate the intimate neural coupling between visual perception and motor representation that underlies manipulable object processing: manipulable object stimuli specifically engage the visuomotor object-directed action representation system, in a constitutive manner that is independent from perceptual awareness. This perceptuo-motor coupling endows the brain with an efficient mechanism for monitoring and planning reactions to external stimuli in the absence of awareness. SIGNIFICANCE STATEMENT Our brain constantly encodes the visual information that hits the retina, leading to a stimulus-specific activation of sensory and semantic representations, even for objects that we do not consciously perceive. Do these unconscious representations encompass the motor programming of actions that could be accomplished congruently with the objects' functions? In this fMRI study, we instantiated unaware visual perception conditions, by dynamically suppressing the visibility of manipulable object pictures with mondrian masks. Despite escaping conscious perception, manipulable objects activated an object-directed action representation system that includes left-hemispheric premotor, parietal, and posterior temporal cortices. This demonstrates that visuomotor encoding occurs independently of conscious object perception. Copyright © 2017 the authors 0270-6474/17/3710712-13$15.00/0.

Evaluating complementary networks of restoration plantings for landscape-scale occurrence of temporally dynamic species.

PubMed

Ikin, Karen; Tulloch, Ayesha; Gibbons, Philip; Ansell, Dean; Seddon, Julian; Lindenmayer, David

2016-10-01

Multibillion dollar investments in land restoration make it critical that conservation goals are achieved cost-effectively. Approaches developed for systematic conservation planning offer opportunities to evaluate landscape-scale, temporally dynamic biodiversity outcomes from restoration and improve on traditional approaches that focus on the most species-rich plantings. We investigated whether it is possible to apply a complementarity-based approach to evaluate the extent to which an existing network of restoration plantings meets representation targets. Using a case study of woodland birds of conservation concern in southeastern Australia, we compared complementarity-based selections of plantings based on temporally dynamic species occurrences with selections based on static species occurrences and selections based on ranking plantings by species richness. The dynamic complementarity approach, which incorporated species occurrences over 5 years, resulted in higher species occurrences and proportion of targets met compared with the static complementarity approach, in which species occurrences were taken at a single point in time. For equivalent cost, the dynamic complementarity approach also always resulted in higher average minimum percent occurrence of species maintained through time and a higher proportion of the bird community meeting representation targets compared with the species-richness approach. Plantings selected under the complementarity approaches represented the full range of planting attributes, whereas those selected under the species-richness approach were larger in size. Our results suggest that future restoration policy should not attempt to achieve all conservation goals within individual plantings, but should instead capitalize on restoration opportunities as they arise to achieve collective value of multiple plantings across the landscape. Networks of restoration plantings with complementary attributes of age, size, vegetation structure, and landscape context lead to considerably better outcomes than conventional restoration objectives of site-scale species richness and are crucial for allocating restoration investment wisely to reach desired conservation goals. © 2016 Society for Conservation Biology.

Motor experience with a sport-specific implement affects motor imagery

PubMed Central

Zhu, Hua; Shen, Cheng; Zhang, Jian

2018-01-01

The present study tested whether sport-specific implements facilitate motor imagery, whereas nonspecific implements disrupt motor imagery. We asked a group of basketball players (experts) and a group of healthy controls (novices) to physically perform (motor execution) and mentally simulate (motor imagery) basketball throws. Subjects produced motor imagery when they were holding a basketball, a volleyball, or nothing. Motor imagery performance was measured by temporal congruence, which is the correspondence between imagery and execution times estimated as (imagery time minus execution time) divided by (imagery time plus execution time), as well as the vividness of motor imagery. Results showed that experts produced greater temporal congruence and vividness of kinesthetic imagery while holding a basketball compared to when they were holding nothing, suggesting a facilitation effect from sport-specific implements. In contrast, experts produced lower temporal congruence and vividness of kinesthetic imagery while holding a volleyball compared to when they were holding nothing, suggesting the interference effect of nonspecific implements. Furthermore, we found a negative correlation between temporal congruence and the vividness of kinesthetic imagery in experts while holding a basketball. On the contrary, the implement manipulation did not modulate the temporal congruence of novices. Our findings suggest that motor representation in experts is built on motor experience associated with specific-implement use and thus was subjected to modulation of the implement held. We conclude that sport-specific implements facilitate motor imagery, whereas nonspecific implements could disrupt motor representation in experts. PMID:29719738

Representation of action in occipito-temporal cortex.

PubMed

Wiggett, Alison J; Downing, Paul E

2011-07-01

A fundamental question for social cognitive neuroscience is how and where in the brain the identities and actions of others are represented. Here we present a replication and extension of a study by Kable and Chatterjee [Kable, J. W., & Chatterjee, A. Specificity of action representations in the lateral occipito-temporal cortex. Journal of Cognitive Neuroscience, 18, 1498-1517, 2006] examining the role of occipito-temporal cortex in these processes. We presented full-cue movies of actors performing whole-body actions and used fMRI to test for action- and identity-specific adaptation effects. We examined a series of functionally defined regions, including the extrastriate and fusiform body areas, the fusiform face area, the parahippocampal place area, the lateral occipital complex, the right posterior superior temporal sulcus, and motion-selective area hMT+. These regions were analyzed with both standard univariate measures as well as multivoxel pattern analyses. Additionally, we performed whole-brain tests for significant adaptation effects. We found significant action-specific adaptation in many areas, but no evidence for identity-specific adaptation. We argue that this finding could be explained by differences in the familiarity of the stimuli presented: The actions shown were familiar but the actors performing the actions were unfamiliar. However, in contrast to previous findings, we found that the action adaptation effect could not be conclusively tied to specific functionally defined regions. Instead, our results suggest that the adaptation to previously seen actions across identities is a widespread effect, evident across lateral and ventral occipito-temporal cortex.

Distinct medial temporal networks encode surprise during motivation by reward versus punishment

PubMed Central

Murty, Vishnu P.; LaBar, Kevin S.; Adcock, R. Alison

2016-01-01

Adaptive motivated behavior requires predictive internal representations of the environment, and surprising events are indications for encoding new representations of the environment. The medial temporal lobe memory system, including the hippocampus and surrounding cortex, encodes surprising events and is influenced by motivational state. Because behavior reflects the goals of an individual, we investigated whether motivational valence (i.e., pursuing rewards versus avoiding punishments) also impacts neural and mnemonic encoding of surprising events. During functional magnetic resonance imaging (fMRI), participants encountered perceptually unexpected events either during the pursuit of rewards or avoidance of punishments. Despite similar levels of motivation across groups, reward and punishment facilitated the processing of surprising events in different medial temporal lobe regions. Whereas during reward motivation, perceptual surprises enhanced activation in the hippocampus, during punishment motivation surprises instead enhanced activation in parahippocampal cortex. Further, we found that reward motivation facilitated hippocampal coupling with ventromedial PFC, whereas punishment motivation facilitated parahippocampal cortical coupling with orbitofrontal cortex. Behaviorally, post-scan testing revealed that reward, but not punishment, motivation resulted in greater memory selectivity for surprising events encountered during goal pursuit. Together these findings demonstrate that neuromodulatory systems engaged by anticipation of reward and punishment target separate components of the medial temporal lobe, modulating medial temporal lobe sensitivity and connectivity. Thus, reward and punishment motivation yield distinct neural contexts for learning, with distinct consequences for how surprises are incorporated into predictive mnemonic models of the environment. PMID:26854903

Distinct medial temporal networks encode surprise during motivation by reward versus punishment.

PubMed

Murty, Vishnu P; LaBar, Kevin S; Adcock, R Alison

2016-10-01

Adaptive motivated behavior requires predictive internal representations of the environment, and surprising events are indications for encoding new representations of the environment. The medial temporal lobe memory system, including the hippocampus and surrounding cortex, encodes surprising events and is influenced by motivational state. Because behavior reflects the goals of an individual, we investigated whether motivational valence (i.e., pursuing rewards versus avoiding punishments) also impacts neural and mnemonic encoding of surprising events. During functional magnetic resonance imaging (fMRI), participants encountered perceptually unexpected events either during the pursuit of rewards or avoidance of punishments. Despite similar levels of motivation across groups, reward and punishment facilitated the processing of surprising events in different medial temporal lobe regions. Whereas during reward motivation, perceptual surprises enhanced activation in the hippocampus, during punishment motivation surprises instead enhanced activation in parahippocampal cortex. Further, we found that reward motivation facilitated hippocampal coupling with ventromedial PFC, whereas punishment motivation facilitated parahippocampal cortical coupling with orbitofrontal cortex. Behaviorally, post-scan testing revealed that reward, but not punishment, motivation resulted in greater memory selectivity for surprising events encountered during goal pursuit. Together these findings demonstrate that neuromodulatory systems engaged by anticipation of reward and punishment target separate components of the medial temporal lobe, modulating medial temporal lobe sensitivity and connectivity. Thus, reward and punishment motivation yield distinct neural contexts for learning, with distinct consequences for how surprises are incorporated into predictive mnemonic models of the environment. Copyright © 2016 Elsevier Inc. All rights reserved.

Distortion of time interval reproduction in an epileptic patient with a focal lesion in the right anterior insular/inferior frontal cortices.

PubMed

Monfort, Vincent; Pfeuty, Micha; Klein, Madelyne; Collé, Steffie; Brissart, Hélène; Jonas, Jacques; Maillard, Louis

2014-11-01

This case report on an epileptic patient suffering from a focal lesion at the junction of the right anterior insular cortex (AIC) and the adjacent inferior frontal cortex (IFC) provides the first evidence that damage to this brain region impairs temporal performance in a visual time reproduction task in which participants had to reproduce the presentation duration (3, 5 and 7s) of emotionally-neutral and -negative pictures. Strikingly, as compared to a group of healthy subjects, the AIC/IFC case considerably overestimated reproduction times despite normal variability. The effect was obtained in all duration and emotion conditions. Such a distortion in time reproduction was not observed in four other epileptic patients without insular or inferior frontal damage. Importantly, the absolute extent of temporal over-reproduction increased in proportion to the magnitude of the target durations, which concurs with the scalar property of interval timing, and points to an impairment of time-specific rather than of non temporal (such as motor) mechanisms. Our data suggest that the disability in temporal reproduction of the AIC/IFC case would result from a distorted memory representation of the encoded duration, occurring during the process of storage and/or of recovery from memory and leading to a deviation of the temporal judgment during the reproduction task. These findings support the recent proposal that the anterior insular/inferior frontal cortices would be involved in time interval representation. Copyright © 2014 Elsevier Ltd. All rights reserved.

Crop vulnerability: Carya

USDA-ARS?s Scientific Manuscript database

Long established native tree populations reflect local adaptations. Representation of diverse populations in accessible ex situ collections that link information on phenotypic expression to information on spatial and temporal origination is the most efficient means of preserving and exploring genet...

Closing the loop: integrating human impacts on water resources to advanced land surface models

NASA Astrophysics Data System (ADS)

Zaitchik, B. F.; Nie, W.; Rodell, M.; Kumar, S.; Li, B.

2016-12-01

Advanced Land Surface Models (LSMs), including those used in the North American Land Data Assimilation System (NLDAS), offer a physically consistent and spatially and temporally complete analysis of the distributed water balance. These models are constrained both by physically-based process representation and by observations ingested as meteorological forcing or as data assimilation updates. As such, they have become important tools for hydrological monitoring and long-term climate analysis. The representation of water management, however, is extremely limited in these models. Recent advances have brought prognostic irrigation routines into models used in NLDAS, while assimilation of Gravity Recovery and Climate Experiment (GRACE) derived estimates of terrestrial water storage anomaly has made it possible to nudge models towards observed states in water storage below the root zone. But with few exceptions these LSMs do not account for the source of irrigation water, leading to a disconnect between the simulated water balance and the observed human impact on water resources. This inconsistency is unacceptable for long-term studies of climate change and human impact on water resources in North America. Here we define the modeling challenge, review instances of models that have begun to account for water withdrawals (e.g., CLM), and present ongoing efforts to improve representation of human impacts on water storage across models through integration of irrigation routines, water withdrawal information, and GRACE Data Assimilation in NLDAS LSMs.

Spacetime representation of topological phononics

NASA Astrophysics Data System (ADS)

Deymier, Pierre A.; Runge, Keith; Lucas, Pierre; Vasseur, Jérôme O.

2018-05-01

Non-conventional topology of elastic waves arises from breaking symmetry of phononic structures either intrinsically through internal resonances or extrinsically via application of external stimuli. We develop a spacetime representation based on twistor theory of an intrinsic topological elastic structure composed of a harmonic chain attached to a rigid substrate. Elastic waves in this structure obey the Klein–Gordon and Dirac equations and possesses spinorial character. We demonstrate the mapping between straight line trajectories of these elastic waves in spacetime and the twistor complex space. The twistor representation of these Dirac phonons is related to their topological and fermion-like properties. The second topological phononic structure is an extrinsic structure composed of a one-dimensional elastic medium subjected to a moving superlattice. We report an analogy between the elastic behavior of this time-dependent superlattice, the scalar quantum field theory and general relativity of two types of exotic particle excitations, namely temporal Dirac phonons and temporal ghost (tachyonic) phonons. These phonons live on separate sides of a two-dimensional frequency space and are delimited by ghost lines reminiscent of the conventional light cone. Both phonon types exhibit spinorial amplitudes that can be measured by mapping the particle behavior to the band structure of elastic waves.

Decoding the future from past experience: learning shapes predictions in early visual cortex.

PubMed

Luft, Caroline D B; Meeson, Alan; Welchman, Andrew E; Kourtzi, Zoe

2015-05-01

Learning the structure of the environment is critical for interpreting the current scene and predicting upcoming events. However, the brain mechanisms that support our ability to translate knowledge about scene statistics to sensory predictions remain largely unknown. Here we provide evidence that learning of temporal regularities shapes representations in early visual cortex that relate to our ability to predict sensory events. We tested the participants' ability to predict the orientation of a test stimulus after exposure to sequences of leftward- or rightward-oriented gratings. Using fMRI decoding, we identified brain patterns related to the observers' visual predictions rather than stimulus-driven activity. Decoding of predicted orientations following structured sequences was enhanced after training, while decoding of cued orientations following exposure to random sequences did not change. These predictive representations appear to be driven by the same large-scale neural populations that encode actual stimulus orientation and to be specific to the learned sequence structure. Thus our findings provide evidence that learning temporal structures supports our ability to predict future events by reactivating selective sensory representations as early as in primary visual cortex. Copyright © 2015 the American Physiological Society.

A Balanced Comparison of Object Invariances in Monkey IT Neurons.

PubMed

Ratan Murty, N Apurva; Arun, Sripati P

2017-01-01

Our ability to recognize objects across variations in size, position, or rotation is based on invariant object representations in higher visual cortex. However, we know little about how these invariances are related. Are some invariances harder than others? Do some invariances arise faster than others? These comparisons can be made only upon equating image changes across transformations. Here, we targeted invariant neural representations in the monkey inferotemporal (IT) cortex using object images with balanced changes in size, position, and rotation. Across the recorded population, IT neurons generalized across size and position both stronger and faster than to rotations in the image plane as well as in depth. We obtained a similar ordering of invariances in deep neural networks but not in low-level visual representations. Thus, invariant neural representations dynamically evolve in a temporal order reflective of their underlying computational complexity.

How the past weighs on the present: social representations of history and their role in identity politics.

PubMed

Liu, James H; Hilton, Denis J

2005-12-01

Socially shared representations of history have been important in creating, maintaining and changing a people's identity. Their management and negotiation are central to interethnic and international relations. We present a narrative framework to represent how collectively significant events become (selectively) incorporated in social representations that enable positioning of ethnic, national and supranational identities. This perspective creates diachronic (temporal) links between the functional (e.g. realistic conflict theory), social identity, and cognitive perspectives on intergroup relations. The charters embedded in these representations condition nations with similar interests to adopt different political stances in dealing with current events, and can influence the perceived stability and legitimacy of social orders. They are also instrumental in determining social identity strategies for reacting to negative social comparisons, and can influence the relationships between national and ethnic identities.

Network adaptation improves temporal representation of naturalistic stimuli in Drosophila eye: I dynamics.

PubMed

Zheng, Lei; Nikolaev, Anton; Wardill, Trevor J; O'Kane, Cahir J; de Polavieja, Gonzalo G; Juusola, Mikko

2009-01-01

Because of the limited processing capacity of eyes, retinal networks must adapt constantly to best present the ever changing visual world to the brain. However, we still know little about how adaptation in retinal networks shapes neural encoding of changing information. To study this question, we recorded voltage responses from photoreceptors (R1-R6) and their output neurons (LMCs) in the Drosophila eye to repeated patterns of contrast values, collected from natural scenes. By analyzing the continuous photoreceptor-to-LMC transformations of these graded-potential neurons, we show that the efficiency of coding is dynamically improved by adaptation. In particular, adaptation enhances both the frequency and amplitude distribution of LMC output by improving sensitivity to under-represented signals within seconds. Moreover, the signal-to-noise ratio of LMC output increases in the same time scale. We suggest that these coding properties can be used to study network adaptation using the genetic tools in Drosophila, as shown in a companion paper (Part II).

Toward improved simulation of river operations through integration with a hydrologic model

USGS Publications Warehouse

Morway, Eric D.; Niswonger, Richard G.; Triana, Enrique

2016-01-01

Advanced modeling tools are needed for informed water resources planning and management. Two classes of modeling tools are often used to this end–(1) distributed-parameter hydrologic models for quantifying supply and (2) river-operation models for sorting out demands under rule-based systems such as the prior-appropriation doctrine. Within each of these two broad classes of models, there are many software tools that excel at simulating the processes specific to each discipline, but have historically over-simplified, or at worse completely neglected, aspects of the other. As a result, water managers reliant on river-operation models for administering water resources need improved tools for representing spatially and temporally varying groundwater resources in conjunctive-use systems. A new tool is described that improves the representation of groundwater/surface-water (GW-SW) interaction within a river-operations modeling context and, in so doing, advances evaluation of system-wide hydrologic consequences of new or altered management regimes.

Network Adaptation Improves Temporal Representation of Naturalistic Stimuli in Drosophila Eye: I Dynamics

PubMed Central

Wardill, Trevor J.; O'Kane, Cahir J.; de Polavieja, Gonzalo G.; Juusola, Mikko

2009-01-01

Because of the limited processing capacity of eyes, retinal networks must adapt constantly to best present the ever changing visual world to the brain. However, we still know little about how adaptation in retinal networks shapes neural encoding of changing information. To study this question, we recorded voltage responses from photoreceptors (R1–R6) and their output neurons (LMCs) in the Drosophila eye to repeated patterns of contrast values, collected from natural scenes. By analyzing the continuous photoreceptor-to-LMC transformations of these graded-potential neurons, we show that the efficiency of coding is dynamically improved by adaptation. In particular, adaptation enhances both the frequency and amplitude distribution of LMC output by improving sensitivity to under-represented signals within seconds. Moreover, the signal-to-noise ratio of LMC output increases in the same time scale. We suggest that these coding properties can be used to study network adaptation using the genetic tools in Drosophila, as shown in a companion paper (Part II). PMID:19180196

Drought Patterns Forecasting using an Auto-Regressive Logistic Model

NASA Astrophysics Data System (ADS)

del Jesus, M.; Sheffield, J.; Méndez Incera, F. J.; Losada, I. J.; Espejo, A.

2014-12-01

Drought is characterized by a water deficit that may manifest across a large range of spatial and temporal scales. Drought may create important socio-economic consequences, many times of catastrophic dimensions. A quantifiable definition of drought is elusive because depending on its impacts, consequences and generation mechanism, different water deficit periods may be identified as a drought by virtue of some definitions but not by others. Droughts are linked to the water cycle and, although a climate change signal may not have emerged yet, they are also intimately linked to climate.In this work we develop an auto-regressive logistic model for drought prediction at different temporal scales that makes use of a spatially explicit framework. Our model allows to include covariates, continuous or categorical, to improve the performance of the auto-regressive component.Our approach makes use of dimensionality reduction (principal component analysis) and classification techniques (K-Means and maximum dissimilarity) to simplify the representation of complex climatic patterns, such as sea surface temperature (SST) and sea level pressure (SLP), while including information on their spatial structure, i.e. considering their spatial patterns. This procedure allows us to include in the analysis multivariate representation of complex climatic phenomena, as the El Niño-Southern Oscillation. We also explore the impact of other climate-related variables such as sun spots. The model allows to quantify the uncertainty of the forecasts and can be easily adapted to make predictions under future climatic scenarios. The framework herein presented may be extended to other applications such as flash flood analysis, or risk assessment of natural hazards.

A study of the Alboran sea mesoscale system by means of empirical orthogonal function decomposition of satellite data

NASA Astrophysics Data System (ADS)

Baldacci, A.; Corsini, G.; Grasso, R.; Manzella, G.; Allen, J. T.; Cipollini, P.; Guymer, T. H.; Snaith, H. M.

2001-05-01

This paper presents the results of a combined empirical orthogonal function (EOF) analysis of Advanced Very High Resolution Radiometer (AVHRR) sea surface temperature (SST) data and sea-viewing wide field-of-view sensor (SeaWiFS) chlorophyll concentration data over the Alboran Sea (Western Mediterranean), covering a period of 1 year (November 1997-October 1998). The aim of this study is to go beyond the limited temporal extent of available in situ measurements by inferring the temporal and spatial variability of the Alboran Gyre system from long temporal series of satellite observations, in order to gain insight on the interactions between the circulation and the biological activity in the system. In this context, EOF decomposition permits concise and synoptic representation of the effects of physical and biological phenomena traced by SST and chlorophyll concentration. Thus, it is possible to focus the analysis on the most significant phenomena and to understand better the complex interactions between physics and biology at the mesoscale. The results of the EOF analysis of AVHRR-SST and SeaWiFS-chlorophyll concentration data are presented and discussed in detail. These improve and complement the knowledge acquired during the in situ observational campaigns of the MAST-III Observations and Modelling of Eddy scale Geostrophic and Ageostrophic motion (OMEGA) Project.

Rapid Transient Pressure Field Computations in the Nearfield of Circular Transducers using Frequency Domain Time-Space Decomposition

PubMed Central

Alles, E. J.; Zhu, Y.; van Dongen, K. W. A.; McGough, R. J.

2013-01-01

The fast nearfield method, when combined with time-space decomposition, is a rapid and accurate approach for calculating transient nearfield pressures generated by ultrasound transducers. However, the standard time-space decomposition approach is only applicable to certain analytical representations of the temporal transducer surface velocity that, when applied to the fast nearfield method, are expressed as a finite sum of products of separate temporal and spatial terms. To extend time-space decomposition such that accelerated transient field simulations are enabled in the nearfield for an arbitrary transducer surface velocity, a new transient simulation method, frequency domain time-space decomposition (FDTSD), is derived. With this method, the temporal transducer surface velocity is transformed into the frequency domain, and then each complex-valued term is processed separately. Further improvements are achieved by spectral clipping, which reduces the number of terms and the computation time. Trade-offs between speed and accuracy are established for FDTSD calculations, and pressure fields obtained with the FDTSD method for a circular transducer are compared to those obtained with Field II and the impulse response method. The FDTSD approach, when combined with the fast nearfield method and spectral clipping, consistently achieves smaller errors in less time and requires less memory than Field II or the impulse response method. PMID:23160476

Do working memory-driven attention shifts speed up visual awareness?

PubMed

Pan, Yi; Cheng, Qiu-Ping

2011-11-01

Previous research has shown that content representations in working memory (WM) can bias attention in favor of matching stimuli in the scene. Using a visual prior-entry procedure, we here investigate whether such WM-driven attention shifts can speed up the conscious awareness of memory-matching relative to memory-mismatching stimuli. Participants were asked to hold a color cue in WM and to subsequently perform a temporal order judgment (TOJ) task by reporting either of two different-colored circles (presented to the left and right of fixation with a variable temporal interval) as having the first onset. One of the two TOJ circles could match the memory cue in color. We found that awareness of the temporal order of the circle onsets was not affected by the contents of WM, even when participants were explicitly informed that one of the TOJ circles would always match the WM contents. The null effect of WM on TOJs was not due to an inability of the memory-matching item to capture attention, since response times to the target in a follow-up experiment were improved when it appeared at the location of the memory-matching item. The present findings suggest that WM-driven attention shifts cannot accelerate phenomenal awareness of matching stimuli in the visual field.

Assessment of the aerosol distribution over Indian subcontinent in CMIP5 models

NASA Astrophysics Data System (ADS)

Sanap, S. D.; Ayantika, D. C.; Pandithurai, G.; Niranjan, K.

2014-04-01

This paper examines the aerosol distribution over Indian subcontinent as represented in 21 models from Coupled Model Inter-comparison Project Phase 5 (CMIP5) simulations, wherein model simulated aerosol optical depth (AOD) is compared with Moderate Resolution Imaging Spectro-radiometer (MODIS) satellite observations. The objective of the study is to provide an assessment of the capability of various global models, participating in CMIP5 project, in capturing the realistic spatial and temporal distribution of aerosol species over the Indian subcontinent. Results from our analysis show that majority of the CMIP5 models (excepting HADGEM2-ES, HADGEM2-CC) seriously underestimates the spatio-temporal variability of aerosol species over the Indian subcontinent, in particular over Indo-Gangetic Plains (IGP). Since IGP region is dominated by anthropogenic activities, high population density, and wind driven transport of dust and other aerosol species, MODIS observations reveal high AOD values over this region. Though the representation of black carbon (BC) loading in many models is fairly good, the dust loading is observed to be significantly low in majority of the models. The presence of pronounced dust activity over northern India and dust being one of the major constituent of aerosol species, the biases in dust loading has a great impact on the AOD of that region. We found that considerable biases in simulating the 850 hPa wind field (which plays important role in transport of dust from adjacent deserts) would be the possible reason for poor representation of dust AOD and in turn total AOD over Indian region in CMIP5 models. In addition, aerosol radiative forcing (ARF) underestimated/overestimated in most of the models. However, spatial distribution of ARF in multi-model ensemble mean is comparable reasonably well with observations with bias in magnitudes. This analysis emphasizes the fundamental need to improve the representation of aerosol species in current state of the art climate models. As reported in Intergovernmental Panel on Climate Change (IPCC) fourth assessment report (AR4), the level of scientific understanding (LOSU) of climatic impact of aerosols is medium-low. For better understanding of short and long term implications of changing concentrations of aerosol species on climate, it is imperative to have a realistic representation of aerosol distribution over regions with high aerosol loading.

Idiosyncratic Patterns of Representational Similarity in Prefrontal Cortex Predict Attentional Performance.

PubMed

Lee, Jeongmi; Geng, Joy J

2017-02-01

The efficiency of finding an object in a crowded environment depends largely on the similarity of nontargets to the search target. Models of attention theorize that the similarity is determined by representations stored within an "attentional template" held in working memory. However, the degree to which the contents of the attentional template are individually unique and where those idiosyncratic representations are encoded in the brain are unknown. We investigated this problem using representational similarity analysis of human fMRI data to measure the common and idiosyncratic representations of famous face morphs during an identity categorization task; data from the categorization task were then used to predict performance on a separate identity search task. We hypothesized that the idiosyncratic categorical representations of the continuous face morphs would predict their distractability when searching for each target identity. The results identified that patterns of activation in the lateral prefrontal cortex (LPFC) as well as in face-selective areas in the ventral temporal cortex were highly correlated with the patterns of behavioral categorization of face morphs and search performance that were common across subjects. However, the individually unique components of the categorization behavior were reliably decoded only in right LPFC. Moreover, the neural pattern in right LPFC successfully predicted idiosyncratic variability in search performance, such that reaction times were longer when distractors had a higher probability of being categorized as the target identity. These results suggest that the prefrontal cortex encodes individually unique components of categorical representations that are also present in attentional templates for target search. Everyone's perception of the world is uniquely shaped by personal experiences and preferences. Using functional MRI, we show that individual differences in the categorization of face morphs between two identities could be decoded from the prefrontal cortex and the ventral temporal cortex. Moreover, the individually unique representations in prefrontal cortex predicted idiosyncratic variability in attentional performance when looking for each identity in the "crowd" of another morphed face in a separate search task. Our results reveal that the representation of task-related information in prefrontal cortex is individually unique and preserved across categorization and search performance. This demonstrates the possibility of predicting individual behaviors across tasks with patterns of brain activity. Copyright © 2017 the authors 0270-6474/17/371257-12$15.00/0.

Time drawings: Spatial representation of temporal concepts.

PubMed

Leone, María Juliana; Salles, Alejo; Pulver, Alejandro; Golombek, Diego Andrés; Sigman, Mariano

2018-03-01

Time representation is a fundamental property of human cognition. Ample evidence shows that time (and numbers) are represented in space. However, how the conceptual mapping varies across individuals, scales, and temporal structures remains largely unknown. To investigate this issue, we conducted a large online study consisting in five experiments that addressed different time scales and topology: Zones of time, Seasons, Days of the week, Parts of the day and Timeline. Participants were asked to map different kinds of time events to a location in space and to determine their size and color. Results showed that time is organized in space in a hierarchical progression: some features appear to be universal (i.e. selection order), others are shaped by how time is organized in distinct cultures (i.e. location order) and, finally, some aspects vary depending on individual features such as age, gender, and chronotype (i.e. size and color). Copyright © 2018 Elsevier Inc. All rights reserved.

The cortical organization of lexical knowledge: A dual lexicon model of spoken language processing

PubMed Central

Gow, David W.

2012-01-01

Current accounts of spoken language assume the existence of a lexicon where wordforms are stored and interact during spoken language perception, understanding and production. Despite the theoretical importance of the wordform lexicon, the exact localization and function of the lexicon in the broader context of language use is not well understood. This review draws on evidence from aphasia, functional imaging, neuroanatomy, laboratory phonology and behavioral results to argue for the existence of parallel lexica that facilitate different processes in the dorsal and ventral speech pathways. The dorsal lexicon, localized in the inferior parietal region including the supramarginal gyrus, serves as an interface between phonetic and articulatory representations. The ventral lexicon, localized in the posterior superior temporal sulcus and middle temporal gyrus, serves as an interface between phonetic and semantic representations. In addition to their interface roles, the two lexica contribute to the robustness of speech processing. PMID:22498237

Resolving human object recognition in space and time

PubMed Central

Cichy, Radoslaw Martin; Pantazis, Dimitrios; Oliva, Aude

2014-01-01

A comprehensive picture of object processing in the human brain requires combining both spatial and temporal information about brain activity. Here, we acquired human magnetoencephalography (MEG) and functional magnetic resonance imaging (fMRI) responses to 92 object images. Multivariate pattern classification applied to MEG revealed the time course of object processing: whereas individual images were discriminated by visual representations early, ordinate and superordinate category levels emerged relatively later. Using representational similarity analysis, we combine human fMRI and MEG to show content-specific correspondence between early MEG responses and primary visual cortex (V1), and later MEG responses and inferior temporal (IT) cortex. We identified transient and persistent neural activities during object processing, with sources in V1 and IT., Finally, human MEG signals were correlated to single-unit responses in monkey IT. Together, our findings provide an integrated space- and time-resolved view of human object categorization during the first few hundred milliseconds of vision. PMID:24464044

Dynamic Integration of Task-Relevant Visual Features in Posterior Parietal Cortex

PubMed Central

Freedman, David J.

2014-01-01

Summary The primate visual system consists of multiple hierarchically organized cortical areas, each specialized for processing distinct aspects of the visual scene. For example, color and form are encoded in ventral pathway areas such as V4 and inferior temporal cortex, while motion is preferentially processed in dorsal pathway areas such as the middle temporal area. Such representations often need to be integrated perceptually to solve tasks which depend on multiple features. We tested the hypothesis that the lateral intraparietal area (LIP) integrates disparate task-relevant visual features by recording from LIP neurons in monkeys trained to identify target stimuli composed of conjunctions of color and motion features. We show that LIP neurons exhibit integrative representations of both color and motion features when they are task relevant, and task-dependent shifts of both direction and color tuning. This suggests that LIP plays a role in flexibly integrating task-relevant sensory signals. PMID:25199703

Cortical dynamics of three-dimensional figure-ground perception of two-dimensional pictures.

PubMed

Grossberg, S

1997-07-01

This article develops the FACADE theory of 3-dimensional (3-D) vision and figure-ground separation to explain data concerning how 2-dimensional pictures give rise to 3-D percepts of occluding and occluded objects. The model describes how geometrical and contrastive properties of a picture can either cooperate or compete when forming the boundaries and surface representation that subserve conscious percepts. Spatially long-range cooperation and spatially short-range competition work together to separate the boundaries of occluding figures from their occluded neighbors. This boundary ownership process is sensitive to image T junctions at which occluded figures contact occluding figures. These boundaries control the filling-in of color within multiple depth-sensitive surface representations. Feedback between surface and boundary representations strengthens consistent boundaries while inhibiting inconsistent ones. Both the boundary and the surface representations of occluded objects may be amodally completed, while the surface representations of unoccluded objects become visible through modal completion. Functional roles for conscious modal and amodal representations in object recognition, spatial attention, and reaching behaviors are discussed. Model interactions are interpreted in terms of visual, temporal, and parietal cortices.

Data Assimilation of AirSWOT and Synthetically Derived SWOT Observations of Water Surface Elevation in a Multichannel River

NASA Astrophysics Data System (ADS)

Altenau, E. H.; Pavelsky, T.; Andreadis, K.; Bates, P. D.; Neal, J. C.

2017-12-01

Multichannel rivers continue to be challenging features to quantify, especially at regional and global scales, which is problematic because accurate representations of such environments are needed to properly monitor the earth's water cycle as it adjusts to climate change. It has been demonstrated that higher-complexity, 2D models outperform lower-complexity, 1D models in simulating multichannel river hydraulics at regional scales due to the inclusion of the channel network's connectivity. However, new remote sensing measurements from the future Surface Water and Ocean Topography (SWOT) mission and it's airborne analog AirSWOT offer new observations that can be used to try and improve the lower-complexity, 1D models to achieve accuracies closer to the higher-complexity, 2D codes. Here, we use an Ensemble Kalman Filter (EnKF) to assimilate AirSWOT water surface elevation (WSE) measurements from a 2015 field campaign into a 1D hydrodynamic model along a 90 km reach of Tanana River, AK. This work is the first to test data assimilation methods using real SWOT-like data from AirSWOT. Additionally, synthetic SWOT observations of WSE are generated across the same study site using a fine-resolution 2D model and assimilated into the coarser-resolution 1D model. Lastly, we compare the abilities of AirSWOT and the synthetic-SWOT observations to improve spatial and temporal model outputs in WSEs. Results indicate 1D model outputs of spatially distributed WSEs improve as observational coverage increases, and improvements in temporal fluctuations in WSEs depend on the number of observations. Furthermore, results reveal that assimilation of AirSWOT observations produce greater error reductions in 1D model outputs compared to synthetic SWOT observations due to lower measurement errors. Both AirSWOT and the synthetic SWOT observations significantly lower spatial and temporal errors in 1D model outputs of WSEs.

Remembering the past and imagining the future

PubMed Central

Byrne, Patrick; Becker, Suzanna; Burgess, Neil

2009-01-01

The neural mechanisms underlying spatial cognition are modelled, integrating neuronal, systems and behavioural data, and addressing the relationships between long-term memory, short-term memory and imagery, and between egocentric and allocentric and visual and idiothetic representations. Long-term spatial memory is modeled as attractor dynamics within medial-temporal allocentric representations, and short-term memory as egocentric parietal representations driven by perception, retrieval and imagery, and modulated by directed attention. Both encoding and retrieval/ imagery require translation between egocentric and allocentric representations, mediated by posterior parietal and retrosplenial areas and utilizing head direction representations in Papez’s circuit. Thus hippocampus effectively indexes information by real or imagined location, while Papez’s circuit translates to imagery or from perception according to the direction of view. Modulation of this translation by motor efference allows “spatial updating” of representations, while prefrontal simulated motor efference allows mental exploration. The alternating temporo-parietal flows of information are organized by the theta rhythm. Simulations demonstrate the retrieval and updating of familiar spatial scenes, hemispatial neglect in memory, and the effects on hippocampal place cell firing of lesioned head direction representations and of conflicting visual and ideothetic inputs. PMID:17500630

When climate science became climate politics: British media representations of climate change in 1988.

PubMed

Jaspal, Rusi; Nerlich, Brigitte

2014-02-01

Climate change has become a pressing environmental concern for scientists, social commentators and politicians. Previous social science research has explored media representations of climate change in various temporal and geographical contexts. Through the lens of Social Representations Theory, this article provides a detailed qualitative thematic analysis of media representations of climate change in the 1988 British broadsheet press, given that this year constitutes an important juncture in this transition of climate change from the domain of science to that of the socio-political sphere. The following themes are outlined: (i) "Climate change: a multi-faceted threat"; (ii) "Collectivisation of threat"; (iii) "Climate change and the attribution of blame"; and (iv) "Speculative solutions to a complex socio-environmental problem." The article provides detailed empirical insights into the "starting-point" for present-day disputes concerning climate change and lays the theoretical foundations for tracking the continuities and discontinuities characterising social representations of climate change in the future.

Manifold decoding for neural representations of face viewpoint and gaze direction using magnetoencephalographic data.

PubMed

Kuo, Po-Chih; Chen, Yong-Sheng; Chen, Li-Fen

2018-05-01

The main challenge in decoding neural representations lies in linking neural activity to representational content or abstract concepts. The transformation from a neural-based to a low-dimensional representation may hold the key to encoding perceptual processes in the human brain. In this study, we developed a novel model by which to represent two changeable features of faces: face viewpoint and gaze direction. These features are embedded in spatiotemporal brain activity derived from magnetoencephalographic data. Our decoding results demonstrate that face viewpoint and gaze direction can be represented by manifold structures constructed from brain responses in the bilateral occipital face area and right superior temporal sulcus, respectively. Our results also show that the superposition of brain activity in the manifold space reveals the viewpoints of faces as well as directions of gazes as perceived by the subject. The proposed manifold representation model provides a novel opportunity to gain further insight into the processing of information in the human brain. © 2018 Wiley Periodicals, Inc.

Representation of Perceptual Color Space in Macaque Posterior Inferior Temporal Cortex (the V4 Complex)

PubMed Central

Bohon, Kaitlin S.; Hermann, Katherine L.; Hansen, Thorsten

2016-01-01

Abstract The lateral geniculate nucleus is thought to represent color using two populations of cone-opponent neurons [L vs M; S vs (L + M)], which establish the cardinal directions in color space (reddish vs cyan; lavender vs lime). How is this representation transformed to bring about color perception? Prior work implicates populations of glob cells in posterior inferior temporal cortex (PIT; the V4 complex), but the correspondence between the neural representation of color in PIT/V4 complex and the organization of perceptual color space is unclear. We compared color-tuning data for populations of glob cells and interglob cells to predictions obtained using models that varied in the color-tuning narrowness of the cells, and the color preference distribution across the populations. Glob cells were best accounted for by simulated neurons that have nonlinear (narrow) tuning and, as a population, represent a color space designed to be perceptually uniform (CIELUV). Multidimensional scaling and representational similarity analyses showed that the color space representations in both glob and interglob populations were correlated with the organization of CIELUV space, but glob cells showed a stronger correlation. Hue could be classified invariant to luminance with high accuracy given glob responses and above-chance accuracy given interglob responses. Luminance could be read out invariant to changes in hue in both populations, but interglob cells tended to prefer stimuli having luminance contrast, regardless of hue, whereas glob cells typically retained hue tuning as luminance contrast was modulated. The combined luminance/hue sensitivity of glob cells is predicted for neurons that can distinguish two colors of the same hue at different luminance levels (orange/brown). PMID:27595132

Semantic retrieval during overt picture description: Left anterior temporal or the parietal lobe?

PubMed

Geranmayeh, Fatemeh; Leech, Robert; Wise, Richard J S

2015-09-01

Retrieval of semantic representations is a central process during overt speech production. There is an increasing consensus that an amodal semantic 'hub' must exist that draws together modality-specific representations of concepts. Based on the distribution of atrophy and the behavioral deficit of patients with the semantic variant of fronto-temporal lobar degeneration, it has been proposed that this hub is localized within both anterior temporal lobes (ATL), and is functionally connected with verbal 'output' systems via the left ATL. An alternative view, dating from Geschwind's proposal in 1965, is that the angular gyrus (AG) is central to object-based semantic representations. In this fMRI study we examined the connectivity of the left ATL and parietal lobe (PL) with whole brain networks known to be activated during overt picture description. We decomposed each of these two brain volumes into 15 regions of interest (ROIs), using independent component analysis. A dual regression analysis was used to establish the connectivity of each ROI with whole brain-networks. An ROI within the left anterior superior temporal sulcus (antSTS) was functionally connected to other parts of the left ATL, including anterior ventromedial left temporal cortex (partially attenuated by signal loss due to susceptibility artifact), a large left dorsolateral prefrontal region (including 'classic' Broca's area), extensive bilateral sensory-motor cortices, and the length of both superior temporal gyri. The time-course of this functionally connected network was associated with picture description but not with non-semantic baseline tasks. This system has the distribution expected for the production of overt speech with appropriate semantic content, and the auditory monitoring of the overt speech output. In contrast, the only left PL ROI that showed connectivity with brain systems most strongly activated by the picture-description task, was in the superior parietal lobe (supPL). This region showed connectivity with predominantly posterior cortical regions required for the visual processing of the pictorial stimuli, with additional connectivity to the dorsal left AG and a small component of the left inferior frontal gyrus. None of the other PL ROIs that included part of the left AG were activated by Speech alone. The best interpretation of these results is that the left antSTS connects the proposed semantic hub (specifically localized to ventral anterior temporal cortex based on clinical neuropsychological studies) to posterior frontal regions and sensory-motor cortices responsible for the overt production of speech. Copyright © 2014 The Authors. Published by Elsevier Ltd.. All rights reserved.

Motor expertise modulates the unconscious processing of human body postures.

PubMed

Güldenpenning, Iris; Koester, Dirk; Kunde, Wilfried; Weigelt, Matthias; Schack, Thomas

2011-09-01

Little is known about the cognitive background of unconscious visuomotor control of complex sports movements. Therefore, we investigated the extent to which novices and skilled high-jump athletes are able to identify visually presented body postures of the high jump unconsciously. We also asked whether or not the manner of processing differs (qualitatively or quantitatively) between these groups as a function of their motor expertise. A priming experiment with not consciously perceivable stimuli was designed to determine whether subliminal priming of movement phases (same vs. different movement phases) or temporal order (i.e. natural vs. reversed movement order) affects target processing. Participants had to decide which phase of the high jump (approach vs. flight phase) a target photograph was taken from. We found a main effect of temporal order for skilled athletes, that is, faster reaction times for prime-target pairs that reflected the natural movement order as opposed to the reversed movement order. This result indicates that temporal-order information pertaining to the domain of expertise plays a critical role in athletes' perceptual capacities. For novices, data analyses revealed an interaction between temporal order and movement phases. That is, only the reversed movement order of flight-approach pictures increased processing time. Taken together, the results suggest that the structure of cognitive movement representation modulates unconscious processing of movement pictures and points to a functional role of motor representations in visual perception.

Accelerated dynamic EPR imaging using fast acquisition and compressive recovery.

PubMed

Ahmad, Rizwan; Samouilov, Alexandre; Zweier, Jay L

2016-12-01

Electron paramagnetic resonance (EPR) allows quantitative imaging of tissue redox status, which provides important information about ischemic syndromes, cancer and other pathologies. For continuous wave EPR imaging, however, poor signal-to-noise ratio and low acquisition efficiency limit its ability to image dynamic processes in vivo including tissue redox, where conditions can change rapidly. Here, we present a data acquisition and processing framework that couples fast acquisition with compressive sensing-inspired image recovery to enable EPR-based redox imaging with high spatial and temporal resolutions. The fast acquisition (FA) allows collecting more, albeit noisier, projections in a given scan time. The composite regularization based processing method, called spatio-temporal adaptive recovery (STAR), not only exploits sparsity in multiple representations of the spatio-temporal image but also adaptively adjusts the regularization strength for each representation based on its inherent level of the sparsity. As a result, STAR adjusts to the disparity in the level of sparsity across multiple representations, without introducing any tuning parameter. Our simulation and phantom imaging studies indicate that a combination of fast acquisition and STAR (FASTAR) enables high-fidelity recovery of volumetric image series, with each volumetric image employing less than 10 s of scan. In addition to image fidelity, the time constants derived from FASTAR also match closely to the ground truth even when a small number of projections are used for recovery. This development will enhance the capability of EPR to study fast dynamic processes that cannot be investigated using existing EPR imaging techniques. Copyright © 2016 Elsevier Inc. All rights reserved.

Spatiotemporal dynamics of processing nonsymbolic number: an event-related potential source localization study.

PubMed

Hyde, Daniel C; Spelke, Elizabeth S

2012-09-01

Coordinated studies with adults, infants, and nonhuman animals provide evidence for two distinct systems of nonverbal number representation. The "parallel individuation" (PI) system selects and retains information about one to three individual entities and the "numerical magnitude" system establishes representations of the approximate cardinal value of a group. Recent event-related potential (ERP) work has demonstrated that these systems reliably evoke functionally and temporally distinct patterns of brain response that correspond to established behavioral signatures. However, relatively little is known about the neural generators of these ERP signatures. To address this question, we targeted known ERP signatures of these systems, by contrasting processing of small versus large nonsymbolic numbers, and used a source localization algorithm (LORETA) to identify their cortical origins. Early processing of small numbers, showing the signature effects of PI on the N1 (∼150 ms), was localized primarily to extrastriate visual regions. In contrast, qualitatively and temporally distinct processing of large numbers, showing the signatures of approximate number representation on the mid-latency P2p (∼200-250 ms), was localized primarily to right intraparietal regions. In comparison, mid-latency small number processing was localized to the right temporal-parietal junction and left-lateralized intraparietal regions. These results add spatial information to the emerging ERP literature documenting the process by which we represent number. Furthermore, these results substantiate recent claims that early attentional processes determine whether a collection of objects will be represented through PI or as an approximate numerical magnitude by providing evidence that downstream processing diverges to distinct cortical regions. Copyright © 2011 Wiley Periodicals, Inc.

Reconstructing the spectrotemporal modulations of real-life sounds from fMRI response patterns

PubMed Central

Santoro, Roberta; Moerel, Michelle; De Martino, Federico; Valente, Giancarlo; Ugurbil, Kamil; Yacoub, Essa; Formisano, Elia

2017-01-01

Ethological views of brain functioning suggest that sound representations and computations in the auditory neural system are optimized finely to process and discriminate behaviorally relevant acoustic features and sounds (e.g., spectrotemporal modulations in the songs of zebra finches). Here, we show that modeling of neural sound representations in terms of frequency-specific spectrotemporal modulations enables accurate and specific reconstruction of real-life sounds from high-resolution functional magnetic resonance imaging (fMRI) response patterns in the human auditory cortex. Region-based analyses indicated that response patterns in separate portions of the auditory cortex are informative of distinctive sets of spectrotemporal modulations. Most relevantly, results revealed that in early auditory regions, and progressively more in surrounding regions, temporal modulations in a range relevant for speech analysis (∼2–4 Hz) were reconstructed more faithfully than other temporal modulations. In early auditory regions, this effect was frequency-dependent and only present for lower frequencies (<∼2 kHz), whereas for higher frequencies, reconstruction accuracy was higher for faster temporal modulations. Further analyses suggested that auditory cortical processing optimized for the fine-grained discrimination of speech and vocal sounds underlies this enhanced reconstruction accuracy. In sum, the present study introduces an approach to embed models of neural sound representations in the analysis of fMRI response patterns. Furthermore, it reveals that, in the human brain, even general purpose and fundamental neural processing mechanisms are shaped by the physical features of real-world stimuli that are most relevant for behavior (i.e., speech, voice). PMID:28420788

Spatiotemporal Context Awareness for Urban Traffic Modeling and Prediction: Sparse Representation Based Variable Selection.

PubMed

Yang, Su; Shi, Shixiong; Hu, Xiaobing; Wang, Minjie

2015-01-01

Spatial-temporal correlations among the data play an important role in traffic flow prediction. Correspondingly, traffic modeling and prediction based on big data analytics emerges due to the city-scale interactions among traffic flows. A new methodology based on sparse representation is proposed to reveal the spatial-temporal dependencies among traffic flows so as to simplify the correlations among traffic data for the prediction task at a given sensor. Three important findings are observed in the experiments: (1) Only traffic flows immediately prior to the present time affect the formation of current traffic flows, which implies the possibility to reduce the traditional high-order predictors into an 1-order model. (2) The spatial context relevant to a given prediction task is more complex than what is assumed to exist locally and can spread out to the whole city. (3) The spatial context varies with the target sensor undergoing prediction and enlarges with the increment of time lag for prediction. Because the scope of human mobility is subject to travel time, identifying the varying spatial context against time lag is crucial for prediction. Since sparse representation can capture the varying spatial context to adapt to the prediction task, it outperforms the traditional methods the inputs of which are confined as the data from a fixed number of nearby sensors. As the spatial-temporal context for any prediction task is fully detected from the traffic data in an automated manner, where no additional information regarding network topology is needed, it has good scalability to be applicable to large-scale networks.

Spatiotemporal Context Awareness for Urban Traffic Modeling and Prediction: Sparse Representation Based Variable Selection

PubMed Central

Yang, Su; Shi, Shixiong; Hu, Xiaobing; Wang, Minjie

2015-01-01

Spatial-temporal correlations among the data play an important role in traffic flow prediction. Correspondingly, traffic modeling and prediction based on big data analytics emerges due to the city-scale interactions among traffic flows. A new methodology based on sparse representation is proposed to reveal the spatial-temporal dependencies among traffic flows so as to simplify the correlations among traffic data for the prediction task at a given sensor. Three important findings are observed in the experiments: (1) Only traffic flows immediately prior to the present time affect the formation of current traffic flows, which implies the possibility to reduce the traditional high-order predictors into an 1-order model. (2) The spatial context relevant to a given prediction task is more complex than what is assumed to exist locally and can spread out to the whole city. (3) The spatial context varies with the target sensor undergoing prediction and enlarges with the increment of time lag for prediction. Because the scope of human mobility is subject to travel time, identifying the varying spatial context against time lag is crucial for prediction. Since sparse representation can capture the varying spatial context to adapt to the prediction task, it outperforms the traditional methods the inputs of which are confined as the data from a fixed number of nearby sensors. As the spatial-temporal context for any prediction task is fully detected from the traffic data in an automated manner, where no additional information regarding network topology is needed, it has good scalability to be applicable to large-scale networks. PMID:26496370

Distinct loci of lexical and semantic access deficits in aphasia: Evidence from voxel-based lesion-symptom mapping and diffusion tensor imaging.

PubMed

Harvey, Denise Y; Schnur, Tatiana T

2015-06-01

Naming pictures and matching words to pictures belonging to the same semantic category negatively affects language production and comprehension. By most accounts, semantic interference arises when accessing lexical representations in naming (e.g., Damian, Vigliocco, & Levelt, 2001) and semantic representations in comprehension (e.g., Forde & Humphreys, 1997). Further, damage to the left inferior frontal gyrus (LIFG), a region implicated in cognitive control, results in increasing semantic interference when items repeat across cycles in both language production and comprehension (Jefferies, Baker, Doran, & Lambon Ralph, 2007). This generates the prediction that the LIFG via white matter connections supports resolution of semantic interference arising from different loci (lexical vs semantic) in the temporal lobe. However, it remains unclear whether the cognitive and neural mechanisms that resolve semantic interference are the same across tasks. Thus, we examined which gray matter structures [using whole brain and region of interest (ROI) approaches] and white matter connections (using deterministic tractography) when damaged impact semantic interference and its increase across cycles when repeatedly producing and understanding words in 15 speakers with varying lexical-semantic deficits from left hemisphere stroke. We found that damage to distinct brain regions, the posterior versus anterior temporal lobe, was associated with semantic interference (collapsed across cycles) in naming and comprehension, respectively. Further, those with LIFG damage compared to those without exhibited marginally larger increases in semantic interference across cycles in naming but not comprehension. Lastly, the inferior fronto-occipital fasciculus, connecting the LIFG with posterior temporal lobe, related to semantic interference in naming, whereas the inferior longitudinal fasciculus (ILF), connecting posterior with anterior temporal regions related to semantic interference in comprehension. These neuroanatomical-behavioral findings have implications for models of the lexical-semantic language network by demonstrating that semantic interference in language production and comprehension involves different representations which differentially recruit a cognitive control mechanism for interference resolution. Copyright © 2015 Elsevier Ltd. All rights reserved.

Attractor concretion as a mechanism for the formation of context representations

PubMed Central

Rigotti, Mattia; Ben Dayan Rubin, Daniel; Morrison, Sara E.; Salzman, C. Daniel; Fusi, Stefano

2010-01-01

Complex tasks often require the memory of recent events, the knowledge about the context in which they occur, and the goals we intend to reach. All this information is stored in our mental states. Given a set of mental states, reinforcement learning (RL) algorithms predict the optimal policy that maximizes future reward. RL algorithms assign a value to each already-known state so that discovering the optimal policy reduces to selecting the action leading to the state with the highest value. But how does the brain create representations of these mental states in the first place? We propose a mechanism for the creation of mental states that contain information about the temporal statistics of the events in a particular context. We suggest that the mental states are represented by stable patterns of reverberating activity, which are attractors of the neural dynamics. These representations are built from neurons that are selective to specific combinations of external events (e.g. sensory stimuli) and pre-existent mental states. Consistent with this notion, we find that neurons in the amygdala and in orbito-frontal cortex (OFC) often exhibit this form of mixed selectivity. We propose that activating different mixed selectivity neurons in a fixed temporal order modifies synaptic connections so that conjunctions of events and mental states merge into a single pattern of reverberating activity. This process corresponds to the birth of a new different mental state that encodes a different temporal context. The concretion process depends on temporal contiguity, i.e. on the probability that a combination of an event and mental states follows or precedes the events and states that define a certain context. The information contained in the context thereby allows an animal to assign unambiguously a value to the events that initially appeared in different situations with different meanings. PMID:20100580

Spatial hearing benefits demonstrated with presentation of acoustic temporal fine structure cues in bilateral cochlear implant listeners.

PubMed

Churchill, Tyler H; Kan, Alan; Goupell, Matthew J; Litovsky, Ruth Y

2014-09-01

Most contemporary cochlear implant (CI) processing strategies discard acoustic temporal fine structure (TFS) information, and this may contribute to the observed deficits in bilateral CI listeners' ability to localize sounds when compared to normal hearing listeners. Additionally, for best speech envelope representation, most contemporary speech processing strategies use high-rate carriers (≥900 Hz) that exceed the limit for interaural pulse timing to provide useful binaural information. Many bilateral CI listeners are sensitive to interaural time differences (ITDs) in low-rate (<300 Hz) constant-amplitude pulse trains. This study explored the trade-off between superior speech temporal envelope representation with high-rate carriers and binaural pulse timing sensitivity with low-rate carriers. The effects of carrier pulse rate and pulse timing on ITD discrimination, ITD lateralization, and speech recognition in quiet were examined in eight bilateral CI listeners. Stimuli consisted of speech tokens processed at different electrical stimulation rates, and pulse timings that either preserved or did not preserve acoustic TFS cues. Results showed that CI listeners were able to use low-rate pulse timing cues derived from acoustic TFS when presented redundantly on multiple electrodes for ITD discrimination and lateralization of speech stimuli.

The temporal representation of speech in a nonlinear model of the guinea pig cochlea

NASA Astrophysics Data System (ADS)

Holmes, Stephen D.; Sumner, Christian J.; O'Mard, Lowel P.; Meddis, Ray

2004-12-01

The temporal representation of speechlike stimuli in the auditory-nerve output of a guinea pig cochlea model is described. The model consists of a bank of dual resonance nonlinear filters that simulate the vibratory response of the basilar membrane followed by a model of the inner hair cell/auditory nerve complex. The model is evaluated by comparing its output with published physiological auditory nerve data in response to single and double vowels. The evaluation includes analyses of individual fibers, as well as ensemble responses over a wide range of best frequencies. In all cases the model response closely follows the patterns in the physiological data, particularly the tendency for the temporal firing pattern of each fiber to represent the frequency of a nearby formant of the speech sound. In the model this behavior is largely a consequence of filter shapes; nonlinear filtering has only a small contribution at low frequencies. The guinea pig cochlear model produces a useful simulation of the measured physiological response to simple speech sounds and is therefore suitable for use in more advanced applications including attempts to generalize these principles to the response of human auditory system, both normal and impaired. .

Improvement of gray-scale representation of horizontally scanning holographic display using error diffusion.

PubMed

Matsumoto, Yuji; Takaki, Yasuhiro

2014-06-15

Horizontally scanning holography can enlarge both screen size and viewing zone angle. A microelectromechanical-system spatial light modulator, which can generate only binary images, is used to generate hologram patterns. Thus, techniques to improve gray-scale representation in reconstructed images should be developed. In this study, the error diffusion technique was used for the binarization of holograms. When the Floyd-Steinberg error diffusion coefficients were used, gray-scale representation was improved. However, the linearity in the gray-scale representation was not satisfactory. We proposed the use of a correction table and showed that the linearity was greatly improved.

Temporal efficiency evaluation and small-worldness characterization in temporal networks

PubMed Central

Dai, Zhongxiang; Chen, Yu; Li, Junhua; Fam, Johnson; Bezerianos, Anastasios; Sun, Yu

2016-01-01

Numerous real-world systems can be modeled as networks. To date, most network studies have been conducted assuming stationary network characteristics. Many systems, however, undergo topological changes over time. Temporal networks, which incorporate time into conventional network models, are therefore more accurate representations of such dynamic systems. Here, we introduce a novel generalized analytical framework for temporal networks, which enables 1) robust evaluation of the efficiency of temporal information exchange using two new network metrics and 2) quantitative inspection of the temporal small-worldness. Specifically, we define new robust temporal network efficiency measures by incorporating the time dependency of temporal distance. We propose a temporal regular network model, and based on this plus the redefined temporal efficiency metrics and widely used temporal random network models, we introduce a quantitative approach for identifying temporal small-world architectures (featuring high temporal network efficiency both globally and locally). In addition, within this framework, we can uncover network-specific dynamic structures. Applications to brain networks, international trade networks, and social networks reveal prominent temporal small-world properties with distinct dynamic network structures. We believe that the framework can provide further insight into dynamic changes in the network topology of various real-world systems and significantly promote research on temporal networks. PMID:27682314

Temporal efficiency evaluation and small-worldness characterization in temporal networks

NASA Astrophysics Data System (ADS)

Dai, Zhongxiang; Chen, Yu; Li, Junhua; Fam, Johnson; Bezerianos, Anastasios; Sun, Yu

2016-09-01

Numerous real-world systems can be modeled as networks. To date, most network studies have been conducted assuming stationary network characteristics. Many systems, however, undergo topological changes over time. Temporal networks, which incorporate time into conventional network models, are therefore more accurate representations of such dynamic systems. Here, we introduce a novel generalized analytical framework for temporal networks, which enables 1) robust evaluation of the efficiency of temporal information exchange using two new network metrics and 2) quantitative inspection of the temporal small-worldness. Specifically, we define new robust temporal network efficiency measures by incorporating the time dependency of temporal distance. We propose a temporal regular network model, and based on this plus the redefined temporal efficiency metrics and widely used temporal random network models, we introduce a quantitative approach for identifying temporal small-world architectures (featuring high temporal network efficiency both globally and locally). In addition, within this framework, we can uncover network-specific dynamic structures. Applications to brain networks, international trade networks, and social networks reveal prominent temporal small-world properties with distinct dynamic network structures. We believe that the framework can provide further insight into dynamic changes in the network topology of various real-world systems and significantly promote research on temporal networks.

Multi-representation based on scientific investigation for enhancing students’ representation skills

NASA Astrophysics Data System (ADS)

Siswanto, J.; Susantini, E.; Jatmiko, B.

2018-03-01

This research aims to implementation learning physics with multi-representation based on the scientific investigation for enhancing students’ representation skills, especially on the magnetic field subject. The research design is one group pretest-posttest. This research was conducted in the department of mathematics education, Universitas PGRI Semarang, with the sample is students of class 2F who take basic physics courses. The data were obtained by representation skills test and documentation of multi-representation worksheet. The Results show gain analysis value of .64 which means some medium improvements. The result of t-test (α = .05) is shows p-value = .001. This learning significantly improves students representation skills.

Unique semantic space in the brain of each beholder predicts perceived similarity

PubMed Central

Charest, Ian; Kievit, Rogier A.; Schmitz, Taylor W.; Deca, Diana; Kriegeskorte, Nikolaus

2014-01-01

The unique way in which each of us perceives the world must arise from our brain representations. If brain imaging could reveal an individual’s unique mental representation, it could help us understand the biological substrate of our individual experiential worlds in mental health and disease. However, imaging studies of object vision have focused on commonalities between individuals rather than individual differences and on category averages rather than representations of particular objects. Here we investigate the individually unique component of brain representations of particular objects with functional MRI (fMRI). Subjects were presented with unfamiliar and personally meaningful object images while we measured their brain activity on two separate days. We characterized the representational geometry by the dissimilarity matrix of activity patterns elicited by particular object images. The representational geometry remained stable across scanning days and was unique in each individual in early visual cortex and human inferior temporal cortex (hIT). The hIT representation predicted perceived similarity as reflected in dissimilarity judgments. Importantly, hIT predicted the individually unique component of the judgments when the objects were personally meaningful. Our results suggest that hIT brain representational idiosyncrasies accessible to fMRI are expressed in an individual's perceptual judgments. The unique way each of us perceives the world thus might reflect the individually unique representation in high-level visual areas. PMID:25246586

Beyond the FFA: The Role of the Ventral Anterior Temporal Lobes in Face Processing

PubMed Central

Collins, Jessica A.; Olson, Ingrid R.

2014-01-01

Extensive research has supported the existence of a specialized face-processing network that is distinct from the visual processing areas used for general object recognition. The majority of this work has been aimed at characterizing the response properties of the fusiform face area (FFA) and the occipital face area (OFA), which together are thought to constitute the core network of brain areas responsible for facial identification. Although accruing evidence has shown that face-selective patches in the ventral anterior temporal lobes (vATLs) are interconnected with the FFA and OFA, and that they play a role in facial identification, the relative contribution of these brain areas to the core face-processing network has remained unarticulated. Here we review recent research critically implicating the vATLs in face perception and memory. We propose that current models of face processing should be revised such that the ventral anterior temporal lobes serve a centralized role in the visual face-processing network. We speculate that a hierarchically organized system of face processing areas extends bilaterally from the inferior occipital gyri to the vATLs, with facial representations becoming increasingly complex and abstracted from low-level perceptual features as they move forward along this network. The anterior temporal face areas may serve as the apex of this hierarchy, instantiating the final stages of face recognition. We further argue that the anterior temporal face areas are ideally suited to serve as an interface between face perception and face memory, linking perceptual representations of individual identity with person-specific semantic knowledge. PMID:24937188

A Balanced Comparison of Object Invariances in Monkey IT Neurons

PubMed Central

2017-01-01

Abstract Our ability to recognize objects across variations in size, position, or rotation is based on invariant object representations in higher visual cortex. However, we know little about how these invariances are related. Are some invariances harder than others? Do some invariances arise faster than others? These comparisons can be made only upon equating image changes across transformations. Here, we targeted invariant neural representations in the monkey inferotemporal (IT) cortex using object images with balanced changes in size, position, and rotation. Across the recorded population, IT neurons generalized across size and position both stronger and faster than to rotations in the image plane as well as in depth. We obtained a similar ordering of invariances in deep neural networks but not in low-level visual representations. Thus, invariant neural representations dynamically evolve in a temporal order reflective of their underlying computational complexity. PMID:28413827

Role of working memory in transformation of visual and motor representations for use in mental simulation.

PubMed

Gabbard, Carl; Lee, Jihye; Caçola, Priscila

2013-01-01

This study examined the role of visual working memory when transforming visual representations to motor representations in the context of motor imagery. Participants viewed randomized number sequences of three, four, and five digits, and then reproduced the sequence by finger tapping using motor imagery or actually executing the movements; movement duration was recorded. One group viewed the stimulus for three seconds and responded immediately, while the second group had a three-second view followed by a three-second blank screen delay before responding. As expected, delay group times were longer with each condition and digit load. Whereas correlations between imagined and executed actions (temporal congruency) were significant in a positive direction for both groups, interestingly, the delay group's values were significantly stronger. That outcome prompts speculation that delay influenced the congruency between motor representation and actual execution.

N300 indexes deficient integration of orthographic and phonological representations in children with dyslexia.

PubMed

Hasko, Sandra; Bruder, Jennifer; Bartling, Jürgen; Schulte-Körne, Gerd

2012-04-01

In transparent orthographies, like German, children with developmental dyslexia (DD) are mainly characterized by a reading fluency deficit. The reading fluency deficit might be traced back to a scarce integration of orthographic and phonological representations. In order to address this question, the present study used EEG to investigate the N300, an ERP component which has been associated with the integration of orthographic and phonological representations. Twenty children without DD and 18 children with DD performed a phonological (P)-orthographic (O) matching task (P-O condition), which tapped the integration of orthographic and phonological representations. A control task was applied which did not require the integration of orthographic and phonological representations and consisted only of orthographic information (O-O condition). The O-O condition revealed a similar N300 distribution between groups with a bilateral activity over fronto-temporal electrodes. However, in the P-O condition N300 differentiated the 2 groups of children. The control group revealed greater activity over left fronto-temporal electrodes, whereas the N300 was distributed bilaterally in the group of children with DD suggesting deficient integration of orthographic and phonological representations. These findings might be related to the reading fluency deficit as it was also observed that better reading fluency was correlated with higher (r=-.36) and earlier peaking (r=-.33) N300 amplitudes in the left hemisphere and attenuated N300 amplitudes (r=.45) in the right hemisphere. Standardized low-resolution electromagnetic tomography analysis (sLORETA) revealed that children with DD rely more on right temporo-parietal brain areas compared to children without DD. Furthermore, in order to rule out that earlier deficient processes might influence the group differences found in the N300, we analyzed the N170 for group differences. We did not find significant differences between children without DD and children with DD. In conclusion the results suggest deficient integration of orthographic and phonological representations in dyslexia, as indexed by the N300, and further highlight how this activity is relevant for fluent reading. Copyright © 2012 Elsevier Ltd. All rights reserved.

Acoustic and Lexical Representations for Affect Prediction in Spontaneous Conversations.

PubMed

Cao, Houwei; Savran, Arman; Verma, Ragini; Nenkova, Ani

2015-01-01

In this article we investigate what representations of acoustics and word usage are most suitable for predicting dimensions of affect|AROUSAL, VALANCE, POWER and EXPECTANCY|in spontaneous interactions. Our experiments are based on the AVEC 2012 challenge dataset. For lexical representations, we compare corpus-independent features based on psychological word norms of emotional dimensions, as well as corpus-dependent representations. We find that corpus-dependent bag of words approach with mutual information between word and emotion dimensions is by far the best representation. For the analysis of acoustics, we zero in on the question of granularity. We confirm on our corpus that utterance-level features are more predictive than word-level features. Further, we study more detailed representations in which the utterance is divided into regions of interest (ROI), each with separate representation. We introduce two ROI representations, which significantly outperform less informed approaches. In addition we show that acoustic models of emotion can be improved considerably by taking into account annotator agreement and training the model on smaller but reliable dataset. Finally we discuss the potential for improving prediction by combining the lexical and acoustic modalities. Simple fusion methods do not lead to consistent improvements over lexical classifiers alone but improve over acoustic models.

Flux-Based Finite Volume representations for general thermal problems

NASA Technical Reports Server (NTRS)

Mohan, Ram V.; Tamma, Kumar K.

1993-01-01

Flux-Based Finite Volume (FV) element representations for general thermal problems are given in conjunction with a generalized trapezoidal gamma-T family of algorithms, formulated following the spirit of what we term as the Lax-Wendroff based FV formulations. The new flux-based representations introduced offer an improved physical interpretation of the problem along with computationally convenient and attractive features. The space and time discretization emanate from a conservation form of the governing equation for thermal problems, and in conjunction with the flux-based element representations give rise to a physically improved and locally conservative numerical formulations. The present representations seek to involve improved locally conservative properties, improved physical representations and computational features; these are based on a 2D, bilinear FV element and can be extended for other cases. Time discretization based on a gamma-T family of algorithms in the spirit of a Lax-Wendroff based FV formulations are employed. Numerical examples involving linear/nonlinear steady and transient situations are shown to demonstrate the applicability of the present representations for thermal analysis situations.

Representation of Complex Spectra in Auditory Cortex

DTIC Science & Technology

1997-01-01

predict the response to any broadband dynamic sound. Fourier Transform Inverse Transform ∫ [.] exp(±2πjΩx±2πjwt) 2 1 2 / 1 1 a 2 1 2 / 1 1 a...Systems Research University of Maryland Spectro-Temporal Transform Ω wx = log f t w = “ripple velocity” Ω = “ripple frequency” Fourier Transform Inverse ... Transform ∫ [.] exp(±2πjΩx±2πjwt) Real functions in the spectro-temporal domain give rise to complex conjugate symmetric functions in the Fourier

Contextual and temporal clinical guidelines.

PubMed Central

Guarnero, A.; Marzuoli, M.; Molino, G.; Terenziani, P.; Torchio, M.; Vanni, K.

1998-01-01

In this paper, we propose an approach for managing clinical guidelines. We sketch a modular architecture, allowing us to separate conceptually distinct aspects in the management and use of clinical guidelines. In particular, we describe the clinical guidelines knowledge representation module and we sketch the acquisition module. The main focus of the paper is the definition of an expressive formalism for representing clinical guidelines, which allows one to deal with the context dependent character of clinical guidelines and takes into account different temporal aspects. PMID:9929306

Reviews and syntheses: Four decades of modeling methane cycling in terrestrial ecosystems

NASA Astrophysics Data System (ADS)

Xu, Xiaofeng; Yuan, Fengming; Hanson, Paul J.; Wullschleger, Stan D.; Thornton, Peter E.; Riley, William J.; Song, Xia; Graham, David E.; Song, Changchun; Tian, Hanqin

2016-06-01

Over the past 4 decades, a number of numerical models have been developed to quantify the magnitude, investigate the spatial and temporal variations, and understand the underlying mechanisms and environmental controls of methane (CH4) fluxes within terrestrial ecosystems. These CH4 models are also used for integrating multi-scale CH4 data, such as laboratory-based incubation and molecular analysis, field observational experiments, remote sensing, and aircraft-based measurements across a variety of terrestrial ecosystems. Here we summarize 40 terrestrial CH4 models to characterize their strengths and weaknesses and to suggest a roadmap for future model improvement and application. Our key findings are that (1) the focus of CH4 models has shifted from theoretical to site- and regional-level applications over the past 4 decades, (2) large discrepancies exist among models in terms of representing CH4 processes and their environmental controls, and (3) significant data-model and model-model mismatches are partially attributed to different representations of landscape characterization and inundation dynamics. Three areas for future improvements and applications of terrestrial CH4 models are that (1) CH4 models should more explicitly represent the mechanisms underlying land-atmosphere CH4 exchange, with an emphasis on improving and validating individual CH4 processes over depth and horizontal space, (2) models should be developed that are capable of simulating CH4 emissions across highly heterogeneous spatial and temporal scales, particularly hot moments and hotspots, and (3) efforts should be invested to develop model benchmarking frameworks that can easily be used for model improvement, evaluation, and integration with data from molecular to global scales. These improvements in CH4 models would be beneficial for the Earth system models and further simulation of climate-carbon cycle feedbacks.

The representation of information about faces in the temporal and frontal lobes.

PubMed

Rolls, Edmund T

2007-01-07

Neurophysiological evidence is described showing that some neurons in the macaque inferior temporal visual cortex have responses that are invariant with respect to the position, size and view of faces and objects, and that these neurons show rapid processing and rapid learning. Which face or object is present is encoded using a distributed representation in which each neuron conveys independent information in its firing rate, with little information evident in the relative time of firing of different neurons. This ensemble encoding has the advantages of maximising the information in the representation useful for discrimination between stimuli using a simple weighted sum of the neuronal firing by the receiving neurons, generalisation and graceful degradation. These invariant representations are ideally suited to provide the inputs to brain regions such as the orbitofrontal cortex and amygdala that learn the reinforcement associations of an individual's face, for then the learning, and the appropriate social and emotional responses, generalise to other views of the same face. A theory is described of how such invariant representations may be produced in a hierarchically organised set of visual cortical areas with convergent connectivity. The theory proposes that neurons in these visual areas use a modified Hebb synaptic modification rule with a short-term memory trace to capture whatever can be captured at each stage that is invariant about objects as the objects change in retinal view, position, size and rotation. Another population of neurons in the cortex in the superior temporal sulcus encodes other aspects of faces such as face expression, eye gaze, face view and whether the head is moving. These neurons thus provide important additional inputs to parts of the brain such as the orbitofrontal cortex and amygdala that are involved in social communication and emotional behaviour. Outputs of these systems reach the amygdala, in which face-selective neurons are found, and also the orbitofrontal cortex, in which some neurons are tuned to face identity and others to face expression. In humans, activation of the orbitofrontal cortex is found when a change of face expression acts as a social signal that behaviour should change; and damage to the orbitofrontal cortex can impair face and voice expression identification, and also the reversal of emotional behaviour that normally occurs when reinforcers are reversed.

Multi-material 3D Models for Temporal Bone Surgical Simulation.

PubMed

Rose, Austin S; Kimbell, Julia S; Webster, Caroline E; Harrysson, Ola L A; Formeister, Eric J; Buchman, Craig A

2015-07-01

A simulated, multicolor, multi-material temporal bone model can be created using 3-dimensional (3D) printing that will prove both safe and beneficial in training for actual temporal bone surgical cases. As the process of additive manufacturing, or 3D printing, has become more practical and affordable, a number of applications for the technology in the field of Otolaryngology-Head and Neck Surgery have been considered. One area of promise is temporal bone surgical simulation. Three-dimensional representations of human temporal bones were created from temporal bone computed tomography (CT) scans using biomedical image processing software. Multi-material models were then printed and dissected in a temporal bone laboratory by attending and resident otolaryngologists. A 5-point Likert scale was used to grade the models for their anatomical accuracy and suitability as a simulation of cadaveric and operative temporal bone drilling. The models produced for this study demonstrate significant anatomic detail and a likeness to human cadaver specimens for drilling and dissection. Simulated temporal bones created by this process have potential benefit in surgical training, preoperative simulation for challenging otologic cases, and the standardized testing of temporal bone surgical skills. © The Author(s) 2015.

Contribution of frontal and temporal lobe function to memory interference from divided attention at retrieval.

PubMed

Fernandes, Myra A; Davidson, Patrick S R; Glisky, Elizabeth L; Moscovitch, Morris

2004-07-01

On the basis of their scores on composite measures of frontal and temporal lobe function, derived from neuropsychological testing, seniors were divided preexperimentally into 4 groups. Participants studied a list of unrelated words under full attention and recalled them while concurrently performing an animacy decision task to words, an odd-digit identification task to numbers, or no distracting task. Large interference effects on memory were produced by the animacy but not by the odd-digit distracting task, and this pattern was not influenced by level of frontal or temporal lobe function. Results show associative retrieval is largely disrupted by competition for common representations, and it is not affected by a reduction in general processing resources, attentional capacity, or competition for memory structures in the temporal lobe.

Declarative Programming with Temporal Constraints, in the Language CG.

PubMed

Negreanu, Lorina

2015-01-01

Specifying and interpreting temporal constraints are key elements of knowledge representation and reasoning, with applications in temporal databases, agent programming, and ambient intelligence. We present and formally characterize the language CG, which tackles this issue. In CG, users are able to develop time-dependent programs, in a flexible and straightforward manner. Such programs can, in turn, be coupled with evolving environments, thus empowering users to control the environment's evolution. CG relies on a structure for storing temporal information, together with a dedicated query mechanism. Hence, we explore the computational complexity of our query satisfaction problem. We discuss previous implementation attempts of CG and introduce a novel prototype which relies on logic programming. Finally, we address the issue of consistency and correctness of CG program execution, using the Event-B modeling approach.

Representations of temporal information in short-term memory: Are they modality-specific?

PubMed

Bratzke, Daniel; Quinn, Katrina R; Ulrich, Rolf; Bausenhart, Karin M

2016-10-01

Rattat and Picard (2012) reported that the coding of temporal information in short-term memory is modality-specific, that is, temporal information received via the visual (auditory) modality is stored as a visual (auditory) code. This conclusion was supported by modality-specific interference effects on visual and auditory duration discrimination, which were induced by secondary tasks (visual tracking or articulatory suppression), presented during a retention interval. The present study assessed the stability of these modality-specific interference effects. Our study did not replicate the selective interference pattern but rather indicated that articulatory suppression not only impairs short-term memory for auditory but also for visual durations. This result pattern supports a crossmodal or an abstract view of temporal encoding. Copyright © 2016 Elsevier B.V. All rights reserved.

Losing the music: aging affects the perception and subcortical neural representation of musical harmony.

PubMed

Bones, Oliver; Plack, Christopher J

2015-03-04

When two musical notes with simple frequency ratios are played simultaneously, the resulting musical chord is pleasing and evokes a sense of resolution or "consonance". Complex frequency ratios, on the other hand, evoke feelings of tension or "dissonance". Consonance and dissonance form the basis of harmony, a central component of Western music. In earlier work, we provided evidence that consonance perception is based on neural temporal coding in the brainstem (Bones et al., 2014). Here, we show that for listeners with clinically normal hearing, aging is associated with a decline in both the perceptual distinction and the distinctiveness of the neural representations of different categories of two-note chords. Compared with younger listeners, older listeners rated consonant chords as less pleasant and dissonant chords as more pleasant. Older listeners also had less distinct neural representations of consonant and dissonant chords as measured using a Neural Consonance Index derived from the electrophysiological "frequency-following response." The results withstood a control for the effect of age on general affect, suggesting that different mechanisms are responsible for the perceived pleasantness of musical chords and affective voices and that, for listeners with clinically normal hearing, age-related differences in consonance perception are likely to be related to differences in neural temporal coding. Copyright © 2015 Bones and Plack.

Spatio-Temporal Data Model for Integrating Evolving Nation-Level Datasets

NASA Astrophysics Data System (ADS)

Sorokine, A.; Stewart, R. N.

2017-10-01

Ability to easily combine the data from diverse sources in a single analytical workflow is one of the greatest promises of the Big Data technologies. However, such integration is often challenging as datasets originate from different vendors, governments, and research communities that results in multiple incompatibilities including data representations, formats, and semantics. Semantics differences are hardest to handle: different communities often use different attribute definitions and associate the records with different sets of evolving geographic entities. Analysis of global socioeconomic variables across multiple datasets over prolonged time is often complicated by the difference in how boundaries and histories of countries or other geographic entities are represented. Here we propose an event-based data model for depicting and tracking histories of evolving geographic units (countries, provinces, etc.) and their representations in disparate data. The model addresses the semantic challenge of preserving identity of geographic entities over time by defining criteria for the entity existence, a set of events that may affect its existence, and rules for mapping between different representations (datasets). Proposed model is used for maintaining an evolving compound database of global socioeconomic and environmental data harvested from multiple sources. Practical implementation of our model is demonstrated using PostgreSQL object-relational database with the use of temporal, geospatial, and NoSQL database extensions.

Cultural constraints on brain development: evidence from a developmental study of visual word processing in mandarin chinese.

PubMed

Cao, Fan; Lee, Rebecca; Shu, Hua; Yang, Yanhui; Xu, Guoqing; Li, Kuncheng; Booth, James R

2010-05-01

Developmental differences in phonological and orthographic processing in Chinese were examined in 9 year olds, 11 year olds, and adults using functional magnetic resonance imaging. Rhyming and spelling judgments were made to 2-character words presented sequentially in the visual modality. The spelling task showed greater activation than the rhyming task in right superior parietal lobule and right inferior temporal gyrus, and there were developmental increases across tasks bilaterally in these regions in addition to bilateral occipital cortex, suggesting increased involvement over age on visuo-orthographic analysis. The rhyming task showed greater activation than the spelling task in left superior temporal gyrus and there were developmental decreases across tasks in this region, suggesting reduced involvement over age on phonological representations. The rhyming and spelling tasks included words with conflicting orthographic and phonological information (i.e., rhyming words spelled differently or nonrhyming words spelled similarly) or nonconflicting information. There was a developmental increase in the difference between conflicting and nonconflicting words in left inferior parietal lobule, suggesting greater engagement of systems for mapping between orthographic and phonological representations. Finally, there were developmental increases across tasks in an anterior (Broadman area [BA] 45, 46) and posterior (BA 9) left inferior frontal gyrus, suggesting greater reliance on controlled retrieval and selection of posterior lexical representations.

Losing the Music: Aging Affects the Perception and Subcortical Neural Representation of Musical Harmony

PubMed Central

Plack, Christopher J.

2015-01-01

When two musical notes with simple frequency ratios are played simultaneously, the resulting musical chord is pleasing and evokes a sense of resolution or “consonance”. Complex frequency ratios, on the other hand, evoke feelings of tension or “dissonance”. Consonance and dissonance form the basis of harmony, a central component of Western music. In earlier work, we provided evidence that consonance perception is based on neural temporal coding in the brainstem (Bones et al., 2014). Here, we show that for listeners with clinically normal hearing, aging is associated with a decline in both the perceptual distinction and the distinctiveness of the neural representations of different categories of two-note chords. Compared with younger listeners, older listeners rated consonant chords as less pleasant and dissonant chords as more pleasant. Older listeners also had less distinct neural representations of consonant and dissonant chords as measured using a Neural Consonance Index derived from the electrophysiological “frequency-following response.” The results withstood a control for the effect of age on general affect, suggesting that different mechanisms are responsible for the perceived pleasantness of musical chords and affective voices and that, for listeners with clinically normal hearing, age-related differences in consonance perception are likely to be related to differences in neural temporal coding. PMID:25740534

Dissociable patterns of brain activity for mentalizing about known others: a role for attachment

PubMed Central

Laurita, Anne C.; Hazan, Cindy

2017-01-01

Abstract The human brain tracks dynamic changes within the social environment, forming and updating representations of individuals in our social milieu. This mechanism of social navigation builds an increasingly complex map of persons with whom we are familiar and form attachments to guide adaptive social behaviors. We examined the neural representation of known others along a continuum of attachment using fMRI. Heterosexual adults (N = 29, 16 females), in romantic relationships for more than 2 years, made trait judgments for a romantic partner, parent, close friend, familiar acquaintance and self-during scanning. Multivariate analysis, partial least squares, was used to identify whole-brain patterns of brain activation associated with trait judgments of known others across a continuum of attachment. Across conditions, trait judgments engaged the default network and lateral prefrontal cortex. Judgments about oneself and a partner were associated with a common activation pattern encompassing anterior and middle cingulate, posterior superior temporal sulcus, as well as anterior insula. Parent and close friend judgments engaged medial and anterior temporal lobe regions. These results provide novel evidence that mentalizing about known familiar others results in differential brain activity. We provide initial evidence that the representation of adult attachment is a distinguishing feature of these differences. PMID:28407150

Parental Socioeconomic Status and the Neural Basis of Arithmetic: Differential Relations to Verbal and Visuo-spatial Representations

PubMed Central

Demir, Özlem Ece; Prado, Jérôme; Booth, James R.

2015-01-01

We examined the relation of parental socioeconomic status (SES) to the neural bases of subtraction in school-age children (9- to 12-year-olds). We independently localized brain regions subserving verbal versus visuo-spatial representations to determine whether the parental SES-related differences in children’s reliance on these neural representations vary as a function of math skill. At higher SES levels, higher skill was associated with greater recruitment of the left temporal cortex, identified by the verbal localizer. At lower SES levels, higher skill was associated with greater recruitment of right parietal cortex, identified by the visuo-spatial localizer. This suggests that depending on parental SES, children engage different neural systems to solve subtraction problems. Furthermore, SES was related to the activation in the left temporal and frontal cortex during the independent verbal localizer task, but it was not related to activation during the independent visuo-spatial localizer task. Differences in activation during the verbal localizer task in turn were related to differences in activation during the subtraction task in right parietal cortex. The relation was stronger at lower SES levels. This result suggests that SES-related differences in the visuo-spatial regions during subtraction might be based in SES-related verbal differences. PMID:25664675

Content Representation in the Human Medial Temporal Lobe

PubMed Central

Liang, Jackson C.; Wagner, Anthony D.

2013-01-01

Current theories of medial temporal lobe (MTL) function focus on event content as an important organizational principle that differentiates MTL subregions. Perirhinal and parahippocampal cortices may play content-specific roles in memory, whereas hippocampal processing is alternately hypothesized to be content specific or content general. Despite anatomical evidence for content-specific MTL pathways, empirical data for content-based MTL subregional dissociations are mixed. Here, we combined functional magnetic resonance imaging with multiple statistical approaches to characterize MTL subregional responses to different classes of novel event content (faces, scenes, spoken words, sounds, visual words). Univariate analyses revealed that responses to novel faces and scenes were distributed across the anterior–posterior axis of MTL cortex, with face responses distributed more anteriorly than scene responses. Moreover, multivariate pattern analyses of perirhinal and parahippocampal data revealed spatially organized representational codes for multiple content classes, including nonpreferred visual and auditory stimuli. In contrast, anterior hippocampal responses were content general, with less accurate overall pattern classification relative to MTL cortex. Finally, posterior hippocampal activation patterns consistently discriminated scenes more accurately than other forms of content. Collectively, our findings indicate differential contributions of MTL subregions to event representation via a distributed code along the anterior–posterior axis of MTL that depends on the nature of event content. PMID:22275474

Improving Representational Competence with Concrete Models

ERIC Educational Resources Information Center

Stieff, Mike; Scopelitis, Stephanie; Lira, Matthew E.; DeSutter, Dane

2016-01-01

Representational competence is a primary contributor to student learning in science, technology, engineering, and math (STEM) disciplines and an optimal target for instruction at all educational levels. We describe the design and implementation of a learning activity that uses concrete models to improve students' representational competence and…

Visualizing the engram: learning stabilizes odor representations in the olfactory network.

PubMed

Shakhawat, Amin M D; Gheidi, Ali; Hou, Qinlong; Dhillon, Sandeep K; Marrone, Diano F; Harley, Carolyn W; Yuan, Qi

2014-11-12

The nature of memory is a central issue in neuroscience. How does our representation of the world change with learning and experience? Here we use the transcription of Arc mRNA, which permits probing the neural representations of temporally separated events, to address this in a well characterized odor learning model. Rat pups readily associate odor with maternal care. In pups, the lateralized olfactory networks are independent, permitting separate training and within-subject control. We use multiday training to create an enduring memory of peppermint odor. Training stabilized rewarded, but not nonrewarded, odor representations in both mitral cells and associated granule cells of the olfactory bulb and in the pyramidal cells of the anterior piriform cortex. An enlarged core of stable, likely highly active neurons represent rewarded odor at both stages of the olfactory network. Odor representations in anterior piriform cortex were sparser than typical in adult rat and did not enlarge with learning. This sparser representation of odor is congruent with the maturation of lateral olfactory tract input in rat pups. Cortical representations elsewhere have been shown to be highly variable in electrophysiological experiments, suggesting brains operate normally using dynamic and network-modulated representations. The olfactory cortical representations here are consistent with the generalized associative model of sparse variable cortical representation, as normal responses to repeated odors were highly variable (∼70% of the cells change as indexed by Arc). Learning and memory modified rewarded odor ensembles to increase stability in a core representational component. Copyright © 2014 the authors 0270-6474/14/3415394-08$15.00/0.

Vegetation Demographics in Earth System Models: a review of progress and priorities

DOE PAGES

Fisher, Rosie A.; Koven, Charles D.; Anderegg, William R. L.; ...

2017-09-18

Numerous current efforts seek to improve the representation of ecosystem ecology and vegetation demographic processes within Earth System Models (ESMs). Furthermore, these developments are widely viewed as an important step in developing greater realism in predictions of future ecosystem states and fluxes. Increased realism, however, leads to increased model complexity, with new features raising a suite of ecological questions that require empirical constraints. We review the developments that permit the representation of plant demographics in ESMs, and identify issues raised by these developments that highlight important gaps in ecological understanding. These issues inevitably translate into uncertainty in model projections butmore » also allow models to be applied to new processes and questions concerning the dynamics of real-world ecosystems. We also argue that stronger and more innovative connections to data, across the range of scales considered, are required to address these gaps in understanding. The development of first-generation land surface models as a unifying framework for ecophysiological understanding stimulated much research into plant physiological traits and gas exchange. Constraining predictions at ecologically relevant spatial and temporal scales will require a similar investment of effort and intensified inter-disciplinary communication.« less

Vegetation Demographics in Earth System Models: a review of progress and priorities

DOE Office of Scientific and Technical Information (OSTI.GOV)

Fisher, Rosie A.; Koven, Charles D.; Anderegg, William R. L.

Numerous current efforts seek to improve the representation of ecosystem ecology and vegetation demographic processes within Earth System Models (ESMs). Furthermore, these developments are widely viewed as an important step in developing greater realism in predictions of future ecosystem states and fluxes. Increased realism, however, leads to increased model complexity, with new features raising a suite of ecological questions that require empirical constraints. We review the developments that permit the representation of plant demographics in ESMs, and identify issues raised by these developments that highlight important gaps in ecological understanding. These issues inevitably translate into uncertainty in model projections butmore » also allow models to be applied to new processes and questions concerning the dynamics of real-world ecosystems. We also argue that stronger and more innovative connections to data, across the range of scales considered, are required to address these gaps in understanding. The development of first-generation land surface models as a unifying framework for ecophysiological understanding stimulated much research into plant physiological traits and gas exchange. Constraining predictions at ecologically relevant spatial and temporal scales will require a similar investment of effort and intensified inter-disciplinary communication.« less

Agro-hydrology and multi-temporal high-resolution remote sensing: toward an explicit spatial processes calibration

NASA Astrophysics Data System (ADS)

Ferrant, S.; Gascoin, S.; Veloso, A.; Salmon-Monviola, J.; Claverie, M.; Rivalland, V.; Dedieu, G.; Demarez, V.; Ceschia, E.; Probst, J.-L.; Durand, P.; Bustillo, V.

2014-12-01

The growing availability of high-resolution satellite image series offers new opportunities in agro-hydrological research and modeling. We investigated the possibilities offered for improving crop-growth dynamic simulation with the distributed agro-hydrological model: topography-based nitrogen transfer and transformation (TNT2). We used a leaf area index (LAI) map series derived from 105 Formosat-2 (F2) images covering the period 2006-2010. The TNT2 model (Beaujouan et al., 2002), calibrated against discharge and in-stream nitrate fluxes for the period 1985-2001, was tested on the 2005-2010 data set (climate, land use, agricultural practices, and discharge and nitrate fluxes at the outlet). Data from the first year (2005) were used to initialize the hydrological model. A priori agricultural practices obtained from an extensive field survey, such as seeding date, crop cultivar, and amount of fertilizer, were used as input variables. Continuous values of LAI as a function of cumulative daily temperature were obtained at the crop-field level by fitting a double logistic equation against discrete satellite-derived LAI. Model predictions of LAI dynamics using the a priori input parameters displayed temporal shifts from those observed LAI profiles that are irregularly distributed in space (between field crops) and time (between years). By resetting the seeding date at the crop-field level, we have developed an optimization method designed to efficiently minimize this temporal shift and better fit the crop growth against both the spatial observations and crop production. This optimization of simulated LAI has a negligible impact on water budgets at the catchment scale (1 mm yr-1 on average) but a noticeable impact on in-stream nitrogen fluxes (around 12%), which is of interest when considering nitrate stream contamination issues and the objectives of TNT2 modeling. This study demonstrates the potential contribution of the forthcoming high spatial and temporal resolution products from the Sentinel-2 satellite mission for improving agro-hydrological modeling by constraining the spatial representation of crop productivity.

Agro-hydrology and multi temporal high resolution remote sensing: toward an explicit spatial processes calibration

NASA Astrophysics Data System (ADS)

Ferrant, S.; Gascoin, S.; Veloso, A.; Salmon-Monviola, J.; Claverie, M.; Rivalland, V.; Dedieu, G.; Demarez, V.; Ceschia, E.; Probst, J.-L.; Durand, P.; Bustillo, V.

2014-07-01

The recent and forthcoming availability of high resolution satellite image series offers new opportunities in agro-hydrological research and modeling. We investigated the perspective offered by improving the crop growth dynamic simulation using the distributed agro-hydrological model, Topography based Nitrogen transfer and Transformation (TNT2), using LAI map series derived from 105 Formosat-2 (F2) images during the period 2006-2010. The TNT2 model (Beaujouan et al., 2002), calibrated with discharge and in-stream nitrate fluxes for the period 1985-2001, was tested on the 2006-2010 dataset (climate, land use, agricultural practices, discharge and nitrate fluxes at the outlet). A priori agricultural practices obtained from an extensive field survey such as seeding date, crop cultivar, and fertilizer amount were used as input variables. Continuous values of LAI as a function of cumulative daily temperature were obtained at the crop field level by fitting a double logistic equation against discrete satellite-derived LAI. Model predictions of LAI dynamics with a priori input parameters showed an temporal shift with observed LAI profiles irregularly distributed in space (between field crops) and time (between years). By re-setting seeding date at the crop field level, we proposed an optimization method to minimize efficiently this temporal shift and better fit the crop growth against the spatial observations as well as crop production. This optimization of simulated LAI has a negligible impact on water budget at the catchment scale (1 mm yr-1 in average) but a noticeable impact on in-stream nitrogen fluxes (around 12%) which is of interest considering nitrate stream contamination issues and TNT2 model objectives. This study demonstrates the contribution of forthcoming high spatial and temporal resolution products of Sentinel-2 satellite mission in improving agro-hydrological modeling by constraining the spatial representation of crop productivity.

Increasingly complex representations of natural movies across the dorsal stream are shared between subjects.

PubMed

Güçlü, Umut; van Gerven, Marcel A J

2017-01-15

Recently, deep neural networks (DNNs) have been shown to provide accurate predictions of neural responses across the ventral visual pathway. We here explore whether they also provide accurate predictions of neural responses across the dorsal visual pathway, which is thought to be devoted to motion processing and action recognition. This is achieved by training deep neural networks to recognize actions in videos and subsequently using them to predict neural responses while subjects are watching natural movies. Moreover, we explore whether dorsal stream representations are shared between subjects. In order to address this question, we examine if individual subject predictions can be made in a common representational space estimated via hyperalignment. Results show that a DNN trained for action recognition can be used to accurately predict how dorsal stream responds to natural movies, revealing a correspondence in representations of DNN layers and dorsal stream areas. It is also demonstrated that models operating in a common representational space can generalize to responses of multiple or even unseen individual subjects to novel spatio-temporal stimuli in both encoding and decoding settings, suggesting that a common representational space underlies dorsal stream responses across multiple subjects. Copyright © 2015 Elsevier Inc. All rights reserved.

From action representation to action execution: exploring the links between cognitive and biomechanical levels of motor control

PubMed Central

Land, William M.; Volchenkov, Dima; Bläsing, Bettina E.; Schack, Thomas

2013-01-01

Along with superior performance, research indicates that expertise is associated with a number of mediating cognitive adaptations. To this extent, extensive practice is associated with the development of general and task-specific mental representations, which play an important role in the organization and control of action. Recently, new experimental methods have been developed, which allow for investigating the organization and structure of these representations, along with the functional structure of the movement kinematics. In the current article, we present a new approach for examining the overlap between skill representations and motor output. In doing so, we first present an architecture model, which addresses links between biomechanical and cognitive levels of motor control. Next, we review the state of the art in assessing memory structures underlying complex action. Following we present a new spatio-temporal decomposition method for illuminating the functional structure of movement kinematics, and finally, we apply these methods to investigate the overlap between the structure of motor representations in memory and their corresponding kinematic structures. Our aim is to understand the extent to which the output at a kinematic level is governed by representations at a cognitive level of motor control. PMID:24065915

Is the difference between right and left ATLs due to the distinction between general and social cognition or between verbal and non-verbal representations?

PubMed

Gainotti, Guido

2015-04-01

The present review aimed to check two proposals alternative to the original version of the 'semantic hub' hypothesis, based on semantic dementia (SD) data, which assumed that left and right anterior temporal lobes (ATLs) store in a unitary, amodal format all kinds of semantic representations. The first alternative proposal is that the right ATL might subsume non-verbal representations and the left ATL lexical-semantic representations and that only in the advanced stages of SD, when atrophy affects the ATLs bilaterally, the semantic impairment becomes 'multi-modal'. The second alternative suggestion is that right and left ATLs might underlie two different domains of knowledge, because general conceptual knowledge might be supported by the left ATL, and social cognition by the right ATL. Results of the review substantially support the first proposal, showing that the right ATL subsumes non-verbal representations and the left ATL lexical-semantic representations. They are less conclusive about the second suggestion, because the right ATL seems to play a more important role in behavioral and emotional functions than in higher level social cognition. Copyright © 2015 Elsevier Ltd. All rights reserved.

Sight and sound converge to form modality-invariant representations in temporo-parietal cortex

PubMed Central

Man, Kingson; Kaplan, Jonas T.; Damasio, Antonio; Meyer, Kaspar

2013-01-01

People can identify objects in the environment with remarkable accuracy, irrespective of the sensory modality they use to perceive them. This suggests that information from different sensory channels converges somewhere in the brain to form modality-invariant representations, i.e., representations that reflect an object independently of the modality through which it has been apprehended. In this functional magnetic resonance imaging study of human subjects, we first identified brain areas that responded to both visual and auditory stimuli and then used crossmodal multivariate pattern analysis to evaluate the neural representations in these regions for content-specificity (i.e., do different objects evoke different representations?) and modality-invariance (i.e., do the sight and the sound of the same object evoke a similar representation?). While several areas became activated in response to both auditory and visual stimulation, only the neural patterns recorded in a region around the posterior part of the superior temporal sulcus displayed both content-specificity and modality-invariance. This region thus appears to play an important role in our ability to recognize objects in our surroundings through multiple sensory channels and to process them at a supra-modal (i.e., conceptual) level. PMID:23175818

Innovative Visualizations Shed Light on Avian Nocturnal Migration

PubMed Central

Farnsworth, Andrew; Aelterman, Bart; Alves, Jose A.; Azijn, Kevin; Bernstein, Garrett; Branco, Sérgio; Desmet, Peter; Dokter, Adriaan M.; Horton, Kyle; Kelling, Steve; Kelly, Jeffrey F.; Leijnse, Hidde; Rong, Jingjing; Sheldon, Daniel; Van den Broeck, Wouter; Van Den Meersche, Jan Klaas; Van Doren, Benjamin Mark; van Gasteren, Hans

2016-01-01

Globally, billions of flying animals undergo seasonal migrations, many of which occur at night. The temporal and spatial scales at which migrations occur and our inability to directly observe these nocturnal movements makes monitoring and characterizing this critical period in migratory animals’ life cycles difficult. Remote sensing, therefore, has played an important role in our understanding of large-scale nocturnal bird migrations. Weather surveillance radar networks in Europe and North America have great potential for long-term low-cost monitoring of bird migration at scales that have previously been impossible to achieve. Such long-term monitoring, however, poses a number of challenges for the ornithological and ecological communities: how does one take advantage of this vast data resource, integrate information across multiple sensors and large spatial and temporal scales, and visually represent the data for interpretation and dissemination, considering the dynamic nature of migration? We assembled an interdisciplinary team of ecologists, meteorologists, computer scientists, and graphic designers to develop two different flow visualizations, which are interactive and open source, in order to create novel representations of broad-front nocturnal bird migration to address a primary impediment to long-term, large-scale nocturnal migration monitoring. We have applied these visualization techniques to mass bird migration events recorded by two different weather surveillance radar networks covering regions in Europe and North America. These applications show the flexibility and portability of such an approach. The visualizations provide an intuitive representation of the scale and dynamics of these complex systems, are easily accessible for a broad interest group, and are biologically insightful. Additionally, they facilitate fundamental ecological research, conservation, mitigation of human–wildlife conflicts, improvement of meteorological products, and public outreach, education, and engagement. PMID:27557096

Binaural speech processing in individuals with auditory neuropathy.

PubMed

Rance, G; Ryan, M M; Carew, P; Corben, L A; Yiu, E; Tan, J; Delatycki, M B

2012-12-13

Auditory neuropathy disrupts the neural representation of sound and may therefore impair processes contingent upon inter-aural integration. The aims of this study were to investigate binaural auditory processing in individuals with axonal (Friedreich ataxia) and demyelinating (Charcot-Marie-Tooth disease type 1A) auditory neuropathy and to evaluate the relationship between the degree of auditory deficit and overall clinical severity in patients with neuropathic disorders. Twenty-three subjects with genetically confirmed Friedreich ataxia and 12 subjects with Charcot-Marie-Tooth disease type 1A underwent psychophysical evaluation of basic auditory processing (intensity discrimination/temporal resolution) and binaural speech perception assessment using the Listening in Spatialized Noise test. Age, gender and hearing-level-matched controls were also tested. Speech perception in noise for individuals with auditory neuropathy was abnormal for each listening condition, but was particularly affected in circumstances where binaural processing might have improved perception through spatial segregation. Ability to use spatial cues was correlated with temporal resolution suggesting that the binaural-processing deficit was the result of disordered representation of timing cues in the left and right auditory nerves. Spatial processing was also related to overall disease severity (as measured by the Friedreich Ataxia Rating Scale and Charcot-Marie-Tooth Neuropathy Score) suggesting that the degree of neural dysfunction in the auditory system accurately reflects generalized neuropathic changes. Measures of binaural speech processing show promise for application in the neurology clinic. In individuals with auditory neuropathy due to both axonal and demyelinating mechanisms the assessment provides a measure of functional hearing ability, a biomarker capable of tracking the natural history of progressive disease and a potential means of evaluating the effectiveness of interventions. Copyright © 2012 IBRO. Published by Elsevier Ltd. All rights reserved.

Neural Representation of Concurrent Harmonic Sounds in Monkey Primary Auditory Cortex: Implications for Models of Auditory Scene Analysis

PubMed Central

Steinschneider, Mitchell; Micheyl, Christophe

2014-01-01

The ability to attend to a particular sound in a noisy environment is an essential aspect of hearing. To accomplish this feat, the auditory system must segregate sounds that overlap in frequency and time. Many natural sounds, such as human voices, consist of harmonics of a common fundamental frequency (F0). Such harmonic complex tones (HCTs) evoke a pitch corresponding to their F0. A difference in pitch between simultaneous HCTs provides a powerful cue for their segregation. The neural mechanisms underlying concurrent sound segregation based on pitch differences are poorly understood. Here, we examined neural responses in monkey primary auditory cortex (A1) to two concurrent HCTs that differed in F0 such that they are heard as two separate “auditory objects” with distinct pitches. We found that A1 can resolve, via a rate-place code, the lower harmonics of both HCTs, a prerequisite for deriving their pitches and for their perceptual segregation. Onset asynchrony between the HCTs enhanced the neural representation of their harmonics, paralleling their improved perceptual segregation in humans. Pitches of the concurrent HCTs could also be temporally represented by neuronal phase-locking at their respective F0s. Furthermore, a model of A1 responses using harmonic templates could qualitatively reproduce psychophysical data on concurrent sound segregation in humans. Finally, we identified a possible intracortical homolog of the “object-related negativity” recorded noninvasively in humans, which correlates with the perceptual segregation of concurrent sounds. Findings indicate that A1 contains sufficient spectral and temporal information for segregating concurrent sounds based on differences in pitch. PMID:25209282

Innovative Visualizations Shed Light on Avian Nocturnal Migration.

PubMed

Shamoun-Baranes, Judy; Farnsworth, Andrew; Aelterman, Bart; Alves, Jose A; Azijn, Kevin; Bernstein, Garrett; Branco, Sérgio; Desmet, Peter; Dokter, Adriaan M; Horton, Kyle; Kelling, Steve; Kelly, Jeffrey F; Leijnse, Hidde; Rong, Jingjing; Sheldon, Daniel; Van den Broeck, Wouter; Van Den Meersche, Jan Klaas; Van Doren, Benjamin Mark; van Gasteren, Hans

2016-01-01

Globally, billions of flying animals undergo seasonal migrations, many of which occur at night. The temporal and spatial scales at which migrations occur and our inability to directly observe these nocturnal movements makes monitoring and characterizing this critical period in migratory animals' life cycles difficult. Remote sensing, therefore, has played an important role in our understanding of large-scale nocturnal bird migrations. Weather surveillance radar networks in Europe and North America have great potential for long-term low-cost monitoring of bird migration at scales that have previously been impossible to achieve. Such long-term monitoring, however, poses a number of challenges for the ornithological and ecological communities: how does one take advantage of this vast data resource, integrate information across multiple sensors and large spatial and temporal scales, and visually represent the data for interpretation and dissemination, considering the dynamic nature of migration? We assembled an interdisciplinary team of ecologists, meteorologists, computer scientists, and graphic designers to develop two different flow visualizations, which are interactive and open source, in order to create novel representations of broad-front nocturnal bird migration to address a primary impediment to long-term, large-scale nocturnal migration monitoring. We have applied these visualization techniques to mass bird migration events recorded by two different weather surveillance radar networks covering regions in Europe and North America. These applications show the flexibility and portability of such an approach. The visualizations provide an intuitive representation of the scale and dynamics of these complex systems, are easily accessible for a broad interest group, and are biologically insightful. Additionally, they facilitate fundamental ecological research, conservation, mitigation of human-wildlife conflicts, improvement of meteorological products, and public outreach, education, and engagement.

Involvement of the prelimbic cortex in contextual fear conditioning with temporal and spatial discontinuity.

PubMed

Santos, Thays Brenner; Kramer-Soares, Juliana Carlota; Favaro, Vanessa Manchim; Oliveira, Maria Gabriela Menezes

2017-10-01

Time plays an important role in conditioning, it is not only possible to associate stimuli with events that overlap, as in delay fear conditioning, but it is also possible to associate stimuli that are discontinuous in time, as shown in trace conditioning for a discrete stimuli. The environment itself can be a powerful conditioned stimulus (CS) and be associated to unconditioned stimulus (US). Thus, the aim of the present study was to determine the parameters in which contextual fear conditioning occurs by the maintenance of a contextual representation over short and long time intervals. The results showed that a contextual representation can be maintained and associated after 5s, even in the absence of a 15s re-exposure to the training context before US delivery. The same effect was not observed with a 24h interval of discontinuity. Furthermore, optimal conditioned response with a 5s interval is produced only when the contexts (of pre-exposure and shock) match. As the pre-limbic cortex (PL) is necessary for the maintenance of a continuous representation of a stimulus, the involvement of the PL in this temporal and contextual processing was investigated. The reversible inactivation of the PL by muscimol infusion impaired the acquisition of contextual fear conditioning with a 5s interval, but not with a 24h interval, and did not impair delay fear conditioning. The data provided evidence that short and long intervals of discontinuity have different mechanisms, thus contributing to a better understanding of PL involvement in contextual fear conditioning and providing a model that considers both temporal and contextual factors in fear conditioning. Copyright © 2017 Elsevier Inc. All rights reserved.

Why trace and delay conditioning are sometimes (but not always) hippocampal dependent: A computational model

PubMed Central

Moustafa, Ahmed A.; Wufong, Ella; Servatius, Richard J.; Pang, Kevin C. H.; Gluck, Mark A.; Myers, Catherine E.

2013-01-01

A recurrent-network model provides a unified account of the hippocampal region in mediating the representation of temporal information in classical eyeblink conditioning. Much empirical research is consistent with a general conclusion that delay conditioning (in which the conditioned stimulus CS and unconditioned stimulus US overlap and co-terminate) is independent of the hippocampal system, while trace conditioning (in which the CS terminates before US onset) depends on the hippocampus. However, recent studies show that, under some circumstances, delay conditioning can be hippocampal-dependent and trace conditioning can be spared following hippocampal lesion. Here, we present an extension of our prior trial-level models of hippocampal function and stimulus representation that can explain these findings within a unified framework. Specifically, the current model includes adaptive recurrent collateral connections that aid in the representation of intra-trial temporal information. With this model, as in our prior models, we argue that the hippocampus is not specialized for conditioned response timing, but rather is a general-purpose system that learns to predict the next state of all stimuli given the current state of variables encoded by activity in recurrent collaterals. As such, the model correctly predicts that hippocampal involvement in classical conditioning should be critical not only when there is an intervening trace interval, but also when there is a long delay between CS onset and US onset. Our model simulates empirical data from many variants of classical conditioning, including delay and trace paradigms in which the length of the CS, the inter-stimulus interval, or the trace interval is varied. Finally, we discuss model limitations, future directions, and several novel empirical predictions of this temporal processing model of hippocampal function and learning. PMID:23178699

Tracking the Spatiotemporal Neural Dynamics of Real-world Object Size and Animacy in the Human Brain.

PubMed

Khaligh-Razavi, Seyed-Mahdi; Cichy, Radoslaw Martin; Pantazis, Dimitrios; Oliva, Aude

2018-06-07

Animacy and real-world size are properties that describe any object and thus bring basic order into our perception of the visual world. Here, we investigated how the human brain processes real-world size and animacy. For this, we applied representational similarity to fMRI and MEG data to yield a view of brain activity with high spatial and temporal resolutions, respectively. Analysis of fMRI data revealed that a distributed and partly overlapping set of cortical regions extending from occipital to ventral and medial temporal cortex represented animacy and real-world size. Within this set, parahippocampal cortex stood out as the region representing animacy and size stronger than most other regions. Further analysis of the detailed representational format revealed differences among regions involved in processing animacy. Analysis of MEG data revealed overlapping temporal dynamics of animacy and real-world size processing starting at around 150 msec and provided the first neuromagnetic signature of real-world object size processing. Finally, to investigate the neural dynamics of size and animacy processing simultaneously in space and time, we combined MEG and fMRI with a novel extension of MEG-fMRI fusion by representational similarity. This analysis revealed partly overlapping and distributed spatiotemporal dynamics, with parahippocampal cortex singled out as a region that represented size and animacy persistently when other regions did not. Furthermore, the analysis highlighted the role of early visual cortex in representing real-world size. A control analysis revealed that the neural dynamics of processing animacy and size were distinct from the neural dynamics of processing low-level visual features. Together, our results provide a detailed spatiotemporal view of animacy and size processing in the human brain.

Event Boundaries Trigger Rapid Memory Reinstatement of the Prior Events to Promote Their Representation in Long-Term Memory.

PubMed

Sols, Ignasi; DuBrow, Sarah; Davachi, Lila; Fuentemilla, Lluís

2017-11-20

Although everyday experiences unfold continuously over time, shifts in context, or event boundaries, can influence how those events come to be represented in memory [1-4]. Specifically, mnemonic binding across sequential representations is more challenging at context shifts, such that successful temporal associations are more likely to be formed within than across contexts [1, 2, 5-9]. However, in order to preserve a subjective sense of continuity, it is important that the memory system bridge temporally adjacent events, even if they occur in seemingly distinct contexts. Here, we used pattern similarity analysis to scalp electroencephalographic (EEG) recordings during a sequential learning task [2, 3] in humans and showed that the detection of event boundaries triggered a rapid memory reinstatement of the just-encoded sequence episode. Memory reactivation was detected rapidly (∼200-800 ms from the onset of the event boundary) and was specific to context shifts that were preceded by an event sequence with episodic content. Memory reinstatement was not observed during the sequential encoding of events within an episode, indicating that memory reactivation was induced specifically upon context shifts. Finally, the degree of neural similarity between neural responses elicited during sequence encoding and at event boundaries correlated positively with participants' ability to later link across sequences of events, suggesting a critical role in binding temporally adjacent events in long-term memory. Current results shed light onto the neural mechanisms that promote episodic encoding not only for information within the event, but also, importantly, in the ability to link across events to create a memory representation of continuous experience. Copyright © 2017 Elsevier Ltd. All rights reserved.

Optimal interpolation schemes to constrain pmPM2.5 in regional modeling over the United States

NASA Astrophysics Data System (ADS)

Sousan, Sinan Dhia Jameel

This thesis presents the use of data assimilation with optimal interpolation (OI) to develop atmospheric aerosol concentration estimates for the United States at high spatial and temporal resolutions. Concentration estimates are highly desirable for a wide range of applications, including visibility, climate, and human health. OI is a viable data assimilation method that can be used to improve Community Multiscale Air Quality (CMAQ) model fine particulate matter (PM2.5) estimates. PM2.5 is the mass of solid and liquid particles with diameters less than or equal to 2.5 µm suspended in the gas phase. OI was employed by combining model estimates with satellite and surface measurements. The satellite data assimilation combined 36 x 36 km aerosol concentrations from CMAQ with aerosol optical depth (AOD) measured by MODIS and AERONET over the continental United States for 2002. Posterior model concentrations generated by the OI algorithm were compared with surface PM2.5 measurements to evaluate a number of possible data assimilation parameters, including model error, observation error, and temporal averaging assumptions. Evaluation was conducted separately for six geographic U.S. regions in 2002. Variability in model error and MODIS biases limited the effectiveness of a single data assimilation system for the entire continental domain. The best combinations of four settings and three averaging schemes led to a domain-averaged improvement in fractional error from 1.2 to 0.97 and from 0.99 to 0.89 at respective IMPROVE and STN monitoring sites. For 38% of OI results, MODIS OI degraded the forward model skill due to biases and outliers in MODIS AOD. Surface data assimilation combined 36 × 36 km aerosol concentrations from the CMAQ model with surface PM2.5 measurements over the continental United States for 2002. The model error covariance matrix was constructed by using the observational method. The observation error covariance matrix included site representation that scaled the observation error by land use (i.e. urban or rural locations). In theory, urban locations should have less effect on surrounding areas than rural sites, which can be controlled using site representation error. The annual evaluations showed substantial improvements in model performance with increases in the correlation coefficient from 0.36 (prior) to 0.76 (posterior), and decreases in the fractional error from 0.43 (prior) to 0.15 (posterior). In addition, the normalized mean error decreased from 0.36 (prior) to 0.13 (posterior), and the RMSE decreased from 5.39 µg m-3 (prior) to 2.32 µg m-3 (posterior). OI decreased model bias for both large spatial areas and point locations, and could be extended to more advanced data assimilation methods. The current work will be applied to a five year (2000-2004) CMAQ simulation aimed at improving aerosol model estimates. The posterior model concentrations will be used to inform exposure studies over the U.S. that relate aerosol exposure to mortality and morbidity rates. Future improvements for the OI techniques used in the current study will include combining both surface and satellite data to improve posterior model estimates. Satellite data have high spatial and temporal resolutions in comparison to surface measurements, which are scarce but more accurate than model estimates. The satellite data are subject to noise affected by location and season of retrieval. The implementation of OI to combine satellite and surface data sets has the potential to improve posterior model estimates for locations that have no direct measurements.

Representing time in language and memory: the role of similarity structure.

PubMed

Faber, Myrthe; Gennari, Silvia P

2015-03-01

Every day we read about or watch events in the world and can easily understand or remember how long they last. What aspects of an event are retained in memory? And how do we extract temporal information from our memory representations? These issues are central to human cognition, as they underlie a fundamental aspect of our mental life, namely our representation of time. This paper reviews previous language studies and reports a visual learning study indicating that properties of the events encoded in memory shape the representation of their duration. The evidence indicates that for a given event, the extent to which its associated properties or sub-components differ from one another modulates our representation of its duration. These properties include the similarity between sub-events and the similarity between the situational contexts in which an event occurs. We suggest that the diversity of representations that we associate with events in memory plays an important role in remembering and estimating the duration of experienced or described events. Copyright © 2014 Elsevier B.V. All rights reserved.

Model-data integration to improve the LPJmL dynamic global vegetation model

NASA Astrophysics Data System (ADS)

Forkel, Matthias; Thonicke, Kirsten; Schaphoff, Sibyll; Thurner, Martin; von Bloh, Werner; Dorigo, Wouter; Carvalhais, Nuno

2017-04-01

Dynamic global vegetation models show large uncertainties regarding the development of the land carbon balance under future climate change conditions. This uncertainty is partly caused by differences in how vegetation carbon turnover is represented in global vegetation models. Model-data integration approaches might help to systematically assess and improve model performances and thus to potentially reduce the uncertainty in terrestrial vegetation responses under future climate change. Here we present several applications of model-data integration with the LPJmL (Lund-Potsdam-Jena managed Lands) dynamic global vegetation model to systematically improve the representation of processes or to estimate model parameters. In a first application, we used global satellite-derived datasets of FAPAR (fraction of absorbed photosynthetic activity), albedo and gross primary production to estimate phenology- and productivity-related model parameters using a genetic optimization algorithm. Thereby we identified major limitations of the phenology module and implemented an alternative empirical phenology model. The new phenology module and optimized model parameters resulted in a better performance of LPJmL in representing global spatial patterns of biomass, tree cover, and the temporal dynamic of atmospheric CO2. Therefore, we used in a second application additionally global datasets of biomass and land cover to estimate model parameters that control vegetation establishment and mortality. The results demonstrate the ability to improve simulations of vegetation dynamics but also highlight the need to improve the representation of mortality processes in dynamic global vegetation models. In a third application, we used multiple site-level observations of ecosystem carbon and water exchange, biomass and soil organic carbon to jointly estimate various model parameters that control ecosystem dynamics. This exercise demonstrates the strong role of individual data streams on the simulated ecosystem dynamics which consequently changed the development of ecosystem carbon stocks and fluxes under future climate and CO2 change. In summary, our results demonstrate challenges and the potential of using model-data integration approaches to improve a dynamic global vegetation model.

Spatiotemporal characteristics of heat waves over China in regional climate simulations within the CORDEX-EA project

NASA Astrophysics Data System (ADS)

Wang, Pinya; Tang, Jianping; Sun, Xuguang; Liu, Jianyong; Juan, Fang

2018-03-01

Using the Weather Research and Forecasting (WRF) model, this paper analyzes the spatiotemporal features of heat waves in 20-year regional climate simulations over East Asia, and investigates the capability of WRF to reproduce observational heat waves in China. Within the framework of the Coordinated Regional Climate Downscaling Experiment (CORDEX), the WRF model is driven by the ERA-Interim (ERAIN) reanalysis, and five continuous simulations are conducted from 1989 to 2008. Of these, four runs apply the interior spectral nudging (SN) technique with different wavenumbers, nudging variables and nudging coefficients. Model validations show that WRF can reasonably reproduce the spatiotemporal features of heat waves in China. Compared with the experiment without SN, the application of SN is effectie on improving the skill of the model in simulating both the spatial distributions and temporal variations of heat waves of different intensities. The WRF model shows advantages in reproducing the synoptic circulations with SN and therefore yields better representations for heat wave events. Besides, the SN method is able to preserve the variability of large-scale circulations quite well, which in turn adjusts the extreme temperature variability towards the observation. Among the four SN experiments, those with stronger nudging coefficients perform better in modulating both the spatial and temporal features of heat waves. In contrast, smaller nudging coefficients weaken the effects of SN on improving WRF's performances.

Geospatial-temporal semantic graph representations of trajectories from remote sensing and geolocation data

DOEpatents

Perkins, David Nikolaus; Brost, Randolph; Ray, Lawrence P.

2017-08-08

Various technologies for facilitating analysis of large remote sensing and geolocation datasets to identify features of interest are described herein. A search query can be submitted to a computing system that executes searches over a geospatial temporal semantic (GTS) graph to identify features of interest. The GTS graph comprises nodes corresponding to objects described in the remote sensing and geolocation datasets, and edges that indicate geospatial or temporal relationships between pairs of nodes in the nodes. Trajectory information is encoded in the GTS graph by the inclusion of movable nodes to facilitate searches for features of interest in the datasets relative to moving objects such as vehicles.

Voxel-Based Lesion Symptom Mapping of Coarse Coding and Suppression Deficits in Patients With Right Hemisphere Damage

PubMed Central

Tompkins, Connie A.; Meigh, Kimberly M.; Prat, Chantel S.

2015-01-01

Purpose This study examined right hemisphere (RH) neuroanatomical correlates of lexical–semantic deficits that predict narrative comprehension in adults with RH brain damage. Coarse semantic coding and suppression deficits were related to lesions by voxel-based lesion symptom mapping. Method Participants were 20 adults with RH cerebrovascular accidents. Measures of coarse coding and suppression deficits were computed from lexical decision reaction times at short (175 ms) and long (1000 ms) prime-target intervals. Lesions were drawn on magnetic resonance imaging images and through normalization were registered on an age-matched brain template. Voxel-based lesion symptom mapping analysis was applied to build a general linear model at each voxel. Z score maps were generated for each deficit, and results were interpreted using automated anatomical labeling procedures. Results A deficit in coarse semantic activation was associated with lesions to the RH posterior middle temporal gyrus, dorsolateral prefrontal cortex, and lenticular nuclei. A maintenance deficit for coarsely coded representations involved the RH temporal pole and dorsolateral prefrontal cortex more medially. Ineffective suppression implicated lesions to the RH inferior frontal gyrus and subcortical regions, as hypothesized, along with the rostral temporal pole. Conclusion Beyond their scientific implications, these lesion–deficit correspondences may help inform the clinical diagnosis and enhance decisions about candidacy for deficit-focused treatment to improve narrative comprehension in individuals with RH damage. PMID:26425785

Voxel-Based Lesion Symptom Mapping of Coarse Coding and Suppression Deficits in Patients With Right Hemisphere Damage.

PubMed

Yang, Ying; Tompkins, Connie A; Meigh, Kimberly M; Prat, Chantel S

2015-11-01

This study examined right hemisphere (RH) neuroanatomical correlates of lexical-semantic deficits that predict narrative comprehension in adults with RH brain damage. Coarse semantic coding and suppression deficits were related to lesions by voxel-based lesion symptom mapping. Participants were 20 adults with RH cerebrovascular accidents. Measures of coarse coding and suppression deficits were computed from lexical decision reaction times at short (175 ms) and long (1000 ms) prime-target intervals. Lesions were drawn on magnetic resonance imaging images and through normalization were registered on an age-matched brain template. Voxel-based lesion symptom mapping analysis was applied to build a general linear model at each voxel. Z score maps were generated for each deficit, and results were interpreted using automated anatomical labeling procedures. A deficit in coarse semantic activation was associated with lesions to the RH posterior middle temporal gyrus, dorsolateral prefrontal cortex, and lenticular nuclei. A maintenance deficit for coarsely coded representations involved the RH temporal pole and dorsolateral prefrontal cortex more medially. Ineffective suppression implicated lesions to the RH inferior frontal gyrus and subcortical regions, as hypothesized, along with the rostral temporal pole. Beyond their scientific implications, these lesion-deficit correspondences may help inform the clinical diagnosis and enhance decisions about candidacy for deficit-focused treatment to improve narrative comprehension in individuals with RH damage.

Audiovisual Temporal Perception in Aging: The Role of Multisensory Integration and Age-Related Sensory Loss

PubMed Central

Brooks, Cassandra J.; Chan, Yu Man; Anderson, Andrew J.; McKendrick, Allison M.

2018-01-01

Within each sensory modality, age-related deficits in temporal perception contribute to the difficulties older adults experience when performing everyday tasks. Since perceptual experience is inherently multisensory, older adults also face the added challenge of appropriately integrating or segregating the auditory and visual cues present in our dynamic environment into coherent representations of distinct objects. As such, many studies have investigated how older adults perform when integrating temporal information across audition and vision. This review covers both direct judgments about temporal information (the sound-induced flash illusion, temporal order, perceived synchrony, and temporal rate discrimination) and judgments regarding stimuli containing temporal information (the audiovisual bounce effect and speech perception). Although an age-related increase in integration has been demonstrated on a variety of tasks, research specifically investigating the ability of older adults to integrate temporal auditory and visual cues has produced disparate results. In this short review, we explore what factors could underlie these divergent findings. We conclude that both task-specific differences and age-related sensory loss play a role in the reported disparity in age-related effects on the integration of auditory and visual temporal information. PMID:29867415

Audiovisual Temporal Perception in Aging: The Role of Multisensory Integration and Age-Related Sensory Loss.

PubMed

Brooks, Cassandra J; Chan, Yu Man; Anderson, Andrew J; McKendrick, Allison M

2018-01-01

Within each sensory modality, age-related deficits in temporal perception contribute to the difficulties older adults experience when performing everyday tasks. Since perceptual experience is inherently multisensory, older adults also face the added challenge of appropriately integrating or segregating the auditory and visual cues present in our dynamic environment into coherent representations of distinct objects. As such, many studies have investigated how older adults perform when integrating temporal information across audition and vision. This review covers both direct judgments about temporal information (the sound-induced flash illusion, temporal order, perceived synchrony, and temporal rate discrimination) and judgments regarding stimuli containing temporal information (the audiovisual bounce effect and speech perception). Although an age-related increase in integration has been demonstrated on a variety of tasks, research specifically investigating the ability of older adults to integrate temporal auditory and visual cues has produced disparate results. In this short review, we explore what factors could underlie these divergent findings. We conclude that both task-specific differences and age-related sensory loss play a role in the reported disparity in age-related effects on the integration of auditory and visual temporal information.

Quantifying the imprint of mesoscale and synoptic-scale atmospheric transport on total column carbon dioxide measurements

NASA Astrophysics Data System (ADS)

Torres, A. D.; Keppel-Aleks, G.; Doney, S. C.; Feng, S.; Lauvaux, T.; Fendrock, M. A.; Rheuben, J.

2017-12-01

Remote sensing instruments provide an unprecedented density of observations of the atmospheric CO2 column average mole fraction (denoted as XCO2), which can be used to constrain regional scale carbon fluxes. Inferring fluxes from XCO2 observations is challenging, as measurements and inversion methods are sensitive to not only the imprint local and large-scale fluxes, but also mesoscale and synoptic-scale atmospheric transport. Quantifying the fine-scale variability in XCO2 from mesoscale and synoptic-scale atmospheric transport will likely improve overall error estimates from flux inversions by improving estimates of representation errors that occur when XCO2 observations are compared to modeled XCO2 in relatively coarse transport models. Here, we utilize various statistical methods to quantify the imprint of atmospheric transport on XCO2 observations. We compare spatial variations along Orbiting Carbon Observatory (OCO-2) satellite tracks to temporal variations observed by the Total Column Carbon Observing Network (TCCON). We observe a coherent seasonal cycle of both within-day temporal and fine-scale spatial variability (of order 10 km) of XCO2 from these two datasets, suggestive of the imprint of mesoscale systems. To account for other potential sources of error in XCO2 retrieval, we compare observed temporal and spatial variations of XCO2 to high-resolution output from the Weather Research and Forecasting (WRF) model run at 9 km resolution. In both simulations and observations, the Northern hemisphere mid-latitude XCO2 showed peak variability during the growing season when atmospheric gradients are largest. These results are qualitatively consistent with our expectations of seasonal variations of the imprint of synoptic and mesoscale atmospheric transport on XCO2 observations; suggesting that these statistical methods could be sensitive to the imprint of atmospheric transport on XCO2 observations.

Extreme storm surge modelling in the North Sea. The role of the sea state, forcing frequency and spatial forcing resolution

NASA Astrophysics Data System (ADS)

Ridder, Nina; de Vries, Hylke; Drijfhout, Sybren; van den Brink, Henk; van Meijgaard, Erik; de Vries, Hans

2018-02-01

This study shows that storm surge model performance in the North Sea is mostly unaffected by the application of temporal variations of surface drag due to changes in sea state provided the choice of a suitable constant Charnock parameter in the sea-state-independent case. Including essential meteorological features on smaller scales and minimising interpolation errors by increasing forcing data resolution are shown to be more important for the improvement of model performance particularly at the high tail of the probability distribution. This is found in a modelling study using WAQUA/DCSMv5 by evaluating the influence of a realistic air-sea momentum transfer parameterization and comparing it to the influence of changes in the spatial and temporal resolution of the applied forcing fields in an effort to support the improvement of impact and climate analysis studies. Particular attention is given to the representation of extreme water levels over the past decades based on the example of the Netherlands. For this, WAQUA/DCSMv5 is forced with ERA-Interim reanalysis data. Model results are obtained from a set of different forcing fields, which either (i) include a wave-state-dependent Charnock parameter or (ii) apply a constant Charnock parameter ( α C h = 0.032) tuned for young sea states in the North Sea, but differ in their spatial and/or temporal resolution. Increasing forcing field resolution from roughly 79 to 12 km through dynamically downscaling can reduce the modelled low bias, depending on coastal station, by up to 0.25 m for the modelled extreme water levels with a 1-year return period and between 0.1 m and 0.5 m for extreme surge heights.

Stochastic Generation of Spatiotemporal Rainfall Events for Flood Risk Assessment

NASA Astrophysics Data System (ADS)

Diederen, D.; Liu, Y.; Gouldby, B.; Diermanse, F.

2017-12-01

Current flood risk analyses that only consider peaks of hydrometeorological forcing variables have limitations regarding their representation of reality. Simplistic assumptions regarding antecedent conditions are required, often different sources of flooding are considered in isolation, and the complex temporal and spatial evolution of the events is not considered. Mid-latitude storms, governed by large scale climatic conditions, often exhibit a high degree of temporal dependency, for example. For sustainable flood risk management, that accounts appropriately for climate change, it is desirable for flood risk analyses to reflect reality more appropriately. Analysis of risk mitigation measures and comparison of their relative performance is therefore likely to be more robust and lead to improved solutions. We provide a new framework for the provision of boundary conditions to flood risk analyses that more appropriately reflects reality. The boundary conditions capture the temporal dependencies of complex storms whilst preserving the extreme values and associated spatial dependencies. We demonstrate the application of this framework to generate a synthetic rainfall events time series boundary condition set from reanalysis rainfall data (CFSR) on the continental scale. We define spatiotemporal clusters of rainfall as events, extract hydrological parameters for each event, generate synthetic parameter sets with a multivariate distribution with a focus on the joint tail probability [Heffernan and Tawn, 2004], and finally create synthetic events from the generated synthetic parameters. We highlight the stochastic integration of (a) spatiotemporal features, e.g. event occurrence intensity over space-time, or time to previous event, which we use for the spatial placement and sequencing of the synthetic events, and (b) value-specific parameters, e.g. peak intensity and event extent. We contrast this to more traditional approaches to highlight the significant improvements in terms of representing the reality of extreme flood events.

A Framework of Temporal-Spatial Descriptors-Based Feature Extraction for Improved Myoelectric Pattern Recognition.

PubMed

Khushaba, Rami N; Al-Timemy, Ali H; Al-Ani, Ahmed; Al-Jumaily, Adel

2017-10-01

The extraction of the accurate and efficient descriptors of muscular activity plays an important role in tackling the challenging problem of myoelectric control of powered prostheses. In this paper, we present a new feature extraction framework that aims to give an enhanced representation of muscular activities through increasing the amount of information that can be extracted from individual and combined electromyogram (EMG) channels. We propose to use time-domain descriptors (TDDs) in estimating the EMG signal power spectrum characteristics; a step that preserves the computational power required for the construction of spectral features. Subsequently, TDD is used in a process that involves: 1) representing the temporal evolution of the EMG signals by progressively tracking the correlation between the TDD extracted from each analysis time window and a nonlinearly mapped version of it across the same EMG channel and 2) representing the spatial coherence between the different EMG channels, which is achieved by calculating the correlation between the TDD extracted from the differences of all possible combinations of pairs of channels and their nonlinearly mapped versions. The proposed temporal-spatial descriptors (TSDs) are validated on multiple sparse and high-density (HD) EMG data sets collected from a number of intact-limbed and amputees performing a large number of hand and finger movements. Classification results showed significant reductions in the achieved error rates in comparison to other methods, with the improvement of at least 8% on average across all subjects. Additionally, the proposed TSDs achieved significantly well in problems with HD-EMG with average classification errors of <5% across all subjects using windows lengths of 50 ms only.

Adaptability to Changes in Temporal Structure Is Fornix-Dependent

ERIC Educational Resources Information Center

Kwok, Sze Chai; Mitchell, Anna S.; Buckley, Mark J.

2015-01-01

Recognition memory deficits, even after short delays, are sometimes observed following hippocampal damage. One hypothesis links the hippocampus with processes in updating contextual memory representation. Here, we used fornix transection, which partially disconnects the hippocampal system, and compares the performance of fornix-transected monkeys…

Neural Prediction Errors Distinguish Perception and Misperception of Speech.

PubMed

Blank, Helen; Spangenberg, Marlene; Davis, Matthew H

2018-06-11

Humans use prior expectations to improve perception, especially of sensory signals that are degraded or ambiguous. However, if sensory input deviates from prior expectations, correct perception depends on adjusting or rejecting prior expectations. Failure to adjust or reject the prior leads to perceptual illusions especially if there is partial overlap (hence partial mismatch) between expectations and input. With speech, "Slips of the ear" occur when expectations lead to misperception. For instance, a entomologist, might be more susceptible to hear "The ants are my friends" for "The answer, my friend" (in the Bob Dylan song "Blowing in the Wind"). Here, we contrast two mechanisms by which prior expectations may lead to misperception of degraded speech. Firstly, clear representations of the common sounds in the prior and input (i.e., expected sounds) may lead to incorrect confirmation of the prior. Secondly, insufficient representations of sounds that deviate between prior and input (i.e., prediction errors) could lead to deception. We used cross-modal predictions from written words that partially match degraded speech to compare neural responses when male and female human listeners were deceived into accepting the prior or correctly reject it. Combined behavioural and multivariate representational similarity analysis of functional magnetic resonance imaging data shows that veridical perception of degraded speech is signalled by representations of prediction error in the left superior temporal sulcus. Instead of using top-down processes to support perception of expected sensory input, our findings suggest that the strength of neural prediction error representations distinguishes correct perception and misperception. SIGNIFICANCE STATEMENT Misperceiving spoken words is an everyday experience with outcomes that range from shared amusement to serious miscommunication. For hearing-impaired individuals, frequent misperception can lead to social withdrawal and isolation with severe consequences for well-being. In this work, we specify the neural mechanisms by which prior expectations - which are so often helpful for perception - can lead to misperception of degraded sensory signals. Most descriptive theories of illusory perception explain misperception as arising from a clear sensory representation of features or sounds that are in common between prior expectations and sensory input. Our work instead provides support for a complementary proposal; namely that misperception occurs when there is an insufficient sensory representations of the deviation between expectations and sensory signals. Copyright © 2018 the authors.

Impaired extraction of speech rhythm from temporal modulation patterns in speech in developmental dyslexia

PubMed Central

Leong, Victoria; Goswami, Usha

2014-01-01

Dyslexia is associated with impaired neural representation of the sound structure of words (phonology). The “phonological deficit” in dyslexia may arise in part from impaired speech rhythm perception, thought to depend on neural oscillatory phase-locking to slow amplitude modulation (AM) patterns in the speech envelope. Speech contains AM patterns at multiple temporal rates, and these different AM rates are associated with phonological units of different grain sizes, e.g., related to stress, syllables or phonemes. Here, we assess the ability of adults with dyslexia to use speech AMs to identify rhythm patterns (RPs). We study 3 important temporal rates: “Stress” (~2 Hz), “Syllable” (~4 Hz) and “Sub-beat” (reduced syllables, ~14 Hz). 21 dyslexics and 21 controls listened to nursery rhyme sentences that had been tone-vocoded using either single AM rates from the speech envelope (Stress only, Syllable only, Sub-beat only) or pairs of AM rates (Stress + Syllable, Syllable + Sub-beat). They were asked to use the acoustic rhythm of the stimulus to identity the original nursery rhyme sentence. The data showed that dyslexics were significantly poorer at detecting rhythm compared to controls when they had to utilize multi-rate temporal information from pairs of AMs (Stress + Syllable or Syllable + Sub-beat). These data suggest that dyslexia is associated with a reduced ability to utilize AMs <20 Hz for rhythm recognition. This perceptual deficit in utilizing AM patterns in speech could be underpinned by less efficient neuronal phase alignment and cross-frequency neuronal oscillatory synchronization in dyslexia. Dyslexics' perceptual difficulties in capturing the full spectro-temporal complexity of speech over multiple timescales could contribute to the development of impaired phonological representations for words, the cognitive hallmark of dyslexia across languages. PMID:24605099

Mapping the spatio-temporal structure of motor cortical LFP and spiking activities during reach-to-grasp movements

PubMed Central

Riehle, Alexa; Wirtssohn, Sarah; Grün, Sonja; Brochier, Thomas

2013-01-01

Grasping an object involves shaping the hand and fingers in relation to the object’s physical properties. Following object contact, it also requires a fine adjustment of grasp forces for secure manipulation. Earlier studies suggest that the control of hand shaping and grasp force involve partially segregated motor cortical networks. However, it is still unclear how information originating from these networks is processed and integrated. We addressed this issue by analyzing massively parallel signals from population measures (local field potentials, LFPs) and single neuron spiking activities recorded simultaneously during a delayed reach-to-grasp task, by using a 100-electrode array chronically implanted in monkey motor cortex. Motor cortical LFPs exhibit a large multi-component movement-related potential (MRP) around movement onset. Here, we show that the peak amplitude of each MRP component and its latency with respect to movement onset vary along the cortical surface covered by the array. Using a comparative mapping approach, we suggest that the spatio-temporal structure of the MRP reflects the complex physical properties of the reach-to-grasp movement. In addition, we explored how the spatio-temporal structure of the MRP relates to two other measures of neuronal activity: the temporal profile of single neuron spiking activity at each electrode site and the somatosensory receptive field properties of single neuron activities. We observe that the spatial representations of LFP and spiking activities overlap extensively and relate to the spatial distribution of proximal and distal representations of the upper limb. Altogether, these data show that, in motor cortex, a precise spatio-temporal pattern of activation is involved for the control of reach-to-grasp movements and provide some new insight about the functional organization of motor cortex during reaching and object manipulation. PMID:23543888

Super Normal Vector for Human Activity Recognition with Depth Cameras.

PubMed

Yang, Xiaodong; Tian, YingLi

2017-05-01

The advent of cost-effectiveness and easy-operation depth cameras has facilitated a variety of visual recognition tasks including human activity recognition. This paper presents a novel framework for recognizing human activities from video sequences captured by depth cameras. We extend the surface normal to polynormal by assembling local neighboring hypersurface normals from a depth sequence to jointly characterize local motion and shape information. We then propose a general scheme of super normal vector (SNV) to aggregate the low-level polynormals into a discriminative representation, which can be viewed as a simplified version of the Fisher kernel representation. In order to globally capture the spatial layout and temporal order, an adaptive spatio-temporal pyramid is introduced to subdivide a depth video into a set of space-time cells. In the extensive experiments, the proposed approach achieves superior performance to the state-of-the-art methods on the four public benchmark datasets, i.e., MSRAction3D, MSRDailyActivity3D, MSRGesture3D, and MSRActionPairs3D.

The role of visual representations during the lexical access of spoken words

PubMed Central

Lewis, Gwyneth; Poeppel, David

2015-01-01

Do visual representations contribute to spoken word recognition? We examine, using MEG, the effects of sublexical and lexical variables at superior temporal (ST) areas and the posterior middle temporal gyrus (pMTG) compared with that of word imageability at visual cortices. Embodied accounts predict early modulation of visual areas by imageability - concurrently with or prior to modulation of pMTG by lexical variables. Participants responded to speech stimuli varying continuously in imageability during lexical decision with simultaneous MEG recording. We employed the linguistic variables in a new type of correlational time course analysis to assess trial-by-trial activation in occipital, ST, and pMTG regions of interest (ROIs). The linguistic variables modulated the ROIs during different time windows. Critically, visual regions reflected an imageability effect prior to effects of lexicality on pMTG. This surprising effect supports a view on which sensory aspects of a lexical item are not a consequence of lexical activation. PMID:24814579

[Investigating phonological planning processes in speech production through a speech-error induction technique].

PubMed

Nakayama, Masataka; Saito, Satoru

2015-08-01

The present study investigated principles of phonological planning, a common serial ordering mechanism for speech production and phonological short-term memory. Nakayama and Saito (2014) have investigated the principles by using a speech-error induction technique, in which participants were exposed to an auditory distracIor word immediately before an utterance of a target word. They demonstrated within-word adjacent mora exchanges and serial position effects on error rates. These findings support, respectively, the temporal distance and the edge principles at a within-word level. As this previous study induced errors using word distractors created by exchanging adjacent morae in the target words, it is possible that the speech errors are expressions of lexical intrusions reflecting interactive activation of phonological and lexical/semantic representations. To eliminate this possibility, the present study used nonword distractors that had no lexical or semantic representations. This approach successfully replicated the error patterns identified in the abovementioned study, further confirming that the temporal distance and edge principles are organizing precepts in phonological planning.

Sensitivity to timing and order in human visual cortex

PubMed Central

Singer, Jedediah M.; Madsen, Joseph R.; Anderson, William S.

2014-01-01

Visual recognition takes a small fraction of a second and relies on the cascade of signals along the ventral visual stream. Given the rapid path through multiple processing steps between photoreceptors and higher visual areas, information must progress from stage to stage very quickly. This rapid progression of information suggests that fine temporal details of the neural response may be important to the brain's encoding of visual signals. We investigated how changes in the relative timing of incoming visual stimulation affect the representation of object information by recording intracranial field potentials along the human ventral visual stream while subjects recognized objects whose parts were presented with varying asynchrony. Visual responses along the ventral stream were sensitive to timing differences as small as 17 ms between parts. In particular, there was a strong dependency on the temporal order of stimulus presentation, even at short asynchronies. From these observations we infer that the neural representation of complex information in visual cortex can be modulated by rapid dynamics on scales of tens of milliseconds. PMID:25429116

Activation in the Right Inferior Parietal Lobule Reflects the Representation of Musical Structure beyond Simple Pitch Discrimination.

PubMed

Royal, Isabelle; Vuvan, Dominique T; Zendel, Benjamin Rich; Robitaille, Nicolas; Schönwiesner, Marc; Peretz, Isabelle

2016-01-01

Pitch discrimination tasks typically engage the superior temporal gyrus and the right inferior frontal gyrus. It is currently unclear whether these regions are equally involved in the processing of incongruous notes in melodies, which requires the representation of musical structure (tonality) in addition to pitch discrimination. To this aim, 14 participants completed two tasks while undergoing functional magnetic resonance imaging, one in which they had to identify a pitch change in a series of non-melodic repeating tones and a second in which they had to identify an incongruous note in a tonal melody. In both tasks, the deviants activated the right superior temporal gyrus. A contrast between deviants in the melodic task and deviants in the non-melodic task (melodic > non-melodic) revealed additional activity in the right inferior parietal lobule. Activation in the inferior parietal lobule likely represents processes related to the maintenance of tonal pitch structure in working memory during pitch discrimination.

Activation in the Right Inferior Parietal Lobule Reflects the Representation of Musical Structure beyond Simple Pitch Discrimination

PubMed Central

Royal, Isabelle; Vuvan, Dominique T.; Zendel, Benjamin Rich; Robitaille, Nicolas; Schönwiesner, Marc; Peretz, Isabelle

2016-01-01

Pitch discrimination tasks typically engage the superior temporal gyrus and the right inferior frontal gyrus. It is currently unclear whether these regions are equally involved in the processing of incongruous notes in melodies, which requires the representation of musical structure (tonality) in addition to pitch discrimination. To this aim, 14 participants completed two tasks while undergoing functional magnetic resonance imaging, one in which they had to identify a pitch change in a series of non-melodic repeating tones and a second in which they had to identify an incongruous note in a tonal melody. In both tasks, the deviants activated the right superior temporal gyrus. A contrast between deviants in the melodic task and deviants in the non-melodic task (melodic > non-melodic) revealed additional activity in the right inferior parietal lobule. Activation in the inferior parietal lobule likely represents processes related to the maintenance of tonal pitch structure in working memory during pitch discrimination. PMID:27195523

Turning I into me: Imagining your future self.

PubMed

Macrae, C Neil; Mitchell, Jason P; Tait, Kirsten A; McNamara, Diana L; Golubickis, Marius; Topalidis, Pavlos P; Christian, Brittany M

2015-12-01

A widely endorsed belief is that perceivers imagine their present selves using a different representational format than imagining their future selves (i.e., near future=first-person; distant future=third-person). But is this really the case? Responding to the paucity of work on this topic, here we considered how temporal distance influences the extent to which individuals direct their attention outward or inward during a brief imaginary episode. Using a non-verbal measure of visual perspective taking (i.e., letter-drawing task) our results confirmed the hypothesized relation between temporal distance and conceptions of the self. Whereas simulations of an event in the near future were dominated by a first-person representation of the self, this switched to a third-person depiction when the event was located in the distant future. Critically, this switch in vantage point was restricted to self-related simulations. The theoretical and practical implications of these findings are considered. Copyright © 2015 Elsevier Inc. All rights reserved.

Speaker Invariance for Phonetic Information: an fMRI Investigation

PubMed Central

Salvata, Caden; Blumstein, Sheila E.; Myers, Emily B.

2012-01-01

The current study explored how listeners map the variable acoustic input onto a common sound structure representation while being able to retain phonetic detail to distinguish among the identity of talkers. An adaptation paradigm was utilized to examine areas which showed an equal neural response (equal release from adaptation) to phonetic change when spoken by the same speaker and when spoken by two different speakers, and insensitivity (failure to show release from adaptation) when the same phonetic input was spoken by a different speaker. Neural areas which showed speaker invariance were located in the anterior portion of the middle superior temporal gyrus bilaterally. These findings provide support for the view that speaker normalization processes allow for the translation of a variable speech input to a common abstract sound structure. That this process appears to occur early in the processing stream, recruiting temporal structures, suggests that this mapping takes place prelexically, before sound structure input is mapped on to lexical representations. PMID:23264714

Emotional modulation of pain: is it the sensation or what we recall?

PubMed

Godinho, Fabio; Magnin, Michel; Frot, Maud; Perchet, Caroline; Garcia-Larrea, Luis

2006-11-01

Emotions modulate pain perception, although the mechanisms underlying this phenomenon remain unclear. In this study, we show that intensity reports significantly increased when painful stimuli were concomitant to images showing human pain, whereas pictures with identical emotional values but without somatic content failed to modulate pain. Early somatosensory responses (<200 ms) remained unmodified by emotions. Conversely, late responses showed a significant enhancement associated with increased pain ratings, localized to the right prefrontal, right temporo-occipital junction, and right temporal pole. In contrast to selective attention, which enhances pain ratings by increasing sensory gain, emotions triggered by seeing other people's pain did not alter processing in SI-SII (primary and second somatosensory areas), but may have biased the transfer to, and the representation of pain in short-term memory buffers (prefrontal), as well as the affective assignment to this representation (temporal pole). Memory encoding and recall, rather than sensory processing, appear to be modulated by empathy with others' physical suffering.

The role of visual representations during the lexical access of spoken words.

PubMed

Lewis, Gwyneth; Poeppel, David

2014-07-01

Do visual representations contribute to spoken word recognition? We examine, using MEG, the effects of sublexical and lexical variables at superior temporal (ST) areas and the posterior middle temporal gyrus (pMTG) compared with that of word imageability at visual cortices. Embodied accounts predict early modulation of visual areas by imageability--concurrently with or prior to modulation of pMTG by lexical variables. Participants responded to speech stimuli varying continuously in imageability during lexical decision with simultaneous MEG recording. We employed the linguistic variables in a new type of correlational time course analysis to assess trial-by-trial activation in occipital, ST, and pMTG regions of interest (ROIs). The linguistic variables modulated the ROIs during different time windows. Critically, visual regions reflected an imageability effect prior to effects of lexicality on pMTG. This surprising effect supports a view on which sensory aspects of a lexical item are not a consequence of lexical activation. Copyright © 2014 Elsevier Inc. All rights reserved.

An Innovative Infrastructure with a Universal Geo-Spatiotemporal Data Representation Supporting Cost-Effective Integration of Diverse Earth Science Data

NASA Technical Reports Server (NTRS)

Rilee, Michael Lee; Kuo, Kwo-Sen

2017-01-01

The SpatioTemporal Adaptive Resolution Encoding (STARE) is a unifying scheme encoding geospatial and temporal information for organizing data on scalable computing/storage resources, minimizing expensive data transfers. STARE provides a compact representation that turns set-logic functions into integer operations, e.g. conditional sub-setting, taking into account representative spatiotemporal resolutions of the data in the datasets. STARE geo-spatiotemporally aligns data placements of diverse data on massive parallel resources to maximize performance. Automating important scientific functions (e.g. regridding) and computational functions (e.g. data placement) allows scientists to focus on domain-specific questions instead of expending their efforts and expertise on data processing. With STARE-enabled automation, SciDB (Scientific Database) plus STARE provides a database interface, reducing costly data preparation, increasing the volume and variety of interoperable data, and easing result sharing. Using SciDB plus STARE as part of an integrated analysis infrastructure dramatically eases combining diametrically different datasets.

Spatio-temporal population estimates for risk management

NASA Astrophysics Data System (ADS)

Cockings, Samantha; Martin, David; Smith, Alan; Martin, Rebecca

2013-04-01

Accurate estimation of population at risk from hazards and effective emergency management of events require not just appropriate spatio-temporal modelling of hazards but also of population. While much recent effort has been focused on improving the modelling and predictions of hazards (both natural and anthropogenic), there has been little parallel advance in the measurement or modelling of population statistics. Different hazard types occur over diverse temporal cycles, are of varying duration and differ significantly in their spatial extent. Even events of the same hazard type, such as flood events, vary markedly in their spatial and temporal characteristics. Conceptually and pragmatically then, population estimates should also be available for similarly varying spatio-temporal scales. Routine population statistics derived from traditional censuses or surveys are usually static representations in both space and time, recording people at their place of usual residence on census/survey night and presenting data for administratively defined areas. Such representations effectively fix the scale of population estimates in both space and time, which is unhelpful for meaningful risk management. Over recent years, the Pop24/7 programme of research, based at the University of Southampton (UK), has developed a framework for spatio-temporal modelling of population, based on gridded population surfaces. Based on a data model which is fully flexible in terms of space and time, the framework allows population estimates to be produced for any time slice relevant to the data contained in the model. It is based around a set of origin and destination centroids, which have capacities, spatial extents and catchment areas, all of which can vary temporally, such as by time of day, day of week, season. A background layer, containing information on features such as transport networks and landuse, provides information on the likelihood of people being in certain places at specific times. Unusual patterns associated with special events can also be modelled and the framework is fully volume preserving. Outputs from the model are gridded population surfaces for the specified time slice, either for total population or by sub-groups (e.g. age). Software to implement the models (SurfaceBuilder247) has been developed and pre-processed layers for typical time slices for England and Wales in 2001 and 2006 are available for UK academic purposes. The outputs and modelling framework from the Pop24/7 programme provide significant opportunities for risk management applications. For estimates of mid- to long-term cumulative population exposure to hazards, such as in flood risk mapping, populations can be produced for numerous time slices and integrated with flood models. For applications in emergency response/ management, time-specific population models can be used as seeds for agent-based models or other response/behaviour models. Estimates for sub-groups of the population also permit exploration of vulnerability through space and time. This paper outlines the requirements for effective spatio-temporal population models for risk management. It then describes the Pop24/7 framework and illustrates its potential for risk management through presentation of examples from natural and anthropogenic hazard applications. The paper concludes by highlighting key challenges for future research in this area.

Fracking in the UK press: threat dynamics in an unfolding debate.

PubMed

Jaspal, Rusi; Nerlich, Brigitte

2014-04-01

Shale gas is a novel source of fossil fuel which is extracted by induced hydraulic fracturing, or "fracking". This article examines the socio-political dimension of fracking as manifested in the UK press at three key temporal points in the debate on the practice. Three newspaper corpora were analysed qualitatively using Thematic Analysis and Social Representations Theory. Three overarching themes are discussed: "April-May 2011: from Optimism to Scepticism"; "November 2011: (De-) Constructing and Re-Constructing Risk and Danger"; "April 2012: consolidating Social Representations of Fracking". In this article, we examine the emergence of and inter-relations between competing social representations, discuss the dynamics of threat positioning and show how threat can be re-construed in order to serve particular socio-political ends in the debate on fracking.

Improving students’ mathematical representational ability through RME-based progressive mathematization

NASA Astrophysics Data System (ADS)

Warsito; Darhim; Herman, T.

2018-01-01

This study aims to determine the differences in the improving of mathematical representation ability based on progressive mathematization with realistic mathematics education (PMR-MP) with conventional learning approach (PB). The method of research is quasi-experiments with non-equivalent control group designs. The study population is all students of class VIII SMPN 2 Tangerang consisting of 6 classes, while the sample was taken two classes with purposive sampling technique. The experimental class is treated with PMR-MP while the control class is treated with PB. The instruments used are test of mathematical representation ability. Data analysis was done by t-test, ANOVA test, post hoc test, and descriptive analysis. The result of analysis can be concluded that: 1) there are differences of mathematical representation ability improvement between students treated by PMR-MP and PB, 2) no interaction between learning approach (PMR-MP, PB) and prior mathematics knowledge (PAM) to improve students’ mathematical representation; 3) Students’ mathematical representation improvement in the level of higher PAM is better than medium, and low PAM students. Thus, based on the process of mathematization, it is very important when the learning direction of PMR-MP emphasizes on the process of building mathematics through a mathematical model.

Future versus present: time perspective and pupillary response in a relatedness judgment task investigating temporal event knowledge.

PubMed

Nowack, Kati; Milfont, Taciano L; van der Meer, Elke

2013-02-01

Mental representations of events contain many components such as typical agents, instruments, objects as well as a temporal dimension that is directed towards the future. While the role of temporal orientation (chronological, reverse) in event knowledge has been demonstrated by numerous studies, little is known about the influence of time perspective (present or future) as source of individual differences affecting event knowledge. The present study combined behavioral data with task-evoked pupil dilation to examine the impact of time perspective on cognitive resource allocation. In a relatedness judgment task, everyday events like raining were paired with an object feature like wet. Chronological items were processed more easily than reverse items regardless of time perspective. When more automatic processes were applied, greater scores on future time perspective were associated with lower error rates for chronological items. This suggests that a match between a strong focus on future consequences and items with a temporal orientation directed toward the future serves to enhance responding accuracy. Indexed by pupillary data, future-oriented participants invested more cognitive resources while outperforming present-oriented participants in reaction times across all conditions. This result was supported by a principal component analysis on the pupil data, which demonstrated the same impact of time perspective on the factor associated with more general aspects of cognitive effort. These findings suggest that future time perspective may be linked to a more general cognitive performance characteristic that improves overall task performance. Copyright © 2012 Elsevier B.V. All rights reserved.

Quality assessment of static aggregation compared to the temporal approach based on a pig trade network in Northern Germany.

PubMed

Büttner, Kathrin; Salau, Jennifer; Krieter, Joachim

2016-07-01

Recent analyses of animal movement networks focused on the static aggregation of trade contacts over different time windows, which neglects the system's temporal variation. In terms of disease spread, ignoring the temporal dynamics can lead to an over- or underestimation of an outbreak's speed and extent. This becomes particularly evident, if the static aggregation allows for the existence of more paths compared to the number of time-respecting paths (i.e. paths in the right chronological order). Therefore, the aim of this study was to reveal differences between static and temporal representations of an animal trade network and to assess the quality of the static aggregation in comparison to the temporal counterpart. Contact data from a pig trade network (2006-2009) of a producer community in Northern Germany were analysed. The results show that a median value of 8.7 % (4.6-14.1%) of the nodes and 3.1% (1.6-5.5%) of the edges were active on a weekly resolution. No fluctuations in the activity patterns were obvious. Furthermore, 50% of the nodes already had one trade contact after approximately six months. For an accumulation window with increasing size (one day each), the accumulation rate, i.e. the relative increase in the number of nodes or edges, stayed relatively constant below 0.07% for the nodes and 0.12 % for the edges. The temporal distances had a much wider distribution than the topological distances. 84% of the temporal distances were smaller than 90 days. The maximum temporal distance was 1000 days, which corresponds to the temporal diameter of the present network. The median temporal correlation coefficient, which measures the probability for an edge to persist across two consecutive time steps, was 0.47, with a maximum value of 0.63 at the accumulation window of 88 days. The causal fidelity measures the fraction of the number of static paths which can also be taken in the temporal network. For the whole observation period relatively high values indicate that 67% of the time-respecting paths existed in both network representations. An increase to 0.87 (0.82-0.88) and 0.92 (0.80-0.98), respectively, could be observed for yearly and monthly aggregation windows. The results show that the investigated pig trade network in its static aggregation represents the temporal dynamics of the system sufficiently well. Therefore, the methodology for analysing static instead of dynamic networks can be used without losing too much information. Copyright © 2016 Elsevier B.V. All rights reserved.

Brain activity is related to individual differences in the number of items stored in auditory short-term memory for pitch: evidence from magnetoencephalography.

PubMed

Grimault, Stephan; Nolden, Sophie; Lefebvre, Christine; Vachon, François; Hyde, Krista; Peretz, Isabelle; Zatorre, Robert; Robitaille, Nicolas; Jolicoeur, Pierre

2014-07-01

We used magnetoencephalography (MEG) to examine brain activity related to the maintenance of non-verbal pitch information in auditory short-term memory (ASTM). We focused on brain activity that increased with the number of items effectively held in memory by the participants during the retention interval of an auditory memory task. We used very simple acoustic materials (i.e., pure tones that varied in pitch) that minimized activation from non-ASTM related systems. MEG revealed neural activity in frontal, temporal, and parietal cortices that increased with a greater number of items effectively held in memory by the participants during the maintenance of pitch representations in ASTM. The present results reinforce the functional role of frontal and temporal cortices in the retention of pitch information in ASTM. This is the first MEG study to provide both fine spatial localization and temporal resolution on the neural mechanisms of non-verbal ASTM for pitch in relation to individual differences in the capacity of ASTM. This research contributes to a comprehensive understanding of the mechanisms mediating the representation and maintenance of basic non-verbal auditory features in the human brain. Copyright © 2014 Elsevier Inc. All rights reserved.

Preserving information in neural transmission.

PubMed

Sincich, Lawrence C; Horton, Jonathan C; Sharpee, Tatyana O

2009-05-13

Along most neural pathways, the spike trains transmitted from one neuron to the next are altered. In the process, neurons can either achieve a more efficient stimulus representation, or extract some biologically important stimulus parameter, or succeed at both. We recorded the inputs from single retinal ganglion cells and the outputs from connected lateral geniculate neurons in the macaque to examine how visual signals are relayed from retina to cortex. We found that geniculate neurons re-encoded multiple temporal stimulus features to yield output spikes that carried more information about stimuli than was available in each input spike. The coding transformation of some relay neurons occurred with no decrement in information rate, despite output spike rates that averaged half the input spike rates. This preservation of transmitted information was achieved by the short-term summation of inputs that geniculate neurons require to spike. A reduced model of the retinal and geniculate visual responses, based on two stimulus features and their associated nonlinearities, could account for >85% of the total information available in the spike trains and the preserved information transmission. These results apply to neurons operating on a single time-varying input, suggesting that synaptic temporal integration can alter the temporal receptive field properties to create a more efficient representation of visual signals in the thalamus than the retina.

Syntactic Computations in the Language Network: Characterizing Dynamic Network Properties Using Representational Similarity Analysis

PubMed Central

Tyler, Lorraine K.; Cheung, Teresa P. L.; Devereux, Barry J.; Clarke, Alex

2013-01-01

The core human capacity of syntactic analysis involves a left hemisphere network involving left inferior frontal gyrus (LIFG) and posterior middle temporal gyrus (LMTG) and the anatomical connections between them. Here we use magnetoencephalography (MEG) to determine the spatio-temporal properties of syntactic computations in this network. Listeners heard spoken sentences containing a local syntactic ambiguity (e.g., “… landing planes …”), at the offset of which they heard a disambiguating verb and decided whether it was an acceptable/unacceptable continuation of the sentence. We charted the time-course of processing and resolving syntactic ambiguity by measuring MEG responses from the onset of each word in the ambiguous phrase and the disambiguating word. We used representational similarity analysis (RSA) to characterize syntactic information represented in the LIFG and left posterior middle temporal gyrus (LpMTG) over time and to investigate their relationship to each other. Testing a variety of lexico-syntactic and ambiguity models against the MEG data, our results suggest early lexico-syntactic responses in the LpMTG and later effects of ambiguity in the LIFG, pointing to a clear differentiation in the functional roles of these two regions. Our results suggest the LpMTG represents and transmits lexical information to the LIFG, which responds to and resolves the ambiguity. PMID:23730293

A discrete spectral analysis for determining quasi-linear viscoelastic properties of biological materials

PubMed Central

Babaei, Behzad; Abramowitch, Steven D.; Elson, Elliot L.; Thomopoulos, Stavros; Genin, Guy M.

2015-01-01

The viscoelastic behaviour of a biological material is central to its functioning and is an indicator of its health. The Fung quasi-linear viscoelastic (QLV) model, a standard tool for characterizing biological materials, provides excellent fits to most stress–relaxation data by imposing a simple form upon a material's temporal relaxation spectrum. However, model identification is challenging because the Fung QLV model's ‘box’-shaped relaxation spectrum, predominant in biomechanics applications, can provide an excellent fit even when it is not a reasonable representation of a material's relaxation spectrum. Here, we present a robust and simple discrete approach for identifying a material's temporal relaxation spectrum from stress–relaxation data in an unbiased way. Our ‘discrete QLV’ (DQLV) approach identifies ranges of time constants over which the Fung QLV model's typical box spectrum provides an accurate representation of a particular material's temporal relaxation spectrum, and is effective at providing a fit to this model. The DQLV spectrum also reveals when other forms or discrete time constants are more suitable than a box spectrum. After validating the approach against idealized and noisy data, we applied the methods to analyse medial collateral ligament stress–relaxation data and identify the strengths and weaknesses of an optimal Fung QLV fit. PMID:26609064

A neural model of the temporal dynamics of figure-ground segregation in motion perception.

PubMed

Raudies, Florian; Neumann, Heiko

2010-03-01

How does the visual system manage to segment a visual scene into surfaces and objects and manage to attend to a target object? Based on psychological and physiological investigations, it has been proposed that the perceptual organization and segmentation of a scene is achieved by the processing at different levels of the visual cortical hierarchy. According to this, motion onset detection, motion-defined shape segregation, and target selection are accomplished by processes which bind together simple features into fragments of increasingly complex configurations at different levels in the processing hierarchy. As an alternative to this hierarchical processing hypothesis, it has been proposed that the processing stages for feature detection and segregation are reflected in different temporal episodes in the response patterns of individual neurons. Such temporal epochs have been observed in the activation pattern of neurons as low as in area V1. Here, we present a neural network model of motion detection, figure-ground segregation and attentive selection which explains these response patterns in an unifying framework. Based on known principles of functional architecture of the visual cortex, we propose that initial motion and motion boundaries are detected at different and hierarchically organized stages in the dorsal pathway. Visual shapes that are defined by boundaries, which were generated from juxtaposed opponent motions, are represented at different stages in the ventral pathway. Model areas in the different pathways interact through feedforward and modulating feedback, while mutual interactions enable the communication between motion and form representations. Selective attention is devoted to shape representations by sending modulating feedback signals from higher levels (working memory) to intermediate levels to enhance their responses. Areas in the motion and form pathway are coupled through top-down feedback with V1 cells at the bottom end of the hierarchy. We propose that the different temporal episodes in the response pattern of V1 cells, as recorded in recent experiments, reflect the strength of modulating feedback signals. This feedback results from the consolidated shape representations from coherent motion patterns and the attentive modulation of responses along the cortical hierarchy. The model makes testable predictions concerning the duration and delay of the temporal episodes of V1 cell responses as well as their response variations that were caused by modulating feedback signals. Copyright 2009 Elsevier Ltd. All rights reserved.

How the Human Brain Represents Perceived Dangerousness or “Predacity” of Animals

PubMed Central

Sha, Long; Guntupalli, J. Swaroop; Oosterhof, Nikolaas; Halchenko, Yaroslav O.; Nastase, Samuel A.; di Oleggio Castello, Matteo Visconti; Abdi, Hervé; Jobst, Barbara C.; Gobbini, M. Ida; Haxby, James V.

2016-01-01

Common or folk knowledge about animals is dominated by three dimensions: (1) level of cognitive complexity or “animacy;” (2) dangerousness or “predacity;” and (3) size. We investigated the neural basis of the perceived dangerousness or aggressiveness of animals, which we refer to more generally as “perception of threat.” Using functional magnetic resonance imaging (fMRI), we analyzed neural activity evoked by viewing images of animal categories that spanned the dissociable semantic dimensions of threat and taxonomic class. The results reveal a distributed network for perception of threat extending along the right superior temporal sulcus. We compared neural representational spaces with target representational spaces based on behavioral judgments and a computational model of early vision and found a processing pathway in which perceived threat emerges as a dominant dimension: whereas visual features predominate in early visual cortex and taxonomy in lateral occipital and ventral temporal cortices, these dimensions fall away progressively from posterior to anterior temporal cortices, leaving threat as the dominant explanatory variable. Our results suggest that the perception of threat in the human brain is associated with neural structures that underlie perception and cognition of social actions and intentions, suggesting a broader role for these regions than has been thought previously, one that includes the perception of potential threat from agents independent of their biological class. SIGNIFICANCE STATEMENT For centuries, philosophers have wondered how the human mind organizes the world into meaningful categories and concepts. Today this question is at the core of cognitive science, but our focus has shifted to understanding how knowledge manifests in dynamic activity of neural systems in the human brain. This study advances the young field of empirical neuroepistemology by characterizing the neural systems engaged by an important dimension in our cognitive representation of the animal kingdom ontological subdomain: how the brain represents the perceived threat, dangerousness, or “predacity” of animals. Our findings reveal how activity for domain-specific knowledge of animals overlaps the social perception networks of the brain, suggesting domain-general mechanisms underlying the representation of conspecifics and other animals. PMID:27170133

Enhancing Young Infants' Representations of Physical Events through Improved Retrieval (Not Encoding) of Information

ERIC Educational Resources Information Center

Wang, Su-hua; Onishi, Kristine H.

2017-01-01

Infants' representations of physical events are surprisingly flexible. Brief exposure to one event can immediately enhance infants' representations of another event. The present experiments tested two potential mechanisms underlying this priming: enhanced encoding or improved retrieval. Five-month-olds saw a target block become hidden inside a…

Improving Foundational Number Representations through Simple Arithmetical Training

ERIC Educational Resources Information Center

Kallai, Arava Y.; Schunn, Christian D.; Ponting, Andrea L.; Fiez, Julie A.

2011-01-01

The aim of this study was to test a training program intended to fine-tune the mental representations of double-digit numbers, thus increasing the discriminability of such numbers. The authors' assumption was that increased fluency in math could be achieved by improving the analogic representations of numbers. The study was completed in the…

Auto-Associative Recurrent Neural Networks and Long Term Dependencies in Novelty Detection for Audio Surveillance Applications

NASA Astrophysics Data System (ADS)

Rossi, A.; Montefoschi, F.; Rizzo, A.; Diligenti, M.; Festucci, C.

2017-10-01

Machine Learning applied to Automatic Audio Surveillance has been attracting increasing attention in recent years. In spite of several investigations based on a large number of different approaches, little attention had been paid to the environmental temporal evolution of the input signal. In this work, we propose an exploration in this direction comparing the temporal correlations extracted at the feature level with the one learned by a representational structure. To this aim we analysed the prediction performances of a Recurrent Neural Network architecture varying the length of the processed input sequence and the size of the time window used in the feature extraction. Results corroborated the hypothesis that sequential models work better when dealing with data characterized by temporal order. However, so far the optimization of the temporal dimension remains an open issue.

Numerical Hindcast Experiments for Study Tropical Convections and MJO Events during Year of Tropical Convection

NASA Astrophysics Data System (ADS)

Chern, J.; Tao, W.; Shen, B.

2011-12-01

The Madden-Julian oscillation (MJO) is the dominant component of intraseasonal variability in the tropic. It interacts and influences a wide range of weather and climate phenomena across different temporal and spatial scales. Despite the important role the MJO plays in the weather and climate system, past multi-model MJO intercomparison studies have shown that current global general circulation models (GCMs) still have considerable shortcomings in representing and forecasting this phenomenon. To improve representation of MJO and tropical convective cloud systems in global model, an Multiscale Modeling Framework (MMF) in which a cloud-resolving model takes the place of the sing-column cumulus parameterization used in convectional GCMs has been successfully developed at NAAS Goddard (Tao et al. 2009). To evaluate and improve the ability of this modeling system in representation and prediction of the MJO, several numerical hindcast experiments of a few selected MJO events during YOTC have been carried out. The ability of the model to simulate the MJO events is examined using diagnostic and skill metrics developed by the CLIVAR MJO Working Group Project as well as comparisons with a high-resolution global mesoscale model simulations, satellite observations, and analysis dataset. Several key variables associated with the MJO are investigated, including precipitation, outgoing longwave radiation, large-scale circulation, surface latent heat flux, low-level moisture convergence, vertical structure of moisture and hydrometers, and vertical diabatic heating profiles to gain insight of cloud processes associated with the MJO events.

The Differential Role of Verbal and Spatial Working Memory in the Neural Basis of Arithmetic

PubMed Central

Demir, Özlem Ece; Prado, Jérôme; Booth, James R.

2014-01-01

We examine the relations of verbal and spatial WM ability to the neural bases of arithmetic in school-age children. We independently localize brain regions subserving verbal versus spatial representations. For multiplication, higher verbal WM ability is associated with greater recruitment of the left temporal cortex, identified by the verbal localizer. For multiplication and subtraction, higher spatial WM ability is associated with greater recruitment of right parietal cortex, identified by the spatial localizer. Depending on their WM ability, children engage different neural systems that manipulate different representations to solve arithmetic problems. PMID:25144257

Spatio-Temporal Gap Analysis of OBIS-SEAMAP Project Data: Assessment and Way Forward

PubMed Central

Kot, Connie Y.; Fujioka, Ei; Hazen, Lucie J.; Best, Benjamin D.; Read, Andrew J.; Halpin, Patrick N.

2010-01-01

The OBIS-SEAMAP project has acquired and served high-quality marine mammal, seabird, and sea turtle data to the public since its inception in 2002. As data accumulated, spatial and temporal biases resulted and a comprehensive gap analysis was needed in order to assess coverage to direct data acquisition for the OBIS-SEAMAP project and for taxa researchers should true gaps in knowledge exist. All datasets published on OBIS-SEAMAP up to February 2009 were summarized spatially and temporally. Seabirds comprised the greatest number of records, compared to the other two taxa, and most records were from shipboard surveys, compared to the other three platforms. Many of the point observations and polyline tracklines were located in northern and central Atlantic and the northeastern and central-eastern Pacific. The Southern Hemisphere generally had the lowest representation of data, with the least number of records in the southern Atlantic and western Pacific regions. Temporally, records of observations for all taxa were the lowest in fall although the number of animals sighted was lowest in the winter. Oceanographic coverage of observations varied by platform for each taxa, which showed that using two or more platforms represented habitat ranges better than using only one alone. Accessible and published datasets not already incorporated do exist within spatial and temporal gaps identified. Other related open-source data portals also contain data that fill gaps, emphasizing the importance of dedicated data exchange. Temporal and spatial gaps were mostly a result of data acquisition effort, development of regional partnerships and collaborations, and ease of field data collection. Future directions should include fostering partnerships with researchers in the Southern Hemisphere while targeting datasets containing species with limited representation. These results can facilitate prioritizing datasets needed to be represented and for planning research for true gaps in space and time. PMID:20886047

Cognitive and Anatomical Underpinnings of the Conceptual Knowledge for Common Objects and Familiar People: A Repetitive Transcranial Magnetic Stimulation Study

PubMed Central

Campanella, Fabio; Fabbro, Franco; Urgesi, Cosimo

2013-01-01

Several studies have addressed the issue of how knowledge of common objects is organized in the brain, whereas the cognitive and anatomical underpinnings of familiar people knowledge have been less explored. Here we applied repetitive transcranial magnetic stimulation (rTMS) over the left and right temporal poles before asking healthy individuals to perform a speeded word-to-picture matching task using familiar people and common objects as stimuli. We manipulated two widely used semantic variables, namely the semantic distance and the familiarity of stimuli, to assess whether the semantic organization of familiar people knowledge is similar to that of common objects. For both objects and faces we reliably found semantic distance and familiarity effects, with less accurate and slower responses for stimulus pairs that were more closely related and less familiar. However, the effects of semantic variables differed across categories, with semantic distance effects larger for objects and familiarity effects larger for faces, suggesting that objects and faces might share a partially comparable organization of their semantic representations. The application of rTMS to the left temporal pole modulated, for both categories, semantic distance, but not familiarity effects, revealing that accessing object and face concepts might rely on overlapping processes within left anterior temporal regions. Crucially, rTMS of the left temporal pole affected only the recognition of pairs of stimuli that could be discriminated at specific levels of categorization (e.g., two kitchen tools or two famous persons), with no effect for discriminations at either superordinate or individual levels. Conversely, rTMS of the right temporal pole induced an overall slowing of reaction times that positively correlated with the visual similarity of the stimuli, suggesting a more perceptual rather than semantic role of the right anterior temporal regions. Results are discussed in the light of current models of face and object semantic representations in the brain. PMID:23704999

Spatio-temporal gap analysis of OBIS-SEAMAP project data: assessment and way forward.

PubMed

Kot, Connie Y; Fujioka, Ei; Hazen, Lucie J; Best, Benjamin D; Read, Andrew J; Halpin, Patrick N

2010-09-24

The OBIS-SEAMAP project has acquired and served high-quality marine mammal, seabird, and sea turtle data to the public since its inception in 2002. As data accumulated, spatial and temporal biases resulted and a comprehensive gap analysis was needed in order to assess coverage to direct data acquisition for the OBIS-SEAMAP project and for taxa researchers should true gaps in knowledge exist. All datasets published on OBIS-SEAMAP up to February 2009 were summarized spatially and temporally. Seabirds comprised the greatest number of records, compared to the other two taxa, and most records were from shipboard surveys, compared to the other three platforms. Many of the point observations and polyline tracklines were located in northern and central Atlantic and the northeastern and central-eastern Pacific. The Southern Hemisphere generally had the lowest representation of data, with the least number of records in the southern Atlantic and western Pacific regions. Temporally, records of observations for all taxa were the lowest in fall although the number of animals sighted was lowest in the winter. Oceanographic coverage of observations varied by platform for each taxa, which showed that using two or more platforms represented habitat ranges better than using only one alone. Accessible and published datasets not already incorporated do exist within spatial and temporal gaps identified. Other related open-source data portals also contain data that fill gaps, emphasizing the importance of dedicated data exchange. Temporal and spatial gaps were mostly a result of data acquisition effort, development of regional partnerships and collaborations, and ease of field data collection. Future directions should include fostering partnerships with researchers in the Southern Hemisphere while targeting datasets containing species with limited representation. These results can facilitate prioritizing datasets needed to be represented and for planning research for true gaps in space and time.

Steps toward “useful” hydroclimatic scenarios for water resource management in the Murray-Darling Basin

NASA Astrophysics Data System (ADS)

Kiem, Anthony S.; Verdon-Kidd, Danielle C.

2011-12-01

There is currently a distinct gap between what climate science can provide and information that is practically useful for (and needed by) natural resource managers. Improved understanding, and model representations, of interactions between the various climate drivers (both regional and global scale), combined with increased knowledge about the interactions between climate processes and hydrological processes at the regional scale, is necessary for improved attribution of climate change impacts, forecasting at a range of temporal scales and extreme event risk profiling (e.g., flood, drought, and bushfire). It is clear that the science has a long way to go in closing these research gaps; however, in the meantime water resource managers in the Murray-Darling Basin, and elsewhere, require hydroclimatic projections (i.e., seasonal to multidecadal future scenarios) that are regionally specific and, importantly, take into account the impacts, and associated uncertainties, of both natural climate variability and anthropogenic change. The strengths and weaknesses of various approaches for supplying this information are discussed in this paper.

Schematic memory components converge within angular gyrus during retrieval

PubMed Central

Wagner, Isabella C; van Buuren, Mariët; Kroes, Marijn CW; Gutteling, Tjerk P; van der Linden, Marieke; Morris, Richard G; Fernández, Guillén

2015-01-01

Mental schemas form associative knowledge structures that can promote the encoding and consolidation of new and related information. Schemas are facilitated by a distributed system that stores components separately, presumably in the form of inter-connected neocortical representations. During retrieval, these components need to be recombined into one representation, but where exactly such recombination takes place is unclear. Thus, we asked where different schema components are neuronally represented and converge during retrieval. Subjects acquired and retrieved two well-controlled, rule-based schema structures during fMRI on consecutive days. Schema retrieval was associated with midline, medial-temporal, and parietal processing. We identified the multi-voxel representations of different schema components, which converged within the angular gyrus during retrieval. Critically, convergence only happened after 24-hour-consolidation and during a transfer test where schema material was applied to novel but related trials. Therefore, the angular gyrus appears to recombine consolidated schema components into one memory representation. DOI: http://dx.doi.org/10.7554/eLife.09668.001 PMID:26575291

Neural coding strategies in auditory cortex.

PubMed

Wang, Xiaoqin

2007-07-01

In contrast to the visual system, the auditory system has longer subcortical pathways and more spiking synapses between the peripheral receptors and the cortex. This unique organization reflects the needs of the auditory system to extract behaviorally relevant information from a complex acoustic environment using strategies different from those used by other sensory systems. The neural representations of acoustic information in auditory cortex can be characterized by three types: (1) isomorphic (faithful) representations of acoustic structures; (2) non-isomorphic transformations of acoustic features and (3) transformations from acoustical to perceptual dimensions. The challenge facing auditory neurophysiologists is to understand the nature of the latter two transformations. In this article, I will review recent studies from our laboratory regarding temporal discharge patterns in auditory cortex of awake marmosets and cortical representations of time-varying signals. Findings from these studies show that (1) firing patterns of neurons in auditory cortex are dependent on stimulus optimality and context and (2) the auditory cortex forms internal representations of sounds that are no longer faithful replicas of their acoustic structures.

Phonological processing of ignored distractor pictures, an fMRI investigation.

PubMed

Bles, Mart; Jansma, Bernadette M

2008-02-11

Neuroimaging studies of attention often focus on interactions between stimulus representations and top-down selection mechanisms in visual cortex. Less is known about the neural representation of distractor stimuli beyond visual areas, and the interactions between stimuli in linguistic processing areas. In the present study, participants viewed simultaneously presented line drawings at peripheral locations, while in the MRI scanner. The names of the objects depicted in these pictures were either phonologically related (i.e. shared the same consonant-vowel onset construction), or unrelated. Attention was directed either at the linguistic properties of one of these pictures, or at the fixation point (i.e. away from the pictures). Phonological representations of unattended pictures could be detected in the posterior superior temporal gyrus, the inferior frontal gyrus, and the insula. Under some circumstances, the name of ignored distractor pictures is retrieved by linguistic areas. This implies that selective attention to a specific location does not completely filter out the representations of distractor stimuli at early perceptual stages.

An infinite branching hierarchy of time-periodic solutions of the Benjamin-Ono equation

DOE Office of Scientific and Technical Information (OSTI.GOV)

Wilkening, Jon

2008-07-01

We present a new representation of solutions of the Benjamin-Ono equation that are periodic in space and time. Up to an additive constant and a Galilean transformation, each of these solutions is a previously known, multi-periodic solution; however, the new representation unifies the subset of such solutions with a fixed spatial period and a continuously varying temporal period into a single network of smooth manifolds connected together by an infinite hierarchy of bifurcations. Our representation explicitly describes the evolution of the Fourier modes of the solution as well as the particle trajectories in a meromorphic representation of these solutions; therefore,more » we have also solved the problem of finding periodic solutions of the ordinary differential equation governing these particles, including a description of a bifurcation mechanism for adding or removing particles without destroying periodicity. We illustrate the types of bifurcation that occur with several examples, including degenerate bifurcations not predicted by linearization about traveling waves.« less

Possible future changes in South East Australian frost frequency: an inter-comparison of statistical downscaling approaches

NASA Astrophysics Data System (ADS)

Crimp, Steven; Jin, Huidong; Kokic, Philip; Bakar, Shuvo; Nicholls, Neville

2018-04-01

Anthropogenic climate change has already been shown to effect the frequency, intensity, spatial extent, duration and seasonality of extreme climate events. Understanding these changes is an important step in determining exposure, vulnerability and focus for adaptation. In an attempt to support adaptation decision-making we have examined statistical modelling techniques to improve the representation of global climate model (GCM) derived projections of minimum temperature extremes (frosts) in Australia. We examine the spatial changes in minimum temperature extreme metrics (e.g. monthly and seasonal frost frequency etc.), for a region exhibiting the strongest station trends in Australia, and compare these changes with minimum temperature extreme metrics derived from 10 GCMs, from the Coupled Model Inter-comparison Project Phase 5 (CMIP 5) datasets, and via statistical downscaling. We compare the observed trends with those derived from the "raw" GCM minimum temperature data as well as examine whether quantile matching (QM) or spatio-temporal (spTimerQM) modelling with Quantile Matching can be used to improve the correlation between observed and simulated extreme minimum temperatures. We demonstrate, that the spTimerQM modelling approach provides correlations with observed daily minimum temperatures for the period August to November of 0.22. This represents an almost fourfold improvement over either the "raw" GCM or QM results. The spTimerQM modelling approach also improves correlations with observed monthly frost frequency statistics to 0.84 as opposed to 0.37 and 0.81 for the "raw" GCM and QM results respectively. We apply the spatio-temporal model to examine future extreme minimum temperature projections for the period 2016 to 2048. The spTimerQM modelling results suggest the persistence of current levels of frost risk out to 2030, with the evidence of continuing decadal variation.

Doctor, Teacher, and Stethoscope: Neural Representation of Different Types of Semantic Relations.

PubMed

Xu, Yangwen; Wang, Xiaosha; Wang, Xiaoying; Men, Weiwei; Gao, Jia-Hong; Bi, Yanchao

2018-03-28

Concepts can be related in many ways. They can belong to the same taxonomic category (e.g., "doctor" and "teacher," both in the category of people) or be associated with the same event context (e.g., "doctor" and "stethoscope," both associated with medical scenarios). How are these two major types of semantic relations coded in the brain? We constructed stimuli from three taxonomic categories (people, manmade objects, and locations) and three thematic categories (school, medicine, and sports) and investigated the neural representations of these two dimensions using representational similarity analyses in human participants (10 men and nine women). In specific regions of interest, the left anterior temporal lobe (ATL) and the left temporoparietal junction (TPJ), we found that, whereas both areas had significant effects of taxonomic information, the taxonomic relations had stronger effects in the ATL than in the TPJ ("doctor" and "teacher" closer in ATL neural activity), with the reverse being true for thematic relations ("doctor" and "stethoscope" closer in TPJ neural activity). A whole-brain searchlight analysis revealed that widely distributed regions, mainly in the left hemisphere, represented the taxonomic dimension. Interestingly, the significant effects of the thematic relations were only observed after the taxonomic differences were controlled for in the left TPJ, the right superior lateral occipital cortex, and other frontal, temporal, and parietal regions. In summary, taxonomic grouping is a primary organizational dimension across distributed brain regions, with thematic grouping further embedded within such taxonomic structures. SIGNIFICANCE STATEMENT How are concepts organized in the brain? It is well established that concepts belonging to the same taxonomic categories (e.g., "doctor" and "teacher") share neural representations in specific brain regions. How concepts are associated in other manners (e.g., "doctor" and "stethoscope," which are thematically related) remains poorly understood. We used representational similarity analyses to unravel the neural representations of these different types of semantic relations by testing the same set of words that could be differently grouped by taxonomic categories or by thematic categories. We found that widely distributed brain areas primarily represented taxonomic categories, with the thematic categories further embedded within the taxonomic structure. Copyright © 2018 the authors 0270-6474/18/383303-15$15.00/0.

Does improvement in maternal attachment representations predict greater maternal sensitivity, child attachment security and lower rates of relapse to substance use? A second test of Mothering from the Inside Out treatment mechanisms.

PubMed

Suchman, Nancy E; DeCoste, Cindy; Borelli, Jessica L; McMahon, Thomas J

2018-02-01

In this study, we replicated a rigorous test of the proposed mechanisms of change associated with Mothering from the Inside out (MIO), an evidence-based parenting therapy that aims to enhance maternal reflective functioning and mental representations of caregiving in mothers enrolled in addiction treatment and caring for young children. First, using data from 84 mothers who enrolled in our second randomized controlled trial, we examined whether therapist fidelity to core MIO treatment components predicted improvement in maternal reflective functioning and mental representations of caregiving, even after taking fidelity to non-MIO components into account. Next, we examined whether improvement in directly targeted outcomes (e.g., maternal mentalizing and mental representations of caregiving) led to improvements in the indirectly targeted outcome of maternal caregiving sensitivity, even after controlling for other plausible competing mechanisms (e.g., improvement in maternal psychiatric distress and substance use). Third, we examined whether improvement in targeted parenting outcomes (e.g., maternal mentalizing, mental representations of caregiving and caregiving sensitivity) was associated in improvement in child attachment status, even after controlling for competing mechanisms (e.g., improvement in maternal psychiatric distress and substance use). Finally, we examined whether improvement in maternal mentalizing and caregiving representations was associated with a reduction in relapse to substance use. Support was found for the first three tests of mechanisms but not the fourth. Implications for future research and intervention development are discussed. Copyright © 2017 Elsevier Inc. All rights reserved.

Visualizing uncertainties with the North Wyke Farm Platform Data Sets

NASA Astrophysics Data System (ADS)

Harris, Paul; Brunsdon, Chris; Lee, Michael

2016-04-01

The North Wyke Farm Platform (NWFP) is a systems-based, farm-scale experiment with the aim of addressing agricultural productivity and ecosystem responses to different management practices. The 63 ha site captures the spatial and/or temporal data necessary to develop a better understanding of the dynamic processes and underlying mechanisms that can be used to model how agricultural grassland systems respond to different management inputs. Via cattle beef and sheep production, the underlying principle is to manage each of three farmlets (each consisting of five hydrologically-isolated sub-catchments) in three contrasting ways: (i) improvement of permanent pasture through use of mineral fertilizers; (ii) improvement through use of legumes; and (iii) improvement through innovation. The connectivity between the timing and intensity of the different management operations, together with the transport of nutrients and potential pollutants from the NWFP is evaluated using numerous inter-linked data collection exercises. In this paper, we introduce some of the visualization opportunities that are possible with this rich data resource, and methods of analysis that might be applied to it, in particular with respect to data and model uncertainty operating across both temporal and spatial dimensions. An important component of the NWFP experiment is the representation of trade-offs with respect to: (a) economic profits, (b) environmental concerns, and (c) societal benefits, under the umbrella of sustainable intensification. Various visualizations exist to display such trade-offs and here we demonstrate ways to tailor them to relay key uncertainties and assessments of risk; and also consider how these visualizations can be honed to suit different audiences.

Multi-sensor Oceanographic Correlations for Pacific Hake Acoustic Survey Improvement

NASA Astrophysics Data System (ADS)

Brozen, M.; Hillyer, N.; Holt, B.; Armstrong, E. M.

2010-12-01

North Pacific hake (Merluccius productus), the most abundant groundfish along the Pacific coast of northwestern America, are an essential source of income for the coastal region from southern California to British Columbia, Canada. However, hake abundance and distribution are highly variable among years, exhibiting variance in both the north-south and east-west distribution as seen in the results from biannual acoustic surveys. This project is part of a larger undertaking, ultimately focused on the prediction of hake distribution to improve the distribution of survey effort and precision of stock assessments in the future. Four remotely sensed oceanographic variables are examined as a first step in improving our understanding the relationship between the intensity of coastal upwelling and other ocean dynamics, and the north-south summer hake distribution. Sea surface height, wind vectors, chlorophyll - a concentrations, and sea surface temperature were acquired from several satellites, including AVHRR, SeaWifs, TOPEX/Poseidon, Jason-1, Jason-2, SSM/I, ASMR-E, and QuikScat. Data were aligned to the same spatial and temporal resolution, and these re-gridded data were then analyzed using empirical orthogonal functions (EOFs). EOFs were used as a spatio-temporally compact representation of the data and to reduce the co-variability of the multiple time series in the dataset. The EOF results were plotted and acoustic survey results were overlaid to understand differences between regions. Although this pilot project used data from only a single year (2007), it demonstrated a methodology for reducing dimensionality of linearly related satellite variables that can used in future applications, and provided insight into multi-dimensional ocean characteristics important for hake distribution.

Audio Motor Training at the Foot Level Improves Space Representation.

PubMed

Aggius-Vella, Elena; Campus, Claudio; Finocchietti, Sara; Gori, Monica

2017-01-01

Spatial representation is developed thanks to the integration of visual signals with the other senses. It has been shown that the lack of vision compromises the development of some spatial representations. In this study we tested the effect of a new rehabilitation device called ABBI (Audio Bracelet for Blind Interaction) to improve space representation. ABBI produces an audio feedback linked to body movement. Previous studies from our group showed that this device improves the spatial representation of space in early blind adults around the upper part of the body. Here we evaluate whether the audio motor feedback produced by ABBI can also improve audio spatial representation of sighted individuals in the space around the legs. Forty five blindfolded sighted subjects participated in the study, subdivided into three experimental groups. An audio space localization (front-back discrimination) task was performed twice by all groups of subjects before and after different kind of training conditions. A group (experimental) performed an audio-motor training with the ABBI device placed on their foot. Another group (control) performed a free motor activity without audio feedback associated with body movement. The other group (control) passively listened to the ABBI sound moved at foot level by the experimenter without producing any body movement. Results showed that only the experimental group, which performed the training with the audio-motor feedback, showed an improvement in accuracy for sound discrimination. No improvement was observed for the two control groups. These findings suggest that the audio-motor training with ABBI improves audio space perception also in the space around the legs in sighted individuals. This result provides important inputs for the rehabilitation of the space representations in the lower part of the body.

Audio Motor Training at the Foot Level Improves Space Representation

PubMed Central

Aggius-Vella, Elena; Campus, Claudio; Finocchietti, Sara; Gori, Monica

2017-01-01

Spatial representation is developed thanks to the integration of visual signals with the other senses. It has been shown that the lack of vision compromises the development of some spatial representations. In this study we tested the effect of a new rehabilitation device called ABBI (Audio Bracelet for Blind Interaction) to improve space representation. ABBI produces an audio feedback linked to body movement. Previous studies from our group showed that this device improves the spatial representation of space in early blind adults around the upper part of the body. Here we evaluate whether the audio motor feedback produced by ABBI can also improve audio spatial representation of sighted individuals in the space around the legs. Forty five blindfolded sighted subjects participated in the study, subdivided into three experimental groups. An audio space localization (front-back discrimination) task was performed twice by all groups of subjects before and after different kind of training conditions. A group (experimental) performed an audio-motor training with the ABBI device placed on their foot. Another group (control) performed a free motor activity without audio feedback associated with body movement. The other group (control) passively listened to the ABBI sound moved at foot level by the experimenter without producing any body movement. Results showed that only the experimental group, which performed the training with the audio-motor feedback, showed an improvement in accuracy for sound discrimination. No improvement was observed for the two control groups. These findings suggest that the audio-motor training with ABBI improves audio space perception also in the space around the legs in sighted individuals. This result provides important inputs for the rehabilitation of the space representations in the lower part of the body. PMID:29326564

Human Object-Similarity Judgments Reflect and Transcend the Primate-IT Object Representation

PubMed Central

Mur, Marieke; Meys, Mirjam; Bodurka, Jerzy; Goebel, Rainer; Bandettini, Peter A.; Kriegeskorte, Nikolaus

2013-01-01

Primate inferior temporal (IT) cortex is thought to contain a high-level representation of objects at the interface between vision and semantics. This suggests that the perceived similarity of real-world objects might be predicted from the IT representation. Here we show that objects that elicit similar activity patterns in human IT (hIT) tend to be judged as similar by humans. The IT representation explained the human judgments better than early visual cortex, other ventral-stream regions, and a range of computational models. Human similarity judgments exhibited category clusters that reflected several categorical divisions that are prevalent in the IT representation of both human and monkey, including the animate/inanimate and the face/body division. Human judgments also reflected the within-category representation of IT. However, the judgments transcended the IT representation in that they introduced additional categorical divisions. In particular, human judgments emphasized human-related additional divisions between human and non-human animals and between man-made and natural objects. hIT was more similar to monkey IT than to human judgments. One interpretation is that IT has evolved visual-feature detectors that distinguish between animates and inanimates and between faces and bodies because these divisions are fundamental to survival and reproduction for all primate species, and that other brain systems serve to more flexibly introduce species-dependent and evolutionarily more recent divisions. PMID:23525516

Collaborative Project: Improving the Representation of Coastal and Estuarine Processes in Earth System Models

DOE Office of Scientific and Technical Information (OSTI.GOV)

Bryan, Frank; Dennis, John; MacCready, Parker

This project aimed to improve long term global climate simulations by resolving and enhancing the representation of the processes involved in the cycling of freshwater through estuaries and coastal regions. This was a collaborative multi-institution project consisting of physical oceanographers, climate model developers, and computational scientists. It specifically targeted the DOE objectives of advancing simulation and predictive capability of climate models through improvements in resolution and physical process representation.

Final Report Collaborative Project: Improving the Representation of Coastal and Estuarine Processes in Earth System Models

DOE Office of Scientific and Technical Information (OSTI.GOV)

Bryan, Frank; Dennis, John; MacCready, Parker

This project aimed to improve long term global climate simulations by resolving and enhancing the representation of the processes involved in the cycling of freshwater through estuaries and coastal regions. This was a collaborative multi-institution project consisting of physical oceanographers, climate model developers, and computational scientists. It specifically targeted the DOE objectives of advancing simulation and predictive capability of climate models through improvements in resolution and physical process representation.

Left insular cortex and left SFG underlie prismatic adaptation effects on time perception: evidence from fMRI.

PubMed

Magnani, Barbara; Frassinetti, Francesca; Ditye, Thomas; Oliveri, Massimiliano; Costantini, Marcello; Walsh, Vincent

2014-05-15

Prismatic adaptation (PA) has been shown to affect left-to-right spatial representations of temporal durations. A leftward aftereffect usually distorts time representation toward an underestimation, while rightward aftereffect usually results in an overestimation of temporal durations. Here, we used functional magnetic resonance imaging (fMRI) to study the neural mechanisms that underlie PA effects on time perception. Additionally, we investigated whether the effect of PA on time is transient or stable and, in the case of stability, which cortical areas are responsible of its maintenance. Functional brain images were acquired while participants (n=17) performed a time reproduction task and a control-task before, immediately after and 30 min after PA inducing a leftward aftereffect, administered outside the scanner. The leftward aftereffect induced an underestimation of time intervals that lasted for at least 30 min. The left anterior insula and the left superior frontal gyrus showed increased functional activation immediately after versus before PA in the time versus the control-task, suggesting these brain areas to be involved in the executive spatial manipulation of the representation of time. The left middle frontal gyrus showed an increase of activation after 30 min with respect to before PA. This suggests that this brain region may play a key role in the maintenance of the PA effect over time. Copyright © 2014. Published by Elsevier Inc.

Neural Representations of Personally Familiar and Unfamiliar Faces in the Anterior Inferior Temporal Cortex of Monkeys

PubMed Central

Eifuku, Satoshi; De Souza, Wania C.; Nakata, Ryuzaburo; Ono, Taketoshi; Tamura, Ryoi

2011-01-01

To investigate the neural representations of faces in primates, particularly in relation to their personal familiarity or unfamiliarity, neuronal activities were chronically recorded from the ventral portion of the anterior inferior temporal cortex (AITv) of macaque monkeys during the performance of a facial identification task using either personally familiar or unfamiliar faces as stimuli. By calculating the correlation coefficients between neuronal responses to the faces for all possible pairs of faces given in the task and then using the coefficients as neuronal population-based similarity measures between the faces in pairs, we analyzed the similarity/dissimilarity relationship between the faces, which were potentially represented by the activities of a population of the face-responsive neurons recorded in the area AITv. The results showed that, for personally familiar faces, different identities were represented by different patterns of activities of the population of AITv neurons irrespective of the view (e.g., front, 90° left, etc.), while different views were not represented independently of their facial identities, which was consistent with our previous report. In the case of personally unfamiliar faces, the faces possessing different identities but presented in the same frontal view were represented as similar, which contrasts with the results for personally familiar faces. These results, taken together, outline the neuronal representations of personally familiar and unfamiliar faces in the AITv neuronal population. PMID:21526206

Semantic domain-specific functional integration for action-related vs. abstract concepts.

PubMed

Ghio, Marta; Tettamanti, Marco

2010-03-01

A central topic in cognitive neuroscience concerns the representation of concepts and the specific neural mechanisms that mediate conceptual knowledge. Recently proposed modal theories assert that concepts are grounded on the integration of multimodal, distributed representations. The aim of the present work is to complement the available neuropsychological and neuroimaging evidence suggesting partially segregated anatomo-functional correlates for concrete vs. abstract concepts, by directly testing the semantic domain-specific patterns of functional integration between language and modal semantic brain regions. We report evidence from a functional magnetic resonance imaging study, in which healthy participants listened to sentences with either an action-related (actions involving physical entities) or an abstract (no physical entities involved) content. We measured functional integration using dynamic causal modeling, and found that the left superior temporal gyrus was more strongly connected: (1) for action-related vs. abstract sentences, with the left-hemispheric action representation system, including sensorimotor areas; (2) for abstract vs. action-related sentences, with left infero-ventral frontal, temporal, and retrosplenial cingulate areas. A selective directionality effect was observed, with causal modulatory effects exerted by perisylvian language regions on peripheral modal areas, and not vice versa. The observed condition-specific modulatory effects are consistent with embodied and situated language processing theories, and indicate that linguistic areas promote a semantic content-specific reactivation of modal simulations by top-down mechanisms. Copyright 2008 Elsevier Inc. All rights reserved.

Motor and linguistic linking of space and time in the cerebellum.

PubMed

Oliveri, Massimiliano; Bonnì, Sonia; Turriziani, Patrizia; Koch, Giacomo; Lo Gerfo, Emanuele; Torriero, Sara; Vicario, Carmelo Mario; Petrosini, Laura; Caltagirone, Carlo

2009-11-20

Recent literature documented the presence of spatial-temporal interactions in the human brain. The aim of the present study was to verify whether representation of past and future is also mapped onto spatial representations and whether the cerebellum may be a neural substrate for linking space and time in the linguistic domain. We asked whether processing of the tense of a verb is influenced by the space where response takes place and by the semantics of the verb. Responses to past tense were facilitated in the left space while responses to future tense were facilitated in the right space. Repetitive transcranial magnetic stimulation (rTMS) of the right cerebellum selectively slowed down responses to future tense of action verbs; rTMS of both cerebellar hemispheres decreased accuracy of responses to past tense in the left space and to future tense in the right space for non-verbs, and to future tense in the right space for state verbs. The results suggest that representation of past and future is mapped onto spatial formats and that motor action could represent the link between spatial and temporal dimensions. Right cerebellar, left motor brain networks could be part of the prospective brain, whose primary function is to use past experiences to anticipate future events. Both cerebellar hemispheres could play a role in establishing the grammatical rules for verb conjugation.

Neural and cognitive face-selective markers: An integrative review.

PubMed

Yovel, Galit

2016-03-01

Faces elicit robust and selective neural responses in the primate brain. These neural responses have been investigated with functional MRI and EEG in numerous studies, which have reported face-selective activations in the occipital-temporal cortex and an electrophysiological face-selective response that peaks 170 ms after stimulus onset at occipital-temporal sites. Evidence for face-selective processes has also been consistently reported in cognitive studies, which investigated the face inversion effect, the composite face effect and the left visual field (LVF) superiority. These cognitive effects indicate that the perceptual representation that we generate for faces differs from the representation that is generated for inverted faces or non-face objects. In this review, I will show that the fMRI and ERP face-selective responses are strongly associated with these three well-established behavioral face-selective measures. I will further review studies that examined the relationship between fMRI and EEG face-selective measures suggesting that they are strongly linked. Taken together these studies imply that a holistic representation of a face is generated at 170 ms after stimulus onset over the right hemisphere. These findings, which reveal a strong link between the various and complementary cognitive and neural measures of face processing, allow to characterize where, when and how faces are represented during the first 200 ms of face processing. Copyright © 2015 Elsevier Ltd. All rights reserved.

Indexing and retrieval of MPEG compressed video

NASA Astrophysics Data System (ADS)

Kobla, Vikrant; Doermann, David S.

1998-04-01

To keep pace with the increased popularity of digital video as an archival medium, the development of techniques for fast and efficient analysis of ideo streams is essential. In particular, solutions to the problems of storing, indexing, browsing, and retrieving video data from large multimedia databases are necessary to a low access to these collections. Given that video is often stored efficiently in a compressed format, the costly overhead of decompression can be reduced by analyzing the compressed representation directly. In earlier work, we presented compressed domain parsing techniques which identified shots, subshots, and scenes. In this article, we present efficient key frame selection, feature extraction, indexing, and retrieval techniques that are directly applicable to MPEG compressed video. We develop a frame type independent representation which normalizes spatial and temporal features including frame type, frame size, macroblock encoding, and motion compensation vectors. Features for indexing are derived directly from this representation and mapped to a low- dimensional space where they can be accessed using standard database techniques. Spatial information is used as primary index into the database and temporal information is used to rank retrieved clips and enhance the robustness of the system. The techniques presented enable efficient indexing, querying, and retrieval of compressed video as demonstrated by our system which typically takes a fraction of a second to retrieve similar video scenes from a database, with over 95 percent recall.

One step forward, two steps back: worker representation and health and safety in the United Kingdom.

PubMed

Walters, David

2006-01-01

There is now quite strong evidence for a set of preconditions that help determine the effectiveness of worker representation and consultation in improving health and safety outcomes. One of these preconditions is a regulatory framework that defines workers' rights to representation and employers' obligations to respond. Using the United Kingdom as its focus, this article explores developments at the national policy level. It shows how long-awaited legislative reforms to improve provisions for worker representation in health and safety have so far failed to materialize and, instead, government strategy has concentrated on promoting voluntary approaches. The author reviews the evidence of what makes worker representation in health and safety effective and suggests that, far from abandoning approaches to legislative reform, the U.K. agencies should be seeking to make improvements to the British provisions if they are to provide the necessary stimulus and support for worker representation in health and safety at work. Such improvements need to address long-standing weaknesses in existing provisions and their relevance to the changing world of work. The arguments presented here apply to the essential role of regulatory support for worker participation in all advanced market economies if it is to improve health and safety outcomes.

Improving Model Representation of Reduced Nitrogen in the Greater Yellowstone Area

NASA Astrophysics Data System (ADS)

Thompson, T. M.

2015-12-01

Human activity, including fossil fuel combustion and agriculture has greatly increased the amount of reactive nitrogen (RN) in the atmosphere and its subsequent deposition to land. Increases in deposition of RN compounds can adversely affect sensitive ecosystems and is a growing problem in many natural areas. The National Park Service in conjunction with Colorado State University researchers and assistance from the Forest Service conducted the Grand Teton Reactive Nitrogen Deposition Study (GrandTReNDS) involving spatially and temporally detailed measurements of RN during spring/summer 2011. In this work it was found that during summer months at the high elevation site Grand Targhee, 62% of the nitrogen deposition was due to reduced nitrogen, about equally split between dry and wet deposition, oxidized nitrogen accounted for 27% of the total, and the remaining was wet deposited organic nitrogen. An important next step to GrandTReNDS is the use of chemical transport models (CTMs) to estimate source contributions to RN in the park. Given the large contribution of reduced nitrogen species to total nitrogen deposition in the park, understanding and properly characterizing ammonia in CTMs is critical to estimating the total nitrogen deposition. A model performance evaluation of the CAMx uni-directional model and CMAQ bi-direction and uni-directional 2011 model simulations versus GrandTReNDS and other datasets was conducted. Preliminary results suggest that, in some areas, model performance of ambient ammonia concentration is more sensitive to the spatial resolution of the model and the accuracy of the spatial representation of emissions than to the incorporation of bi-directional flux. Additional model sensitivity runs, including sensitivity to resolution (with and without bi-directional flux capabilities), changes to model estimated ammonia dry deposition velocities, and improved representation of the spatial distribution of ammonia emissions, are used to identify the best set of options for GrandTReNDS modeling, and to provide a measure of uncertainties. This will help atmospheric scientists identify deficiencies in the models and inform future model development.

Magnetic Stimulation Studies of Foveal Representation

ERIC Educational Resources Information Center

Lavidor, Michal; Walsh, Vincent

2004-01-01

The right and left visual fields each project to the contralateral cerebral hemispheres, but the extent of the functional overlap of the two hemifields along the vertical meridian is still under debate. After presenting the spatial, temporal, and functional specifications of Transcranial Magnetic Stimulation (TMS), we show that TMS is particularly…

Innovative Uses of Video Analysis

ERIC Educational Resources Information Center

Brown, Douglas; Cox, Anne J.

2009-01-01

The value of video analysis in physics education is well established, and both commercial and free educational video analysis programs are readily available. The video format is familiar to students, contains a wealth of spatial and temporal data, and provides a bridge between direct observations and abstract representations of physical phenomena.…

Arabic Morphology in the Neural Language System

ERIC Educational Resources Information Center

Boudelaa, Sami; Pulvermuller, Friedemann; Hauk, Olaf; Shtyrov, Yury; Marslen-Wilson, William

2010-01-01

There are two views about morphology, the aspect of language concerned with the internal structure of words. One view holds that morphology is a domain of knowledge with a specific type of neurocognitive representation supported by specific brain mechanisms lateralized to left fronto-temporal cortex. The alternate view characterizes morphological…

Shared Semantic Representations for Coordinating Distributed Robot Teams

DTIC Science & Technology

2003-12-01

Encoding of Rules, Variables, and Dynamic Bindings Using Temporal Synchrony." Behavioral and Brain Sciences, 16:3 p. 417-494. 29 16. Marvin Minsky . "Plain...is limited. Minsky [16] also describes a proposal for c-lines, a frame implementation mechanism similar in spirit to role passing, although the details

Neural Mechanisms of Conceptual Relations

ERIC Educational Resources Information Center

Lewis, Gwyneth A.

2017-01-01

An over-arching goal in neurolinguistic research is to characterize the neural bases of semantic representation. A particularly relevant goal concerns whether we represent features and events (a) together in a generalized semantic hub or (b) separately in distinct but complementary systems. While the left anterior temporal lobe (ATL) is strongly…

Planning in Young Children: A Review and Synthesis

ERIC Educational Resources Information Center

McCormack, Teresa; Atance, Cristina M.

2011-01-01

Research on the development of planning is reviewed in the context of a framework that considers the role of three types of cognitive flexibility in planning development: event-independent temporal representation, executive function, and self-projection. It is argued that the emergence of planning abilities in the preschool period is dependent…

Characterizing Reinforcement Learning Methods through Parameterized Learning Problems

DTIC Science & Technology

2011-06-03

extraneous. The agent could potentially adapt these representational aspects by applying methods from feature selection ( Kolter and Ng, 2009; Petrik et al...611–616. AAAI Press. Kolter , J. Z. and Ng, A. Y. (2009). Regularization and feature selection in least-squares temporal difference learning. In A. P

Influence of Aerosols And Surface Reflectance On NO2 Retrieval Over China From 2005 to 2015

NASA Astrophysics Data System (ADS)

Liu, M.; Lin, J.

2016-12-01

Satellite observation is a powerful way to analysis annual and seasonal variations of nitrogen dioxide (NO2). However, much retrieval of vertical column densities (VCDs) of normally do not explicitly account for aerosol optical effects and surface reflectance anisotropy that vary with space and time. In traditional retrieval, aerosols' effects are often considered as cloud. However, China has complicated aerosols type and aerosol loading. Their optical properties may be very different from the cloud. Furthermore, China has undergone big changes in land use type in recent 10 years. Traditional climatology surface reflectance data may not have representation. In order to study spatial-temporal variation of and influences of these two factors on variations and trends, we use an improved retrieval method of VCDs over China, called the POMINO, based on measurements from the Ozone Monitoring Instrument (OMI), and we compare the results of without aerosol, without surface reflectance treatments and without both to the original POMINO product from 2005 to 2015. Furthermore, we will study correspondent spatial-temporal variations of aerosols, represented by MODIS aerosol optical depth (AOD) data and CALIOP extinction data; surface reflectance, represented by MODIS bidirectional reflectance distribution function (BRDF) data.

When math operations have visuospatial meanings versus purely symbolic definitions: Which solving stages and brain regions are affected?

PubMed

Pyke, Aryn A; Fincham, Jon M; Anderson, John R

2017-06-01

How does processing differ during purely symbolic problem solving versus when mathematical operations can be mentally associated with meaningful (here, visuospatial) referents? Learners were trained on novel math operations (↓, ↑), that were defined strictly symbolically or in terms of a visuospatial interpretation (operands mapped to dimensions of shaded areas, answer = total area). During testing (scanner session), no visuospatial representations were displayed. However, we expected visuospatially-trained learners to form mental visuospatial representations for problems, and exhibit distinct activations. Since some solution intervals were long (~10s) and visuospatial representations might only be instantiated in some stages during solving, group differences were difficult to detect when treating the solving interval as a whole. However, an HSMM-MVPA process (Anderson and Fincham, 2014a) to parse fMRI data identified four distinct problem-solving stages in each group, dubbed: 1) encode; 2) plan; 3) compute; and 4) respond. We assessed stage-specific differences across groups. During encoding, several regions implicated in general semantic processing and/or mental imagery were more active in visuospatially-trained learners, including: bilateral supramarginal, precuneus, cuneus, parahippocampus, and left middle temporal regions. Four of these regions again emerged in the computation stage: precuneus, right supramarginal/angular, left supramarginal/inferior parietal, and left parahippocampal gyrus. Thus, mental visuospatial representations may not just inform initial problem interpretation (followed by symbolic computation), but may scaffold on-going computation. In the second stage, higher activations were found among symbolically-trained solvers in frontal regions (R. medial and inferior and L. superior) and the right angular and middle temporal gyrus. Activations in contrasting regions may shed light on solvers' degree of use of symbolic versus mental visuospatial strategies, even in absence of behavioral differences. Copyright © 2017 Elsevier Inc. All rights reserved.

Development of brain networks involved in spoken word processing of Mandarin Chinese.

PubMed

Cao, Fan; Khalid, Kainat; Lee, Rebecca; Brennan, Christine; Yang, Yanhui; Li, Kuncheng; Bolger, Donald J; Booth, James R

2011-08-01

Developmental differences in phonological and orthographic processing of Chinese spoken words were examined in 9-year-olds, 11-year-olds and adults using functional magnetic resonance imaging (fMRI). Rhyming and spelling judgments were made to two-character words presented sequentially in the auditory modality. Developmental comparisons between adults and both groups of children combined showed that age-related changes in activation in visuo-orthographic regions depended on a task. There were developmental increases in the left inferior temporal gyrus and the right inferior occipital gyrus in the spelling task, suggesting more extensive visuo-orthographic processing in a task that required access to these representations. Conversely, there were developmental decreases in activation in the left fusiform gyrus and left middle occipital gyrus in the rhyming task, suggesting that the development of reading is marked by reduced involvement of orthography in a spoken language task that does not require access to these orthographic representations. Developmental decreases may arise from the existence of extensive homophony (auditory words that have multiple spellings) in Chinese. In addition, we found that 11-year-olds and adults showed similar activation in the left superior temporal gyrus across tasks, with both groups showing greater activation than 9-year-olds. This pattern suggests early development of perceptual representations of phonology. In contrast, 11-year-olds and 9-year-olds showed similar activation in the left inferior frontal gyrus across tasks, with both groups showing weaker activation than adults. This pattern suggests late development of controlled retrieval and selection of lexical representations. Altogether, this study suggests differential effects of character acquisition on development of components of the language network in Chinese as compared to previous reports on alphabetic languages. Published by Elsevier Inc.

Modulation of the semantic system by word imageability.

PubMed

Sabsevitz, D S; Medler, D A; Seidenberg, M; Binder, J R

2005-08-01

A prevailing neurobiological theory of semantic memory proposes that part of our knowledge about concrete, highly imageable concepts is stored in the form of sensory-motor representations. While this theory predicts differential activation of the semantic system by concrete and abstract words, previous functional imaging studies employing this contrast have provided relatively little supporting evidence. We acquired event-related functional magnetic resonance imaging (fMRI) data while participants performed a semantic similarity judgment task on a large number of concrete and abstract noun triads. Task difficulty was manipulated by varying the degree to which the words in the triad were similar in meaning. Concrete nouns, relative to abstract nouns, produced greater activation in a bilateral network of multimodal and heteromodal association areas, including ventral and medial temporal, posterior-inferior parietal, dorsal prefrontal, and posterior cingulate cortex. In contrast, abstract nouns produced greater activation almost exclusively in the left hemisphere in superior temporal and inferior frontal cortex. Increasing task difficulty modulated activation mainly in attention, working memory, and response monitoring systems, with almost no effect on areas that were modulated by imageability. These data provide critical support for the hypothesis that concrete, imageable concepts activate perceptually based representations not available to abstract concepts. In contrast, processing abstract concepts makes greater demands on left perisylvian phonological and lexical retrieval systems. The findings are compatible with dual coding theory and less consistent with single-code models of conceptual representation. The lack of overlap between imageability and task difficulty effects suggests that once the neural representation of a concept is activated, further maintenance and manipulation of that information in working memory does not further increase neural activation in the conceptual store.

Cognitive and anatomic double dissociation in the representation of concrete and abstract words in semantic variant and behavioral variant frontotemporal degeneration.

PubMed

Cousins, Katheryn A Q; York, Collin; Bauer, Laura; Grossman, Murray

2016-04-01

We examine the anatomic basis for abstract and concrete lexical representations in semantic memory by assessing patients with focal neurodegenerative disease. Prior evidence from healthy adult studies suggests that there may be an anatomical dissociation between abstract and concrete representations: abstract words more strongly activate the left inferior frontal gyrus relative to concrete words, while concrete words more strongly activate left anterior-inferior temporal regions. However, this double dissociation has not been directly examined. We test this dissociation in two patient groups with focal cortical atrophy in each of these regions, the behavioral variant of Frontotemporal Degeneration (bvFTD) and the semantic variant of Primary Progressive Aphasia (svPPA). We administered an associativity judgment task for abstract and concrete words, where subjects select which of two words is best associated with a given target word. Both bvFTD and svPPA patients were significantly impaired in their overall performance compared to controls. While controls treated concrete and abstract words equally, we found a category-specific double dissociation in patients' judgments: bvFTD patients showed a concreteness effect (CE), with significantly worse performance for abstract compared to concrete words, while svPPA patients showed reversal of the CE, with significantly worse performance for concrete over abstract words. Regression analyses also revealed an anatomic double dissociation: The CE is associated with inferior frontal atrophy in bvFTD, while reversal of the CE is associated with left anterior-inferior temporal atrophy in svPPA. These results support a cognitive and anatomic model of semantic memory organization where abstract and concrete representations are supported by dissociable neuroanatomic substrates. Copyright © 2016 Elsevier Ltd. All rights reserved.

A Novel Temporal Bone Simulation Model Using 3D Printing Techniques.

PubMed

Mowry, Sarah E; Jammal, Hachem; Myer, Charles; Solares, Clementino Arturo; Weinberger, Paul

2015-09-01

An inexpensive temporal bone model for use in a temporal bone dissection laboratory setting can be made using a commercially available, consumer-grade 3D printer. Several models for a simulated temporal bone have been described but use commercial-grade printers and materials to produce these models. The goal of this project was to produce a plastic simulated temporal bone on an inexpensive 3D printer that recreates the visual and haptic experience associated with drilling a human temporal bone. Images from a high-resolution CT of a normal temporal bone were converted into stereolithography files via commercially available software, with image conversion and print settings adjusted to achieve optimal print quality. The temporal bone model was printed using acrylonitrile butadiene styrene (ABS) plastic filament on a MakerBot 2x 3D printer. Simulated temporal bones were drilled by seven expert temporal bone surgeons, assessing the fidelity of the model as compared with a human cadaveric temporal bone. Using a four-point scale, the simulated bones were assessed for haptic experience and recreation of the temporal bone anatomy. The created model was felt to be an accurate representation of a human temporal bone. All raters felt strongly this would be a good training model for junior residents or to simulate difficult surgical anatomy. Material cost for each model was $1.92. A realistic, inexpensive, and easily reproducible temporal bone model can be created on a consumer-grade desktop 3D printer.

Neural plasticity associated with recently versus often heard objects.

PubMed

Bourquin, Nathalie M-P; Spierer, Lucas; Murray, Micah M; Clarke, Stephanie

2012-09-01

In natural settings the same sound source is often heard repeatedly, with variations in spectro-temporal and spatial characteristics. We investigated how such repetitions influence sound representations and in particular how auditory cortices keep track of recently vs. often heard objects. A set of 40 environmental sounds was presented twice, i.e. as prime and as repeat, while subjects categorized the corresponding sound sources as living vs. non-living. Electrical neuroimaging analyses were applied to auditory evoked potentials (AEPs) comparing primes vs. repeats (effect of presentation) and the four experimental sections. Dynamic analysis of distributed source estimations revealed i) a significant main effect of presentation within the left temporal convexity at 164-215 ms post-stimulus onset; and ii) a significant main effect of section in the right temporo-parietal junction at 166-213 ms. A 3-way repeated measures ANOVA (hemisphere×presentation×section) applied to neural activity of the above clusters during the common time window confirmed the specificity of the left hemisphere for the effect of presentation, but not that of the right hemisphere for the effect of section. In conclusion, spatio-temporal dynamics of neural activity encode the temporal history of exposure to sound objects. Rapidly occurring plastic changes within the semantic representations of the left hemisphere keep track of objects heard a few seconds before, independent of the more general sound exposure history. Progressively occurring and more long-lasting plastic changes occurring predominantly within right hemispheric networks, which are known to code for perceptual, semantic and spatial aspects of sound objects, keep track of multiple exposures. Copyright © 2012 Elsevier Inc. All rights reserved.

A voxel-based asymmetry study of the relationship between hemispheric asymmetry and language dominance in Wada tested patients.

PubMed

Keller, Simon S; Roberts, Neil; Baker, Gus; Sluming, Vanessa; Cezayirli, Enis; Mayes, Andrew; Eldridge, Paul; Marson, Anthony G; Wieshmann, Udo C

2018-03-23

Determining the anatomical basis of hemispheric language dominance (HLD) remains an important scientific endeavor. The Wada test remains the gold standard test for HLD and provides a unique opportunity to determine the relationship between HLD and hemispheric structural asymmetries on MRI. In this study, we applied a whole-brain voxel-based asymmetry (VBA) approach to determine the relationship between interhemispheric structural asymmetries and HLD in a large consecutive sample of Wada tested patients. Of 135 patients, 114 (84.4%) had left HLD, 10 (7.4%) right HLD, and 11 (8.2%) bilateral language representation. Fifty-four controls were also studied. Right-handed controls and right-handed patients with left HLD had comparable structural brain asymmetries in cortical, subcortical, and cerebellar regions that have previously been documented in healthy people. However, these patients and controls differed in structural asymmetry of the mesial temporal lobe and a circumscribed region in the superior temporal gyrus, suggesting that only asymmetries of these regions were due to brain alterations caused by epilepsy. Additional comparisons between patients with left and right HLD, matched for type and location of epilepsy, revealed that structural asymmetries of insula, pars triangularis, inferior temporal gyrus, orbitofrontal cortex, ventral temporo-occipital cortex, mesial somatosensory cortex, and mesial cerebellum were significantly associated with the side of HLD. Patients with right HLD and bilateral language representation were significantly less right-handed. These results suggest that structural asymmetries of an insular-fronto-temporal network may be related to HLD. © 2018 The Authors Human Brain Mapping Published by Wiley Periodicals, Inc.

Developmental changes in brain regions involved in phonological and orthographic processing during spoken language processing

PubMed Central

Cone, Nadia E.; Burman, Douglas D.; Bitan, Tali; Bolger, Donald J.; Booth, James R.

2008-01-01

Developmental differences in brain activation of 9- to 15-year-old children were examined during an auditory rhyme decision task to spoken words using functional magnetic resonance imaging (fMRI). As a group, children showed activation in left superior/middle temporal gyri (BA 22, 21), right middle temporal gyrus (BA 21), dorsal (BA 45, pars opercularis) and ventral (BA 46, pars triangularis) aspects of left inferior frontal gyrus, and left fusiform gyrus (BA 37). There was a developmental increase in activation in left middle temporal gyrus (BA 22) across all lexical conditions, suggesting that automatic semantic processing increases with age regardless of task demands. Activation in left dorsal inferior frontal gyrus also showed developmental increases for the conflicting (e.g. PINT-MINT) compared to the non-conflicting (e.g. PRESS-LIST) non-rhyming conditions, indicating that this area becomes increasingly involved in strategic phonological processing in the face of conflicting orthographic and phonological representations. Left inferior temporal/fusiform gyrus (BA 37) activation was also greater for the conflicting (e.g. PINT-MINT) condition, and a developmental increase was found in the positive relationship between individuals' reaction time and activation in left lingual/fusiform gyrus (BA 18) in this condition, indicating an age-related increase in the association between longer reaction times and greater visual-orthographic processing in this conflicting condition. These results suggest that orthographic processing is automatically engaged by children in a task that does not require access to orthographic information for correct performance, especially when orthographic and phonological representations conflict, and especially for longer response latencies in older children. PMID:18413290

Designing for Temporal Awareness: The Role of Temporality in Time-Critical Medical Teamwork

PubMed Central

Kusunoki, Diana S.; Sarcevic, Aleksandra

2016-01-01

This paper describes the role of temporal information in emergency medical teamwork and how time-based features can be designed to support the temporal awareness of clinicians in this fast-paced and dynamic environment. Engagement in iterative design activities with clinicians over the course of two years revealed a strong need for time-based features and mechanisms, including timestamps for tasks based on absolute time and automatic stopclocks measuring time by counting up since task performance. We describe in detail the aspects of temporal awareness central to clinicians’ awareness needs and then provide examples of how we addressed these needs through the design of a shared information display. As an outcome of this process, we define four types of time representation techniques to facilitate the design of time-based features: (1) timestamps based on absolute time, (2) timestamps relative to the process start time, (3) time since task performance, and (4) time until the next required task. PMID:27478880

Levels of word processing and incidental memory: dissociable mechanisms in the temporal lobe.

PubMed

Castillo, E M; Simos, P G; Davis, R N; Breier, J; Fitzgerald, M E; Papanicolaou, A C

2001-11-16

Word recall is facilitated when deep (e.g. semantic) processing is applied during encoding. This fact raises the question of the existence of specific brain mechanisms supporting different levels of information processing that can modulate incidental memory performance. In this study we obtained spatiotemporal brain activation profiles, using magnetic source imaging, from 10 adult volunteers as they performed a shallow (phonological) processing task and a deep (semantic) processing task. When phonological analysis of the word stimuli into their constituent phonemes was required, activation was largely restricted to the posterior portion of the left superior temporal gyrus (area 22). Conversely, when access to lexical/semantic representations was required, activation was found predominantly in the left middle temporal gyrus and medial temporal cortex. The differential engagement of each mechanism during word encoding was associated with dramatic changes in subsequent incidental memory performance.

Oligomer formation in the troposphere: from experimental knowledge to 3-D modeling

NASA Astrophysics Data System (ADS)

Lemaire, Vincent; Coll, Isabelle; Couvidat, Florian; Mouchel-Vallon, Camille; Seigneur, Christian; Siour, Guillaume

2016-04-01

The organic fraction of atmospheric aerosols has proven to be a critical element of air quality and climate issues. However, its composition and the aging processes it undergoes remain insufficiently understood. This work builds on laboratory knowledge to simulate the formation of oligomers from biogenic secondary organic aerosol (BSOA) in the troposphere at the continental scale. We compare the results of two different modeling approaches, a first-order kinetic process and a pH-dependent parameterization, both implemented in the CHIMERE air quality model (AQM) (www.lmd.polytechnique.fr/chimere), to simulate the spatial and temporal distribution of oligomerized secondary organic aerosol (SOA) over western Europe. We also included a comparison of organic carbon (OC) concentrations at two EMEP (European Monitoring and Evaluation Programme) stations. Our results show that there is a strong dependence of the results on the selected modeling approach: while the irreversible kinetic process leads to the oligomerization of about 50 % of the total BSOA mass, the pH-dependent approach shows a broader range of impacts, with a strong dependency on environmental parameters (pH and nature of aerosol) and the possibility for the process to be reversible. In parallel, we investigated the sensitivity of each modeling approach to the representation of SOA precursor solubility (Henry's law constant values). Finally, the pros and cons of each approach for the representation of SOA aging are discussed and recommendations are provided to improve current representations of oligomer formation in AQMs.

Hierarchical Organization of Auditory and Motor Representations in Speech Perception: Evidence from Searchlight Similarity Analysis

PubMed Central

Evans, Samuel; Davis, Matthew H.

2015-01-01

How humans extract the identity of speech sounds from highly variable acoustic signals remains unclear. Here, we use searchlight representational similarity analysis (RSA) to localize and characterize neural representations of syllables at different levels of the hierarchically organized temporo-frontal pathways for speech perception. We asked participants to listen to spoken syllables that differed considerably in their surface acoustic form by changing speaker and degrading surface acoustics using noise-vocoding and sine wave synthesis while we recorded neural responses with functional magnetic resonance imaging. We found evidence for a graded hierarchy of abstraction across the brain. At the peak of the hierarchy, neural representations in somatomotor cortex encoded syllable identity but not surface acoustic form, at the base of the hierarchy, primary auditory cortex showed the reverse. In contrast, bilateral temporal cortex exhibited an intermediate response, encoding both syllable identity and the surface acoustic form of speech. Regions of somatomotor cortex associated with encoding syllable identity in perception were also engaged when producing the same syllables in a separate session. These findings are consistent with a hierarchical account of how variable acoustic signals are transformed into abstract representations of the identity of speech sounds. PMID:26157026

Improving rainfall representation for large-scale hydrological modelling of tropical mountain basins

NASA Astrophysics Data System (ADS)

Zulkafli, Zed; Buytaert, Wouter; Onof, Christian; Lavado, Waldo; Guyot, Jean-Loup

2013-04-01

Errors in the forcing data are sometimes overlooked in hydrological studies even when they could be the most important source of uncertainty. The latter particularly holds true in tropical countries with short historical records of rainfall monitoring and remote areas with sparse rain gauge network. In such instances, alternative data such as the remotely sensed precipitation from the TRMM (Tropical Rainfall Measuring Mission) satellite have been used. These provide a good spatial representation of rainfall processes but have been established in the literature to contain volumetric biases that may impair the results of hydrological modelling or worse, are compensated during model calibration. In this study, we analysed precipitation time series from the TMPA (TRMM Multiple Precipitation Algorithm, version 6) against measurements from over 300 gauges in the Andes and Amazon regions of Peru and Ecuador. We found moderately good monthly correlation between the pixel and gauge pairs but a severe underestimation of rainfall amounts and wet days. The discrepancy between the time series pairs is particularly visible over the east side of the Andes and may be attributed to localized and orographic-driven high intensity rainfall, which the satellite product may have limited skills at capturing due to technical and scale issues. This consequently results in a low bias in the simulated streamflow volumes further downstream. In comparison, with the recently released TMPA, version 7, the biases reduce. This work further explores several approaches to merge the two sources of rainfall measurements, each of a different spatial and temporal support, with the objective of improving the representation of rainfall in hydrological simulations. The methods used are (1) mean bias correction (2) data assimilation using Kalman filter Bayesian updating. The results are evaluated by means of (1) a comparison of runoff ratios (the ratio of the total runoff and the total precipitation over an extended period) in multiple basins, and (2) a comparison of the outcome of hydrological modelling using the distributed JULES (Joint-UK Land Environment Simulator) land surface model. First results indicate an improvement in the water balance that directly translates into an increased hydrological performance. The more interesting aspect of the study, however, will be the insights into the nature of satellite precipitation errors in this extreme environment and the optimal means of improving the data to generate increased confidence in hydrological predictions.

Understanding face perception by means of human electrophysiology.

PubMed

Rossion, Bruno

2014-06-01

Electrophysiological recordings on the human scalp provide a wealth of information about the temporal dynamics and nature of face perception at a global level of brain organization. The time window between 100 and 200 ms witnesses the transition between low-level and high-level vision, an N170 component correlating with conscious interpretation of a visual stimulus as a face. This face representation is rapidly refined as information accumulates during this time window, allowing the individualization of faces. To improve the sensitivity and objectivity of face perception measures, it is increasingly important to go beyond transient visual stimulation by recording electrophysiological responses at periodic frequency rates. This approach has recently provided face perception thresholds and the first objective signature of integration of facial parts in the human brain. Copyright © 2014 Elsevier Ltd. All rights reserved.

Stochastic generators of multi-site daily temperature: comparison of performances in various applications

NASA Astrophysics Data System (ADS)

Evin, Guillaume; Favre, Anne-Catherine; Hingray, Benoit

2018-02-01

We present a multi-site stochastic model for the generation of average daily temperature, which includes a flexible parametric distribution and a multivariate autoregressive process. Different versions of this model are applied to a set of 26 stations located in Switzerland. The importance of specific statistical characteristics of the model (seasonality, marginal distributions of standardized temperature, spatial and temporal dependence) is discussed. In particular, the proposed marginal distribution is shown to improve the reproduction of extreme temperatures (minima and maxima). We also demonstrate that the frequency and duration of cold spells and heat waves are dramatically underestimated when the autocorrelation of temperature is not taken into account in the model. An adequate representation of these characteristics can be crucial depending on the field of application, and we discuss potential implications in different contexts (agriculture, forestry, hydrology, human health).

Cortical network reorganization guided by sensory input features.

PubMed

Kilgard, Michael P; Pandya, Pritesh K; Engineer, Navzer D; Moucha, Raluca

2002-12-01

Sensory experience alters the functional organization of cortical networks. Previous studies using behavioral training motivated by aversive or rewarding stimuli have demonstrated that cortical plasticity is specific to salient inputs in the sensory environment. Sensory experience associated with electrical activation of the basal forebrain (BasF) generates similar input specific plasticity. By directly engaging plasticity mechanisms and avoiding extensive behavioral training, BasF stimulation makes it possible to efficiently explore how specific sensory features contribute to cortical plasticity. This review summarizes our observations that cortical networks employ a variety of strategies to improve the representation of the sensory environment. Different combinations of receptive-field, temporal, and spectrotemporal plasticity were generated in primary auditory cortex neurons depending on the pitch, modulation rate, and order of sounds paired with BasF stimulation. Simple tones led to map expansion, while modulated tones altered the maximum cortical following rate. Exposure to complex acoustic sequences led to the development of combination-sensitive responses. This remodeling of cortical response characteristics may reflect changes in intrinsic cellular mechanisms, synaptic efficacy, and local neuronal connectivity. The intricate relationship between the pattern of sensory activation and cortical plasticity suggests that network-level rules alter the functional organization of the cortex to generate the most behaviorally useful representation of the sensory environment.

Empirical Orthogonal Function (EOF) Analysis of Storm-Time GPS Total Electron Content Variations

NASA Astrophysics Data System (ADS)

Thomas, E. G.; Coster, A. J.; Zhang, S.; McGranaghan, R. M.; Shepherd, S. G.; Baker, J. B.; Ruohoniemi, J. M.

2016-12-01

Large perturbations in ionospheric density are known to occur during geomagnetic storms triggered by dynamic structures in the solar wind. These ionospheric storm effects have long attracted interest due to their impact on the propagation characteristics of radio wave communications. Over the last two decades, maps of vertically-integrated total electron content (TEC) based on data collected by worldwide networks of Global Positioning System (GPS) receivers have dramatically improved our ability to monitor the spatiotemporal dynamics of prominent storm-time features such as polar cap patches and storm enhanced density (SED) plumes. In this study, we use an empirical orthogonal function (EOF) decomposition technique to identify the primary modes of spatial and temporal variability in the storm-time GPS TEC response at midlatitudes over North America during more than 100 moderate geomagnetic storms from 2001-2013. We next examine the resulting time-varying principal components and their correlation with various geophysical indices and parameters in order to derive an analytical representation. Finally, we use a truncated reconstruction of the EOF basis functions and parameterization of the principal components to produce an empirical representation of the geomagnetic storm-time response of GPS TEC for all magnetic local times local times and seasons at midlatitudes in the North American sector.

Separate Brain Circuits Support Integrative and Semantic Priming in the Human Language System.

PubMed

Feng, Gangyi; Chen, Qi; Zhu, Zude; Wang, Suiping

2016-07-01

Semantic priming is a crucial phenomenon to study the organization of semantic memory. A novel type of priming effect, integrative priming, has been identified behaviorally, whereby a prime word facilitates recognition of a target word when the 2 concepts can be combined to form a unitary representation. We used both functional and anatomical imaging approaches to investigate the neural substrates supporting such integrative priming, and compare them with those in semantic priming. Similar behavioral priming effects for both semantic (Bread-Cake) and integrative conditions (Cherry-Cake) were observed when compared with an unrelated condition. However, a clearly dissociated brain response was observed between these 2 types of priming. The semantic-priming effect was localized to the posterior superior temporal and middle temporal gyrus. In contrast, the integrative-priming effect localized to the left anterior inferior frontal gyrus and left anterior temporal cortices. Furthermore, fiber tractography showed that the integrative-priming regions were connected via uncinate fasciculus fiber bundle forming an integrative circuit, whereas the semantic-priming regions connected to the posterior frontal cortex via separated pathways. The results point to dissociable neural pathways underlying the 2 distinct types of priming, illuminating the neural circuitry organization of semantic representation and integration. © The Author 2015. Published by Oxford University Press. All rights reserved. For Permissions, please e-mail: journals.permissions@oup.com.

Toward an understanding of the cerebral substrates of woman's orgasm.

PubMed

Bianchi-Demicheli, Francesco; Ortigue, Stephanie

2007-09-20

The way women experience orgasm is of interest to scientists, clinicians, and laypeople. Whereas the origin and the function of a woman's orgasm remains controversial, the current models of sexual function acknowledge a combined role of central (spinal and cerebral) and peripheral processes during orgasm experience. At the central level, although it is accepted that the spinal cord drives orgasm, the cerebral involvement and cognitive representation of a woman's orgasm has not been extensively investigated. Important gaps in our knowledge remain. Recently, the astonishing advances of neuroimaging techniques applied in parallel with a neuropsychological approach allowed the unravelling of specific functional neuroanatomy of a woman's orgasm. Here, clinical and experimental findings on the cortico-subcortical pathway of a woman's orgasm are reviewed and compared with the neural basis of a man's orgasm. By defining the specific brain areas that sustain the assumed higher-order representation of a woman's orgasm, this review provides a foundation for future studies. The next challenge of functional imaging and neuropsychological studies is to understand the hierarchical interactions between these multiple cortical areas, not only with a correlation analysis but also with high spatio-temporal resolution techniques demonstrating the causal necessity, the temporal time course and the direction of the causality. Further studies using a multi-disciplinary approach are needed to identify the spatio-temporal dynamic of a woman's orgasm, its dysfunctions and possible new treatments.

The medial temporal lobe-conduit of parallel connectivity: a model for attention, memory, and perception.

PubMed

Mozaffari, Brian

2014-01-01

Based on the notion that the brain is equipped with a hierarchical organization, which embodies environmental contingencies across many time scales, this paper suggests that the medial temporal lobe (MTL)-located deep in the hierarchy-serves as a bridge connecting supra- to infra-MTL levels. Bridging the upper and lower regions of the hierarchy provides a parallel architecture that optimizes information flow between upper and lower regions to aid attention, encoding, and processing of quick complex visual phenomenon. Bypassing intermediate hierarchy levels, information conveyed through the MTL "bridge" allows upper levels to make educated predictions about the prevailing context and accordingly select lower representations to increase the efficiency of predictive coding throughout the hierarchy. This selection or activation/deactivation is associated with endogenous attention. In the event that these "bridge" predictions are inaccurate, this architecture enables the rapid encoding of novel contingencies. A review of hierarchical models in relation to memory is provided along with a new theory, Medial-temporal-lobe Conduit for Parallel Connectivity (MCPC). In this scheme, consolidation is considered as a secondary process, occurring after a MTL-bridged connection, which eventually allows upper and lower levels to access each other directly. With repeated reactivations, as contingencies become consolidated, less MTL activity is predicted. Finally, MTL bridging may aid processing transient but structured perceptual events, by allowing communication between upper and lower levels without calling on intermediate levels of representation.

Cardiac C-arm computed tomography using a 3D + time ROI reconstruction method with spatial and temporal regularization

DOE Office of Scientific and Technical Information (OSTI.GOV)

Mory, Cyril, E-mail: cyril.mory@philips.com; Philips Research Medisys, 33 rue de Verdun, 92156 Suresnes; Auvray, Vincent

2014-02-15

Purpose: Reconstruction of the beating heart in 3D + time in the catheter laboratory using only the available C-arm system would improve diagnosis, guidance, device sizing, and outcome control for intracardiac interventions, e.g., electrophysiology, valvular disease treatment, structural or congenital heart disease. To obtain such a reconstruction, the patient's electrocardiogram (ECG) must be recorded during the acquisition and used in the reconstruction. In this paper, the authors present a 4D reconstruction method aiming to reconstruct the heart from a single sweep 10 s acquisition. Methods: The authors introduce the 4D RecOnstructiOn using Spatial and TEmporal Regularization (short 4D ROOSTER) method,more » which reconstructs all cardiac phases at once, as a 3D + time volume. The algorithm alternates between a reconstruction step based on conjugate gradient and four regularization steps: enforcing positivity, averaging along time outside a motion mask that contains the heart and vessels, 3D spatial total variation minimization, and 1D temporal total variation minimization. Results: 4D ROOSTER recovers the different temporal representations of a moving Shepp and Logan phantom, and outperforms both ECG-gated simultaneous algebraic reconstruction technique and prior image constrained compressed sensing on a clinical case. It generates 3D + time reconstructions with sharp edges which can be used, for example, to estimate the patient's left ventricular ejection fraction. Conclusions: 4D ROOSTER can be applied for human cardiac C-arm CT, and potentially in other dynamic tomography areas. It can easily be adapted to other problems as regularization is decoupled from projection and back projection.« less

The influence of monetary incentives on context processing in younger and older adults: an event-related potential study.

PubMed

Schmitt, Hannah; Ferdinand, Nicola K; Kray, Jutta

2015-06-01

Recent evidence has indicated that neuronal activity related to reward anticipation benefits subsequent stimulus processing, but the effect of penalties remains largely unknown. Since the dual-mechanisms-of-control theory (DMC; Braver & Barch, Neuroscience and Biobehavioral Reviews, 26, 809-81, 2002) assumes that temporal differences in context updating underlie age differences in cognitive control, in this study we investigated whether motivational cues (signaling the chance to win or the risk to lose money, relative to neutral cues) preceding context information in a modified AX-CPT paradigm influence the temporal stages of context processing in younger and older adults. In the behavioral data, younger adults benefited from gain cues, evident in their enhanced context updating, whereas older adults exhibited slowed responding after motivational cues, irrespective of valence. Event-related potentials (ERPs) revealed that the enhanced processing of motivational cues in the P2 and P3b was mainly age-invariant, whereas age-differential effects were found for the ERP correlates of context processing. Younger adults showed improved context maintenance (i.e., a larger negative-going CNV), as well as increased conflict detection (larger N450) and resolution (indicated by a sustained positivity), whenever incorrect responding would lead to a monetary loss. In contrast, motivationally salient cues benefited context representations (in cue-locked P3b amplitudes), but increased working memory demands during response preparation (via a temporally prolonged P3b) in older adults. In sum, motivational valence and salience effects differentially modulated the temporal stages of context processing in younger and older adults. These results are discussed in terms of the DMC theory, recent findings of emotion regulation in old age, and the relationship between cognitive and affective processing.

Temporal pattern processing in songbirds.

PubMed

Comins, Jordan A; Gentner, Timothy Q

2014-10-01

Understanding how the brain perceives, organizes and uses patterned information is directly related to the neurobiology of language. Given the present limitations, such knowledge at the scale of neurons, neural circuits and neural populations can only come from non-human models, focusing on shared capacities that are relevant to language processing. Here we review recent advances in the behavioral and neural basis of temporal pattern processing of natural auditory communication signals in songbirds, focusing on European starlings. We suggest a general inhibitory circuit for contextual modulation that can act to control sensory representations based on patterning rules. Copyright © 2014. Published by Elsevier Ltd.

Multiplicative Forests for Continuous-Time Processes

PubMed Central

Weiss, Jeremy C.; Natarajan, Sriraam; Page, David

2013-01-01

Learning temporal dependencies between variables over continuous time is an important and challenging task. Continuous-time Bayesian networks effectively model such processes but are limited by the number of conditional intensity matrices, which grows exponentially in the number of parents per variable. We develop a partition-based representation using regression trees and forests whose parameter spaces grow linearly in the number of node splits. Using a multiplicative assumption we show how to update the forest likelihood in closed form, producing efficient model updates. Our results show multiplicative forests can be learned from few temporal trajectories with large gains in performance and scalability. PMID:25284967

Multiplicative Forests for Continuous-Time Processes.

PubMed

Weiss, Jeremy C; Natarajan, Sriraam; Page, David

2012-01-01

Learning temporal dependencies between variables over continuous time is an important and challenging task. Continuous-time Bayesian networks effectively model such processes but are limited by the number of conditional intensity matrices, which grows exponentially in the number of parents per variable. We develop a partition-based representation using regression trees and forests whose parameter spaces grow linearly in the number of node splits. Using a multiplicative assumption we show how to update the forest likelihood in closed form, producing efficient model updates. Our results show multiplicative forests can be learned from few temporal trajectories with large gains in performance and scalability.