The effects of aging on emotion-induced modulations of source retrieval ERPs: evidence for valence biases.

PubMed

Newsome, Rachel N; Dulas, Michael R; Duarte, Audrey

2012-12-01

Many behavioral studies have shown that memory is enhanced for emotionally salient events across the lifespan. It has been suggested that this mnemonic boost may be observed for both age groups, particularly the old, in part because emotional information is retrieved with less effort than neutral information. Neuroimaging evidence suggests that inefficient retrieval processing (temporally delayed and attenuated) may contribute to age-related impairments in episodic memory for neutral events. It is not entirely clear whether emotional salience may reduce these age-related changes in neural activity associated with episodic retrieval for neutral events. Here, we investigated these ideas using event-related potentials (ERPs) to assess the neural correlates of successful source memory retrieval ("old-new effects") for neutral and emotional (negative and positive) images. Behavioral results showed that older adults demonstrated source memory impairments compared to the young but that both groups showed reduced source memory accuracy for negative compared to positive and neutral images; most likely due to an arousal-induced memory tradeoff for the negative images, which were subjectively more arousing than both positive and neutral images. ERP results showed that early onsetting old-new effects, between 100 and 300 ms, were observed for emotional but not neutral images in both age groups. Interestingly, these early effects were observed for negative items in the young and for positive items in the old. These ERP findings offer support for the idea that emotional events may be retrieved more automatically than neutral events across the lifespan. Furthermore, we suggest that very early retrieval mechanisms, possibly perceptual priming or familiarity, may underlie the negativity and positivity effects sometimes observed in the young and old, respectively, for various behavioral measures of attention and memory. Copyright © 2012 Elsevier Ltd. All rights reserved.

Data augmentation-assisted deep learning of hand-drawn partially colored sketches for visual search

PubMed Central

Muhammad, Khan; Baik, Sung Wook

2017-01-01

In recent years, image databases are growing at exponential rates, making their management, indexing, and retrieval, very challenging. Typical image retrieval systems rely on sample images as queries. However, in the absence of sample query images, hand-drawn sketches are also used. The recent adoption of touch screen input devices makes it very convenient to quickly draw shaded sketches of objects to be used for querying image databases. This paper presents a mechanism to provide access to visual information based on users’ hand-drawn partially colored sketches using touch screen devices. A key challenge for sketch-based image retrieval systems is to cope with the inherent ambiguity in sketches due to the lack of colors, textures, shading, and drawing imperfections. To cope with these issues, we propose to fine-tune a deep convolutional neural network (CNN) using augmented dataset to extract features from partially colored hand-drawn sketches for query specification in a sketch-based image retrieval framework. The large augmented dataset contains natural images, edge maps, hand-drawn sketches, de-colorized, and de-texturized images which allow CNN to effectively model visual contents presented to it in a variety of forms. The deep features extracted from CNN allow retrieval of images using both sketches and full color images as queries. We also evaluated the role of partial coloring or shading in sketches to improve the retrieval performance. The proposed method is tested on two large datasets for sketch recognition and sketch-based image retrieval and achieved better classification and retrieval performance than many existing methods. PMID:28859140

Experiments with a novel content-based image retrieval software: can we eliminate classification systems in adolescent idiopathic scoliosis?

PubMed

Menon, K Venugopal; Kumar, Dinesh; Thomas, Tessamma

2014-02-01

Study Design Preliminary evaluation of new tool. Objective To ascertain whether the newly developed content-based image retrieval (CBIR) software can be used successfully to retrieve images of similar cases of adolescent idiopathic scoliosis (AIS) from a database to help plan treatment without adhering to a classification scheme. Methods Sixty-two operated cases of AIS were entered into the newly developed CBIR database. Five new cases of different curve patterns were used as query images. The images were fed into the CBIR database that retrieved similar images from the existing cases. These were analyzed by a senior surgeon for conformity to the query image. Results Within the limits of variability set for the query system, all the resultant images conformed to the query image. One case had no similar match in the series. The other four retrieved several images that were matching with the query. No matching case was left out in the series. The postoperative images were then analyzed to check for surgical strategies. Broad guidelines for treatment could be derived from the results. More precise query settings, inclusion of bending films, and a larger database will enhance accurate retrieval and better decision making. Conclusion The CBIR system is an effective tool for accurate documentation and retrieval of scoliosis images. Broad guidelines for surgical strategies can be made from the postoperative images of the existing cases without adhering to any classification scheme.

Effectiveness of image features and similarity measures in cluster-based approaches for content-based image retrieval

NASA Astrophysics Data System (ADS)

Du, Hongbo; Al-Jubouri, Hanan; Sellahewa, Harin

2014-05-01

Content-based image retrieval is an automatic process of retrieving images according to image visual contents instead of textual annotations. It has many areas of application from automatic image annotation and archive, image classification and categorization to homeland security and law enforcement. The key issues affecting the performance of such retrieval systems include sensible image features that can effectively capture the right amount of visual contents and suitable similarity measures to find similar and relevant images ranked in a meaningful order. Many different approaches, methods and techniques have been developed as a result of very intensive research in the past two decades. Among many existing approaches, is a cluster-based approach where clustering methods are used to group local feature descriptors into homogeneous regions, and search is conducted by comparing the regions of the query image against those of the stored images. This paper serves as a review of works in this area. The paper will first summarize the existing work reported in the literature and then present the authors' own investigations in this field. The paper intends to highlight not only achievements made by recent research but also challenges and difficulties still remaining in this area.

Multi-instance learning based on instance consistency for image retrieval

NASA Astrophysics Data System (ADS)

Zhang, Miao; Wu, Zhize; Wan, Shouhong; Yue, Lihua; Yin, Bangjie

2017-07-01

Multiple-instance learning (MIL) has been successfully utilized in image retrieval. Existing approaches cannot select positive instances correctly from positive bags which may result in a low accuracy. In this paper, we propose a new image retrieval approach called multiple instance learning based on instance-consistency (MILIC) to mitigate such issue. First, we select potential positive instances effectively in each positive bag by ranking instance-consistency (IC) values of instances. Then, we design a feature representation scheme, which can represent the relationship among bags and instances, based on potential positive instances to convert a bag into a single instance. Finally, we can use a standard single-instance learning strategy, such as the support vector machine, for performing object-based image retrieval. Experimental results on two challenging data sets show the effectiveness of our proposal in terms of accuracy and run time.

A similarity learning approach to content-based image retrieval: application to digital mammography.

PubMed

El-Naqa, Issam; Yang, Yongyi; Galatsanos, Nikolas P; Nishikawa, Robert M; Wernick, Miles N

2004-10-01

In this paper, we describe an approach to content-based retrieval of medical images from a database, and provide a preliminary demonstration of our approach as applied to retrieval of digital mammograms. Content-based image retrieval (CBIR) refers to the retrieval of images from a database using information derived from the images themselves, rather than solely from accompanying text indices. In the medical-imaging context, the ultimate aim of CBIR is to provide radiologists with a diagnostic aid in the form of a display of relevant past cases, along with proven pathology and other suitable information. CBIR may also be useful as a training tool for medical students and residents. The goal of information retrieval is to recall from a database information that is relevant to the user's query. The most challenging aspect of CBIR is the definition of relevance (similarity), which is used to guide the retrieval machine. In this paper, we pursue a new approach, in which similarity is learned from training examples provided by human observers. Specifically, we explore the use of neural networks and support vector machines to predict the user's notion of similarity. Within this framework we propose using a hierarchal learning approach, which consists of a cascade of a binary classifier and a regression module to optimize retrieval effectiveness and efficiency. We also explore how to incorporate online human interaction to achieve relevance feedback in this learning framework. Our experiments are based on a database consisting of 76 mammograms, all of which contain clustered microcalcifications (MCs). Our goal is to retrieve mammogram images containing similar MC clusters to that in a query. The performance of the retrieval system is evaluated using precision-recall curves computed using a cross-validation procedure. Our experimental results demonstrate that: 1) the learning framework can accurately predict the perceptual similarity reported by human observers, thereby serving as a basis for CBIR; 2) the learning-based framework can significantly outperform a simple distance-based similarity metric; 3) the use of the hierarchical two-stage network can improve retrieval performance; and 4) relevance feedback can be effectively incorporated into this learning framework to achieve improvement in retrieval precision based on online interaction with users; and 5) the retrieved images by the network can have predicting value for the disease condition of the query.

Determining similarity in histological images using graph-theoretic description and matching methods for content-based image retrieval in medical diagnostics.

PubMed

Sharma, Harshita; Alekseychuk, Alexander; Leskovsky, Peter; Hellwich, Olaf; Anand, R S; Zerbe, Norman; Hufnagl, Peter

2012-10-04

Computer-based analysis of digitalized histological images has been gaining increasing attention, due to their extensive use in research and routine practice. The article aims to contribute towards the description and retrieval of histological images by employing a structural method using graphs. Due to their expressive ability, graphs are considered as a powerful and versatile representation formalism and have obtained a growing consideration especially by the image processing and computer vision community. The article describes a novel method for determining similarity between histological images through graph-theoretic description and matching, for the purpose of content-based retrieval. A higher order (region-based) graph-based representation of breast biopsy images has been attained and a tree-search based inexact graph matching technique has been employed that facilitates the automatic retrieval of images structurally similar to a given image from large databases. The results obtained and evaluation performed demonstrate the effectiveness and superiority of graph-based image retrieval over a common histogram-based technique. The employed graph matching complexity has been reduced compared to the state-of-the-art optimal inexact matching methods by applying a pre-requisite criterion for matching of nodes and a sophisticated design of the estimation function, especially the prognosis function. The proposed method is suitable for the retrieval of similar histological images, as suggested by the experimental and evaluation results obtained in the study. It is intended for the use in Content Based Image Retrieval (CBIR)-requiring applications in the areas of medical diagnostics and research, and can also be generalized for retrieval of different types of complex images. The virtual slide(s) for this article can be found here: http://www.diagnosticpathology.diagnomx.eu/vs/1224798882787923.

Determining similarity in histological images using graph-theoretic description and matching methods for content-based image retrieval in medical diagnostics

PubMed Central

2012-01-01

Background Computer-based analysis of digitalized histological images has been gaining increasing attention, due to their extensive use in research and routine practice. The article aims to contribute towards the description and retrieval of histological images by employing a structural method using graphs. Due to their expressive ability, graphs are considered as a powerful and versatile representation formalism and have obtained a growing consideration especially by the image processing and computer vision community. Methods The article describes a novel method for determining similarity between histological images through graph-theoretic description and matching, for the purpose of content-based retrieval. A higher order (region-based) graph-based representation of breast biopsy images has been attained and a tree-search based inexact graph matching technique has been employed that facilitates the automatic retrieval of images structurally similar to a given image from large databases. Results The results obtained and evaluation performed demonstrate the effectiveness and superiority of graph-based image retrieval over a common histogram-based technique. The employed graph matching complexity has been reduced compared to the state-of-the-art optimal inexact matching methods by applying a pre-requisite criterion for matching of nodes and a sophisticated design of the estimation function, especially the prognosis function. Conclusion The proposed method is suitable for the retrieval of similar histological images, as suggested by the experimental and evaluation results obtained in the study. It is intended for the use in Content Based Image Retrieval (CBIR)-requiring applications in the areas of medical diagnostics and research, and can also be generalized for retrieval of different types of complex images. Virtual Slides The virtual slide(s) for this article can be found here: http://www.diagnosticpathology.diagnomx.eu/vs/1224798882787923. PMID:23035717

Quantification of signal detection performance degradation induced by phase-retrieval in propagation-based x-ray phase-contrast imaging

NASA Astrophysics Data System (ADS)

Chou, Cheng-Ying; Anastasio, Mark A.

2016-04-01

In propagation-based X-ray phase-contrast (PB XPC) imaging, the measured image contains a mixture of absorption- and phase-contrast. To obtain separate images of the projected absorption and phase (i.e., refractive) properties of a sample, phase retrieval methods can be employed. It has been suggested that phase-retrieval can always improve image quality in PB XPC imaging. However, when objective (task-based) measures of image quality are employed, this is not necessarily true and phase retrieval can be detrimental. In this work, signal detection theory is utilized to quantify the performance of a Hotelling observer (HO) for detecting a known signal in a known background. Two cases are considered. In the first case, the HO acts directly on the measured intensity data. In the second case, the HO acts on either the retrieved phase or absorption image. We demonstrate that the performance of the HO is superior when acting on the measured intensity data. The loss of task-specific information induced by phase-retrieval is quantified by computing the efficiency of the HO as the ratio of the test statistic signal-to-noise ratio (SNR) for the two cases. The effect of the system geometry on this efficiency is systematically investigated. Our findings confirm that phase-retrieval can impair signal detection performance in XPC imaging.

Interactive radiographic image retrieval system.

PubMed

Kundu, Malay Kumar; Chowdhury, Manish; Das, Sudeb

2017-02-01

Content based medical image retrieval (CBMIR) systems enable fast diagnosis through quantitative assessment of the visual information and is an active research topic over the past few decades. Most of the state-of-the-art CBMIR systems suffer from various problems: computationally expensive due to the usage of high dimensional feature vectors and complex classifier/clustering schemes. Inability to properly handle the "semantic gap" and the high intra-class versus inter-class variability problem of the medical image database (like radiographic image database). This yields an exigent demand for developing highly effective and computationally efficient retrieval system. We propose a novel interactive two-stage CBMIR system for diverse collection of medical radiographic images. Initially, Pulse Coupled Neural Network based shape features are used to find out the most probable (similar) image classes using a novel "similarity positional score" mechanism. This is followed by retrieval using Non-subsampled Contourlet Transform based texture features considering only the images of the pre-identified classes. Maximal information compression index is used for unsupervised feature selection to achieve better results. To reduce the semantic gap problem, the proposed system uses a novel fuzzy index based relevance feedback mechanism by incorporating subjectivity of human perception in an analytic manner. Extensive experiments were carried out to evaluate the effectiveness of the proposed CBMIR system on a subset of Image Retrieval in Medical Applications (IRMA)-2009 database consisting of 10,902 labeled radiographic images of 57 different modalities. We obtained overall average precision of around 98% after only 2-3 iterations of relevance feedback mechanism. We assessed the results by comparisons with some of the state-of-the-art CBMIR systems for radiographic images. Unlike most of the existing CBMIR systems, in the proposed two-stage hierarchical framework, main importance is given on constructing efficient and compact feature vector representation, search-space reduction and handling the "semantic gap" problem effectively, without compromising the retrieval performance. Experimental results and comparisons show that the proposed system performs efficiently in the radiographic medical image retrieval field. Copyright © 2016 Elsevier Ireland Ltd. All rights reserved.

Experimental Studies on a Compact Storage Scheme for Wavelet-based Multiresolution Subregion Retrieval

NASA Technical Reports Server (NTRS)

Poulakidas, A.; Srinivasan, A.; Egecioglu, O.; Ibarra, O.; Yang, T.

1996-01-01

Wavelet transforms, when combined with quantization and a suitable encoding, can be used to compress images effectively. In order to use them for image library systems, a compact storage scheme for quantized coefficient wavelet data must be developed with a support for fast subregion retrieval. We have designed such a scheme and in this paper we provide experimental studies to demonstrate that it achieves good image compression ratios, while providing a natural indexing mechanism that facilitates fast retrieval of portions of the image at various resolutions.

Effect of anxiety on behavioural pattern separation in humans

PubMed Central

Mathur, Ambika; Adu-Brimpong, Joel; Hale, Elizabeth A.; Ernst, Monique; Grillon, Christian

2016-01-01

Behavioural pattern separation (BPS), the ability to distinguish among similar stimuli based on subtle physical differences, has been used to study the mechanism underlying stimulus generalisation. Fear overgeneralisation is often observed in individuals with posttraumatic stress disorder and other anxiety disorders. However, the relationship between anxiety and BPS remains unclear. The purpose of this study was to determine the effect of anxiety (threat of shock) on BPS, which was assessed across separate encoding and retrieval sessions. Images were encoded/retrieved during blocks of threat or safety in a 2 × 2 factorial design. During retrieval, participants indicated whether images were new, old, or altered. Better accuracy was observed for altered images encoded during periods of threat compared to safety, but only if those images were also retrieved during periods of safety. These results suggest that overgeneralisation in anxiety may be due to altered pattern separation. PMID:26480349

Retrieve polarization aberration from image degradation: a new measurement method in DUV lithography

NASA Astrophysics Data System (ADS)

Xiang, Zhongbo; Li, Yanqiu

2017-10-01

Detailed knowledge of polarization aberration (PA) of projection lens in higher-NA DUV lithographic imaging is necessary due to its impact to imaging degradations, and precise measurement of PA is conductive to computational lithography techniques such as RET and OPC. Current in situ measurement method of PA thorough the detection of degradations of aerial images need to do linear approximation and apply the assumption of 3-beam/2-beam interference condition. The former approximation neglects the coupling effect of the PA coefficients, which would significantly influence the accuracy of PA retrieving. The latter assumption restricts the feasible pitch of test masks in higher-NA system, conflicts with the Kirhhoff diffraction model of test mask used in retrieving model, and introduces 3D mask effect as a source of retrieving error. In this paper, a new in situ measurement method of PA is proposed. It establishes the analytical quadratic relation between the PA coefficients and the degradations of aerial images of one-dimensional dense lines in coherent illumination through vector aerial imaging, which does not rely on the assumption of 3-beam/2- beam interference and linear approximation. In this case, the retrieval of PA from image degradation can be convert from the nonlinear system of m-quadratic equations to a multi-objective quadratic optimization problem, and finally be solved by nonlinear least square method. Some preliminary simulation results are given to demonstrate the correctness and accuracy of the new PA retrieving model.

A Novel Image Retrieval Based on Visual Words Integration of SIFT and SURF

PubMed Central

Ali, Nouman; Bajwa, Khalid Bashir; Sablatnig, Robert; Chatzichristofis, Savvas A.; Iqbal, Zeshan; Rashid, Muhammad; Habib, Hafiz Adnan

2016-01-01

With the recent evolution of technology, the number of image archives has increased exponentially. In Content-Based Image Retrieval (CBIR), high-level visual information is represented in the form of low-level features. The semantic gap between the low-level features and the high-level image concepts is an open research problem. In this paper, we present a novel visual words integration of Scale Invariant Feature Transform (SIFT) and Speeded-Up Robust Features (SURF). The two local features representations are selected for image retrieval because SIFT is more robust to the change in scale and rotation, while SURF is robust to changes in illumination. The visual words integration of SIFT and SURF adds the robustness of both features to image retrieval. The qualitative and quantitative comparisons conducted on Corel-1000, Corel-1500, Corel-2000, Oliva and Torralba and Ground Truth image benchmarks demonstrate the effectiveness of the proposed visual words integration. PMID:27315101

Landmark Image Retrieval by Jointing Feature Refinement and Multimodal Classifier Learning.

PubMed

Zhang, Xiaoming; Wang, Senzhang; Li, Zhoujun; Ma, Shuai; Xiaoming Zhang; Senzhang Wang; Zhoujun Li; Shuai Ma; Ma, Shuai; Zhang, Xiaoming; Wang, Senzhang; Li, Zhoujun

2018-06-01

Landmark retrieval is to return a set of images with their landmarks similar to those of the query images. Existing studies on landmark retrieval focus on exploiting the geometries of landmarks for visual similarity matches. However, the visual content of social images is of large diversity in many landmarks, and also some images share common patterns over different landmarks. On the other side, it has been observed that social images usually contain multimodal contents, i.e., visual content and text tags, and each landmark has the unique characteristic of both visual content and text content. Therefore, the approaches based on similarity matching may not be effective in this environment. In this paper, we investigate whether the geographical correlation among the visual content and the text content could be exploited for landmark retrieval. In particular, we propose an effective multimodal landmark classification paradigm to leverage the multimodal contents of social image for landmark retrieval, which integrates feature refinement and landmark classifier with multimodal contents by a joint model. The geo-tagged images are automatically labeled for classifier learning. Visual features are refined based on low rank matrix recovery, and multimodal classification combined with group sparse is learned from the automatically labeled images. Finally, candidate images are ranked by combining classification result and semantic consistence measuring between the visual content and text content. Experiments on real-world datasets demonstrate the superiority of the proposed approach as compared to existing methods.

Validation of Cloud Properties From Multiple Satellites Using CALIOP Data

NASA Technical Reports Server (NTRS)

Yost, Christopher R.; Minnis, Patrick; Bedka, Kristopher M.; Heck, Patrick W.; Palikonda, Rabindra; Sun-Mack, Sunny; Trepte, Qing

2016-01-01

The NASA Langley Satellite ClOud and Radiative Property retrieval System (SatCORPS) is routinely applied to multispectral imagery from several geostationary and polar-orbiting imagers to retrieve cloud properties for weather and climate applications. Validation of the retrievals with independent datasets is continuously ongoing in order to understand differences caused by calibration, spatial resolution, viewing geometry, and other factors. The CALIOP instrument provides a decade of detailed cloud observations which can be used to evaluate passive imager retrievals of cloud boundaries, thermodynamic phase, cloud optical depth, and water path on a global scale. This paper focuses on comparisons of CALIOP retrievals to retrievals from MODIS, VIIRS, AVHRR, GOES, SEVIRI, and MTSAT. CALIOP is particularly skilled at detecting weakly-scattering cirrus clouds with optical depths less than approx. 0.5. These clouds are often undetected by passive imagers and the effect this has on the property retrievals is discussed.

Medical Image Retrieval: A Multimodal Approach

PubMed Central

Cao, Yu; Steffey, Shawn; He, Jianbiao; Xiao, Degui; Tao, Cui; Chen, Ping; Müller, Henning

2014-01-01

Medical imaging is becoming a vital component of war on cancer. Tremendous amounts of medical image data are captured and recorded in a digital format during cancer care and cancer research. Facing such an unprecedented volume of image data with heterogeneous image modalities, it is necessary to develop effective and efficient content-based medical image retrieval systems for cancer clinical practice and research. While substantial progress has been made in different areas of content-based image retrieval (CBIR) research, direct applications of existing CBIR techniques to the medical images produced unsatisfactory results, because of the unique characteristics of medical images. In this paper, we develop a new multimodal medical image retrieval approach based on the recent advances in the statistical graphic model and deep learning. Specifically, we first investigate a new extended probabilistic Latent Semantic Analysis model to integrate the visual and textual information from medical images to bridge the semantic gap. We then develop a new deep Boltzmann machine-based multimodal learning model to learn the joint density model from multimodal information in order to derive the missing modality. Experimental results with large volume of real-world medical images have shown that our new approach is a promising solution for the next-generation medical imaging indexing and retrieval system. PMID:26309389

Image Location Estimation by Salient Region Matching.

PubMed

Qian, Xueming; Zhao, Yisi; Han, Junwei

2015-11-01

Nowadays, locations of images have been widely used in many application scenarios for large geo-tagged image corpora. As to images which are not geographically tagged, we estimate their locations with the help of the large geo-tagged image set by content-based image retrieval. In this paper, we exploit spatial information of useful visual words to improve image location estimation (or content-based image retrieval performances). We proposed to generate visual word groups by mean-shift clustering. To improve the retrieval performance, spatial constraint is utilized to code the relative position of visual words. We proposed to generate a position descriptor for each visual word and build fast indexing structure for visual word groups. Experiments show the effectiveness of our proposed approach.

Intelligent retrieval of medical images from the Internet

NASA Astrophysics Data System (ADS)

Tang, Yau-Kuo; Chiang, Ted T.

1996-05-01

The object of this study is using Internet resources to provide a cost-effective, user-friendly method to access the medical image archive system and to provide an easy method for the user to identify the images required. This paper describes the prototype system architecture, the implementation, and results. In the study, we prototype the Intelligent Medical Image Retrieval (IMIR) system as a Hypertext Transport Prototype server and provide Hypertext Markup Language forms for user, as an Internet client, using browser to enter image retrieval criteria for review. We are developing the intelligent retrieval engine, with the capability to map the free text search criteria to the standard terminology used for medical image identification. We evaluate retrieved records based on the number of the free text entries matched and their relevance level to the standard terminology. We are in the integration and testing phase. We have collected only a few different types of images for testing and have trained a few phrases to map the free text to the standard medical terminology. Nevertheless, we are able to demonstrate the IMIR's ability to search, retrieve, and review medical images from the archives using general Internet browser. The prototype also uncovered potential problems in performance, security, and accuracy. Additional studies and enhancements will make the system clinically operational.

Feature hashing for fast image retrieval

NASA Astrophysics Data System (ADS)

Yan, Lingyu; Fu, Jiarun; Zhang, Hongxin; Yuan, Lu; Xu, Hui

2018-03-01

Currently, researches on content based image retrieval mainly focus on robust feature extraction. However, due to the exponential growth of online images, it is necessary to consider searching among large scale images, which is very timeconsuming and unscalable. Hence, we need to pay much attention to the efficiency of image retrieval. In this paper, we propose a feature hashing method for image retrieval which not only generates compact fingerprint for image representation, but also prevents huge semantic loss during the process of hashing. To generate the fingerprint, an objective function of semantic loss is constructed and minimized, which combine the influence of both the neighborhood structure of feature data and mapping error. Since the machine learning based hashing effectively preserves neighborhood structure of data, it yields visual words with strong discriminability. Furthermore, the generated binary codes leads image representation building to be of low-complexity, making it efficient and scalable to large scale databases. Experimental results show good performance of our approach.

Automatic medical image annotation and keyword-based image retrieval using relevance feedback.

PubMed

Ko, Byoung Chul; Lee, JiHyeon; Nam, Jae-Yeal

2012-08-01

This paper presents novel multiple keywords annotation for medical images, keyword-based medical image retrieval, and relevance feedback method for image retrieval for enhancing image retrieval performance. For semantic keyword annotation, this study proposes a novel medical image classification method combining local wavelet-based center symmetric-local binary patterns with random forests. For keyword-based image retrieval, our retrieval system use the confidence score that is assigned to each annotated keyword by combining probabilities of random forests with predefined body relation graph. To overcome the limitation of keyword-based image retrieval, we combine our image retrieval system with relevance feedback mechanism based on visual feature and pattern classifier. Compared with other annotation and relevance feedback algorithms, the proposed method shows both improved annotation performance and accurate retrieval results.

Fusion of Deep Learning and Compressed Domain features for Content Based Image Retrieval.

PubMed

Liu, Peizhong; Guo, Jing-Ming; Wu, Chi-Yi; Cai, Danlin

2017-08-29

This paper presents an effective image retrieval method by combining high-level features from Convolutional Neural Network (CNN) model and low-level features from Dot-Diffused Block Truncation Coding (DDBTC). The low-level features, e.g., texture and color, are constructed by VQ-indexed histogram from DDBTC bitmap, maximum, and minimum quantizers. Conversely, high-level features from CNN can effectively capture human perception. With the fusion of the DDBTC and CNN features, the extended deep learning two-layer codebook features (DL-TLCF) is generated using the proposed two-layer codebook, dimension reduction, and similarity reweighting to improve the overall retrieval rate. Two metrics, average precision rate (APR) and average recall rate (ARR), are employed to examine various datasets. As documented in the experimental results, the proposed schemes can achieve superior performance compared to the state-of-the-art methods with either low- or high-level features in terms of the retrieval rate. Thus, it can be a strong candidate for various image retrieval related applications.

A hierarchical knowledge-based approach for retrieving similar medical images described with semantic annotations

PubMed Central

Kurtz, Camille; Beaulieu, Christopher F.; Napel, Sandy; Rubin, Daniel L.

2014-01-01

Computer-assisted image retrieval applications could assist radiologist interpretations by identifying similar images in large archives as a means to providing decision support. However, the semantic gap between low-level image features and their high level semantics may impair the system performances. Indeed, it can be challenging to comprehensively characterize the images using low-level imaging features to fully capture the visual appearance of diseases on images, and recently the use of semantic terms has been advocated to provide semantic descriptions of the visual contents of images. However, most of the existing image retrieval strategies do not consider the intrinsic properties of these terms during the comparison of the images beyond treating them as simple binary (presence/absence) features. We propose a new framework that includes semantic features in images and that enables retrieval of similar images in large databases based on their semantic relations. It is based on two main steps: (1) annotation of the images with semantic terms extracted from an ontology, and (2) evaluation of the similarity of image pairs by computing the similarity between the terms using the Hierarchical Semantic-Based Distance (HSBD) coupled to an ontological measure. The combination of these two steps provides a means of capturing the semantic correlations among the terms used to characterize the images that can be considered as a potential solution to deal with the semantic gap problem. We validate this approach in the context of the retrieval and the classification of 2D regions of interest (ROIs) extracted from computed tomographic (CT) images of the liver. Under this framework, retrieval accuracy of more than 0.96 was obtained on a 30-images dataset using the Normalized Discounted Cumulative Gain (NDCG) index that is a standard technique used to measure the effectiveness of information retrieval algorithms when a separate reference standard is available. Classification results of more than 95% were obtained on a 77-images dataset. For comparison purpose, the use of the Earth Mover's Distance (EMD), which is an alternative distance metric that considers all the existing relations among the terms, led to results retrieval accuracy of 0.95 and classification results of 93% with a higher computational cost. The results provided by the presented framework are competitive with the state-of-the-art and emphasize the usefulness of the proposed methodology for radiology image retrieval and classification. PMID:24632078

Retrieval of land cover information under thin fog in Landsat TM image

NASA Astrophysics Data System (ADS)

Wei, Yuchun

2008-04-01

Thin fog, which often appears in remote sensing image of subtropical climate region, has resulted in the low image quantity and bad image mapping. Therefore, it is necessary to develop the image processing method to retrieve land cover information under thin fog. In this paper, the Landsat TM image near the Taihu Lake that is in the subtropical climate zone of China was used as an example, and the workflow and method used to retrieve the land cover information under thin fog have been built based on ENVI software and a single TM image. The basic step covers three parts: 1) isolating the thin fog area in image according to the spectral difference of different bands; 2) retrieving the visible band information of different land cover types under thin fog from the near-infrared bands according to the relationships between near-infrared bands and visible bands of different land cover types in the area without fog; 3) image post-process. The result showed that the method in the paper is easy and suitable, and can be used to improve the quantity of TM image mapping more effectively.

Inter-Comparison of GOES-8 Imager and Sounder Skin Temperature Retrievals

NASA Technical Reports Server (NTRS)

Haines, Stephanie L.; Suggs, Ronnie J.; Jedlovec, Gary J.; Arnold, James E. (Technical Monitor)

2001-01-01

Skin temperature (ST) retrievals derived from geostationary satellite observations have both high temporal and spatial resolutions and are therefore useful for applications such as assimilation into mesoscale forecast models, nowcasting, and diagnostic studies. Our retrieval method uses a Physical Split Window technique requiring at least two channels within the longwave infrared window. On current GOES satellites, including GOES-11, there are two Imager channels within the required spectral interval. However, beginning with the GOES-M satellite the 12-um channel will be removed, leaving only one longwave channel. The Sounder instrument will continue to have three channels within the longwave window, and therefore ST retrievals will be derived from Sounder measurements. This research compares retrievals from the two instruments and evaluates the effects of the spatial resolution and sensor calibration differences on the retrievals. Both Imager and Sounder retrievals are compared to ground-truth data to evaluate the overall accuracy of the technique. An analysis of GOES-8 and GOES-11 intercomparisons is also presented.

Observations of Three-Dimensional Radiative Effects that Influence Satellite Retrievals of Cloud Properties

NASA Technical Reports Server (NTRS)

Varnai, Tamas; Marshak, Alexander; Lau, William K. M. (Technical Monitor)

2001-01-01

This paper examines three-dimensional (3D) radiative effects, which arise from horizontal radiative interactions between areas that have different cloud properties. Earlier studies have argued that these effects can cause significant uncertainties in current satellite retrievals of cloud properties, because the retrievals rely on one-dimensional (1D) theory and do not consider the effects of horizontal changes in cloud properties. This study addresses two questions: which retrieved cloud properties are influenced by 3D radiative effects, and where 3D effects tend to occur? The influence of 3D effects is detected from the wayside illumination and shadowing make clouds appear asymmetric: Areas appear brighter if the cloud top surface is tilted toward, rather than away from, the Sun. The analysis of 30 images by the Moderate Resolution Imaging Spectroradiometer (MODIS) reveals that retrievals of cloud optical thickness and cloud water content are most influenced by 3D effects, whereas retrievals of cloud particle size are much less affected. The results also indicate that while 3D effects are strongest at cloud edges, cloud top variability in cloud interiors, even in overcast regions, also produces considerable 3D effects. Finally, significant 3D effects are found in a wide variety of situations, ranging from thin clouds to thick ones and from low clouds to high ones.

Effects of Internal and External Vividness on Hippocampal Connectivity during Memory Retrieval

PubMed Central

Ford, Jaclyn H.; Kensinger, Elizabeth A.

2016-01-01

Successful memory for an image can be supported by retrieval of one’s personal reaction to the image (i.e., internal vividness), as well as retrieval of the specific details of the image itself (i.e., external vividness). Prior research suggests that memory vividness relies on regions within the medial temporal lobe, particularly the hippocampus, but it is unclear whether internal and external vividness are supported by the hippocampus in a similar way. To address this open question, the current study examined hippocampal connectivity associated with enhanced internal and external vividness ratings during retrieval. Participants encoded complex visual images paired with verbal titles. During a scanned retrieval session, they were presented with the titles and asked whether each had been seen with an image during encoding. Following retrieval of each image, participants were asked to rate internal and external vividness. Increased hippocampal activity was associated with higher vividness ratings for both scales, supporting prior evidence implicating the hippocampus in retrieval of memory detail. However, different patterns of hippocampal connectivity related to enhanced external and internal vividness. Further, hippocampal connectivity with medial prefrontal regions was associated with increased ratings of internal vividness, but with decreased ratings of external vividness. These findings suggest that the hippocampus may contribute to increased internal and external vividness via distinct mechanisms and that external and internal vividness of memories should be considered as separable measures. PMID:26778653

Amphetamine fails to alter cued recollection of emotional images: study of encoding, retrieval, and state-dependency.

PubMed

Weafer, Jessica; Gallo, David A; de Wit, Harriet

2014-01-01

Stimulant drugs facilitate both encoding and retrieval of salient information in laboratory animals, but less is known about their effects on memory for emotionally salient visual images in humans. The current study investigated dextroamphetamine (AMP) effects on memory for emotional pictures in healthy humans, by administering the drug only at encoding, only at retrieval, or at both encoding and retrieval. During the encoding session, all participants viewed standardized positive, neutral, and negative pictures from the International Affective Picture System (IAPS). 48 hours later they attended a retrieval session testing their cued recollection of these stimuli. Participants were randomly assigned to one of four conditions (N=20 each): condition AP (20 mg AMP at encoding and placebo (PL) at retrieval); condition PA (PL at encoding and AMP at retrieval); condition AA (AMP at encoding and retrieval); or condition PP (PL at encoding and retrieval). Amphetamine produced its expected effects on physiological and subjective measures, and negative pictures were recollected more frequently than neutral pictures. However, contrary to hypotheses, AMP did not affect recollection for positive, negative, or neutral stimuli, whether it was administered at encoding, retrieval, or at both encoding and retrieval. Moreover, recollection accuracy was not state-dependent. Considered in light of other recent drug studies in humans, this study highlights the sensitivity of drug effects to memory testing conditions and suggests future strategies for translating preclinical findings to human behavioral laboratories.

Amphetamine Fails to Alter Cued Recollection of Emotional Images: Study of Encoding, Retrieval, and State-Dependency

PubMed Central

Weafer, Jessica; Gallo, David A.; de Wit, Harriet

2014-01-01

Stimulant drugs facilitate both encoding and retrieval of salient information in laboratory animals, but less is known about their effects on memory for emotionally salient visual images in humans. The current study investigated dextroamphetamine (AMP) effects on memory for emotional pictures in healthy humans, by administering the drug only at encoding, only at retrieval, or at both encoding and retrieval. During the encoding session, all participants viewed standardized positive, neutral, and negative pictures from the International Affective Picture System (IAPS). 48 hours later they attended a retrieval session testing their cued recollection of these stimuli. Participants were randomly assigned to one of four conditions (N = 20 each): condition AP (20 mg AMP at encoding and placebo (PL) at retrieval); condition PA (PL at encoding and AMP at retrieval); condition AA (AMP at encoding and retrieval); or condition PP (PL at encoding and retrieval). Amphetamine produced its expected effects on physiological and subjective measures, and negative pictures were recollected more frequently than neutral pictures. However, contrary to hypotheses, AMP did not affect recollection for positive, negative, or neutral stimuli, whether it was administered at encoding, retrieval, or at both encoding and retrieval. Moreover, recollection accuracy was not state-dependent. Considered in light of other recent drug studies in humans, this study highlights the sensitivity of drug effects to memory testing conditions and suggests future strategies for translating preclinical findings to human behavioral laboratories. PMID:24587355

Social Image Tag Ranking by Two-View Learning

NASA Astrophysics Data System (ADS)

Zhuang, Jinfeng; Hoi, Steven C. H.

Tags play a central role in text-based social image retrieval and browsing. However, the tags annotated by web users could be noisy, irrelevant, and often incomplete for describing the image contents, which may severely deteriorate the performance of text-based image retrieval models. In order to solve this problem, researchers have proposed techniques to rank the annotated tags of a social image according to their relevance to the visual content of the image. In this paper, we aim to overcome the challenge of social image tag ranking for a corpus of social images with rich user-generated tags by proposing a novel two-view learning approach. It can effectively exploit both textual and visual contents of social images to discover the complicated relationship between tags and images. Unlike the conventional learning approaches that usually assumes some parametric models, our method is completely data-driven and makes no assumption about the underlying models, making the proposed solution practically more effective. We formulate our method as an optimization task and present an efficient algorithm to solve it. To evaluate the efficacy of our method, we conducted an extensive set of experiments by applying our technique to both text-based social image retrieval and automatic image annotation tasks. Our empirical results showed that the proposed method can be more effective than the conventional approaches.

Generating region proposals for histopathological whole slide image retrieval.

PubMed

Ma, Yibing; Jiang, Zhiguo; Zhang, Haopeng; Xie, Fengying; Zheng, Yushan; Shi, Huaqiang; Zhao, Yu; Shi, Jun

2018-06-01

Content-based image retrieval is an effective method for histopathological image analysis. However, given a database of huge whole slide images (WSIs), acquiring appropriate region-of-interests (ROIs) for training is significant and difficult. Moreover, histopathological images can only be annotated by pathologists, resulting in the lack of labeling information. Therefore, it is an important and challenging task to generate ROIs from WSI and retrieve image with few labels. This paper presents a novel unsupervised region proposing method for histopathological WSI based on Selective Search. Specifically, the WSI is over-segmented into regions which are hierarchically merged until the WSI becomes a single region. Nucleus-oriented similarity measures for region mergence and Nucleus-Cytoplasm color space for histopathological image are specially defined to generate accurate region proposals. Additionally, we propose a new semi-supervised hashing method for image retrieval. The semantic features of images are extracted with Latent Dirichlet Allocation and transformed into binary hashing codes with Supervised Hashing. The methods are tested on a large-scale multi-class database of breast histopathological WSIs. The results demonstrate that for one WSI, our region proposing method can generate 7.3 thousand contoured regions which fit well with 95.8% of the ROIs annotated by pathologists. The proposed hashing method can retrieve a query image among 136 thousand images in 0.29 s and reach precision of 91% with only 10% of images labeled. The unsupervised region proposing method can generate regions as predictions of lesions in histopathological WSI. The region proposals can also serve as the training samples to train machine-learning models for image retrieval. The proposed hashing method can achieve fast and precise image retrieval with small amount of labels. Furthermore, the proposed methods can be potentially applied in online computer-aided-diagnosis systems. Copyright © 2018 Elsevier B.V. All rights reserved.

Conjunctive patches subspace learning with side information for collaborative image retrieval.

PubMed

Zhang, Lining; Wang, Lipo; Lin, Weisi

2012-08-01

Content-Based Image Retrieval (CBIR) has attracted substantial attention during the past few years for its potential practical applications to image management. A variety of Relevance Feedback (RF) schemes have been designed to bridge the semantic gap between the low-level visual features and the high-level semantic concepts for an image retrieval task. Various Collaborative Image Retrieval (CIR) schemes aim to utilize the user historical feedback log data with similar and dissimilar pairwise constraints to improve the performance of a CBIR system. However, existing subspace learning approaches with explicit label information cannot be applied for a CIR task, although the subspace learning techniques play a key role in various computer vision tasks, e.g., face recognition and image classification. In this paper, we propose a novel subspace learning framework, i.e., Conjunctive Patches Subspace Learning (CPSL) with side information, for learning an effective semantic subspace by exploiting the user historical feedback log data for a CIR task. The CPSL can effectively integrate the discriminative information of labeled log images, the geometrical information of labeled log images and the weakly similar information of unlabeled images together to learn a reliable subspace. We formally formulate this problem into a constrained optimization problem and then present a new subspace learning technique to exploit the user historical feedback log data. Extensive experiments on both synthetic data sets and a real-world image database demonstrate the effectiveness of the proposed scheme in improving the performance of a CBIR system by exploiting the user historical feedback log data.

Opposing effects of negative emotion on amygdalar and hippocampal memory for items and associations

PubMed Central

Horner, Aidan J.; Hørlyck, Lone D.; Burgess, Neil

2016-01-01

Although negative emotion can strengthen memory of an event it can also result in memory disturbances, as in post-traumatic stress disorder (PTSD). We examined the effects of negative item content on amygdalar and hippocampal function in memory for the items themselves and for the associations between them. During fMRI, we examined encoding and retrieval of paired associates made up of all four combinations of neutral and negative images. At test, participants were cued with an image and, if recognised, had to retrieve the associated (target) image. The presence of negative images increased item memory but reduced associative memory. At encoding, subsequent item recognition correlated with amygdala activity, while subsequent associative memory correlated with hippocampal activity. Hippocampal activity was reduced by the presence of negative images, during encoding and correct associative retrieval. In contrast, amygdala activity increased for correctly retrieved negative images, even when cued by a neutral image. Our findings support a dual representation account, whereby negative emotion up-regulates the amygdala to strengthen item memory but down-regulates the hippocampus to weaken associative representations. These results have implications for the development and treatment of clinical disorders in which diminished associations between emotional stimuli and their context contribute to negative symptoms, as in PTSD. PMID:26969864

Coupled Retrieval of Liquid Water Cloud and Above-Cloud Aerosol Properties Using the Airborne Multiangle SpectroPolarimetric Imager (AirMSPI)

NASA Astrophysics Data System (ADS)

Xu, Feng; van Harten, Gerard; Diner, David J.; Davis, Anthony B.; Seidel, Felix C.; Rheingans, Brian; Tosca, Mika; Alexandrov, Mikhail D.; Cairns, Brian; Ferrare, Richard A.; Burton, Sharon P.; Fenn, Marta A.; Hostetler, Chris A.; Wood, Robert; Redemann, Jens

2018-03-01

An optimization algorithm is developed to retrieve liquid water cloud properties including cloud optical depth (COD), droplet size distribution and cloud top height (CTH), and above-cloud aerosol properties including aerosol optical depth (AOD), single-scattering albedo, and microphysical properties from sweep-mode observations by Jet Propulsion Laboratory's Airborne Multiangle SpectroPolarimetric Imager (AirMSPI) instrument. The retrieval is composed of three major steps: (1) initial estimate of the mean droplet size distribution across the entire image of 80-100 km along track by 10-25 km across track from polarimetric cloudbow observations, (2) coupled retrieval of image-scale cloud and above-cloud aerosol properties by fitting the polarimetric data at all observation angles, and (3) iterative retrieval of 1-D radiative transfer-based COD and droplet size distribution at pixel scale (25 m) by establishing relationships between COD and droplet size and fitting the total radiance measurements. Our retrieval is tested using 134 AirMSPI data sets acquired during the National Aeronautics and Space Administration (NASA) field campaign ObseRvations of Aerosols above CLouds and their intEractionS. The retrieved above-cloud AOD and CTH are compared to coincident HSRL-2 (HSRL-2, NASA Langley Research Center) data, and COD and droplet size distribution parameters (effective radius reff and effective variance veff) are compared to coincident Research Scanning Polarimeter (RSP) (NASA Goddard Institute for Space Studies) data. Mean absolute differences between AirMSPI and HSRL-2 retrievals of above-cloud AOD at 532 nm and CTH are 0.03 and <0.5 km, respectively. At RSP's footprint scale ( 323 m), mean absolute differences between RSP and AirMSPI retrievals of COD, reff, and veff in the cloudbow area are 2.33, 0.69 μm, and 0.020, respectively. Neglect of smoke aerosols above cloud leads to an underestimate of image-averaged COD by 15%.

Cross-Domain Shoe Retrieval with a Semantic Hierarchy of Attribute Classification Network.

PubMed

Zhan, Huijing; Shi, Boxin; Kot, Alex C

2017-08-04

Cross-domain shoe image retrieval is a challenging problem, because the query photo from the street domain (daily life scenario) and the reference photo in the online domain (online shop images) have significant visual differences due to the viewpoint and scale variation, self-occlusion, and cluttered background. This paper proposes the Semantic Hierarchy Of attributE Convolutional Neural Network (SHOE-CNN) with a three-level feature representation for discriminative shoe feature expression and efficient retrieval. The SHOE-CNN with its newly designed loss function systematically merges semantic attributes of closer visual appearances to prevent shoe images with the obvious visual differences being confused with each other; the features extracted from image, region, and part levels effectively match the shoe images across different domains. We collect a large-scale shoe dataset composed of 14341 street domain and 12652 corresponding online domain images with fine-grained attributes to train our network and evaluate our system. The top-20 retrieval accuracy improves significantly over the solution with the pre-trained CNN features.

Toward privacy-preserving JPEG image retrieval

NASA Astrophysics Data System (ADS)

Cheng, Hang; Wang, Jingyue; Wang, Meiqing; Zhong, Shangping

2017-07-01

This paper proposes a privacy-preserving retrieval scheme for JPEG images based on local variance. Three parties are involved in the scheme: the content owner, the server, and the authorized user. The content owner encrypts JPEG images for privacy protection by jointly using permutation cipher and stream cipher, and then, the encrypted versions are uploaded to the server. With an encrypted query image provided by an authorized user, the server may extract blockwise local variances in different directions without knowing the plaintext content. After that, it can calculate the similarity between the encrypted query image and each encrypted database image by a local variance-based feature comparison mechanism. The authorized user with the encryption key can decrypt the returned encrypted images with plaintext content similar to the query image. The experimental results show that the proposed scheme not only provides effective privacy-preserving retrieval service but also ensures both format compliance and file size preservation for encrypted JPEG images.

Occam's razor: supporting visual query expression for content-based image queries

NASA Astrophysics Data System (ADS)

Venters, Colin C.; Hartley, Richard J.; Hewitt, William T.

2005-01-01

This paper reports the results of a usability experiment that investigated visual query formulation on three dimensions: effectiveness, efficiency, and user satisfaction. Twenty eight evaluation sessions were conducted in order to assess the extent to which query by visual example supports visual query formulation in a content-based image retrieval environment. In order to provide a context and focus for the investigation, the study was segmented by image type, user group, and use function. The image type consisted of a set of abstract geometric device marks supplied by the UK Trademark Registry. Users were selected from the 14 UK Patent Information Network offices. The use function was limited to the retrieval of images by shape similarity. Two client interfaces were developed for comparison purposes: Trademark Image Browser Engine (TRIBE) and Shape Query Image Retrieval Systems Engine (SQUIRE).

Occam"s razor: supporting visual query expression for content-based image queries

NASA Astrophysics Data System (ADS)

Venters, Colin C.; Hartley, Richard J.; Hewitt, William T.

2004-12-01

This paper reports the results of a usability experiment that investigated visual query formulation on three dimensions: effectiveness, efficiency, and user satisfaction. Twenty eight evaluation sessions were conducted in order to assess the extent to which query by visual example supports visual query formulation in a content-based image retrieval environment. In order to provide a context and focus for the investigation, the study was segmented by image type, user group, and use function. The image type consisted of a set of abstract geometric device marks supplied by the UK Trademark Registry. Users were selected from the 14 UK Patent Information Network offices. The use function was limited to the retrieval of images by shape similarity. Two client interfaces were developed for comparison purposes: Trademark Image Browser Engine (TRIBE) and Shape Query Image Retrieval Systems Engine (SQUIRE).

Effects of internal and external vividness on hippocampal connectivity during memory retrieval.

PubMed

Ford, Jaclyn H; Kensinger, Elizabeth A

2016-10-01

Successful memory for an image can be supported by retrieval of one's personal reaction to the image (i.e., internal vividness), as well as retrieval of the specific details of the image itself (i.e., external vividness). Prior research suggests that memory vividness relies on regions within the medial temporal lobe, particularly the hippocampus, but it is unclear whether internal and external vividness are supported by the hippocampus in a similar way. To address this open question, the current study examined hippocampal connectivity associated with enhanced internal and external vividness ratings during retrieval. Participants encoded complex visual images paired with verbal titles. During a scanned retrieval session, they were presented with the titles and asked whether each had been seen with an image during encoding. Following retrieval of each image, participants were asked to rate internal and external vividness. Increased hippocampal activity was associated with higher vividness ratings for both scales, supporting prior evidence implicating the hippocampus in retrieval of memory detail. However, different patterns of hippocampal connectivity related to enhanced external and internal vividness. Further, hippocampal connectivity with medial prefrontal regions was associated with increased ratings of internal vividness, but with decreased ratings of external vividness. These findings suggest that the hippocampus may contribute to increased internal and external vividness via distinct mechanisms and that external and internal vividness of memories should be considered as separable measures. Copyright © 2016 Elsevier Inc. All rights reserved.

Hybrid Histogram Descriptor: A Fusion Feature Representation for Image Retrieval.

PubMed

Feng, Qinghe; Hao, Qiaohong; Chen, Yuqi; Yi, Yugen; Wei, Ying; Dai, Jiangyan

2018-06-15

Currently, visual sensors are becoming increasingly affordable and fashionable, acceleratingly the increasing number of image data. Image retrieval has attracted increasing interest due to space exploration, industrial, and biomedical applications. Nevertheless, designing effective feature representation is acknowledged as a hard yet fundamental issue. This paper presents a fusion feature representation called a hybrid histogram descriptor (HHD) for image retrieval. The proposed descriptor comprises two histograms jointly: a perceptually uniform histogram which is extracted by exploiting the color and edge orientation information in perceptually uniform regions; and a motif co-occurrence histogram which is acquired by calculating the probability of a pair of motif patterns. To evaluate the performance, we benchmarked the proposed descriptor on RSSCN7, AID, Outex-00013, Outex-00014 and ETHZ-53 datasets. Experimental results suggest that the proposed descriptor is more effective and robust than ten recent fusion-based descriptors under the content-based image retrieval framework. The computational complexity was also analyzed to give an in-depth evaluation. Furthermore, compared with the state-of-the-art convolutional neural network (CNN)-based descriptors, the proposed descriptor also achieves comparable performance, but does not require any training process.

[Modeling continuous scaling of NDVI based on fractal theory].

PubMed

Luan, Hai-Jun; Tian, Qing-Jiu; Yu, Tao; Hu, Xin-Li; Huang, Yan; Du, Ling-Tong; Zhao, Li-Min; Wei, Xi; Han, Jie; Zhang, Zhou-Wei; Li, Shao-Peng

2013-07-01

Scale effect was one of the very important scientific problems of remote sensing. The scale effect of quantitative remote sensing can be used to study retrievals' relationship between different-resolution images, and its research became an effective way to confront the challenges, such as validation of quantitative remote sensing products et al. Traditional up-scaling methods cannot describe scale changing features of retrievals on entire series of scales; meanwhile, they are faced with serious parameters correction issues because of imaging parameters' variation of different sensors, such as geometrical correction, spectral correction, etc. Utilizing single sensor image, fractal methodology was utilized to solve these problems. Taking NDVI (computed by land surface radiance) as example and based on Enhanced Thematic Mapper Plus (ETM+) image, a scheme was proposed to model continuous scaling of retrievals. Then the experimental results indicated that: (a) For NDVI, scale effect existed, and it could be described by fractal model of continuous scaling; (2) The fractal method was suitable for validation of NDVI. All of these proved that fractal was an effective methodology of studying scaling of quantitative remote sensing.

A similarity measure method combining location feature for mammogram retrieval.

PubMed

Wang, Zhiqiong; Xin, Junchang; Huang, Yukun; Li, Chen; Xu, Ling; Li, Yang; Zhang, Hao; Gu, Huizi; Qian, Wei

2018-05-28

Breast cancer, the most common malignancy among women, has a high mortality rate in clinical practice. Early detection, diagnosis and treatment can reduce the mortalities of breast cancer greatly. The method of mammogram retrieval can help doctors to find the early breast lesions effectively and determine a reasonable feature set for image similarity measure. This will improve the accuracy effectively for mammogram retrieval. This paper proposes a similarity measure method combining location feature for mammogram retrieval. Firstly, the images are pre-processed, the regions of interest are detected and the lesions are segmented in order to get the center point and radius of the lesions. Then, the method, namely Coherent Point Drift, is used for image registration with the pre-defined standard image. The center point and radius of the lesions after registration are obtained and the standard location feature of the image is constructed. This standard location feature can help figure out the location similarity between the image pair from the query image to each dataset image in the database. Next, the content feature of the image is extracted, including the Histogram of Oriented Gradients, the Edge Direction Histogram, the Local Binary Pattern and the Gray Level Histogram, and the image pair content similarity can be calculated using the Earth Mover's Distance. Finally, the location similarity and content similarity are fused to form the image fusion similarity, and the specified number of the most similar images can be returned according to it. In the experiment, 440 mammograms, which are from Chinese women in Northeast China, are used as the database. When fusing 40% lesion location feature similarity and 60% content feature similarity, the results have obvious advantages. At this time, precision is 0.83, recall is 0.76, comprehensive indicator is 0.79, satisfaction is 96.0%, mean is 4.2 and variance is 17.7. The results show that the precision and recall of this method have obvious advantage, compared with the content-based image retrieval.

Validating a Geographical Image Retrieval System.

ERIC Educational Resources Information Center

Zhu, Bin; Chen, Hsinchun

2000-01-01

Summarizes a prototype geographical image retrieval system that demonstrates how to integrate image processing and information analysis techniques to support large-scale content-based image retrieval. Describes an experiment to validate the performance of this image retrieval system against that of human subjects by examining similarity analysis…

Secure image retrieval with multiple keys

NASA Astrophysics Data System (ADS)

Liang, Haihua; Zhang, Xinpeng; Wei, Qiuhan; Cheng, Hang

2018-03-01

This article proposes a secure image retrieval scheme under a multiuser scenario. In this scheme, the owner first encrypts and uploads images and their corresponding features to the cloud; then, the user submits the encrypted feature of the query image to the cloud; next, the cloud compares the encrypted features and returns encrypted images with similar content to the user. To find the nearest neighbor in the encrypted features, an encryption with multiple keys is proposed, in which the query feature of each user is encrypted by his/her own key. To improve the key security and space utilization, global optimization and Gaussian distribution are, respectively, employed to generate multiple keys. The experiments show that the proposed encryption can provide effective and secure image retrieval for each user and ensure confidentiality of the query feature of each user.

Web Mining for Web Image Retrieval.

ERIC Educational Resources Information Center

Chen, Zheng; Wenyin, Liu; Zhang, Feng; Li, Mingjing; Zhang, Hongjiang

2001-01-01

Presents a prototype system for image retrieval from the Internet using Web mining. Discusses the architecture of the Web image retrieval prototype; document space modeling; user log mining; and image retrieval experiments to evaluate the proposed system. (AEF)

Activating attachment representations during memory retrieval modulates intrusive traumatic memories.

PubMed

Bryant, Richard A; Chan, Iris

2017-10-01

Although priming mental representations of attachment security reduces arousal, research has not examined the effect of attachment on the retrieval of emotionally arousing memories. This study investigated the effect of priming attachment security on the retrieval of emotional memories. Seventy-five participants viewed negative and neutral images, and two days later received either an attachment prime or a control prime immediately prior to free recall of the images. Two days later, participants reported how frequently they experienced intrusions of the negative images. The attachment group had less distress, and reported fewer subsequent intrusions than the control group. Attachment style moderated these effects such that individuals with an avoidant attachment style were not impacted by the attachment prime. These findings suggest that priming attachment security decreases distress during memory reactivation, and this may reduce subsequent intrusive memories. Copyright © 2017 Elsevier Inc. All rights reserved.

Encoding processes during retrieval tasks.

PubMed

Buckner, R L; Wheeler, M E; Sheridan, M A

2001-04-01

Episodic memory encoding is pervasive across many kinds of task and often arises as a secondary processing effect in tasks that do not require intentional memorization. To illustrate the pervasive nature of information processing that leads to episodic encoding, a form of incidental encoding was explored based on the "Testing" phenomenon: The incidental-encoding task was an episodic memory retrieval task. Behavioral data showed that performing a memory retrieval task was as effective as intentional instructions at promoting episodic encoding. During fMRI imaging, subjects viewed old and new words and indicated whether they remembered them. Relevant to encoding, the fate of the new words was examined using a second, surprise test of recognition after the imaging session. fMRI analysis of those new words that were later remembered revealed greater activity in left frontal regions than those that were later forgotten - the same pattern of results as previously observed for traditional incidental and intentional episodic encoding tasks. This finding may offer a partial explanation for why repeated testing improves memory performance. Furthermore, the observation of correlates of episodic memory encoding during retrieval tasks challenges some interpretations that arise from direct comparisons between "encoding tasks" and "retrieval tasks" in imaging data. Encoding processes and their neural correlates may arise in many tasks, even those nominally labeled as retrieval tasks by the experimenter.

Content-based retrieval of historical Ottoman documents stored as textual images.

PubMed

Saykol, Ediz; Sinop, Ali Kemal; Güdükbay, Ugur; Ulusoy, Ozgür; Cetin, A Enis

2004-03-01

There is an accelerating demand to access the visual content of documents stored in historical and cultural archives. Availability of electronic imaging tools and effective image processing techniques makes it feasible to process the multimedia data in large databases. In this paper, a framework for content-based retrieval of historical documents in the Ottoman Empire archives is presented. The documents are stored as textual images, which are compressed by constructing a library of symbols occurring in a document, and the symbols in the original image are then replaced with pointers into the codebook to obtain a compressed representation of the image. The features in wavelet and spatial domain based on angular and distance span of shapes are used to extract the symbols. In order to make content-based retrieval in historical archives, a query is specified as a rectangular region in an input image and the same symbol-extraction process is applied to the query region. The queries are processed on the codebook of documents and the query images are identified in the resulting documents using the pointers in textual images. The querying process does not require decompression of images. The new content-based retrieval framework is also applicable to many other document archives using different scripts.

Effortful Retrieval Reduces Hippocampal Activity and Impairs Incidental Encoding

PubMed Central

Reas, Emilie T.; Brewer, James B.

2014-01-01

Functional imaging studies frequently report that the hippocampus is engaged by successful episodic memory retrieval. However, considering that concurrent encoding of the background environment occurs during retrieval and influences medial temporal lobe activity, it is plausible that hippocampal encoding functions are reduced with increased attentional engagement during effortful retrieval. Expanding upon evidence that retrieval efforts suppress activity in hippocampal regions implicated in encoding, this study examines the influence of retrieval effort on encoding performance and the interactive effects of encoding and retrieval on hippocampal and neocortical activity. Functional magnetic resonance imaging was conducted while subjects performed a word recognition task with incidental picture encoding. Both lower memory strength and increased search duration were associated with encoding failure and reduced hippocampal and default network activity. Activity in the anterior hippocampus tracked encoding, which was more strongly deactivated when incidental encoding was unsuccessful. These findings highlight potential contributions from background encoding processes to hippocampal activations during neuroimaging studies of episodic memory retrieval. PMID:23378272

The comparative effectiveness of conventional and digital image libraries.

PubMed

McColl, R I; Johnson, A

2001-03-01

Before introducing a hospital-wide image database to improve access, navigation and retrieval speed, a comparative study between a conventional slide library and a matching image database was undertaken to assess its relative benefits. Paired time trials and personal questionnaires revealed faster retrieval rates, higher image quality, and easier viewing for the pilot digital image database. Analysis of confidentiality, copyright and data protection exposed similar issues for both systems, thus concluding that the digital image database is a more effective library system. The authors suggest that in the future, medical images will be stored on large, professionally administered, centrally located file servers, allowing specialist image libraries to be tailored locally for individual users. The further integration of the database with web technology will enable cheap and efficient remote access for a wide range of users.

A novel image retrieval algorithm based on PHOG and LSH

NASA Astrophysics Data System (ADS)

Wu, Hongliang; Wu, Weimin; Peng, Jiajin; Zhang, Junyuan

2017-08-01

PHOG can describe the local shape of the image and its relationship between the spaces. The using of PHOG algorithm to extract image features in image recognition and retrieval and other aspects have achieved good results. In recent years, locality sensitive hashing (LSH) algorithm has been superior to large-scale data in solving near-nearest neighbor problems compared with traditional algorithms. This paper presents a novel image retrieval algorithm based on PHOG and LSH. First, we use PHOG to extract the feature vector of the image, then use L different LSH hash table to reduce the dimension of PHOG texture to index values and map to different bucket, and finally extract the corresponding value of the image in the bucket for second image retrieval using Manhattan distance. This algorithm can adapt to the massive image retrieval, which ensures the high accuracy of the image retrieval and reduces the time complexity of the retrieval. This algorithm is of great significance.

Surface reflectance retrieval from imaging spectrometer data using three atmospheric codes

NASA Astrophysics Data System (ADS)

Staenz, Karl; Williams, Daniel J.; Fedosejevs, Gunar; Teillet, Phil M.

1994-12-01

Surface reflectance retrieval from imaging spectrometer data has become important for quantitative information extraction in many application areas. In order to calculate surface reflectance from remotely measured radiance, radiative transfer codes play an important role for removal of the scattering and gaseous absorption effects of the atmosphere. The present study evaluates surface reflectances retrieved from airborne visible/infrared imaging spectrometer (AVIRIS) data using three radiative transfer codes: modified 5S (M5S), 6S, and MODTRAN2. Comparisons of the retrieved surface reflectance with ground-based reflectance were made for different target types such as asphalt, gravel, grass/soil mixture (soccer field), and water (Sooke Lake). The results indicate that the estimation of the atmospheric water vapor content is important for an accurate surface reflectance retrieval regardless of the radiative transfer code used. For the present atmospheric conditions, a difference of 0.1 in aerosol optical depth had little impact on the retrieved surface reflectance. The performance of MODTRAN2 is superior in the gas absorption regions compared to M5S and 6S.

TRECVID: the utility of a content-based video retrieval evaluation

NASA Astrophysics Data System (ADS)

Hauptmann, Alexander G.

2006-01-01

TRECVID, an annual retrieval evaluation benchmark organized by NIST, encourages research in information retrieval from digital video. TRECVID benchmarking covers both interactive and manual searching by end users, as well as the benchmarking of some supporting technologies including shot boundary detection, extraction of semantic features, and the automatic segmentation of TV news broadcasts. Evaluations done in the context of the TRECVID benchmarks show that generally, speech transcripts and annotations provide the single most important clue for successful retrieval. However, automatically finding the individual images is still a tremendous and unsolved challenge. The evaluations repeatedly found that none of the multimedia analysis and retrieval techniques provide a significant benefit over retrieval using only textual information such as from automatic speech recognition transcripts or closed captions. In interactive systems, we do find significant differences among the top systems, indicating that interfaces can make a huge difference for effective video/image search. For interactive tasks efficient interfaces require few key clicks, but display large numbers of images for visual inspection by the user. The text search finds the right context region in the video in general, but to select specific relevant images we need good interfaces to easily browse the storyboard pictures. In general, TRECVID has motivated the video retrieval community to be honest about what we don't know how to do well (sometimes through painful failures), and has focused us to work on the actual task of video retrieval, as opposed to flashy demos based on technological capabilities.

Satellite retrievals of Karenia brevis harmful algal blooms in the West Florida shelf using neural networks and impacts of temporal variabilities

NASA Astrophysics Data System (ADS)

El-Habashi, Ahmed; Duran, Claudia M.; Lovko, Vincent; Tomlinson, Michelle C.; Stumpf, Richard P.; Ahmed, Sam

2017-07-01

We apply a neural network (NN) technique to detect/track Karenia brevis harmful algal blooms (KB HABs) plaguing West Florida shelf (WFS) coasts from Visible-Infrared Imaging Radiometer Suite (VIIRS) satellite observations. Previously KB HABs detection primarily relied on the Moderate Resolution Imaging Spectroradiometer Aqua (MODIS-A) satellite, depending on its remote sensing reflectance signal at the 678-nm chlorophyll fluorescence band (Rrs678) needed for normalized fluorescence height and related red band difference retrieval algorithms. VIIRS, MODIS-A's successor, does not have a 678-nm channel. Instead, our NN uses Rrs at 486-, 551-, and 671-nm VIIRS channels to retrieve phytoplankton absorption at 443 nm (a). The retrieved a images are next filtered by applying limits, defined by (i) low Rrs551-nm backscatter and (ii) a minimum a value associated with KB HABs. The filtered residual images are then converted to show chlorophyll-a concentrations [Chla] and KB cell counts. VIIRS retrievals using our NN and five other retrieval algorithms were compared and evaluated against numerous in situ measurements made over the four-year 2012 to 2016 period, for which VIIRS data are available. These comparisons confirm the viability and higher retrieval accuracies of the NN technique, when combined with the filtering constraints, for effective detection of KB HABs. Analysis of these results as well as sequential satellite observations and recent field measurements underline the importance of short-term temporal variabilities on retrieval accuracies.

Learning Short Binary Codes for Large-scale Image Retrieval.

PubMed

Liu, Li; Yu, Mengyang; Shao, Ling

2017-03-01

Large-scale visual information retrieval has become an active research area in this big data era. Recently, hashing/binary coding algorithms prove to be effective for scalable retrieval applications. Most existing hashing methods require relatively long binary codes (i.e., over hundreds of bits, sometimes even thousands of bits) to achieve reasonable retrieval accuracies. However, for some realistic and unique applications, such as on wearable or mobile devices, only short binary codes can be used for efficient image retrieval due to the limitation of computational resources or bandwidth on these devices. In this paper, we propose a novel unsupervised hashing approach called min-cost ranking (MCR) specifically for learning powerful short binary codes (i.e., usually the code length shorter than 100 b) for scalable image retrieval tasks. By exploring the discriminative ability of each dimension of data, MCR can generate one bit binary code for each dimension and simultaneously rank the discriminative separability of each bit according to the proposed cost function. Only top-ranked bits with minimum cost-values are then selected and grouped together to compose the final salient binary codes. Extensive experimental results on large-scale retrieval demonstrate that MCR can achieve comparative performance as the state-of-the-art hashing algorithms but with significantly shorter codes, leading to much faster large-scale retrieval.

Document image retrieval through word shape coding.

PubMed

Lu, Shijian; Li, Linlin; Tan, Chew Lim

2008-11-01

This paper presents a document retrieval technique that is capable of searching document images without OCR (optical character recognition). The proposed technique retrieves document images by a new word shape coding scheme, which captures the document content through annotating each word image by a word shape code. In particular, we annotate word images by using a set of topological shape features including character ascenders/descenders, character holes, and character water reservoirs. With the annotated word shape codes, document images can be retrieved by either query keywords or a query document image. Experimental results show that the proposed document image retrieval technique is fast, efficient, and tolerant to various types of document degradation.

Similarity estimation for reference image retrieval in mammograms using convolutional neural network

NASA Astrophysics Data System (ADS)

Muramatsu, Chisako; Higuchi, Shunichi; Morita, Takako; Oiwa, Mikinao; Fujita, Hiroshi

2018-02-01

Periodic breast cancer screening with mammography is considered effective in decreasing breast cancer mortality. For screening programs to be successful, an intelligent image analytic system may support radiologists' efficient image interpretation. In our previous studies, we have investigated image retrieval schemes for diagnostic references of breast lesions on mammograms and ultrasound images. Using a machine learning method, reliable similarity measures that agree with radiologists' similarity were determined and relevant images could be retrieved. However, our previous method includes a feature extraction step, in which hand crafted features were determined based on manual outlines of the masses. Obtaining the manual outlines of masses is not practical in clinical practice and such data would be operator-dependent. In this study, we investigated a similarity estimation scheme using a convolutional neural network (CNN) to skip such procedure and to determine data-driven similarity scores. By using CNN as feature extractor, in which extracted features were employed in determination of similarity measures with a conventional 3-layered neural network, the determined similarity measures were correlated well with the subjective ratings and the precision of retrieving diagnostically relevant images was comparable with that of the conventional method using handcrafted features. By using CNN for determination of similarity measure directly, the result was also comparable. By optimizing the network parameters, results may be further improved. The proposed method has a potential usefulness in determination of similarity measure without precise lesion outlines for retrieval of similar mass images on mammograms.

A unified framework of image latent feature learning on Sina microblog

NASA Astrophysics Data System (ADS)

Wei, Jinjin; Jin, Zhigang; Zhou, Yuan; Zhang, Rui

2015-10-01

Large-scale user-contributed images with texts are rapidly increasing on the social media websites, such as Sina microblog. However, the noise and incomplete correspondence between the images and the texts give rise to the difficulty in precise image retrieval and ranking. In this paper, a hypergraph-based learning framework is proposed for image ranking, which simultaneously utilizes visual feature, textual content and social link information to estimate the relevance between images. Representing each image as a vertex in the hypergraph, complex relationship between images can be reflected exactly. Then updating the weight of hyperedges throughout the hypergraph learning process, the effect of different edges can be adaptively modulated in the constructed hypergraph. Furthermore, the popularity degree of the image is employed to re-rank the retrieval results. Comparative experiments on a large-scale Sina microblog data-set demonstrate the effectiveness of the proposed approach.

Research on image retrieval using deep convolutional neural network combining L1 regularization and PRelu activation function

NASA Astrophysics Data System (ADS)

QingJie, Wei; WenBin, Wang

2017-06-01

In this paper, the image retrieval using deep convolutional neural network combined with regularization and PRelu activation function is studied, and improves image retrieval accuracy. Deep convolutional neural network can not only simulate the process of human brain to receive and transmit information, but also contains a convolution operation, which is very suitable for processing images. Using deep convolutional neural network is better than direct extraction of image visual features for image retrieval. However, the structure of deep convolutional neural network is complex, and it is easy to over-fitting and reduces the accuracy of image retrieval. In this paper, we combine L1 regularization and PRelu activation function to construct a deep convolutional neural network to prevent over-fitting of the network and improve the accuracy of image retrieval

Textile Retrieval Based on Image Content from CDC and Webcam Cameras in Indoor Environments.

PubMed

García-Olalla, Oscar; Alegre, Enrique; Fernández-Robles, Laura; Fidalgo, Eduardo; Saikia, Surajit

2018-04-25

Textile based image retrieval for indoor environments can be used to retrieve images that contain the same textile, which may indicate that scenes are related. This makes up a useful approach for law enforcement agencies who want to find evidence based on matching between textiles. In this paper, we propose a novel pipeline that allows searching and retrieving textiles that appear in pictures of real scenes. Our approach is based on first obtaining regions containing textiles by using MSER on high pass filtered images of the RGB, HSV and Hue channels of the original photo. To describe the textile regions, we demonstrated that the combination of HOG and HCLOSIB is the best option for our proposal when using the correlation distance to match the query textile patch with the candidate regions. Furthermore, we introduce a new dataset, TextilTube, which comprises a total of 1913 textile regions labelled within 67 classes. We yielded 84.94% of success in the 40 nearest coincidences and 37.44% of precision taking into account just the first coincidence, which outperforms the current deep learning methods evaluated. Experimental results show that this pipeline can be used to set up an effective textile based image retrieval system in indoor environments.

Textile Retrieval Based on Image Content from CDC and Webcam Cameras in Indoor Environments

PubMed Central

García-Olalla, Oscar; Saikia, Surajit

2018-01-01

Textile based image retrieval for indoor environments can be used to retrieve images that contain the same textile, which may indicate that scenes are related. This makes up a useful approach for law enforcement agencies who want to find evidence based on matching between textiles. In this paper, we propose a novel pipeline that allows searching and retrieving textiles that appear in pictures of real scenes. Our approach is based on first obtaining regions containing textiles by using MSER on high pass filtered images of the RGB, HSV and Hue channels of the original photo. To describe the textile regions, we demonstrated that the combination of HOG and HCLOSIB is the best option for our proposal when using the correlation distance to match the query textile patch with the candidate regions. Furthermore, we introduce a new dataset, TextilTube, which comprises a total of 1913 textile regions labelled within 67 classes. We yielded 84.94% of success in the 40 nearest coincidences and 37.44% of precision taking into account just the first coincidence, which outperforms the current deep learning methods evaluated. Experimental results show that this pipeline can be used to set up an effective textile based image retrieval system in indoor environments. PMID:29693590

Facing the phase problem in Coherent Diffractive Imaging via Memetic Algorithms.

PubMed

Colombo, Alessandro; Galli, Davide Emilio; De Caro, Liberato; Scattarella, Francesco; Carlino, Elvio

2017-02-09

Coherent Diffractive Imaging is a lensless technique that allows imaging of matter at a spatial resolution not limited by lens aberrations. This technique exploits the measured diffraction pattern of a coherent beam scattered by periodic and non-periodic objects to retrieve spatial information. The diffracted intensity, for weak-scattering objects, is proportional to the modulus of the Fourier Transform of the object scattering function. Any phase information, needed to retrieve its scattering function, has to be retrieved by means of suitable algorithms. Here we present a new approach, based on a memetic algorithm, i.e. a hybrid genetic algorithm, to face the phase problem, which exploits the synergy of deterministic and stochastic optimization methods. The new approach has been tested on simulated data and applied to the phasing of transmission electron microscopy coherent electron diffraction data of a SrTiO 3 sample. We have been able to quantitatively retrieve the projected atomic potential, and also image the oxygen columns, which are not directly visible in the relevant high-resolution transmission electron microscopy images. Our approach proves to be a new powerful tool for the study of matter at atomic resolution and opens new perspectives in those applications in which effective phase retrieval is necessary.

Integrating user profile in medical CBIR systems to answer perceptual similarity queries

NASA Astrophysics Data System (ADS)

Bugatti, Pedro H.; Kaster, Daniel S.; Ponciano-Silva, Marcelo; Traina, Agma J. M.; Traina, Caetano, Jr.

2011-03-01

Techniques for Content-Based Image Retrieval (CBIR) have been intensively explored due to the increase in the amount of captured images and the need of fast retrieval of them. The medical field is a specific example that generates a large flow of information, especially digital images employed for diagnosing. One issue that still remains unsolved deals with how to reach the perceptual similarity. That is, to achieve an effective retrieval, one must characterize and quantify the perceptual similarity regarding the specialist in the field. Therefore, the present paper was conceived to fill in this gap creating a consistent support to perform similarity queries over medical images, maintaining the semantics of a given query desired by the user. CBIR systems relying in relevance feedback techniques usually request the users to label relevant images. In this paper, we present a simple but highly effective strategy to survey user profiles, taking advantage of such labeling to implicitly gather the user perceptual similarity. The user profiles maintain the settings desired for each user, allowing tuning the similarity assessment, which encompasses dynamically changing the distance function employed through an interactive process. Experiments using computed tomography lung images show that the proposed approach is effective in capturing the users' perception.

Combining textual and visual information for image retrieval in the medical domain.

PubMed

Gkoufas, Yiannis; Morou, Anna; Kalamboukis, Theodore

2011-01-01

In this article we have assembled the experience obtained from our participation in the imageCLEF evaluation task over the past two years. Exploitation on the use of linear combinations for image retrieval has been attempted by combining visual and textual sources of images. From our experiments we conclude that a mixed retrieval technique that applies both textual and visual retrieval in an interchangeably repeated manner improves the performance while overcoming the scalability limitations of visual retrieval. In particular, the mean average precision (MAP) has increased from 0.01 to 0.15 and 0.087 for 2009 and 2010 data, respectively, when content-based image retrieval (CBIR) is performed on the top 1000 results from textual retrieval based on natural language processing (NLP).

A boosting framework for visuality-preserving distance metric learning and its application to medical image retrieval.

PubMed

Yang, Liu; Jin, Rong; Mummert, Lily; Sukthankar, Rahul; Goode, Adam; Zheng, Bin; Hoi, Steven C H; Satyanarayanan, Mahadev

2010-01-01

Similarity measurement is a critical component in content-based image retrieval systems, and learning a good distance metric can significantly improve retrieval performance. However, despite extensive study, there are several major shortcomings with the existing approaches for distance metric learning that can significantly affect their application to medical image retrieval. In particular, "similarity" can mean very different things in image retrieval: resemblance in visual appearance (e.g., two images that look like one another) or similarity in semantic annotation (e.g., two images of tumors that look quite different yet are both malignant). Current approaches for distance metric learning typically address only one goal without consideration of the other. This is problematic for medical image retrieval where the goal is to assist doctors in decision making. In these applications, given a query image, the goal is to retrieve similar images from a reference library whose semantic annotations could provide the medical professional with greater insight into the possible interpretations of the query image. If the system were to retrieve images that did not look like the query, then users would be less likely to trust the system; on the other hand, retrieving images that appear superficially similar to the query but are semantically unrelated is undesirable because that could lead users toward an incorrect diagnosis. Hence, learning a distance metric that preserves both visual resemblance and semantic similarity is important. We emphasize that, although our study is focused on medical image retrieval, the problem addressed in this work is critical to many image retrieval systems. We present a boosting framework for distance metric learning that aims to preserve both visual and semantic similarities. The boosting framework first learns a binary representation using side information, in the form of labeled pairs, and then computes the distance as a weighted Hamming distance using the learned binary representation. A boosting algorithm is presented to efficiently learn the distance function. We evaluate the proposed algorithm on a mammographic image reference library with an Interactive Search-Assisted Decision Support (ISADS) system and on the medical image data set from ImageCLEF. Our results show that the boosting framework compares favorably to state-of-the-art approaches for distance metric learning in retrieval accuracy, with much lower computational cost. Additional evaluation with the COREL collection shows that our algorithm works well for regular image data sets.

Left Posterior Parietal Cortex Participates in Both Task Preparation and Episodic Retrieval

PubMed Central

Phillips, Jeffrey S.; Velanova, Katerina; Wolk, David A.; Wheeler, Mark E.

2012-01-01

Optimal memory retrieval depends not only on the fidelity of stored information, but also on the attentional state of the subject. Factors such as mental preparedness to engage in stimulus processing can facilitate or hinder memory retrieval. The current study used functional magnetic resonance imaging (fMRI) to distinguish preparatory brain activity before episodic and semantic retrieval tasks from activity associated with retrieval itself. A catch-trial imaging paradigm permitted separation of neural responses to preparatory task cues and memory probes. Episodic and semantic task preparation engaged a common set of brain regions, including the bilateral intraparietal sulcus (IPS), left fusiform gyrus (FG), and the pre-supplementary motor area (pre-SMA). In the subsequent retrieval phase, the left IPS was among a set of frontoparietal regions that responded differently to old and new stimuli. In contrast, the right IPS responded to preparatory cues with little modulation during memory retrieval. The findings support a strong left-lateralization of retrieval success effects in left parietal cortex, and further indicate that left IPS performs operations that are common to both task preparation and memory retrieval. Such operations may be related to attentional control, monitoring of stimulus relevance, or retrieval. PMID:19285142

A new method of content based medical image retrieval and its applications to CT imaging sign retrieval.

PubMed

Ma, Ling; Liu, Xiabi; Gao, Yan; Zhao, Yanfeng; Zhao, Xinming; Zhou, Chunwu

2017-02-01

This paper proposes a new method of content based medical image retrieval through considering fused, context-sensitive similarity. Firstly, we fuse the semantic and visual similarities between the query image and each image in the database as their pairwise similarities. Then, we construct a weighted graph whose nodes represent the images and edges measure their pairwise similarities. By using the shortest path algorithm over the weighted graph, we obtain a new similarity measure, context-sensitive similarity measure, between the query image and each database image to complete the retrieval process. Actually, we use the fused pairwise similarity to narrow down the semantic gap for obtaining a more accurate pairwise similarity measure, and spread it on the intrinsic data manifold to achieve the context-sensitive similarity for a better retrieval performance. The proposed method has been evaluated on the retrieval of the Common CT Imaging Signs of Lung Diseases (CISLs) and achieved not only better retrieval results but also the satisfactory computation efficiency. Copyright © 2017 Elsevier Inc. All rights reserved.

A hierarchical SVG image abstraction layer for medical imaging

NASA Astrophysics Data System (ADS)

Kim, Edward; Huang, Xiaolei; Tan, Gang; Long, L. Rodney; Antani, Sameer

2010-03-01

As medical imaging rapidly expands, there is an increasing need to structure and organize image data for efficient analysis, storage and retrieval. In response, a large fraction of research in the areas of content-based image retrieval (CBIR) and picture archiving and communication systems (PACS) has focused on structuring information to bridge the "semantic gap", a disparity between machine and human image understanding. An additional consideration in medical images is the organization and integration of clinical diagnostic information. As a step towards bridging the semantic gap, we design and implement a hierarchical image abstraction layer using an XML based language, Scalable Vector Graphics (SVG). Our method encodes features from the raw image and clinical information into an extensible "layer" that can be stored in a SVG document and efficiently searched. Any feature extracted from the raw image including, color, texture, orientation, size, neighbor information, etc., can be combined in our abstraction with high level descriptions or classifications. And our representation can natively characterize an image in a hierarchical tree structure to support multiple levels of segmentation. Furthermore, being a world wide web consortium (W3C) standard, SVG is able to be displayed by most web browsers, interacted with by ECMAScript (standardized scripting language, e.g. JavaScript, JScript), and indexed and retrieved by XML databases and XQuery. Using these open source technologies enables straightforward integration into existing systems. From our results, we show that the flexibility and extensibility of our abstraction facilitates effective storage and retrieval of medical images.

An imager-based multispectral retrieval of above-cloud absorbing aerosol optical depth and the optical and microphysical properties of underlying marine stratocumulus clouds

NASA Astrophysics Data System (ADS)

Meyer, K.; Platnick, S. E.; Zhang, Z.

2014-12-01

Clouds, aerosols, and their interactions are widely considered to be key uncertainty components in our current understanding of the Earth's atmosphere and radiation budget. The work presented here is focused on the quasi-permanent marine boundary layer (MBL) clouds over the southeastern Atlantic Ocean, which underlie a near-persistent smoke layer produced from extensive biomass burning throughout the southern African savanna during austral winter. The absorption of the above-cloud smoke layer, which increases with decreasing wavelength, can introduce biases into imager-based cloud optical and microphysical property retrievals of the underlying MBL clouds. This effect is more pronounced for cloud optical thickness retrievals, which are typically derived from the visible or near-IR wavelength channels (effective particle size retrievals are derived from short and mid-wave IR channels that are less affected by aerosol absorption). Here, a new method is introduced to simultaneously retrieve the above-cloud smoke aerosol optical depth (AOD) and the unbiased cloud optical thickness (COT) and effective radius (CER) using multiple spectral channels in the visible and near- and shortwave-IR. The technique has been applied to MODIS, and retrieval results and statistics, as well as comparisons with other A-Train sensors, are shown.

Enhancements in medicine by integrating content based image retrieval in computer-aided diagnosis

NASA Astrophysics Data System (ADS)

Aggarwal, Preeti; Sardana, H. K.

2010-02-01

Computer-aided diagnosis (CAD) has become one of the major research subjects in medical imaging and diagnostic radiology. With cad, radiologists use the computer output as a "second opinion" and make the final decisions. Retrieving images is a useful tool to help radiologist to check medical image and diagnosis. The impact of contentbased access to medical images is frequently reported but existing systems are designed for only a particular context of diagnosis. The challenge in medical informatics is to develop tools for analyzing the content of medical images and to represent them in a way that can be efficiently searched and compared by the physicians. CAD is a concept established by taking into account equally the roles of physicians and computers. To build a successful computer aided diagnostic system, all the relevant technologies, especially retrieval need to be integrated in such a manner that should provide effective and efficient pre-diagnosed cases with proven pathology for the current case at the right time. In this paper, it is suggested that integration of content-based image retrieval (CBIR) in cad can bring enormous results in medicine especially in diagnosis. This approach is also compared with other approaches by highlighting its advantages over those approaches.

Broadband Phase Retrieval for Image-Based Wavefront Sensing

NASA Technical Reports Server (NTRS)

Dean, Bruce H.

2007-01-01

A focus-diverse phase-retrieval algorithm has been shown to perform adequately for the purpose of image-based wavefront sensing when (1) broadband light (typically spanning the visible spectrum) is used in forming the images by use of an optical system under test and (2) the assumption of monochromaticity is applied to the broadband image data. Heretofore, it had been assumed that in order to obtain adequate performance, it is necessary to use narrowband or monochromatic light. Some background information, including definitions of terms and a brief description of pertinent aspects of image-based phase retrieval, is prerequisite to a meaningful summary of the present development. Phase retrieval is a general term used in optics to denote estimation of optical imperfections or aberrations of an optical system under test. The term image-based wavefront sensing refers to a general class of algorithms that recover optical phase information, and phase-retrieval algorithms constitute a subset of this class. In phase retrieval, one utilizes the measured response of the optical system under test to produce a phase estimate. The optical response of the system is defined as the image of a point-source object, which could be a star or a laboratory point source. The phase-retrieval problem is characterized as image-based in the sense that a charge-coupled-device camera, preferably of scientific imaging quality, is used to collect image data where the optical system would normally form an image. In a variant of phase retrieval, denoted phase-diverse phase retrieval [which can include focus-diverse phase retrieval (in which various defocus planes are used)], an additional known aberration (or an equivalent diversity function) is superimposed as an aid in estimating unknown aberrations by use of an image-based wavefront-sensing algorithm. Image-based phase-retrieval differs from such other wavefront-sensing methods, such as interferometry, shearing interferometry, curvature wavefront sensing, and Shack-Hartmann sensing, all of which entail disadvantages in comparison with image-based methods. The main disadvantages of these non-image based methods are complexity of test equipment and the need for a wavefront reference.

Improved image retrieval based on fuzzy colour feature vector

NASA Astrophysics Data System (ADS)

Ben-Ahmeida, Ahlam M.; Ben Sasi, Ahmed Y.

2013-03-01

One of Image indexing techniques is the Content-Based Image Retrieval which is an efficient way for retrieving images from the image database automatically based on their visual contents such as colour, texture, and shape. In this paper will be discuss how using content-based image retrieval (CBIR) method by colour feature extraction and similarity checking. By dividing the query image and all images in the database into pieces and extract the features of each part separately and comparing the corresponding portions in order to increase the accuracy in the retrieval. The proposed approach is based on the use of fuzzy sets, to overcome the problem of curse of dimensionality. The contribution of colour of each pixel is associated to all the bins in the histogram using fuzzy-set membership functions. As a result, the Fuzzy Colour Histogram (FCH), outperformed the Conventional Colour Histogram (CCH) in image retrieving, due to its speedy results, where were images represented as signatures that took less size of memory, depending on the number of divisions. The results also showed that FCH is less sensitive and more robust to brightness changes than the CCH with better retrieval recall values.

Relevance feedback for CBIR: a new approach based on probabilistic feature weighting with positive and negative examples.

PubMed

Kherfi, Mohammed Lamine; Ziou, Djemel

2006-04-01

In content-based image retrieval, understanding the user's needs is a challenging task that requires integrating him in the process of retrieval. Relevance feedback (RF) has proven to be an effective tool for taking the user's judgement into account. In this paper, we present a new RF framework based on a feature selection algorithm that nicely combines the advantages of a probabilistic formulation with those of using both the positive example (PE) and the negative example (NE). Through interaction with the user, our algorithm learns the importance he assigns to image features, and then applies the results obtained to define similarity measures that correspond better to his judgement. The use of the NE allows images undesired by the user to be discarded, thereby improving retrieval accuracy. As for the probabilistic formulation of the problem, it presents a multitude of advantages and opens the door to more modeling possibilities that achieve a good feature selection. It makes it possible to cluster the query data into classes, choose the probability law that best models each class, model missing data, and support queries with multiple PE and/or NE classes. The basic principle of our algorithm is to assign more importance to features with a high likelihood and those which distinguish well between PE classes and NE classes. The proposed algorithm was validated separately and in image retrieval context, and the experiments show that it performs a good feature selection and contributes to improving retrieval effectiveness.

Kingfisher: a system for remote sensing image database management

NASA Astrophysics Data System (ADS)

Bruzzo, Michele; Giordano, Ferdinando; Dellepiane, Silvana G.

2003-04-01

At present retrieval methods in remote sensing image database are mainly based on spatial-temporal information. The increasing amount of images to be collected by the ground station of earth observing systems emphasizes the need for database management with intelligent data retrieval capabilities. The purpose of the proposed method is to realize a new content based retrieval system for remote sensing images database with an innovative search tool based on image similarity. This methodology is quite innovative for this application, at present many systems exist for photographic images, as for example QBIC and IKONA, but they are not able to extract and describe properly remote image content. The target database is set by an archive of images originated from an X-SAR sensor (spaceborne mission, 1994). The best content descriptors, mainly texture parameters, guarantees high retrieval performances and can be extracted without losses independently of image resolution. The latter property allows DBMS (Database Management System) to process low amount of information, as in the case of quick-look images, improving time performance and memory access without reducing retrieval accuracy. The matching technique has been designed to enable image management (database population and retrieval) independently of dimensions (width and height). Local and global content descriptors are compared, during retrieval phase, with the query image and results seem to be very encouraging.

A framework for medical image retrieval using machine learning and statistical similarity matching techniques with relevance feedback.

PubMed

Rahman, Md Mahmudur; Bhattacharya, Prabir; Desai, Bipin C

2007-01-01

A content-based image retrieval (CBIR) framework for diverse collection of medical images of different imaging modalities, anatomic regions with different orientations and biological systems is proposed. Organization of images in such a database (DB) is well defined with predefined semantic categories; hence, it can be useful for category-specific searching. The proposed framework consists of machine learning methods for image prefiltering, similarity matching using statistical distance measures, and a relevance feedback (RF) scheme. To narrow down the semantic gap and increase the retrieval efficiency, we investigate both supervised and unsupervised learning techniques to associate low-level global image features (e.g., color, texture, and edge) in the projected PCA-based eigenspace with their high-level semantic and visual categories. Specially, we explore the use of a probabilistic multiclass support vector machine (SVM) and fuzzy c-mean (FCM) clustering for categorization and prefiltering of images to reduce the search space. A category-specific statistical similarity matching is proposed in a finer level on the prefiltered images. To incorporate a better perception subjectivity, an RF mechanism is also added to update the query parameters dynamically and adjust the proposed matching functions. Experiments are based on a ground-truth DB consisting of 5000 diverse medical images of 20 predefined categories. Analysis of results based on cross-validation (CV) accuracy and precision-recall for image categorization and retrieval is reported. It demonstrates the improvement, effectiveness, and efficiency achieved by the proposed framework.

Eye movements reduce vividness and emotionality of "flashforwards".

PubMed

Engelhard, Iris M; van den Hout, Marcel A; Janssen, Wilco C; van der Beek, Jorinde

2010-05-01

Earlier studies have shown that eye movements during retrieval of disturbing images about past events reduce their vividness and emotionality, which may be due to both tasks competing for working memory resources. This study examined whether eye movements reduce vividness and emotionality of visual distressing images about feared future events: "flashforwards". A non-clinical sample was asked to select two images of feared future events, which were self-rated for vividness and emotionality. These images were retrieved while making eye movements or without a concurrent secondary task, and then vividness and emotionality were rated again. Relative to the no-dual task condition, eye movements while thinking of future-oriented images resulted in decreased ratings of image vividness and emotional intensity. Apparently, eye movements reduce vividness and emotionality of visual images about past and future feared events. This is in line with a working memory account of the beneficial effects of eye movements, which predicts that any task that taxes working memory during retrieval of disturbing mental images will be beneficial. Copyright 2010 Elsevier Ltd. All rights reserved.

Visual Based Retrieval Systems and Web Mining--Introduction.

ERIC Educational Resources Information Center

Iyengar, S. S.

2001-01-01

Briefly discusses Web mining and image retrieval techniques, and then presents a summary of articles in this special issue. Articles focus on Web content mining, artificial neural networks as tools for image retrieval, content-based image retrieval systems, and personalizing the Web browsing experience using media agents. (AEF)

A hierarchical storage management (HSM) scheme for cost-effective on-line archival using lossy compression.

PubMed

Avrin, D E; Andriole, K P; Yin, L; Gould, R G; Arenson, R L

2001-03-01

A hierarchical storage management (HSM) scheme for cost-effective on-line archival of image data using lossy compression is described. This HSM scheme also provides an off-site tape backup mechanism and disaster recovery. The full-resolution image data are viewed originally for primary diagnosis, then losslessly compressed and sent off site to a tape backup archive. In addition, the original data are wavelet lossy compressed (at approximately 25:1 for computed radiography, 10:1 for computed tomography, and 5:1 for magnetic resonance) and stored on a large RAID device for maximum cost-effective, on-line storage and immediate retrieval of images for review and comparison. This HSM scheme provides a solution to 4 problems in image archiving, namely cost-effective on-line storage, disaster recovery of data, off-site tape backup for the legal record, and maximum intermediate storage and retrieval through the use of on-site lossy compression.

Comparing the quality of accessing medical literature using content-based visual and textual information retrieval

NASA Astrophysics Data System (ADS)

Müller, Henning; Kalpathy-Cramer, Jayashree; Kahn, Charles E., Jr.; Hersh, William

2009-02-01

Content-based visual information (or image) retrieval (CBIR) has been an extremely active research domain within medical imaging over the past ten years, with the goal of improving the management of visual medical information. Many technical solutions have been proposed, and application scenarios for image retrieval as well as image classification have been set up. However, in contrast to medical information retrieval using textual methods, visual retrieval has only rarely been applied in clinical practice. This is despite the large amount and variety of visual information produced in hospitals every day. This information overload imposes a significant burden upon clinicians, and CBIR technologies have the potential to help the situation. However, in order for CBIR to become an accepted clinical tool, it must demonstrate a higher level of technical maturity than it has to date. Since 2004, the ImageCLEF benchmark has included a task for the comparison of visual information retrieval algorithms for medical applications. In 2005, a task for medical image classification was introduced and both tasks have been run successfully for the past four years. These benchmarks allow an annual comparison of visual retrieval techniques based on the same data sets and the same query tasks, enabling the meaningful comparison of various retrieval techniques. The datasets used from 2004-2007 contained images and annotations from medical teaching files. In 2008, however, the dataset used was made up of 67,000 images (along with their associated figure captions and the full text of their corresponding articles) from two Radiological Society of North America (RSNA) scientific journals. This article describes the results of the medical image retrieval task of the ImageCLEF 2008 evaluation campaign. We compare the retrieval results of both visual and textual information retrieval systems from 15 research groups on the aforementioned data set. The results show clearly that, currently, visual retrieval alone does not achieve the performance necessary for real-world clinical applications. Most of the common visual retrieval techniques have a MAP (Mean Average Precision) of around 2-3%, which is much lower than that achieved using textual retrieval (MAP=29%). Advanced machine learning techniques, together with good training data, have been shown to improve the performance of visual retrieval systems in the past. Multimodal retrieval (basing retrieval on both visual and textual information) can achieve better results than purely visual, but only when carefully applied. In many cases, multimodal retrieval systems performed even worse than purely textual retrieval systems. On the other hand, some multimodal retrieval systems demonstrated significantly increased early precision, which has been shown to be a desirable behavior in real-world systems.

An effective content-based image retrieval technique for image visuals representation based on the bag-of-visual-words model

PubMed Central

Jabeen, Safia; Mehmood, Zahid; Mahmood, Toqeer; Saba, Tanzila; Rehman, Amjad; Mahmood, Muhammad Tariq

2018-01-01

For the last three decades, content-based image retrieval (CBIR) has been an active research area, representing a viable solution for retrieving similar images from an image repository. In this article, we propose a novel CBIR technique based on the visual words fusion of speeded-up robust features (SURF) and fast retina keypoint (FREAK) feature descriptors. SURF is a sparse descriptor whereas FREAK is a dense descriptor. Moreover, SURF is a scale and rotation-invariant descriptor that performs better in the case of repeatability, distinctiveness, and robustness. It is robust to noise, detection errors, geometric, and photometric deformations. It also performs better at low illumination within an image as compared to the FREAK descriptor. In contrast, FREAK is a retina-inspired speedy descriptor that performs better for classification-based problems as compared to the SURF descriptor. Experimental results show that the proposed technique based on the visual words fusion of SURF-FREAK descriptors combines the features of both descriptors and resolves the aforementioned issues. The qualitative and quantitative analysis performed on three image collections, namely Corel-1000, Corel-1500, and Caltech-256, shows that proposed technique based on visual words fusion significantly improved the performance of the CBIR as compared to the feature fusion of both descriptors and state-of-the-art image retrieval techniques. PMID:29694429

An effective content-based image retrieval technique for image visuals representation based on the bag-of-visual-words model.

PubMed

Jabeen, Safia; Mehmood, Zahid; Mahmood, Toqeer; Saba, Tanzila; Rehman, Amjad; Mahmood, Muhammad Tariq

2018-01-01

For the last three decades, content-based image retrieval (CBIR) has been an active research area, representing a viable solution for retrieving similar images from an image repository. In this article, we propose a novel CBIR technique based on the visual words fusion of speeded-up robust features (SURF) and fast retina keypoint (FREAK) feature descriptors. SURF is a sparse descriptor whereas FREAK is a dense descriptor. Moreover, SURF is a scale and rotation-invariant descriptor that performs better in the case of repeatability, distinctiveness, and robustness. It is robust to noise, detection errors, geometric, and photometric deformations. It also performs better at low illumination within an image as compared to the FREAK descriptor. In contrast, FREAK is a retina-inspired speedy descriptor that performs better for classification-based problems as compared to the SURF descriptor. Experimental results show that the proposed technique based on the visual words fusion of SURF-FREAK descriptors combines the features of both descriptors and resolves the aforementioned issues. The qualitative and quantitative analysis performed on three image collections, namely Corel-1000, Corel-1500, and Caltech-256, shows that proposed technique based on visual words fusion significantly improved the performance of the CBIR as compared to the feature fusion of both descriptors and state-of-the-art image retrieval techniques.

A Query Expansion Framework in Image Retrieval Domain Based on Local and Global Analysis

PubMed Central

Rahman, M. M.; Antani, S. K.; Thoma, G. R.

2011-01-01

We present an image retrieval framework based on automatic query expansion in a concept feature space by generalizing the vector space model of information retrieval. In this framework, images are represented by vectors of weighted concepts similar to the keyword-based representation used in text retrieval. To generate the concept vocabularies, a statistical model is built by utilizing Support Vector Machine (SVM)-based classification techniques. The images are represented as “bag of concepts” that comprise perceptually and/or semantically distinguishable color and texture patches from local image regions in a multi-dimensional feature space. To explore the correlation between the concepts and overcome the assumption of feature independence in this model, we propose query expansion techniques in the image domain from a new perspective based on both local and global analysis. For the local analysis, the correlations between the concepts based on the co-occurrence pattern, and the metrical constraints based on the neighborhood proximity between the concepts in encoded images, are analyzed by considering local feedback information. We also analyze the concept similarities in the collection as a whole in the form of a similarity thesaurus and propose an efficient query expansion based on the global analysis. The experimental results on a photographic collection of natural scenes and a biomedical database of different imaging modalities demonstrate the effectiveness of the proposed framework in terms of precision and recall. PMID:21822350

Qualification of a Null Lens Using Image-Based Phase Retrieval

NASA Technical Reports Server (NTRS)

Bolcar, Matthew R.; Aronstein, David L.; Hill, Peter C.; Smith, J. Scott; Zielinski, Thomas P.

2012-01-01

In measuring the figure error of an aspheric optic using a null lens, the wavefront contribution from the null lens must be independently and accurately characterized in order to isolate the optical performance of the aspheric optic alone. Various techniques can be used to characterize such a null lens, including interferometry, profilometry and image-based methods. Only image-based methods, such as phase retrieval, can measure the null-lens wavefront in situ - in single-pass, and at the same conjugates and in the same alignment state in which the null lens will ultimately be used - with no additional optical components. Due to the intended purpose of a Dull lens (e.g., to null a large aspheric wavefront with a near-equal-but-opposite spherical wavefront), characterizing a null-lens wavefront presents several challenges to image-based phase retrieval: Large wavefront slopes and high-dynamic-range data decrease the capture range of phase-retrieval algorithms, increase the requirements on the fidelity of the forward model of the optical system, and make it difficult to extract diagnostic information (e.g., the system F/#) from the image data. In this paper, we present a study of these effects on phase-retrieval algorithms in the context of a null lens used in component development for the Climate Absolute Radiance and Refractivity Observatory (CLARREO) mission. Approaches for mitigation are also discussed.

Medical image retrieval system using multiple features from 3D ROIs

NASA Astrophysics Data System (ADS)

Lu, Hongbing; Wang, Weiwei; Liao, Qimei; Zhang, Guopeng; Zhou, Zhiming

2012-02-01

Compared to a retrieval using global image features, features extracted from regions of interest (ROIs) that reflect distribution patterns of abnormalities would benefit more for content-based medical image retrieval (CBMIR) systems. Currently, most CBMIR systems have been designed for 2D ROIs, which cannot reflect 3D anatomical features and region distribution of lesions comprehensively. To further improve the accuracy of image retrieval, we proposed a retrieval method with 3D features including both geometric features such as Shape Index (SI) and Curvedness (CV) and texture features derived from 3D Gray Level Co-occurrence Matrix, which were extracted from 3D ROIs, based on our previous 2D medical images retrieval system. The system was evaluated with 20 volume CT datasets for colon polyp detection. Preliminary experiments indicated that the integration of morphological features with texture features could improve retrieval performance greatly. The retrieval result using features extracted from 3D ROIs accorded better with the diagnosis from optical colonoscopy than that based on features from 2D ROIs. With the test database of images, the average accuracy rate for 3D retrieval method was 76.6%, indicating its potential value in clinical application.

Evaluating performance of biomedical image retrieval systems – an overview of the medical image retrieval task at ImageCLEF 2004–2013

PubMed Central

Kalpathy-Cramer, Jayashree; de Herrera, Alba García Seco; Demner-Fushman, Dina; Antani, Sameer; Bedrick, Steven; Müller, Henning

2014-01-01

Medical image retrieval and classification have been extremely active research topics over the past 15 years. With the ImageCLEF benchmark in medical image retrieval and classification a standard test bed was created that allows researchers to compare their approaches and ideas on increasingly large and varied data sets including generated ground truth. This article describes the lessons learned in ten evaluations campaigns. A detailed analysis of the data also highlights the value of the resources created. PMID:24746250

Multiple Object Retrieval in Image Databases Using Hierarchical Segmentation Tree

ERIC Educational Resources Information Center

Chen, Wei-Bang

2012-01-01

The purpose of this research is to develop a new visual information analysis, representation, and retrieval framework for automatic discovery of salient objects of user's interest in large-scale image databases. In particular, this dissertation describes a content-based image retrieval framework which supports multiple-object retrieval. The…

Object-Location-Aware Hashing for Multi-Label Image Retrieval via Automatic Mask Learning.

PubMed

Huang, Chang-Qin; Yang, Shang-Ming; Pan, Yan; Lai, Han-Jiang

2018-09-01

Learning-based hashing is a leading approach of approximate nearest neighbor search for large-scale image retrieval. In this paper, we develop a deep supervised hashing method for multi-label image retrieval, in which we propose to learn a binary "mask" map that can identify the approximate locations of objects in an image, so that we use this binary "mask" map to obtain length-limited hash codes which mainly focus on an image's objects but ignore the background. The proposed deep architecture consists of four parts: 1) a convolutional sub-network to generate effective image features; 2) a binary "mask" sub-network to identify image objects' approximate locations; 3) a weighted average pooling operation based on the binary "mask" to obtain feature representations and hash codes that pay most attention to foreground objects but ignore the background; and 4) the combination of a triplet ranking loss designed to preserve relative similarities among images and a cross entropy loss defined on image labels. We conduct comprehensive evaluations on four multi-label image data sets. The results indicate that the proposed hashing method achieves superior performance gains over the state-of-the-art supervised or unsupervised hashing baselines.

Cloud Liquid Water Path Comparisons from Passive Microwave and Solar Reflectance Satellite Measurements: Assessment of Sub-Field-of-View Cloud Effects in Microwave Retrievals

NASA Technical Reports Server (NTRS)

Greenwald, Thomas J.; Christopher, Sundar A.; Chou, Joyce

1997-01-01

Satellite observations of the cloud liquid water path (LWP) are compared from special sensor microwave imager (SSM/I) measurements and GOES 8 imager solar reflectance (SR) measurements to ascertain the impact of sub-field-of-view (FOV) cloud effects on SSM/I 37 GHz retrievals. The SR retrievals also incorporate estimates of the cloud droplet effective radius derived from the GOES 8 3.9-micron channel. The comparisons consist of simultaneous collocated and full-resolution measurements and are limited to nonprecipitating marine stratocumulus in the eastern Pacific for two days in October 1995. The retrievals from these independent methods are consistent for overcast SSM/I FOVS, with RMS differences as low as 0.030 kg/sq m, although biases exist for clouds with more open spatial structure, where the RMS differences increase to 0.039 kg/sq m. For broken cloudiness within the SSM/I FOV the average beam-filling error (BFE) in the microwave retrievals is found to be about 22% (average cloud amount of 73%). This systematic error is comparable with the average random errors in the microwave retrievals. However, even larger BFEs can be expected for individual FOVs and for regions with less cloudiness. By scaling the microwave retrievals by the cloud amount within the FOV, the systematic BFE can be significantly reduced but with increased RMS differences of O.046-0.058 kg/sq m when compared to the SR retrievals. The beam-filling effects reported here are significant and are expected to impact directly upon studies that use instantaneous SSM/I measurements of cloud LWP, such as cloud classification studies and validation studies involving surface-based or in situ data.

Performance analysis of algorithms for retrieval of magnetic resonance images for interactive teleradiology

NASA Astrophysics Data System (ADS)

Atkins, M. Stella; Hwang, Robert; Tang, Simon

2001-05-01

We have implemented a prototype system consisting of a Java- based image viewer and a web server extension component for transmitting Magnetic Resonance Images (MRI) to an image viewer, to test the performance of different image retrieval techniques. We used full-resolution images, and images compressed/decompressed using the Set Partitioning in Hierarchical Trees (SPIHT) image compression algorithm. We examined the SPIHT decompression algorithm using both non- progressive and progressive transmission, focusing on the running times of the algorithm, client memory usage and garbage collection. We also compared the Java implementation with a native C++ implementation of the non- progressive SPIHT decompression variant. Our performance measurements showed that for uncompressed image retrieval using a 10Mbps Ethernet, a film of 16 MR images can be retrieved and displayed almost within interactive times. The native C++ code implementation of the client-side decoder is twice as fast as the Java decoder. If the network bandwidth is low, the high communication time for retrieving uncompressed images may be reduced by use of SPIHT-compressed images, although the image quality is then degraded. To provide diagnostic quality images, we also investigated the retrieval of up to 3 images on a MR film at full-resolution, using progressive SPIHT decompression. The Java-based implementation of progressive decompression performed badly, mainly due to the memory requirements for maintaining the image states, and the high cost of execution of the Java garbage collector. Hence, in systems where the bandwidth is high, such as found in a hospital intranet, SPIHT image compression does not provide advantages for image retrieval performance.

Image Re-Ranking Based on Topic Diversity.

PubMed

Qian, Xueming; Lu, Dan; Wang, Yaxiong; Zhu, Li; Tang, Yuan Yan; Wang, Meng

2017-08-01

Social media sharing Websites allow users to annotate images with free tags, which significantly contribute to the development of the web image retrieval. Tag-based image search is an important method to find images shared by users in social networks. However, how to make the top ranked result relevant and with diversity is challenging. In this paper, we propose a topic diverse ranking approach for tag-based image retrieval with the consideration of promoting the topic coverage performance. First, we construct a tag graph based on the similarity between each tag. Then, the community detection method is conducted to mine the topic community of each tag. After that, inter-community and intra-community ranking are introduced to obtain the final retrieved results. In the inter-community ranking process, an adaptive random walk model is employed to rank the community based on the multi-information of each topic community. Besides, we build an inverted index structure for images to accelerate the searching process. Experimental results on Flickr data set and NUS-Wide data sets show the effectiveness of the proposed approach.

Retrieving clinically relevant diabetic retinopathy images using a multi-class multiple-instance framework

NASA Astrophysics Data System (ADS)

Chandakkar, Parag S.; Venkatesan, Ragav; Li, Baoxin

2013-02-01

Diabetic retinopathy (DR) is a vision-threatening complication from diabetes mellitus, a medical condition that is rising globally. Unfortunately, many patients are unaware of this complication because of absence of symptoms. Regular screening of DR is necessary to detect the condition for timely treatment. Content-based image retrieval, using archived and diagnosed fundus (retinal) camera DR images can improve screening efficiency of DR. This content-based image retrieval study focuses on two DR clinical findings, microaneurysm and neovascularization, which are clinical signs of non-proliferative and proliferative diabetic retinopathy. The authors propose a multi-class multiple-instance image retrieval framework which deploys a modified color correlogram and statistics of steerable Gaussian Filter responses, for retrieving clinically relevant images from a database of DR fundus image database.

Dissociating neural markers of stimulus memorability and subjective recognition during episodic retrieval.

PubMed

Bainbridge, Wilma A; Rissman, Jesse

2018-06-06

While much of memory research takes an observer-centric focus looking at participant performance, recent work has pinpointed important item-centric effects on memory, or how intrinsically memorable a given stimulus is. However, little is known about the neural correlates of memorability during memory retrieval, or how such correlates relate to subjective memory behavior. Here, stimuli and blood-oxygen-level dependent data from a prior functional magnetic resonance imaging (fMRI) study were reanalyzed using a memorability-based framework. In that study, sixteen participants studied 200 novel face images and were scanned while making recognition memory judgments on those faces, interspersed with 200 unstudied faces. In the current investigation, memorability scores for those stimuli were obtained through an online crowd-sourced (N = 740) continuous recognition test that measured each image's corrected recognition rate. Representational similarity analyses were conducted across the brain to identify regions wherein neural pattern similarity tracked item-specific effects (stimulus memorability) versus observer-specific effects (individual memory performance). We find two non-overlapping sets of regions, with memorability-related information predominantly represented within ventral and medial temporal regions and memory retrieval outcome-related information within fronto-parietal regions. These memorability-based effects persist regardless of image history, implying that coding of stimulus memorability may be a continuous and automatic perceptual process.

Coupled retrieval of water cloud and above-cloud aerosol properties using the Airborne Multiangle SpectroPolarimetric Imager (AirMSPI)

NASA Astrophysics Data System (ADS)

Xu, F.; van Harten, G.; Diner, D. J.; Rheingans, B. E.; Tosca, M.; Seidel, F. C.; Bull, M. A.; Tkatcheva, I. N.; McDuffie, J. L.; Garay, M. J.; Davis, A. B.; Jovanovic, V. M.; Brian, C.; Alexandrov, M. D.; Hostetler, C. A.; Ferrare, R. A.; Burton, S. P.

2017-12-01

The Airborne Multiangle SpectroPolarimetric Imager (AirMSPI) has been flying aboard the NASA ER-2 high altitude aircraft since October 2010. AirMSPI acquires radiance and polarization data in bands centered at 355, 380, 445, 470*, 555, 660*, 865*, and 935 nm (*denotes polarimetric bands). In sweep mode, georectified images cover an area of 80-100 km (along track) by 10-25 km (across track) between ±66° off nadir, with a map-projected spatial resolution of 25 meters. An efficient and flexible retrieval algorithm has been developed using AirMSPI polarimetric bands for simultaneous retrieval of cloud and above-cloud aerosol microphysical properties. We design a three-step retrieval approach, namely 1) estimating effective droplet size distribution using polarimetric cloudbow observations and using it as initial guess for Step 2; 2) combining water cloud and aerosol above cloud retrieval by fitting polarimetric signals at all scattering angles (e.g. from 80° to 180°); and 3) constructing a lookup table of radiance for a set of cloud optical depth grids using aerosol and cloud information retrieved from Step 2 and then estimating pixel-scale cloud optical depth based on 1D radiative transfer (RT) theory by fitting the AirMSPI radiance. Retrieval uncertainty is formulated by accounting for instrumental errors and constraints imposed on spectral variations of aerosol and cloud droplet optical properties. As the forward RT model, a hybrid approach is developed to combine the computational strengths of Markov-chain and adding-doubling methods to model polarized RT in a coupled aerosol, Rayleigh and cloud system. Our retrieval approach is tested using 134 AirMSPI datasets acquired during NASA ORACLES field campaign in 09/2016, with low to high aerosol loadings. For validation, the retrieved aerosol optical depths and cloud-top heights are compared to coincident High Spectral Resolution Lidar-2 (HSRL-2) data, and the droplet size parameters including effective radius and effective variance and cloud optical thickness are compared to coincident Research Scanning Polarimeter (RSP) data.

3D Cloud Radiative Effects on Aerosol Optical Thickness Retrievals in Cumulus Cloud Fields in the Biomass Burning Region in Brazil

NASA Technical Reports Server (NTRS)

Wen, Guo-Yong; Marshak, Alexander; Cahalan, Robert F.

2004-01-01

Aerosol amount in clear regions of a cloudy atmosphere is a critical parameter in studying the interaction between aerosols and clouds. Since the global cloud cover is about 50%, cloudy scenes are often encountered in any satellite images. Aerosols are more or less transparent, while clouds are extremely reflective in the visible spectrum of solar radiation. The radiative transfer in clear-cloudy condition is highly three- dimensional (3D). This paper focuses on estimating the 3D effects on aerosol optical thickness retrievals using Monte Carlo simulations. An ASTER image of cumulus cloud fields in the biomass burning region in Brazil is simulated in this study. The MODIS products (i-e., cloud optical thickness, particle effective radius, cloud top pressure, surface reflectance, etc.) are used to construct the cloud property and surface reflectance fields. To estimate the cloud 3-D effects, we assume a plane-parallel stratification of aerosol properties in the 60 km x 60 km ASTER image. The simulated solar radiation at the top of the atmosphere is compared with plane-parallel calculations. Furthermore, the 3D cloud radiative effects on aerosol optical thickness retrieval are estimated.

Hyperspectral remote sensing image retrieval system using spectral and texture features.

PubMed

Zhang, Jing; Geng, Wenhao; Liang, Xi; Li, Jiafeng; Zhuo, Li; Zhou, Qianlan

2017-06-01

Although many content-based image retrieval systems have been developed, few studies have focused on hyperspectral remote sensing images. In this paper, a hyperspectral remote sensing image retrieval system based on spectral and texture features is proposed. The main contributions are fourfold: (1) considering the "mixed pixel" in the hyperspectral image, endmembers as spectral features are extracted by an improved automatic pixel purity index algorithm, then the texture features are extracted with the gray level co-occurrence matrix; (2) similarity measurement is designed for the hyperspectral remote sensing image retrieval system, in which the similarity of spectral features is measured with the spectral information divergence and spectral angle match mixed measurement and in which the similarity of textural features is measured with Euclidean distance; (3) considering the limited ability of the human visual system, the retrieval results are returned after synthesizing true color images based on the hyperspectral image characteristics; (4) the retrieval results are optimized by adjusting the feature weights of similarity measurements according to the user's relevance feedback. The experimental results on NASA data sets can show that our system can achieve comparable superior retrieval performance to existing hyperspectral analysis schemes.

A fast image retrieval method based on SVM and imbalanced samples in filtering multimedia message spam

NASA Astrophysics Data System (ADS)

Chen, Zhang; Peng, Zhenming; Peng, Lingbing; Liao, Dongyi; He, Xin

2011-11-01

With the swift and violent development of the Multimedia Messaging Service (MMS), it becomes an urgent task to filter the Multimedia Message (MM) spam effectively in real-time. For the fact that most MMs contain images or videos, a method based on retrieving images is given in this paper for filtering MM spam. The detection method used in this paper is a combination of skin-color detection, texture detection, and face detection, and the classifier for this imbalanced problem is a very fast multi-classification combining Support vector machine (SVM) with unilateral binary decision tree. The experiments on 3 test sets show that the proposed method is effective, with the interception rate up to 60% and the average detection time for each image less than 1 second.

Encryption of QR code and grayscale image in interference-based scheme with high quality retrieval and silhouette problem removal

NASA Astrophysics Data System (ADS)

Qin, Yi; Wang, Hongjuan; Wang, Zhipeng; Gong, Qiong; Wang, Danchen

2016-09-01

In optical interference-based encryption (IBE) scheme, the currently available methods have to employ the iterative algorithms in order to encrypt two images and retrieve cross-talk free decrypted images. In this paper, we shall show that this goal can be achieved via an analytical process if one of the two images is QR code. For decryption, the QR code is decrypted in the conventional architecture and the decryption has a noisy appearance. Nevertheless, the robustness of QR code against noise enables the accurate acquisition of its content from the noisy retrieval, as a result of which the primary QR code can be exactly regenerated. Thereafter, a novel optical architecture is proposed to recover the grayscale image by aid of the QR code. In addition, the proposal has totally eliminated the silhouette problem existing in the previous IBE schemes, and its effectiveness and feasibility have been demonstrated by numerical simulations.

Mobile object retrieval in server-based image databases

NASA Astrophysics Data System (ADS)

Manger, D.; Pagel, F.; Widak, H.

2013-05-01

The increasing number of mobile phones equipped with powerful cameras leads to huge collections of user-generated images. To utilize the information of the images on site, image retrieval systems are becoming more and more popular to search for similar objects in an own image database. As the computational performance and the memory capacity of mobile devices are constantly increasing, this search can often be performed on the device itself. This is feasible, for example, if the images are represented with global image features or if the search is done using EXIF or textual metadata. However, for larger image databases, if multiple users are meant to contribute to a growing image database or if powerful content-based image retrieval methods with local features are required, a server-based image retrieval backend is needed. In this work, we present a content-based image retrieval system with a client server architecture working with local features. On the server side, the scalability to large image databases is addressed with the popular bag-of-word model with state-of-the-art extensions. The client end of the system focuses on a lightweight user interface presenting the most similar images of the database highlighting the visual information which is common with the query image. Additionally, new images can be added to the database making it a powerful and interactive tool for mobile contentbased image retrieval.

An oil film information retrieval method overcoming the influence of sun glitter, based on AISA+ airborne hyper-spectral image

NASA Astrophysics Data System (ADS)

Zhan, Yuanzeng; Mao, Tianming; Gong, Fang; Wang, Difeng; Chen, Jianyu

2010-10-01

As an effective survey tool for oil spill detection, the airborne hyper-spectral sensor affords the potentiality for retrieving the quantitative information of oil slick which is useful for the cleanup of spilled oil. But many airborne hyper-spectral images are affected by sun glitter which distorts radiance values and spectral ratios used for oil slick detection. In 2005, there's an oil spill event leaking at oil drilling platform in The South China Sea, and an AISA+ airborne hyper-spectral image recorded this event will be selected for studying in this paper, which is affected by sun glitter terribly. Through a spectrum analysis of the oil and water samples, two features -- "spectral rotation" and "a pair of fixed points" can be found in spectral curves between crude oil film and water. Base on these features, an oil film information retrieval method which can overcome the influence of sun glitter is presented. Firstly, the radiance of the image is converted to normal apparent reflectance (NormAR). Then, based on the features of "spectral rotation" (used for distinguishing oil film and water) and "a pair of fixed points" (used for overcoming the effect of sun glitter), NormAR894/NormAR516 is selected as an indicator of oil film. Finally, by using a threshold combined with the technologies of image filter and mathematic morphology, the distribution and relative thickness of oil film are retrieved.

Mobile medical image retrieval

NASA Astrophysics Data System (ADS)

Duc, Samuel; Depeursinge, Adrien; Eggel, Ivan; Müller, Henning

2011-03-01

Images are an integral part of medical practice for diagnosis, treatment planning and teaching. Image retrieval has gained in importance mainly as a research domain over the past 20 years. Both textual and visual retrieval of images are essential. In the process of mobile devices becoming reliable and having a functionality equaling that of formerly desktop clients, mobile computing has gained ground and many applications have been explored. This creates a new field of mobile information search & access and in this context images can play an important role as they often allow understanding complex scenarios much quicker and easier than free text. Mobile information retrieval in general has skyrocketed over the past year with many new applications and tools being developed and all sorts of interfaces being adapted to mobile clients. This article describes constraints of an information retrieval system including visual and textual information retrieval from the medical literature of BioMedCentral and of the RSNA journals Radiology and Radiographics. Solutions for mobile data access with an example on an iPhone in a web-based environment are presented as iPhones are frequently used and the operating system is bound to become the most frequent smartphone operating system in 2011. A web-based scenario was chosen to allow for a use by other smart phone platforms such as Android as well. Constraints of small screens and navigation with touch screens are taken into account in the development of the application. A hybrid choice had to be taken to allow for taking pictures with the cell phone camera and upload them for visual similarity search as most producers of smart phones block this functionality to web applications. Mobile information access and in particular access to images can be surprisingly efficient and effective on smaller screens. Images can be read on screen much faster and relevance of documents can be identified quickly through the use of images contained in the text. Problems with the many, often incompatible mobile platforms were discovered and are listed in the text. Mobile information access is a quickly growing domain and the constraints of mobile access also need to be taken into account for image retrieval. The demonstrated access to the medical literature is most relevant as the medical literature and their images are clearly the largest knowledge source in the medical field.

Information recovery in propagation-based imaging with decoherence effects

NASA Astrophysics Data System (ADS)

Froese, Heinrich; Lötgering, Lars; Wilhein, Thomas

2017-05-01

During the past decades the optical imaging community witnessed a rapid emergence of novel imaging modalities such as coherent diffraction imaging (CDI), propagation-based imaging and ptychography. These methods have been demonstrated to recover complex-valued scalar wave fields from redundant data without the need for refractive or diffractive optical elements. This renders these techniques suitable for imaging experiments with EUV and x-ray radiation, where the use of lenses is complicated by fabrication, photon efficiency and cost. However, decoherence effects can have detrimental effects on the reconstruction quality of the numerical algorithms involved. Here we demonstrate propagation-based optical phase retrieval from multiple near-field intensities with decoherence effects such as partially coherent illumination, detector point spread, binning and position uncertainties of the detector. Methods for overcoming these systematic experimental errors - based on the decomposition of the data into mutually incoherent modes - are proposed and numerically tested. We believe that the results presented here open up novel algorithmic methods to accelerate detector readout rates and enable subpixel resolution in propagation-based phase retrieval. Further the techniques are straightforward to be extended to methods such as CDI, ptychography and holography.

A content-based image retrieval method for optical colonoscopy images based on image recognition techniques

NASA Astrophysics Data System (ADS)

Nosato, Hirokazu; Sakanashi, Hidenori; Takahashi, Eiichi; Murakawa, Masahiro

2015-03-01

This paper proposes a content-based image retrieval method for optical colonoscopy images that can find images similar to ones being diagnosed. Optical colonoscopy is a method of direct observation for colons and rectums to diagnose bowel diseases. It is the most common procedure for screening, surveillance and treatment. However, diagnostic accuracy for intractable inflammatory bowel diseases, such as ulcerative colitis (UC), is highly dependent on the experience and knowledge of the medical doctor, because there is considerable variety in the appearances of colonic mucosa within inflammations with UC. In order to solve this issue, this paper proposes a content-based image retrieval method based on image recognition techniques. The proposed retrieval method can find similar images from a database of images diagnosed as UC, and can potentially furnish the medical records associated with the retrieved images to assist the UC diagnosis. Within the proposed method, color histogram features and higher order local auto-correlation (HLAC) features are adopted to represent the color information and geometrical information of optical colonoscopy images, respectively. Moreover, considering various characteristics of UC colonoscopy images, such as vascular patterns and the roughness of the colonic mucosa, we also propose an image enhancement method to highlight the appearances of colonic mucosa in UC. In an experiment using 161 UC images from 32 patients, we demonstrate that our method improves the accuracy of retrieving similar UC images.

Accessing long-term memory representations during visual change detection.

PubMed

Beck, Melissa R; van Lamsweerde, Amanda E

2011-04-01

In visual change detection tasks, providing a cue to the change location concurrent with the test image (post-cue) can improve performance, suggesting that, without a cue, not all encoded representations are automatically accessed. Our studies examined the possibility that post-cues can encourage the retrieval of representations stored in long-term memory (LTM). Participants detected changes in images composed of familiar objects. Performance was better when the cue directed attention to the post-change object. Supporting the role of LTM in the cue effect, the effect was similar regardless of whether the cue was presented during the inter-stimulus interval, concurrent with the onset of the test image, or after the onset of the test image. Furthermore, the post-cue effect and LTM performance were similarly influenced by encoding time. These findings demonstrate that monitoring the visual world for changes does not automatically engage LTM retrieval.

Document image database indexing with pictorial dictionary

NASA Astrophysics Data System (ADS)

Akbari, Mohammad; Azimi, Reza

2010-02-01

In this paper we introduce a new approach for information retrieval from Persian document image database without using Optical Character Recognition (OCR).At first an attribute called subword upper contour label is defined then, a pictorial dictionary is constructed based on this attribute for the subwords. By this approach we address two issues in document image retrieval: keyword spotting and retrieval according to the document similarities. The proposed methods have been evaluated on a Persian document image database. The results have proved the ability of this approach in document image information retrieval.

Comparing features sets for content-based image retrieval in a medical-case database

NASA Astrophysics Data System (ADS)

Muller, Henning; Rosset, Antoine; Vallee, Jean-Paul; Geissbuhler, Antoine

2004-04-01

Content-based image retrieval systems (CBIRSs) have frequently been proposed for the use in medical image databases and PACS. Still, only few systems were developed and used in a real clinical environment. It rather seems that medical professionals define their needs and computer scientists develop systems based on data sets they receive with little or no interaction between the two groups. A first study on the diagnostic use of medical image retrieval also shows an improvement in diagnostics when using CBIRSs which underlines the potential importance of this technique. This article explains the use of an open source image retrieval system (GIFT - GNU Image Finding Tool) for the retrieval of medical images in the medical case database system CasImage that is used in daily, clinical routine in the university hospitals of Geneva. Although the base system of GIFT shows an unsatisfactory performance, already little changes in the feature space show to significantly improve the retrieval results. The performance of variations in feature space with respect to color (gray level) quantizations and changes in texture analysis (Gabor filters) is compared. Whereas stock photography relies mainly on colors for retrieval, medical images need a large number of gray levels for successful retrieval, especially when executing feedback queries. The results also show that a too fine granularity in the gray levels lowers the retrieval quality, especially with single-image queries. For the evaluation of the retrieval peformance, a subset of the entire case database of more than 40,000 images is taken with a total of 3752 images. Ground truth was generated by a user who defined the expected query result of a perfect system by selecting images relevant to a given query image. The results show that a smaller number of gray levels (32 - 64) leads to a better retrieval performance, especially when using relevance feedback. The use of more scales and directions for the Gabor filters in the texture analysis also leads to improved results but response time is going up equally due to the larger feature space. CBIRSs can be of great use in managing large medical image databases. They allow to find images that might otherwise be lost for research and publications. They also give students students the possibility to navigate within large image repositories. In the future, CBIR might also become more important in case-based reasoning and evidence-based medicine to support the diagnostics because first studies show good results.

Supervised graph hashing for histopathology image retrieval and classification.

PubMed

Shi, Xiaoshuang; Xing, Fuyong; Xu, KaiDi; Xie, Yuanpu; Su, Hai; Yang, Lin

2017-12-01

In pathology image analysis, morphological characteristics of cells are critical to grade many diseases. With the development of cell detection and segmentation techniques, it is possible to extract cell-level information for further analysis in pathology images. However, it is challenging to conduct efficient analysis of cell-level information on a large-scale image dataset because each image usually contains hundreds or thousands of cells. In this paper, we propose a novel image retrieval based framework for large-scale pathology image analysis. For each image, we encode each cell into binary codes to generate image representation using a novel graph based hashing model and then conduct image retrieval by applying a group-to-group matching method to similarity measurement. In order to improve both computational efficiency and memory requirement, we further introduce matrix factorization into the hashing model for scalable image retrieval. The proposed framework is extensively validated with thousands of lung cancer images, and it achieves 97.98% classification accuracy and 97.50% retrieval precision with all cells of each query image used. Copyright © 2017 Elsevier B.V. All rights reserved.

On combining image-based and ontological semantic dissimilarities for medical image retrieval applications

PubMed Central

Kurtz, Camille; Depeursinge, Adrien; Napel, Sandy; Beaulieu, Christopher F.; Rubin, Daniel L.

2014-01-01

Computer-assisted image retrieval applications can assist radiologists by identifying similar images in archives as a means to providing decision support. In the classical case, images are described using low-level features extracted from their contents, and an appropriate distance is used to find the best matches in the feature space. However, using low-level image features to fully capture the visual appearance of diseases is challenging and the semantic gap between these features and the high-level visual concepts in radiology may impair the system performance. To deal with this issue, the use of semantic terms to provide high-level descriptions of radiological image contents has recently been advocated. Nevertheless, most of the existing semantic image retrieval strategies are limited by two factors: they require manual annotation of the images using semantic terms and they ignore the intrinsic visual and semantic relationships between these annotations during the comparison of the images. Based on these considerations, we propose an image retrieval framework based on semantic features that relies on two main strategies: (1) automatic “soft” prediction of ontological terms that describe the image contents from multi-scale Riesz wavelets and (2) retrieval of similar images by evaluating the similarity between their annotations using a new term dissimilarity measure, which takes into account both image-based and ontological term relations. The combination of these strategies provides a means of accurately retrieving similar images in databases based on image annotations and can be considered as a potential solution to the semantic gap problem. We validated this approach in the context of the retrieval of liver lesions from computed tomographic (CT) images and annotated with semantic terms of the RadLex ontology. The relevance of the retrieval results was assessed using two protocols: evaluation relative to a dissimilarity reference standard defined for pairs of images on a 25-images dataset, and evaluation relative to the diagnoses of the retrieved images on a 72-images dataset. A normalized discounted cumulative gain (NDCG) score of more than 0.92 was obtained with the first protocol, while AUC scores of more than 0.77 were obtained with the second protocol. This automatical approach could provide real-time decision support to radiologists by showing them similar images with associated diagnoses and, where available, responses to therapies. PMID:25036769

Minimizing the semantic gap in biomedical content-based image retrieval

NASA Astrophysics Data System (ADS)

Guan, Haiying; Antani, Sameer; Long, L. Rodney; Thoma, George R.

2010-03-01

A major challenge in biomedical Content-Based Image Retrieval (CBIR) is to achieve meaningful mappings that minimize the semantic gap between the high-level biomedical semantic concepts and the low-level visual features in images. This paper presents a comprehensive learning-based scheme toward meeting this challenge and improving retrieval quality. The article presents two algorithms: a learning-based feature selection and fusion algorithm and the Ranking Support Vector Machine (Ranking SVM) algorithm. The feature selection algorithm aims to select 'good' features and fuse them using different similarity measurements to provide a better representation of the high-level concepts with the low-level image features. Ranking SVM is applied to learn the retrieval rank function and associate the selected low-level features with query concepts, given the ground-truth ranking of the training samples. The proposed scheme addresses four major issues in CBIR to improve the retrieval accuracy: image feature extraction, selection and fusion, similarity measurements, the association of the low-level features with high-level concepts, and the generation of the rank function to support high-level semantic image retrieval. It models the relationship between semantic concepts and image features, and enables retrieval at the semantic level. We apply it to the problem of vertebra shape retrieval from a digitized spine x-ray image set collected by the second National Health and Nutrition Examination Survey (NHANES II). The experimental results show an improvement of up to 41.92% in the mean average precision (MAP) over conventional image similarity computation methods.

Seasonal Bias of Retrieved Ice Cloud Optical Properties Based on MISR and MODIS Measurements

NASA Astrophysics Data System (ADS)

Wang, Y.; Hioki, S.; Yang, P.; Di Girolamo, L.; Fu, D.

2017-12-01

The precise estimation of two important cloud optical and microphysical properties, cloud particle optical thickness and cloud particle effective radius, is fundamental in the study of radiative energy budget and hydrological cycle. In retrieving these two properties, an appropriate selection of ice particle surface roughness is important because it substantially affects the single-scattering properties. At present, using a predetermined ice particle shape without spatial and temporal variations is a common practice in satellite-based retrieval. This approach leads to substantial uncertainties in retrievals. The cloud radiances measured by each of the cameras of the Multi-angle Imaging SpectroRadiometer (MISR) instrument are used to estimate spherical albedo values at different scattering angles. By analyzing the directional distribution of estimated spherical albedo values, the degree of ice particle surface roughness is estimated. With an optimal degree of ice particle roughness, cloud optical thickness and effective radius are retrieved based on a bi-spectral shortwave technique in conjunction with two Moderate Resolution Imaging Spectroradiometer (MODIS) bands centered at 0.86 and 2.13 μm. The seasonal biases of retrieved cloud optical and microphysical properties, caused by the uncertainties in ice particle roughness, are investigated by using one year of MISR-MODIS fused data.

Observation of Phase Objects by Using an X-ray Microscope with a Foucault Knife-Edge

DOE Office of Scientific and Technical Information (OSTI.GOV)

Watanabe, N.; Sasaya, T.; Imai, Y.

2011-09-09

An x-ray microscope with a zone plate was assembled at the synchrotron radiation source of BL3C, Photon Factory. A Foucault knife-edge was set at the back focal plate of the objective zone plate and phase retrieval was tested by scanning the knife-edge. A preliminary result shows that scanning the knife-edge during exposure was effective for phase retrieval. Phase-contrast tomography was investigated using differential projection images calculated from two Schlieren images with the oppositely oriented knife-edges. Fairly good reconstruction images of polystyrene beads and spores could be obtained.

Signature detection and matching for document image retrieval.

PubMed

Zhu, Guangyu; Zheng, Yefeng; Doermann, David; Jaeger, Stefan

2009-11-01

As one of the most pervasive methods of individual identification and document authentication, signatures present convincing evidence and provide an important form of indexing for effective document image processing and retrieval in a broad range of applications. However, detection and segmentation of free-form objects such as signatures from clustered background is currently an open document analysis problem. In this paper, we focus on two fundamental problems in signature-based document image retrieval. First, we propose a novel multiscale approach to jointly detecting and segmenting signatures from document images. Rather than focusing on local features that typically have large variations, our approach captures the structural saliency using a signature production model and computes the dynamic curvature of 2D contour fragments over multiple scales. This detection framework is general and computationally tractable. Second, we treat the problem of signature retrieval in the unconstrained setting of translation, scale, and rotation invariant nonrigid shape matching. We propose two novel measures of shape dissimilarity based on anisotropic scaling and registration residual error and present a supervised learning framework for combining complementary shape information from different dissimilarity metrics using LDA. We quantitatively study state-of-the-art shape representations, shape matching algorithms, measures of dissimilarity, and the use of multiple instances as query in document image retrieval. We further demonstrate our matching techniques in offline signature verification. Extensive experiments using large real-world collections of English and Arabic machine-printed and handwritten documents demonstrate the excellent performance of our approaches.

Optical image transformation and encryption by phase-retrieval-based double random-phase encoding and compressive ghost imaging

NASA Astrophysics Data System (ADS)

Yuan, Sheng; Yang, Yangrui; Liu, Xuemei; Zhou, Xin; Wei, Zhenzhuo

2018-01-01

An optical image transformation and encryption scheme is proposed based on double random-phase encoding (DRPE) and compressive ghost imaging (CGI) techniques. In this scheme, a secret image is first transformed into a binary image with the phase-retrieval-based DRPE technique, and then encoded by a series of random amplitude patterns according to the ghost imaging (GI) principle. Compressive sensing, corrosion and expansion operations are implemented to retrieve the secret image in the decryption process. This encryption scheme takes the advantage of complementary capabilities offered by the phase-retrieval-based DRPE and GI-based encryption techniques. That is the phase-retrieval-based DRPE is used to overcome the blurring defect of the decrypted image in the GI-based encryption, and the CGI not only reduces the data amount of the ciphertext, but also enhances the security of DRPE. Computer simulation results are presented to verify the performance of the proposed encryption scheme.

Content-based image retrieval on mobile devices

NASA Astrophysics Data System (ADS)

Ahmad, Iftikhar; Abdullah, Shafaq; Kiranyaz, Serkan; Gabbouj, Moncef

2005-03-01

Content-based image retrieval area possesses a tremendous potential for exploration and utilization equally for researchers and people in industry due to its promising results. Expeditious retrieval of desired images requires indexing of the content in large-scale databases along with extraction of low-level features based on the content of these images. With the recent advances in wireless communication technology and availability of multimedia capable phones it has become vital to enable query operation in image databases and retrieve results based on the image content. In this paper we present a content-based image retrieval system for mobile platforms, providing the capability of content-based query to any mobile device that supports Java platform. The system consists of light-weight client application running on a Java enabled device and a server containing a servlet running inside a Java enabled web server. The server responds to image query using efficient native code from selected image database. The client application, running on a mobile phone, is able to initiate a query request, which is handled by a servlet in the server for finding closest match to the queried image. The retrieved results are transmitted over mobile network and images are displayed on the mobile phone. We conclude that such system serves as a basis of content-based information retrieval on wireless devices and needs to cope up with factors such as constraints on hand-held devices and reduced network bandwidth available in mobile environments.

Functional imaging of the semantic system: retrieval of sensory-experienced and verbally learned knowledge.

PubMed

Noppeney, Uta; Price, Cathy J

2003-01-01

This paper considers how functional neuro-imaging can be used to investigate the organization of the semantic system and the limitations associated with this technique. The majority of the functional imaging studies of the semantic system have looked for divisions by varying stimulus category. These studies have led to divergent results and no clear anatomical hypotheses have emerged to account for the dissociations seen in behavioral studies. Only a few functional imaging studies have used task as a variable to differentiate the neural correlates of semantic features more directly. We extend these findings by presenting a new study that contrasts tasks that differentially weight sensory (color and taste) and verbally learned (origin) semantic features. Irrespective of the type of semantic feature retrieved, a common semantic system was activated as demonstrated in many previous studies. In addition, the retrieval of verbally learned, but not sensory-experienced, features enhanced activation in medial and lateral posterior parietal areas. We attribute these "verbally learned" effects to differences in retrieval strategy and conclude that evidence for segregation of semantic features at an anatomical level remains weak. We believe that functional imaging has the potential to increase our understanding of the neuronal infrastructure that sustains semantic processing but progress may require multiple experiments until a consistent explanatory framework emerges.

Optically secured information retrieval using two authenticated phase-only masks.

PubMed

Wang, Xiaogang; Chen, Wen; Mei, Shengtao; Chen, Xudong

2015-10-23

We propose an algorithm for jointly designing two phase-only masks (POMs) that allow for the encryption and noise-free retrieval of triple images. The images required for optical retrieval are first stored in quick-response (QR) codes for noise-free retrieval and flexible readout. Two sparse POMs are respectively calculated from two different images used as references for authentication based on modified Gerchberg-Saxton algorithm (GSA) and pixel extraction, and are then used as support constraints in a modified double-phase retrieval algorithm (MPRA), together with the above-mentioned QR codes. No visible information about the target images or the reference images can be obtained from each of these authenticated POMs. This approach allows users to authenticate the two POMs used for image reconstruction without visual observation of the reference images. It also allows user to friendly access and readout with mobile devices.

Optically secured information retrieval using two authenticated phase-only masks

PubMed Central

Wang, Xiaogang; Chen, Wen; Mei, Shengtao; Chen, Xudong

2015-01-01

We propose an algorithm for jointly designing two phase-only masks (POMs) that allow for the encryption and noise-free retrieval of triple images. The images required for optical retrieval are first stored in quick-response (QR) codes for noise-free retrieval and flexible readout. Two sparse POMs are respectively calculated from two different images used as references for authentication based on modified Gerchberg-Saxton algorithm (GSA) and pixel extraction, and are then used as support constraints in a modified double-phase retrieval algorithm (MPRA), together with the above-mentioned QR codes. No visible information about the target images or the reference images can be obtained from each of these authenticated POMs. This approach allows users to authenticate the two POMs used for image reconstruction without visual observation of the reference images. It also allows user to friendly access and readout with mobile devices. PMID:26494213

Optically secured information retrieval using two authenticated phase-only masks

NASA Astrophysics Data System (ADS)

Wang, Xiaogang; Chen, Wen; Mei, Shengtao; Chen, Xudong

2015-10-01

We propose an algorithm for jointly designing two phase-only masks (POMs) that allow for the encryption and noise-free retrieval of triple images. The images required for optical retrieval are first stored in quick-response (QR) codes for noise-free retrieval and flexible readout. Two sparse POMs are respectively calculated from two different images used as references for authentication based on modified Gerchberg-Saxton algorithm (GSA) and pixel extraction, and are then used as support constraints in a modified double-phase retrieval algorithm (MPRA), together with the above-mentioned QR codes. No visible information about the target images or the reference images can be obtained from each of these authenticated POMs. This approach allows users to authenticate the two POMs used for image reconstruction without visual observation of the reference images. It also allows user to friendly access and readout with mobile devices.

Content-Based Medical Image Retrieval

NASA Astrophysics Data System (ADS)

Müller, Henning; Deserno, Thomas M.

This chapter details the necessity for alternative access concepts to the currently mainly text-based methods in medical information retrieval. This need is partly due to the large amount of visual data produced, the increasing variety of medical imaging data and changing user patterns. The stored visual data contain large amounts of unused information that, if well exploited, can help diagnosis, teaching and research. The chapter briefly reviews the history of image retrieval and its general methods before technologies that have been developed in the medical domain are focussed. We also discuss evaluation of medical content-based image retrieval (CBIR) systems and conclude with pointing out their strengths, gaps, and further developments. As examples, the MedGIFT project and the Image Retrieval in Medical Applications (IRMA) framework are presented.

High resolution satellite image indexing and retrieval using SURF features and bag of visual words

NASA Astrophysics Data System (ADS)

Bouteldja, Samia; Kourgli, Assia

2017-03-01

In this paper, we evaluate the performance of SURF descriptor for high resolution satellite imagery (HRSI) retrieval through a BoVW model on a land-use/land-cover (LULC) dataset. Local feature approaches such as SIFT and SURF descriptors can deal with a large variation of scale, rotation and illumination of the images, providing, therefore, a better discriminative power and retrieval efficiency than global features, especially for HRSI which contain a great range of objects and spatial patterns. Moreover, we combine SURF and color features to improve the retrieval accuracy, and we propose to learn a category-specific dictionary for each image category which results in a more discriminative image representation and boosts the image retrieval performance.

Latent Semantic Analysis as a Method of Content-Based Image Retrieval in Medical Applications

ERIC Educational Resources Information Center

Makovoz, Gennadiy

2010-01-01

The research investigated whether a Latent Semantic Analysis (LSA)-based approach to image retrieval can map pixel intensity into a smaller concept space with good accuracy and reasonable computational cost. From a large set of M computed tomography (CT) images, a retrieval query found all images for a particular patient based on semantic…

A normative database and determinants of lexical retrieval for 186 Arabic nouns: effects of psycholinguistic and morpho-syntactic variables on naming latency.

PubMed

Khwaileh, Tariq; Body, Richard; Herbert, Ruth

2014-12-01

Research into lexical retrieval requires pictorial stimuli standardised for key psycholinguistic variables. Such databases exist in a number of languages but not in Arabic. In addition there are few studies of the effects of psycholinguistic and morpho-syntactic variables on Arabic lexical retrieval. The current study identified a set of culturally and linguistically appropriate concept labels, and corresponding photographic representations for Levantine Arabic. The set included masculine and feminine nouns, nouns from both types of plural formation (sound and broken), and both rational and irrational nouns. Levantine Arabic speakers provided norms for visual complexity, imageability, age of acquisition, naming latency and name agreement. This delivered a normative database for a set of 186 Arabic nouns. The effects of the morpho-syntactic and the psycholinguistic variables on lexical retrieval were explored using the database. Imageability and age of acquisition were the only significant determinants of successful lexical retrieval in Arabic. None of the other variables, including all the linguistic variables, had any effect on production time. The normative database is available for the use of clinicians and researchers in the Arab world in the domains of speech and language pathology, neurolinguistics and psycholinguistics. The database and the photographic representations will be soon available for free download from the first author's personal webpage or via email.

Simultaneously inferring above-cloud absorbing aerosol optical thickness and underlying liquid phase cloud optical and microphysical properties using MODIS

NASA Astrophysics Data System (ADS)

Meyer, Kerry; Platnick, Steven; Zhang, Zhibo

2015-06-01

The regional haze over the southeast (SE) Atlantic Ocean induced by biomass burning in southern Africa can be problematic for passive imager-based retrievals of the underlying quasi-permanent marine boundary layer (MBL) clouds and for estimates of top-of-atmosphere (TOA) aerosol direct radiative effect (DRE). Here an algorithm is introduced to simultaneously retrieve above-cloud aerosol optical thickness (AOT), the cloud optical thickness (COT), and cloud effective particle radius (CER) of the underlying MBL clouds while also providing pixel-level estimates of retrieval uncertainty. This approach utilizes reflectance measurements at six Moderate Resolution Imaging Spectroradiometer (MODIS) channels from the visible to the shortwave infrared. Retrievals are run under two aerosol model assumptions on 8 years (2006-2013) of June-October Aqua MODIS data over the SE Atlantic, from which a regional cloud and above-cloud aerosol climatology is produced. The cloud retrieval methodology is shown to yield COT and CER consistent with those from the MODIS operational cloud product (MOD06) when forcing AOT to zero, while the full COT-CER-AOT retrievals that account for the above-cloud aerosol attenuation increase regional monthly mean COT and CER by up to 9% and 2%, respectively. Retrieved AOT is roughly 3 to 5 times larger than the collocated 532 nm Cloud-Aerosol Lidar with Orthogonal Polarization (CALIOP) retrievals, though closer agreement is observed with the CALIOP 1064 nm retrievals, a result consistent with previous case study analyses. Regional cloudy-sky above-cloud aerosol DRE calculations are also performed that illustrate the importance of the aerosol model assumption and underlying cloud retrievals.

Gradient descent algorithm applied to wavefront retrieval from through-focus images by an extreme ultraviolet microscope with partially coherent source

DOE PAGES

Yamazoe, Kenji; Mochi, Iacopo; Goldberg, Kenneth A.

2014-12-01

The wavefront retrieval by gradient descent algorithm that is typically applied to coherent or incoherent imaging is extended to retrieve a wavefront from a series of through-focus images by partially coherent illumination. For accurate retrieval, we modeled partial coherence as well as object transmittance into the gradient descent algorithm. However, this modeling increases the computation time due to the complexity of partially coherent imaging simulation that is repeatedly used in the optimization loop. To accelerate the computation, we incorporate not only the Fourier transform but also an eigenfunction decomposition of the image. As a demonstration, the extended algorithm is appliedmore » to retrieve a field-dependent wavefront of a microscope operated at extreme ultraviolet wavelength (13.4 nm). The retrieved wavefront qualitatively matches the expected characteristics of the lens design.« less

Gradient descent algorithm applied to wavefront retrieval from through-focus images by an extreme ultraviolet microscope with partially coherent source

DOE Office of Scientific and Technical Information (OSTI.GOV)

Yamazoe, Kenji; Mochi, Iacopo; Goldberg, Kenneth A.

The wavefront retrieval by gradient descent algorithm that is typically applied to coherent or incoherent imaging is extended to retrieve a wavefront from a series of through-focus images by partially coherent illumination. For accurate retrieval, we modeled partial coherence as well as object transmittance into the gradient descent algorithm. However, this modeling increases the computation time due to the complexity of partially coherent imaging simulation that is repeatedly used in the optimization loop. To accelerate the computation, we incorporate not only the Fourier transform but also an eigenfunction decomposition of the image. As a demonstration, the extended algorithm is appliedmore » to retrieve a field-dependent wavefront of a microscope operated at extreme ultraviolet wavelength (13.4 nm). The retrieved wavefront qualitatively matches the expected characteristics of the lens design.« less

Study on ice cloud optical thickness retrieval with MODIS IR spectral bands

NASA Astrophysics Data System (ADS)

Zhang, Hong; Li, Jun

2005-01-01

The operational Moderate-Resolution Imaging Spectroradiometer (MODIS) products for cloud properties such as cloud-top pressure (CTP), effective cloud amount (ECA), cloud particle size (CPS), cloud optical thickness (COT), and cloud phase (CP) have been available for users globally. An approach to retrieve COT is investigated using MODIS infrared (IR) window spectral bands (8.5 mm, 11mm, and 12 mm). The COT retrieval from MODIS IR bands has the potential to provide microphysical properties with high spatial resolution during night. The results are compared with those from operational MODIS products derived from the visible (VIS) and near-infrared (NIR) bands during day. Sensitivity of COT to MODIS spectral brightness temperature (BT) and BT difference (BTD) values is studied. A look-up table is created from the cloudy radiative transfer model accounting for the cloud absorption and scattering for the cloud microphysical property retrieval. The potential applications and limitations are also discussed. This algorithm can be applied to the future imager systems such as Visible/Infrared Imager/Radiometer Suite (VIIRS) on the National Polar-orbiting Operational Environmental Satellite System (NPOESS) and Advanced Baseline Imager (ABI) on the Geostationary Operational Environmental Satellite (GOES)-R.

Advantages of phase retrieval for fast x-ray tomographic microscopy

NASA Astrophysics Data System (ADS)

Mokso, R.; Marone, F.; Irvine, S.; Nyvlt, M.; Schwyn, D.; Mader, K.; Taylor, G. K.; Krapp, H. G.; Skeren, M.; Stampanoni, M.

2013-12-01

In near-field imaging with partially coherent x-rays, the phase shifting properties of the sample are encoded in the diffraction fringes that appear as an additional intensity modulation in the x-ray projection images. These Fresnel fringes are often regarded as purely an enhancement of the visibility at the interfaces. We show that retrieving the phase information contained in these patterns significantly advances the developments in fast micro-tomography. Improving temporal resolution without intensifying radiation damage implies a shortening of the exposure time rather than increasing the photon flux on the sample. Phase retrieval, to a large extent, compensates the consequent photon count moderation in the images, by fully exploiting the stronger refraction effect as compared with absorption. Two single-distance phase retrieval methods are evaluated for the case of an in situ 3 Hz micro-tomography of a rapidly evolving liquid foam, and an in vivo 6 Hz micro-tomography of a blowfly. A new dual-detector setup is introduced for simultaneous acquisition of two near-field diffraction patterns. Our goal is to couple high temporal, spatial and density resolution in a single imaging system in a dose-efficient manner, opening further options for dynamic four-dimensional studies.

Creating a classification of image types in the medical literature for visual categorization

NASA Astrophysics Data System (ADS)

Müller, Henning; Kalpathy-Cramer, Jayashree; Demner-Fushman, Dina; Antani, Sameer

2012-02-01

Content-based image retrieval (CBIR) from specialized collections has often been proposed for use in such areas as diagnostic aid, clinical decision support, and teaching. The visual retrieval from broad image collections such as teaching files, the medical literature or web images, by contrast, has not yet reached a high maturity level compared to textual information retrieval. Visual image classification into a relatively small number of classes (20-100) on the other hand, has shown to deliver good results in several benchmarks. It is, however, currently underused as a basic technology for retrieval tasks, for example, to limit the search space. Most classification schemes for medical images are focused on specific areas and consider mainly the medical image types (modalities), imaged anatomy, and view, and merge them into a single descriptor or classification hierarchy. Furthermore, they often ignore other important image types such as biological images, statistical figures, flowcharts, and diagrams that frequently occur in the biomedical literature. Most of the current classifications have also been created for radiology images, which are not the only types to be taken into account. With Open Access becoming increasingly widespread particularly in medicine, images from the biomedical literature are more easily available for use. Visual information from these images and knowledge that an image is of a specific type or medical modality could enrich retrieval. This enrichment is hampered by the lack of a commonly agreed image classification scheme. This paper presents a hierarchy for classification of biomedical illustrations with the goal of using it for visual classification and thus as a basis for retrieval. The proposed hierarchy is based on relevant parts of existing terminologies, such as the IRMA-code (Image Retrieval in Medical Applications), ad hoc classifications and hierarchies used in imageCLEF (Image retrieval task at the Cross-Language Evaluation Forum) and NLM's (National Library of Medicine) OpenI. Furtheron, mappings to NLM's MeSH (Medical Subject Headings), RSNA's RadLex (Radiological Society of North America, Radiology Lexicon), and the IRMA code are also attempted for relevant image types. Advantages derived from such hierarchical classification for medical image retrieval are being evaluated through benchmarks such as imageCLEF, and R&D systems such as NLM's OpenI. The goal is to extend this hierarchy progressively and (through adding image types occurring in the biomedical literature) to have a terminology for visual image classification based on image types distinguishable by visual means and occurring in the medical open access literature.

Rotation invariant deep binary hashing for fast image retrieval

NASA Astrophysics Data System (ADS)

Dai, Lai; Liu, Jianming; Jiang, Aiwen

2017-07-01

In this paper, we study how to compactly represent image's characteristics for fast image retrieval. We propose supervised rotation invariant compact discriminative binary descriptors through combining convolutional neural network with hashing. In the proposed network, binary codes are learned by employing a hidden layer for representing latent concepts that dominate on class labels. A loss function is proposed to minimize the difference between binary descriptors that describe reference image and the rotated one. Compared with some other supervised methods, the proposed network doesn't have to require pair-wised inputs for binary code learning. Experimental results show that our method is effective and achieves state-of-the-art results on the CIFAR-10 and MNIST datasets.

Characterizing region of interest in image using MPEG-7 visual descriptors

NASA Astrophysics Data System (ADS)

Ryu, Min-Sung; Park, Soo-Jun; Won, Chee Sun

2005-08-01

In this paper, we propose a region-based image retrieval system using EHD (Edge Histogram Descriptor) and CLD (Color Layout Descriptor) of MPEG-7 descriptors. The combined descriptor can efficiently describe edge and color features in terms of sub-image regions. That is, the basic unit for the selection of the region-of-interest (ROI) in the image is the sub-image block of the EHD, which corresponds to 16 (i.e., 4x4) non-overlapping image blocks in the image space. This implies that, to have a one-to-one region correspondence between EHD and CLD, we need to take an 8x8 inverse DCT (IDCT) for the CLD. Experimental results show that the proposed retrieval scheme can be used for image retrieval with the ROI based image retrieval for MPEG-7 indexed images.

Web tools for effective retrieval, visualization, and evaluation of cardiology medical images and records

NASA Astrophysics Data System (ADS)

Masseroli, Marco; Pinciroli, Francesco

2000-12-01

To provide easy retrieval, integration and evaluation of multimodal cardiology images and data in a web browser environment, distributed application technologies and java programming were used to implement a client-server architecture based on software agents. The server side manages secure connections and queries to heterogeneous remote databases and file systems containing patient personal and clinical data. The client side is a Java applet running in a web browser and providing a friendly medical user interface to perform queries on patient and medical test dat and integrate and visualize properly the various query results. A set of tools based on Java Advanced Imaging API enables to process and analyze the retrieved cardiology images, and quantify their features in different regions of interest. The platform-independence Java technology makes the developed prototype easy to be managed in a centralized form and provided in each site where an intranet or internet connection can be located. Giving the healthcare providers effective tools for querying, visualizing and evaluating comprehensively cardiology medical images and records in all locations where they can need them- i.e. emergency, operating theaters, ward, or even outpatient clinics- the developed prototype represents an important aid in providing more efficient diagnoses and medical treatments.

Storage and retrieval of large digital images

DOEpatents

Bradley, J.N.

1998-01-20

Image compression and viewing are implemented with (1) a method for performing DWT-based compression on a large digital image with a computer system possessing a two-level system of memory and (2) a method for selectively viewing areas of the image from its compressed representation at multiple resolutions and, if desired, in a client-server environment. The compression of a large digital image I(x,y) is accomplished by first defining a plurality of discrete tile image data subsets T{sub ij}(x,y) that, upon superposition, form the complete set of image data I(x,y). A seamless wavelet-based compression process is effected on I(x,y) that is comprised of successively inputting the tiles T{sub ij}(x,y) in a selected sequence to a DWT routine, and storing the resulting DWT coefficients in a first primary memory. These coefficients are periodically compressed and transferred to a secondary memory to maintain sufficient memory in the primary memory for data processing. The sequence of DWT operations on the tiles T{sub ij}(x,y) effectively calculates a seamless DWT of I(x,y). Data retrieval consists of specifying a resolution and a region of I(x,y) for display. The subset of stored DWT coefficients corresponding to each requested scene is determined and then decompressed for input to an inverse DWT, the output of which forms the image display. The repeated process whereby image views are specified may take the form an interaction with a computer pointing device on an image display from a previous retrieval. 6 figs.

Storage and retrieval of large digital images

DOEpatents

Bradley, Jonathan N.

1998-01-01

Image compression and viewing are implemented with (1) a method for performing DWT-based compression on a large digital image with a computer system possessing a two-level system of memory and (2) a method for selectively viewing areas of the image from its compressed representation at multiple resolutions and, if desired, in a client-server environment. The compression of a large digital image I(x,y) is accomplished by first defining a plurality of discrete tile image data subsets T.sub.ij (x,y) that, upon superposition, form the complete set of image data I(x,y). A seamless wavelet-based compression process is effected on I(x,y) that is comprised of successively inputting the tiles T.sub.ij (x,y) in a selected sequence to a DWT routine, and storing the resulting DWT coefficients in a first primary memory. These coefficients are periodically compressed and transferred to a secondary memory to maintain sufficient memory in the primary memory for data processing. The sequence of DWT operations on the tiles T.sub.ij (x,y) effectively calculates a seamless DWT of I(x,y). Data retrieval consists of specifying a resolution and a region of I(x,y) for display. The subset of stored DWT coefficients corresponding to each requested scene is determined and then decompressed for input to an inverse DWT, the output of which forms the image display. The repeated process whereby image views are specified may take the form an interaction with a computer pointing device on an image display from a previous retrieval.

Large-scale retrieval for medical image analytics: A comprehensive review.

PubMed

Li, Zhongyu; Zhang, Xiaofan; Müller, Henning; Zhang, Shaoting

2018-01-01

Over the past decades, medical image analytics was greatly facilitated by the explosion of digital imaging techniques, where huge amounts of medical images were produced with ever-increasing quality and diversity. However, conventional methods for analyzing medical images have achieved limited success, as they are not capable to tackle the huge amount of image data. In this paper, we review state-of-the-art approaches for large-scale medical image analysis, which are mainly based on recent advances in computer vision, machine learning and information retrieval. Specifically, we first present the general pipeline of large-scale retrieval, summarize the challenges/opportunities of medical image analytics on a large-scale. Then, we provide a comprehensive review of algorithms and techniques relevant to major processes in the pipeline, including feature representation, feature indexing, searching, etc. On the basis of existing work, we introduce the evaluation protocols and multiple applications of large-scale medical image retrieval, with a variety of exploratory and diagnostic scenarios. Finally, we discuss future directions of large-scale retrieval, which can further improve the performance of medical image analysis. Copyright © 2017 Elsevier B.V. All rights reserved.

World Wide Web Based Image Search Engine Using Text and Image Content Features

NASA Astrophysics Data System (ADS)

Luo, Bo; Wang, Xiaogang; Tang, Xiaoou

2003-01-01

Using both text and image content features, a hybrid image retrieval system for Word Wide Web is developed in this paper. We first use a text-based image meta-search engine to retrieve images from the Web based on the text information on the image host pages to provide an initial image set. Because of the high-speed and low cost nature of the text-based approach, we can easily retrieve a broad coverage of images with a high recall rate and a relatively low precision. An image content based ordering is then performed on the initial image set. All the images are clustered into different folders based on the image content features. In addition, the images can be re-ranked by the content features according to the user feedback. Such a design makes it truly practical to use both text and image content for image retrieval over the Internet. Experimental results confirm the efficiency of the system.

Content-based cell pathology image retrieval by combining different features

NASA Astrophysics Data System (ADS)

Zhou, Guangquan; Jiang, Lu; Luo, Limin; Bao, Xudong; Shu, Huazhong

2004-04-01

Content Based Color Cell Pathology Image Retrieval is one of the newest computer image processing applications in medicine. Recently, some algorithms have been developed to achieve this goal. Because of the particularity of cell pathology images, the result of the image retrieval based on single characteristic is not satisfactory. A new method for pathology image retrieval by combining color, texture and morphologic features to search cell images is proposed. Firstly, nucleus regions of leukocytes in images are automatically segmented by K-mean clustering method. Then single leukocyte region is detected by utilizing thresholding algorithm segmentation and mathematics morphology. The features that include color, texture and morphologic features are extracted from single leukocyte to represent main attribute in the search query. The features are then normalized because the numerical value range and physical meaning of extracted features are different. Finally, the relevance feedback system is introduced. So that the system can automatically adjust the weights of different features and improve the results of retrieval system according to the feedback information. Retrieval results using the proposed method fit closely with human perception and are better than those obtained with the methods based on single feature.

A novel biomedical image indexing and retrieval system via deep preference learning.

PubMed

Pang, Shuchao; Orgun, Mehmet A; Yu, Zhezhou

2018-05-01

The traditional biomedical image retrieval methods as well as content-based image retrieval (CBIR) methods originally designed for non-biomedical images either only consider using pixel and low-level features to describe an image or use deep features to describe images but still leave a lot of room for improving both accuracy and efficiency. In this work, we propose a new approach, which exploits deep learning technology to extract the high-level and compact features from biomedical images. The deep feature extraction process leverages multiple hidden layers to capture substantial feature structures of high-resolution images and represent them at different levels of abstraction, leading to an improved performance for indexing and retrieval of biomedical images. We exploit the current popular and multi-layered deep neural networks, namely, stacked denoising autoencoders (SDAE) and convolutional neural networks (CNN) to represent the discriminative features of biomedical images by transferring the feature representations and parameters of pre-trained deep neural networks from another domain. Moreover, in order to index all the images for finding the similarly referenced images, we also introduce preference learning technology to train and learn a kind of a preference model for the query image, which can output the similarity ranking list of images from a biomedical image database. To the best of our knowledge, this paper introduces preference learning technology for the first time into biomedical image retrieval. We evaluate the performance of two powerful algorithms based on our proposed system and compare them with those of popular biomedical image indexing approaches and existing regular image retrieval methods with detailed experiments over several well-known public biomedical image databases. Based on different criteria for the evaluation of retrieval performance, experimental results demonstrate that our proposed algorithms outperform the state-of-the-art techniques in indexing biomedical images. We propose a novel and automated indexing system based on deep preference learning to characterize biomedical images for developing computer aided diagnosis (CAD) systems in healthcare. Our proposed system shows an outstanding indexing ability and high efficiency for biomedical image retrieval applications and it can be used to collect and annotate the high-resolution images in a biomedical database for further biomedical image research and applications. Copyright © 2018 Elsevier B.V. All rights reserved.

Validation of MODIS Aerosol Retrieval Over Ocean

NASA Technical Reports Server (NTRS)

Remer, Lorraine A.; Tanre, Didier; Kaufman, Yoram J.; Ichoku, Charles; Mattoo, Shana; Levy, Robert; Chu, D. Allen; Holben, Brent N.; Dubovik, Oleg; Ahmad, Ziauddin;

A Fast Smoothing Algorithm for Post-Processing of Surface Reflectance Spectra Retrieved from Airborne Imaging Spectrometer Data

PubMed Central

Gao, Bo-Cai; Liu, Ming

2013-01-01

Surface reflectance spectra retrieved from remotely sensed hyperspectral imaging data using radiative transfer models often contain residual atmospheric absorption and scattering effects. The reflectance spectra may also contain minor artifacts due to errors in radiometric and spectral calibrations. We have developed a fast smoothing technique for post-processing of retrieved surface reflectance spectra. In the present spectral smoothing technique, model-derived reflectance spectra are first fit using moving filters derived with a cubic spline smoothing algorithm. A common gain curve, which contains minor artifacts in the model-derived reflectance spectra, is then derived. This gain curve is finally applied to all of the reflectance spectra in a scene to obtain the spectrally smoothed surface reflectance spectra. Results from analysis of hyperspectral imaging data collected with the Airborne Visible/Infrared Imaging Spectrometer (AVIRIS) data are given. Comparisons between the smoothed spectra and those derived with the empirical line method are also presented. PMID:24129022

Scalable Integrated Region-Based Image Retrieval Using IRM and Statistical Clustering.

ERIC Educational Resources Information Center

Wang, James Z.; Du, Yanping

Statistical clustering is critical in designing scalable image retrieval systems. This paper presents a scalable algorithm for indexing and retrieving images based on region segmentation. The method uses statistical clustering on region features and IRM (Integrated Region Matching), a measure developed to evaluate overall similarity between images…

Web Image Retrieval Using Self-Organizing Feature Map.

ERIC Educational Resources Information Center

Wu, Qishi; Iyengar, S. Sitharama; Zhu, Mengxia

2001-01-01

Provides an overview of current image retrieval systems. Describes the architecture of the SOFM (Self Organizing Feature Maps) based image retrieval system, discussing the system architecture and features. Introduces the Kohonen model, and describes the implementation details of SOFM computation and its learning algorithm. Presents a test example…

Automated semantic indexing of figure captions to improve radiology image retrieval.

PubMed

Kahn, Charles E; Rubin, Daniel L

2009-01-01

We explored automated concept-based indexing of unstructured figure captions to improve retrieval of images from radiology journals. The MetaMap Transfer program (MMTx) was used to map the text of 84,846 figure captions from 9,004 peer-reviewed, English-language articles to concepts in three controlled vocabularies from the UMLS Metathesaurus, version 2006AA. Sampling procedures were used to estimate the standard information-retrieval metrics of precision and recall, and to evaluate the degree to which concept-based retrieval improved image retrieval. Precision was estimated based on a sample of 250 concepts. Recall was estimated based on a sample of 40 concepts. The authors measured the impact of concept-based retrieval to improve upon keyword-based retrieval in a random sample of 10,000 search queries issued by users of a radiology image search engine. Estimated precision was 0.897 (95% confidence interval, 0.857-0.937). Estimated recall was 0.930 (95% confidence interval, 0.838-1.000). In 5,535 of 10,000 search queries (55%), concept-based retrieval found results not identified by simple keyword matching; in 2,086 searches (21%), more than 75% of the results were found by concept-based search alone. Concept-based indexing of radiology journal figure captions achieved very high precision and recall, and significantly improved image retrieval.

Water vapor retrieval from near-IR measurements of polarized scanning atmospheric corrector

NASA Astrophysics Data System (ADS)

Qie, Lili; Ning, Yuanming; Zhang, Yang; Chen, Xingfeng; Ma, Yan; Li, Zhengqiang; Cui, Wenyu

2018-02-01

Water vapor and aerosol are two key atmospheric factors effecting the remote sensing image quality. As water vapor is responsible for most of the solar radiation absorption occurring in the cloudless atmosphere, accurate measurement of water content is important to not only atmospheric correction of remote sensing images, but also many other applications such as the study of energy balance and global climate change, land surface temperature retrieval in thermal remote sensing. A multi-spectral, single-angular, polarized radiometer called Polarized Scanning Atmospheric Corrector (PSAC) were developed in China, which are designed to mount on the same satellite platform with the principle payload and provide essential parameters for principle payload image atmospheric correction. PSAC detect water vapor content via measuring atmosphere reflectance at water vapor absorbing channels (i.e. 0.91 μm) and nearby atmospheric window channel (i.e. 0.865μm). A near-IR channel ratio method was implemented to retrieve column water vapor (CWV) amount from PSAC measurements. Field experiments were performed at Yantai, in Shandong province of China, PSAC aircraft observations were acquired. The comparison between PSAC retrievals and ground-based Sun-sky radiometer measurements of CWV during the experimental flights illustrates that this method retrieves CWV with relative deviations ranging from 4% 13%. This method retrieve CWV more accurate over land than over ocean, as the water reflectance is low.

Ontology-guided organ detection to retrieve web images of disease manifestation: towards the construction of a consumer-based health image library.

PubMed

Chen, Yang; Ren, Xiaofeng; Zhang, Guo-Qiang; Xu, Rong

2013-01-01

Visual information is a crucial aspect of medical knowledge. Building a comprehensive medical image base, in the spirit of the Unified Medical Language System (UMLS), would greatly benefit patient education and self-care. However, collection and annotation of such a large-scale image base is challenging. To combine visual object detection techniques with medical ontology to automatically mine web photos and retrieve a large number of disease manifestation images with minimal manual labeling effort. As a proof of concept, we first learnt five organ detectors on three detection scales for eyes, ears, lips, hands, and feet. Given a disease, we used information from the UMLS to select affected body parts, ran the pretrained organ detectors on web images, and combined the detection outputs to retrieve disease images. Compared with a supervised image retrieval approach that requires training images for every disease, our ontology-guided approach exploits shared visual information of body parts across diseases. In retrieving 2220 web images of 32 diseases, we reduced manual labeling effort to 15.6% while improving the average precision by 3.9% from 77.7% to 81.6%. For 40.6% of the diseases, we improved the precision by 10%. The results confirm the concept that the web is a feasible source for automatic disease image retrieval for health image database construction. Our approach requires a small amount of manual effort to collect complex disease images, and to annotate them by standard medical ontology terms.

A concept-based interactive biomedical image retrieval approach using visualness and spatial information

NASA Astrophysics Data System (ADS)

Rahman, Md M.; Antani, Sameer K.; Demner-Fushman, Dina; Thoma, George R.

2015-03-01

This paper presents a novel approach to biomedical image retrieval by mapping image regions to local concepts and represent images in a weighted entropy-based concept feature space. The term concept refers to perceptually distinguishable visual patches that are identified locally in image regions and can be mapped to a glossary of imaging terms. Further, the visual significance (e.g., visualness) of concepts is measured as Shannon entropy of pixel values in image patches and is used to refine the feature vector. Moreover, the system can assist user in interactively select a Region-Of-Interest (ROI) and search for similar image ROIs. Further, a spatial verification step is used as a post-processing step to improve retrieval results based on location information. The hypothesis that such approaches would improve biomedical image retrieval, is validated through experiments on a data set of 450 lung CT images extracted from journal articles from four different collections.

Validation of Cloud Parameters Derived from Geostationary Satellites, AVHRR, MODIS, and VIIRS Using SatCORPS Algorithms

NASA Technical Reports Server (NTRS)

Minnis, P.; Sun-Mack, S.; Bedka, K. M.; Yost, C. R.; Trepte, Q. Z.; Smith, W. L., Jr.; Painemal, D.; Chen, Y.; Palikonda, R.; Dong, X.;

Compressed domain indexing of losslessly compressed images

NASA Astrophysics Data System (ADS)

Schaefer, Gerald

2001-12-01

Image retrieval and image compression have been pursued separately in the past. Only little research has been done on a synthesis of the two by allowing image retrieval to be performed directly in the compressed domain of images without the need to uncompress them first. In this paper methods for image retrieval in the compressed domain of losslessly compressed images are introduced. While most image compression techniques are lossy, i.e. discard visually less significant information, lossless techniques are still required in fields like medical imaging or in situations where images must not be changed due to legal reasons. The algorithms in this paper are based on predictive coding methods where a pixel is encoded based on the pixel values of its (already encoded) neighborhood. The first method is based on an understanding that predictively coded data is itself indexable and represents a textural description of the image. The second method operates directly on the entropy encoded data by comparing codebooks of images. Experiments show good image retrieval results for both approaches.

Linear information retrieval method in X-ray grating-based phase contrast imaging and its interchangeability with tomographic reconstruction

NASA Astrophysics Data System (ADS)

Wu, Z.; Gao, K.; Wang, Z. L.; Shao, Q. G.; Hu, R. F.; Wei, C. X.; Zan, G. B.; Wali, F.; Luo, R. H.; Zhu, P. P.; Tian, Y. C.

2017-06-01

In X-ray grating-based phase contrast imaging, information retrieval is necessary for quantitative research, especially for phase tomography. However, numerous and repetitive processes have to be performed for tomographic reconstruction. In this paper, we report a novel information retrieval method, which enables retrieving phase and absorption information by means of a linear combination of two mutually conjugate images. Thanks to the distributive law of the multiplication as well as the commutative law and associative law of the addition, the information retrieval can be performed after tomographic reconstruction, thus simplifying the information retrieval procedure dramatically. The theoretical model of this method is established in both parallel beam geometry for Talbot interferometer and fan beam geometry for Talbot-Lau interferometer. Numerical experiments are also performed to confirm the feasibility and validity of the proposed method. In addition, we discuss its possibility in cone beam geometry and its advantages compared with other methods. Moreover, this method can also be employed in other differential phase contrast imaging methods, such as diffraction enhanced imaging, non-interferometric imaging, and edge illumination.

Breast Histopathological Image Retrieval Based on Latent Dirichlet Allocation.

PubMed

Ma, Yibing; Jiang, Zhiguo; Zhang, Haopeng; Xie, Fengying; Zheng, Yushan; Shi, Huaqiang; Zhao, Yu

2017-07-01

In the field of pathology, whole slide image (WSI) has become the major carrier of visual and diagnostic information. Content-based image retrieval among WSIs can aid the diagnosis of an unknown pathological image by finding its similar regions in WSIs with diagnostic information. However, the huge size and complex content of WSI pose several challenges for retrieval. In this paper, we propose an unsupervised, accurate, and fast retrieval method for a breast histopathological image. Specifically, the method presents a local statistical feature of nuclei for morphology and distribution of nuclei, and employs the Gabor feature to describe the texture information. The latent Dirichlet allocation model is utilized for high-level semantic mining. Locality-sensitive hashing is used to speed up the search. Experiments on a WSI database with more than 8000 images from 15 types of breast histopathology demonstrate that our method achieves about 0.9 retrieval precision as well as promising efficiency. Based on the proposed framework, we are developing a search engine for an online digital slide browsing and retrieval platform, which can be applied in computer-aided diagnosis, pathology education, and WSI archiving and management.

Propagation phasor approach for holographic image reconstruction

PubMed Central

Luo, Wei; Zhang, Yibo; Göröcs, Zoltán; Feizi, Alborz; Ozcan, Aydogan

2016-01-01

To achieve high-resolution and wide field-of-view, digital holographic imaging techniques need to tackle two major challenges: phase recovery and spatial undersampling. Previously, these challenges were separately addressed using phase retrieval and pixel super-resolution algorithms, which utilize the diversity of different imaging parameters. Although existing holographic imaging methods can achieve large space-bandwidth-products by performing pixel super-resolution and phase retrieval sequentially, they require large amounts of data, which might be a limitation in high-speed or cost-effective imaging applications. Here we report a propagation phasor approach, which for the first time combines phase retrieval and pixel super-resolution into a unified mathematical framework and enables the synthesis of new holographic image reconstruction methods with significantly improved data efficiency. In this approach, twin image and spatial aliasing signals, along with other digital artifacts, are interpreted as noise terms that are modulated by phasors that analytically depend on the lateral displacement between hologram and sensor planes, sample-to-sensor distance, wavelength, and the illumination angle. Compared to previous holographic reconstruction techniques, this new framework results in five- to seven-fold reduced number of raw measurements, while still achieving a competitive resolution and space-bandwidth-product. We also demonstrated the success of this approach by imaging biological specimens including Papanicolaou and blood smears. PMID:26964671

Phase retrieval using regularization method in intensity correlation imaging

NASA Astrophysics Data System (ADS)

Li, Xiyu; Gao, Xin; Tang, Jia; Lu, Changming; Wang, Jianli; Wang, Bin

2014-11-01

Intensity correlation imaging(ICI) method can obtain high resolution image with ground-based low precision mirrors, in the imaging process, phase retrieval algorithm should be used to reconstituted the object's image. But the algorithm now used(such as hybrid input-output algorithm) is sensitive to noise and easy to stagnate. However the signal-to-noise ratio of intensity interferometry is low especially in imaging astronomical objects. In this paper, we build the mathematical model of phase retrieval and simplified it into a constrained optimization problem of a multi-dimensional function. New error function was designed by noise distribution and prior information using regularization method. The simulation results show that the regularization method can improve the performance of phase retrieval algorithm and get better image especially in low SNR condition

Global Contrast Based Salient Region Detection.

PubMed

Cheng, Ming-Ming; Mitra, Niloy J; Huang, Xiaolei; Torr, Philip H S; Hu, Shi-Min

2015-03-01

Automatic estimation of salient object regions across images, without any prior assumption or knowledge of the contents of the corresponding scenes, enhances many computer vision and computer graphics applications. We introduce a regional contrast based salient object detection algorithm, which simultaneously evaluates global contrast differences and spatial weighted coherence scores. The proposed algorithm is simple, efficient, naturally multi-scale, and produces full-resolution, high-quality saliency maps. These saliency maps are further used to initialize a novel iterative version of GrabCut, namely SaliencyCut, for high quality unsupervised salient object segmentation. We extensively evaluated our algorithm using traditional salient object detection datasets, as well as a more challenging Internet image dataset. Our experimental results demonstrate that our algorithm consistently outperforms 15 existing salient object detection and segmentation methods, yielding higher precision and better recall rates. We also show that our algorithm can be used to efficiently extract salient object masks from Internet images, enabling effective sketch-based image retrieval (SBIR) via simple shape comparisons. Despite such noisy internet images, where the saliency regions are ambiguous, our saliency guided image retrieval achieves a superior retrieval rate compared with state-of-the-art SBIR methods, and additionally provides important target object region information.

Natural texture retrieval based on perceptual similarity measurement

NASA Astrophysics Data System (ADS)

Gao, Ying; Dong, Junyu; Lou, Jianwen; Qi, Lin; Liu, Jun

2018-04-01

A typical texture retrieval system performs feature comparison and might not be able to make human-like judgments of image similarity. Meanwhile, it is commonly known that perceptual texture similarity is difficult to be described by traditional image features. In this paper, we propose a new texture retrieval scheme based on texture perceptual similarity. The key of the proposed scheme is that prediction of perceptual similarity is performed by learning a non-linear mapping from image features space to perceptual texture space by using Random Forest. We test the method on natural texture dataset and apply it on a new wallpapers dataset. Experimental results demonstrate that the proposed texture retrieval scheme with perceptual similarity improves the retrieval performance over traditional image features.

Complex amplitude reconstruction by iterative amplitude-phase retrieval algorithm with reference

NASA Astrophysics Data System (ADS)

Shen, Cheng; Guo, Cheng; Tan, Jiubin; Liu, Shutian; Liu, Zhengjun

2018-06-01

Multi-image iterative phase retrieval methods have been successfully applied in plenty of research fields due to their simple but efficient implementation. However, there is a mismatch between the measurement of the first long imaging distance and the sequential interval. In this paper, an amplitude-phase retrieval algorithm with reference is put forward without additional measurements or priori knowledge. It gets rid of measuring the first imaging distance. With a designed update formula, it significantly raises the convergence speed and the reconstruction fidelity, especially in phase retrieval. Its superiority over the original amplitude-phase retrieval (APR) method is validated by numerical analysis and experiments. Furthermore, it provides a conceptual design of a compact holographic image sensor, which can achieve numerical refocusing easily.

Taxing Working Memory during Retrieval of Emotional Memories Does Not Reduce Memory Accessibility When Cued with Reminders

PubMed Central

van Schie, Kevin; Engelhard, Iris M.; van den Hout, Marcel A.

2015-01-01

Earlier studies have shown that when individuals recall an emotional memory while simultaneously doing a demanding dual-task [e.g., playing Tetris, mental arithmetic, making eye movements (EM)], this reduces self-reported vividness and emotionality of the memory. These effects have been found up to 1 week later, but have largely been confined to self-report ratings. This study examined whether this dual-tasking intervention reduces memory performance (i.e., accessibility of emotional memories). Undergraduates (N = 60) studied word-image pairs and rated the retrieved image on vividness and emotionality when cued with the word. Then they viewed the cues and recalled the images with or without making EM. Finally, they re-rated the images on vividness and emotionality. Additionally, fragments from images from all conditions were presented and participants identified which fragment was paired earlier with which cue. Findings showed no effect of the dual-task manipulation on self-reported ratings and latency responses. Several possible explanations for the lack of effects are discussed, but the cued recall procedure in our experiment seems to explain the absence of effects best. The study demonstrates boundaries to the effects of the “dual-tasking” procedure. PMID:25729370

Leveraging Terminologies for Retrieval of Radiology Reports with Critical Imaging Findings

PubMed Central

Warden, Graham I.; Lacson, Ronilda; Khorasani, Ramin

2011-01-01

Introduction: Communication of critical imaging findings is an important component of medical quality and safety. A fundamental challenge includes retrieval of radiology reports that contain these findings. This study describes the expressiveness and coverage of existing medical terminologies for critical imaging findings and evaluates radiology report retrieval using each terminology. Methods: Four terminologies were evaluated: National Cancer Institute Thesaurus (NCIT), Radiology Lexicon (RadLex), Systemized Nomenclature of Medicine (SNOMED-CT), and International Classification of Diseases (ICD-9-CM). Concepts in each terminology were identified for 10 critical imaging findings. Three findings were subsequently selected to evaluate document retrieval. Results: SNOMED-CT consistently demonstrated the highest number of overall terms (mean=22) for each of ten critical findings. However, retrieval rate and precision varied between terminologies for the three findings evaluated. Conclusion: No single terminology is optimal for retrieving radiology reports with critical findings. The expressiveness of a terminology does not consistently correlate with radiology report retrieval. PMID:22195212

Neural correlates of emotional recognition memory in schizophrenia: effects of valence and arousal.

PubMed

Lakis, Nadia; Jiménez, José A; Mancini-Marïe, Adham; Stip, Emmanuel; Lavoie, Marc E; Mendrek, Adrianna

2011-12-30

Schizophrenia patients are often impaired in their memory for emotional events compared with healthy subjects. Investigations of the neural correlates of emotional memory in schizophrenia patients are scarce in the literature. The present study aimed to compare cerebral activations in schizophrenia patients and healthy controls during memory retrieval of emotional images that varied in both valence and arousal. In a study with functional magnetic resonance imaging, 37 schizophrenia patients were compared with 37 healthy participants while performing a yes/no recognition paradigm with positive, negative (differing in arousal intensity) and neutral images. Schizophrenia patients performed worse than healthy controls in all experimental conditions. They showed less cerebral activation in limbic and prefrontal regions than controls during retrieval of negatively valenced stimuli, but had a similar pattern of brain activation compared with controls during retrieval of positively valenced stimuli (particularly in the high arousal condition) in the cerebellum, temporal lobe and prefrontal cortex. Both groups demonstrated increased brain activations in the high relative to low arousing conditions. Our results suggest atypical brain function during retrieval of negative pictures, but intact functional circuitry of positive affect during episodic memory retrieval in schizophrenia patients. The arousal data revealed that schizophrenia patients closely resemble the control group at both the behavioral and neurofunctional level. 2011 Elsevier Ireland Ltd. All rights reserved.

Neural network retrievals of Karenia brevis harmful algal blooms in the West Florida Shelf (Conference Presentation)

NASA Astrophysics Data System (ADS)

Ahmed, Samir; El-Habashi, Ahmed

2016-10-01

Effective detection and tracking of Karenia brevis Harmful Algal Blooms (KB HAB) that frequently plague the coasts and beaches of the West Florida Shelf (WFS) is important because of their negative impacts on ecology. They pose threats to fisheries, human health, and directly affect tourism and local economies. Detection and tracking capabilities are needed for use with the Visible Infrared Imaging Radiometer Suite (VIIRS) satellite, so that HABs monitoring capabilities, which previously relied on imagery from the Moderate Resolution Imaging Spectroradiometer Aqua, can be extended to VIIRS. Unfortunately, VIIRS, unlike its predecessor MODIS-A, does not have a 678 nm channel to detect chlorophyll fluorescence, which is used in the normalized fluorescence height (nFLH) algorithm, or in the Red Band Difference (RBD) algorithm. Both these techniques have demonstrated that the remote sensing reflectance signal from the MODIS-A fluorescence band (Rrs 678 nm) helps in effectively detecting and tracking KB HABs in the WFS. To overcome the lack of a fluorescence channel on VIIRS, the approach described here, bypasses the need for measurements at 678nm, and permits extension of KB HABs satellite monitoring to VIIRS. The essence of the approach is the application of a standard multiband neural network (NN) inversion algorithm, previously developed and reported by us, that takes VIIRS Rrs measurements at the 486, 551 and 671nm bands as inputs, and produces as output the related Inherent Optical Properties (IOPs), namely: absorption coefficients of phytoplankton (aph443) dissolved organic matter (ag) and non-algal particulates (adm) as well as the particulate backscatter coefficient, (bbp) all at 443nm. We next need to relate aph443 in the VIIRS NN retrieved image to equivalent KB HABs concentrations. To do this, we apply additional constraints, defined by (i) low backscatter manifested as a maximum Rrs551 value and (ii) a minimum [Chla] threshold (and hence an equivalent minimum aph443min value) that are both known to be associated with KB HABs in the WFS. These two constraining filter processes are applied sequentially to the VIIRS NN retrieved aph443 image. First an image is made of retrieved VIIRS Rrs551. A mask is then made of all pixels with Rrs551≥ Rrs551max, the maximum value known to be compatible with the existence KB HABs. This is applied, as a filter to the VIIRS NN retrieved aph443 image to exclude pixels with Rrs551≥ Rrs551max. The residual image will then only show aph443 values that comply with Rrs551≤ Rrs551max. Then, in a second filter process, all values of aph443 ≤ aph443min are eliminated. The residual image will now only show aph443 values that are compatible with both criteria for KB HABs, and are therefore representative of KB HABs. It will be shown that when both these filter condition are applied to VIIRS NN aph443 retrievals, they can be used to effectively delineate and quantify KB HABs in the WFS. The KB HABs retrieved in this manner also show good correlations with in-situ KB HABs measurements as well as with nFLH retrievals and other techniques to which the same filtering criteria have been applied, confirming the viability of the approach.

Efficient Retrieval of Massive Ocean Remote Sensing Images via a Cloud-Based Mean-Shift Algorithm.

PubMed

Yang, Mengzhao; Song, Wei; Mei, Haibin

2017-07-23

The rapid development of remote sensing (RS) technology has resulted in the proliferation of high-resolution images. There are challenges involved in not only storing large volumes of RS images but also in rapidly retrieving the images for ocean disaster analysis such as for storm surges and typhoon warnings. In this paper, we present an efficient retrieval of massive ocean RS images via a Cloud-based mean-shift algorithm. Distributed construction method via the pyramid model is proposed based on the maximum hierarchical layer algorithm and used to realize efficient storage structure of RS images on the Cloud platform. We achieve high-performance processing of massive RS images in the Hadoop system. Based on the pyramid Hadoop distributed file system (HDFS) storage method, an improved mean-shift algorithm for RS image retrieval is presented by fusion with the canopy algorithm via Hadoop MapReduce programming. The results show that the new method can achieve better performance for data storage than HDFS alone and WebGIS-based HDFS. Speedup and scaleup are very close to linear changes with an increase of RS images, which proves that image retrieval using our method is efficient.

Efficient Retrieval of Massive Ocean Remote Sensing Images via a Cloud-Based Mean-Shift Algorithm

PubMed Central

Song, Wei; Mei, Haibin

2017-01-01

The rapid development of remote sensing (RS) technology has resulted in the proliferation of high-resolution images. There are challenges involved in not only storing large volumes of RS images but also in rapidly retrieving the images for ocean disaster analysis such as for storm surges and typhoon warnings. In this paper, we present an efficient retrieval of massive ocean RS images via a Cloud-based mean-shift algorithm. Distributed construction method via the pyramid model is proposed based on the maximum hierarchical layer algorithm and used to realize efficient storage structure of RS images on the Cloud platform. We achieve high-performance processing of massive RS images in the Hadoop system. Based on the pyramid Hadoop distributed file system (HDFS) storage method, an improved mean-shift algorithm for RS image retrieval is presented by fusion with the canopy algorithm via Hadoop MapReduce programming. The results show that the new method can achieve better performance for data storage than HDFS alone and WebGIS-based HDFS. Speedup and scaleup are very close to linear changes with an increase of RS images, which proves that image retrieval using our method is efficient. PMID:28737699

Dynamic "inline" images: context-sensitive retrieval and integration of images into Web documents.

PubMed

Kahn, Charles E

2008-09-01

Integrating relevant images into web-based information resources adds value for research and education. This work sought to evaluate the feasibility of using "Web 2.0" technologies to dynamically retrieve and integrate pertinent images into a radiology web site. An online radiology reference of 1,178 textual web documents was selected as the set of target documents. The ARRS GoldMiner image search engine, which incorporated 176,386 images from 228 peer-reviewed journals, retrieved images on demand and integrated them into the documents. At least one image was retrieved in real-time for display as an "inline" image gallery for 87% of the web documents. Each thumbnail image was linked to the full-size image at its original web site. Review of 20 randomly selected Collaborative Hypertext of Radiology documents found that 69 of 72 displayed images (96%) were relevant to the target document. Users could click on the "More" link to search the image collection more comprehensively and, from there, link to the full text of the article. A gallery of relevant radiology images can be inserted easily into web pages on any web server. Indexing by concepts and keywords allows context-aware image retrieval, and searching by document title and subject metadata yields excellent results. These techniques allow web developers to incorporate easily a context-sensitive image gallery into their documents.

Automated Semantic Indexing of Figure Captions to Improve Radiology Image Retrieval

PubMed Central

Kahn, Charles E.; Rubin, Daniel L.

2009-01-01

Objective We explored automated concept-based indexing of unstructured figure captions to improve retrieval of images from radiology journals. Design The MetaMap Transfer program (MMTx) was used to map the text of 84,846 figure captions from 9,004 peer-reviewed, English-language articles to concepts in three controlled vocabularies from the UMLS Metathesaurus, version 2006AA. Sampling procedures were used to estimate the standard information-retrieval metrics of precision and recall, and to evaluate the degree to which concept-based retrieval improved image retrieval. Measurements Precision was estimated based on a sample of 250 concepts. Recall was estimated based on a sample of 40 concepts. The authors measured the impact of concept-based retrieval to improve upon keyword-based retrieval in a random sample of 10,000 search queries issued by users of a radiology image search engine. Results Estimated precision was 0.897 (95% confidence interval, 0.857–0.937). Estimated recall was 0.930 (95% confidence interval, 0.838–1.000). In 5,535 of 10,000 search queries (55%), concept-based retrieval found results not identified by simple keyword matching; in 2,086 searches (21%), more than 75% of the results were found by concept-based search alone. Conclusion Concept-based indexing of radiology journal figure captions achieved very high precision and recall, and significantly improved image retrieval. PMID:19261938

Percutaneous Management of Accidentally Retained Foreign Bodies During Image-Guided Non-vascular Procedures: Novel Technique Using a Large-Bore Biopsy System

DOE Office of Scientific and Technical Information (OSTI.GOV)

Cazzato, Roberto Luigi, E-mail: gigicazzato@hotmail.it; Garnon, Julien, E-mail: juleiengarnon@gmail.com; Ramamurthy, Nitin, E-mail: nitin-ramamurthy@hotmail.com

ObjectiveTo describe a novel percutaneous image-guided technique using a large-bore biopsy system to retrieve foreign bodies (FBs) accidentally retained during non-vascular interventional procedures.Materials and MethodsBetween May 2013 and October 2015, five patients underwent percutaneous retrieval of five iatrogenic FBs, including a biopsy needle tip in the femoral head following osteoblastoma biopsy and radiofrequency ablation (RFA); a co-axial needle shaft within a giant desmoid tumour following cryoablation; and three post-vertebroplasty cement tails within paraspinal muscles. All FBs were retrieved immediately following original procedures under local or general anaesthesia, using combined computed tomography (CT) and fluoroscopic guidance. The basic technique involved positioningmore » a 6G trocar sleeve around the FB long axis and co-axially advancing an 8G biopsy needle to retrieve the FB within the biopsy core. Retrospective chart review facilitated analysis of procedures, FBs, technical success, and complications.ResultsMean FB size was 23 mm (range 8–74 mm). Four FBs were located within 10 mm of non-vascular significant anatomic structures. The basic technique was successful in 3 cases; 2 cases required technical modifications including using a stiff guide-wire to facilitate retrieval in the case of the post-cryoablation FB; and using the central mandrin of the 6G trocar to push a cement tract back into an augmented vertebra when initial retrieval failed. Overall technical success (FB retrieval or removal to non-hazardous location) was 100 %, with no complications.ConclusionPercutaneous image-guided retrieval of iatrogenic FBs using a large-bore biopsy system is a feasible, safe, effective, and versatile technique, with potential advantages over existing methods.« less

Uncertainties in cloud phase and optical thickness retrievals from the Earth Polychromatic Imaging Camera (EPIC)

NASA Astrophysics Data System (ADS)

Meyer, Kerry; Yang, Yuekui; Platnick, Steven

2016-04-01

This paper presents an investigation of the expected uncertainties of a single-channel cloud optical thickness (COT) retrieval technique, as well as a simple cloud-temperature-threshold-based thermodynamic phase approach, in support of the Deep Space Climate Observatory (DSCOVR) mission. DSCOVR cloud products will be derived from Earth Polychromatic Imaging Camera (EPIC) observations in the ultraviolet and visible spectra. Since EPIC is not equipped with a spectral channel in the shortwave or mid-wave infrared that is sensitive to cloud effective radius (CER), COT will be inferred from a single visible channel with the assumption of appropriate CER values for liquid and ice phase clouds. One month of Aqua MODerate-resolution Imaging Spectroradiometer (MODIS) daytime granules from April 2005 is selected for investigating cloud phase sensitivity, and a subset of these granules that has similar EPIC Sun-view geometry is selected for investigating COT uncertainties. EPIC COT retrievals are simulated with the same algorithm as the operational MODIS cloud products (MOD06), except using fixed phase-dependent CER values. Uncertainty estimates are derived by comparing the single-channel COT retrievals with the baseline bi-spectral MODIS retrievals. Results show that a single-channel COT retrieval is feasible for EPIC. For ice clouds, single-channel retrieval errors are minimal (< 2 %) due to the particle size insensitivity of the assumed ice crystal (i.e., severely roughened aggregate of hexagonal columns) scattering properties at visible wavelengths, while for liquid clouds the error is mostly limited to within 10 %, although for thin clouds (COT < 2) the error can be higher. Potential uncertainties in EPIC cloud masking and cloud temperature retrievals are not considered in this study.

User-oriented evaluation of a medical image retrieval system for radiologists.

PubMed

Markonis, Dimitrios; Holzer, Markus; Baroz, Frederic; De Castaneda, Rafael Luis Ruiz; Boyer, Célia; Langs, Georg; Müller, Henning

2015-10-01

This article reports the user-oriented evaluation of a text- and content-based medical image retrieval system. User tests with radiologists using a search system for images in the medical literature are presented. The goal of the tests is to assess the usability of the system, identify system and interface aspects that need improvement and useful additions. Another objective is to investigate the system's added value to radiology information retrieval. The study provides an insight into required specifications and potential shortcomings of medical image retrieval systems through a concrete methodology for conducting user tests. User tests with a working image retrieval system of images from the biomedical literature were performed in an iterative manner, where each iteration had the participants perform radiology information seeking tasks and then refining the system as well as the user study design itself. During these tasks the interaction of the users with the system was monitored, usability aspects were measured, retrieval success rates recorded and feedback was collected through survey forms. In total, 16 radiologists participated in the user tests. The success rates in finding relevant information were on average 87% and 78% for image and case retrieval tasks, respectively. The average time for a successful search was below 3 min in both cases. Users felt quickly comfortable with the novel techniques and tools (after 5 to 15 min), such as content-based image retrieval and relevance feedback. User satisfaction measures show a very positive attitude toward the system's functionalities while the user feedback helped identifying the system's weak points. The participants proposed several potentially useful new functionalities, such as filtering by imaging modality and search for articles using image examples. The iterative character of the evaluation helped to obtain diverse and detailed feedback on all system aspects. Radiologists are quickly familiar with the functionalities but have several comments on desired functionalities. The analysis of the results can potentially assist system refinement for future medical information retrieval systems. Moreover, the methodology presented as well as the discussion on the limitations and challenges of such studies can be useful for user-oriented medical image retrieval evaluation, as user-oriented evaluation of interactive system is still only rarely performed. Such interactive evaluations can be limited in effort if done iteratively and can give many insights for developing better systems. Copyright © 2015. Published by Elsevier Ireland Ltd.

Effective method for detecting regions of given colors and the features of the region surfaces

NASA Astrophysics Data System (ADS)

Gong, Yihong; Zhang, HongJiang

1994-03-01

Color can be used as a very important cue for image recognition. In industrial and commercial areas, color is widely used as a trademark or identifying feature in objects, such as packaged goods, advertising signs, etc. In image database systems, one may retrieve an image of interest by specifying prominent colors and their locations in the image (image retrieval by contents). These facts enable us to detect or identify a target object using colors. However, this task depends mainly on how effectively we can identify a color and detect regions of the given color under possibly non-uniform illumination conditions such as shade, highlight, and strong contrast. In this paper, we present an effective method to detect regions matching given colors, along with the features of the region surfaces. We adopt the HVC color coordinates in the method because of its ability of completely separating the luminant and chromatic components of colors. Three basis functions functionally serving as the low-pass, high-pass, and band-pass filters, respectively, are introduced.

Improvements for retrieval of cloud droplet size by the POLDER instrument

NASA Astrophysics Data System (ADS)

Shang, H.; Husi, L.; Bréon, F. M.; Ma, R.; Chen, L.; Wang, Z.

2017-12-01

The principles of cloud droplet size retrieval via Polarization and Directionality of the Earth's Reflectance (POLDER) requires that clouds be horizontally homogeneous. The retrieval is performed by combining all measurements from an area of 150 km × 150 km to compensate for POLDER's insufficient directional sampling. Using POLDER-like data simulated with the RT3 model, we investigate the impact of cloud horizontal inhomogeneity and directional sampling on the retrieval and analyze which spatial resolution is potentially accessible from the measurements. Case studies show that the sub-grid-scale variability in droplet effective radius (CDR) can significantly reduce valid retrievals and introduce small biases to the CDR ( 1.5µm) and effective variance (EV) estimates. Nevertheless, the sub-grid-scale variations in EV and cloud optical thickness (COT) only influence the EV retrievals and not the CDR estimate. In the directional sampling cases studied, the retrieval using limited observations is accurate and is largely free of random noise. Several improvements have been made to the original POLDER droplet size retrieval. For example, measurements in the primary rainbow region (137-145°) are used to ensure retrievals of large droplet (>15 µm) and to reduce the uncertainties caused by cloud heterogeneity. A premium resoltion of 0.8° is determined by considering successful retrievals and cloud horizontal homogeneity. The improved algorithm is applied to measurements of POLDER in 2008, and we further compared our retrievals with cloud effective radii estimations of Moderate Resolution Imaging Spectroradiometer (MODIS). The results indicate that in global scale, the cloud effective radii and effective variance is larger in the central ocean than inland and coast areas. Over heavy polluted regions, the cloud droplets has small effective radii and narraw distribution due to the influence of aerosol particles.

Phase retrieval by coherent modulation imaging.

PubMed

Zhang, Fucai; Chen, Bo; Morrison, Graeme R; Vila-Comamala, Joan; Guizar-Sicairos, Manuel; Robinson, Ian K

2016-11-18

Phase retrieval is a long-standing problem in imaging when only the intensity of the wavefield can be recorded. Coherent diffraction imaging is a lensless technique that uses iterative algorithms to recover amplitude and phase contrast images from diffraction intensity data. For general samples, phase retrieval from a single-diffraction pattern has been an algorithmic and experimental challenge. Here we report a method of phase retrieval that uses a known modulation of the sample exit wave. This coherent modulation imaging method removes inherent ambiguities of coherent diffraction imaging and uses a reliable, rapidly converging iterative algorithm involving three planes. It works for extended samples, does not require tight support for convergence and relaxes dynamic range requirements on the detector. Coherent modulation imaging provides a robust method for imaging in materials and biological science, while its single-shot capability will benefit the investigation of dynamical processes with pulsed sources, such as X-ray free-electron lasers.

A novel class sensitive hashing technique for large-scale content-based remote sensing image retrieval

NASA Astrophysics Data System (ADS)

Reato, Thomas; Demir, Begüm; Bruzzone, Lorenzo

2017-10-01

This paper presents a novel class sensitive hashing technique in the framework of large-scale content-based remote sensing (RS) image retrieval. The proposed technique aims at representing each image with multi-hash codes, each of which corresponds to a primitive (i.e., land cover class) present in the image. To this end, the proposed method consists of a three-steps algorithm. The first step is devoted to characterize each image by primitive class descriptors. These descriptors are obtained through a supervised approach, which initially extracts the image regions and their descriptors that are then associated with primitives present in the images. This step requires a set of annotated training regions to define primitive classes. A correspondence between the regions of an image and the primitive classes is built based on the probability of each primitive class to be present at each region. All the regions belonging to the specific primitive class with a probability higher than a given threshold are highly representative of that class. Thus, the average value of the descriptors of these regions is used to characterize that primitive. In the second step, the descriptors of primitive classes are transformed into multi-hash codes to represent each image. This is achieved by adapting the kernel-based supervised locality sensitive hashing method to multi-code hashing problems. The first two steps of the proposed technique, unlike the standard hashing methods, allow one to represent each image by a set of primitive class sensitive descriptors and their hash codes. Then, in the last step, the images in the archive that are very similar to a query image are retrieved based on a multi-hash-code-matching scheme. Experimental results obtained on an archive of aerial images confirm the effectiveness of the proposed technique in terms of retrieval accuracy when compared to the standard hashing methods.

Web-based multimedia information retrieval for clinical application research

NASA Astrophysics Data System (ADS)

Cao, Xinhua; Hoo, Kent S., Jr.; Zhang, Hong; Ching, Wan; Zhang, Ming; Wong, Stephen T. C.

2001-08-01

We described a web-based data warehousing method for retrieving and analyzing neurological multimedia information. The web-based method supports convenient access, effective search and retrieval of clinical textual and image data, and on-line analysis. To improve the flexibility and efficiency of multimedia information query and analysis, a three-tier, multimedia data warehouse for epilepsy research has been built. The data warehouse integrates clinical multimedia data related to epilepsy from disparate sources and archives them into a well-defined data model.

Optical image encryption via high-quality computational ghost imaging using iterative phase retrieval

NASA Astrophysics Data System (ADS)

Liansheng, Sui; Yin, Cheng; Bing, Li; Ailing, Tian; Krishna Asundi, Anand

2018-07-01

A novel computational ghost imaging scheme based on specially designed phase-only masks, which can be efficiently applied to encrypt an original image into a series of measured intensities, is proposed in this paper. First, a Hadamard matrix with a certain order is generated, where the number of elements in each row is equal to the size of the original image to be encrypted. Each row of the matrix is rearranged into the corresponding 2D pattern. Then, each pattern is encoded into the phase-only masks by making use of an iterative phase retrieval algorithm. These specially designed masks can be wholly or partially used in the process of computational ghost imaging to reconstruct the original information with high quality. When a significantly small number of phase-only masks are used to record the measured intensities in a single-pixel bucket detector, the information can be authenticated without clear visualization by calculating the nonlinear correlation map between the original image and its reconstruction. The results illustrate the feasibility and effectiveness of the proposed computational ghost imaging mechanism, which will provide an effective alternative for enriching the related research on the computational ghost imaging technique.

A comparative study for chest radiograph image retrieval using binary texture and deep learning classification.

PubMed

Anavi, Yaron; Kogan, Ilya; Gelbart, Elad; Geva, Ofer; Greenspan, Hayit

2015-08-01

In this work various approaches are investigated for X-ray image retrieval and specifically chest pathology retrieval. Given a query image taken from a data set of 443 images, the objective is to rank images according to similarity. Different features, including binary features, texture features, and deep learning (CNN) features are examined. In addition, two approaches are investigated for the retrieval task. One approach is based on the distance of image descriptors using the above features (hereon termed the "descriptor"-based approach); the second approach ("classification"-based approach) is based on a probability descriptor, generated by a pair-wise classification of each two classes (pathologies) and their decision values using an SVM classifier. Best results are achieved using deep learning features in a classification scheme.

A novel content-based medical image retrieval method based on query topic dependent image features (QTDIF)

NASA Astrophysics Data System (ADS)

Xiong, Wei; Qiu, Bo; Tian, Qi; Mueller, Henning; Xu, Changsheng

2005-04-01

Medical image retrieval is still mainly a research domain with a large variety of applications and techniques. With the ImageCLEF 2004 benchmark, an evaluation framework has been created that includes a database, query topics and ground truth data. Eleven systems (with a total of more than 50 runs) compared their performance in various configurations. The results show that there is not any one feature that performs well on all query tasks. Key to successful retrieval is rather the selection of features and feature weights based on a specific set of input features, thus on the query task. In this paper we propose a novel method based on query topic dependent image features (QTDIF) for content-based medical image retrieval. These feature sets are designed to capture both inter-category and intra-category statistical variations to achieve good retrieval performance in terms of recall and precision. We have used Gaussian Mixture Models (GMM) and blob representation to model medical images and construct the proposed novel QTDIF for CBIR. Finally, trained multi-class support vector machines (SVM) are used for image similarity ranking. The proposed methods have been tested over the Casimage database with around 9000 images, for the given 26 image topics, used for imageCLEF 2004. The retrieval performance has been compared with the medGIFT system, which is based on the GNU Image Finding Tool (GIFT). The experimental results show that the proposed QTDIF-based CBIR can provide significantly better performance than systems based general features only.

The impact of self-imagery on aspects of the self-concept in individuals with high levels of eating disorder cognitions.

PubMed

Harlowe, Jodie; Farrar, Stephanie; Stopa, Lusia; Turner, Hannah

2018-05-08

Low self-esteem has been identified as a maintaining factor in Cognitive Behavioural models of eating disorders and links have been identified between early memories, negative core beliefs and mental imagery. This study explored the impact of positive and negative self-imagery on aspects of the working self (implicit and explicit self-esteem, self-concept clarity and self-discrepancy) and affect. Participants with high levels of eating disorder cognitions completed measures of explicit self-esteem, self-concept clarity, self-discrepancy and affect prior to completing a positive or negative self-imagery retrieval task. Baseline measures were then repeated and a measure of implicit self-esteem completed. Positive self-imagery retrieval led to a significant increase in positive explicit self-esteem and a significant reduction in negative explicit self-esteem and actual-ideal self-discrepancies. Negative self-imagery retrieval led to a significant increase in negative explicit self-esteem and actual-ideal self-discrepancies and a significant reduction in positive explicit self-esteem. Levels of implicit self-esteem did not differ between the two groups post imagery manipulation. Retrieving a positive self-image also led to an improvement in state self-concept clarity; however, no effect was found for the negative self-imagery intervention. Holding a positive self-image in mind led to an increase in state positive affect and a reduction in state negative affect. The opposite was found for negative self-image retrieval. The study did not measure implicit self-esteem at baseline. Imagery techniques that involve the retrieval of a positive self-image may help to improve aspects of the working-self and affect in those with eating difficulties. Copyright © 2018 Elsevier Ltd. All rights reserved.

Can Imageability Help Us Draw the Line between Storage and Composition?

ERIC Educational Resources Information Center

Prado, Elizabeth L.; Ullman, Michael T.

2009-01-01

Language requires both storage and composition. However, exactly what is retrieved from memory and what is assembled remains controversial, especially for inflected words. Here, "imageability effects" is introduced as a new diagnostic of storage and a complement to frequency effects. In 2 studies of past-tense morphology, more reliable…

Measuring and Predicting Tag Importance for Image Retrieval.

PubMed

Li, Shangwen; Purushotham, Sanjay; Chen, Chen; Ren, Yuzhuo; Kuo, C-C Jay

2017-12-01

Textual data such as tags, sentence descriptions are combined with visual cues to reduce the semantic gap for image retrieval applications in today's Multimodal Image Retrieval (MIR) systems. However, all tags are treated as equally important in these systems, which may result in misalignment between visual and textual modalities during MIR training. This will further lead to degenerated retrieval performance at query time. To address this issue, we investigate the problem of tag importance prediction, where the goal is to automatically predict the tag importance and use it in image retrieval. To achieve this, we first propose a method to measure the relative importance of object and scene tags from image sentence descriptions. Using this as the ground truth, we present a tag importance prediction model to jointly exploit visual, semantic and context cues. The Structural Support Vector Machine (SSVM) formulation is adopted to ensure efficient training of the prediction model. Then, the Canonical Correlation Analysis (CCA) is employed to learn the relation between the image visual feature and tag importance to obtain robust retrieval performance. Experimental results on three real-world datasets show a significant performance improvement of the proposed MIR with Tag Importance Prediction (MIR/TIP) system over other MIR systems.

Passive remote sensing of altitude and optical depth of dust plumes using the oxygen A and B bands: First results from EPIC/DSCOVR at Lagrange-1 point

NASA Astrophysics Data System (ADS)

Xu, Xiaoguang; Wang, Jun; Wang, Yi; Zeng, Jing; Torres, Omar; Yang, Yuekui; Marshak, Alexander; Reid, Jeffrey; Miller, Steve

2017-07-01

We presented an algorithm for inferring aerosol layer height (ALH) and optical depth (AOD) over ocean surface from radiances in oxygen A and B bands measured by the Earth Polychromatic Imaging Camera (EPIC) on the Deep Space Climate Observatory (DSCOVR) orbiting at Lagrangian-1 point. The algorithm was applied to EPIC imagery of a 2 day dust outbreak over the North Atlantic Ocean. Retrieved ALHs and AODs were evaluated against counterparts observed by Cloud-Aerosol Lidar with Orthogonal Polarization (CALIOP), Moderate Resolution Imaging Spectroradiometer, and Aerosol Robotic Network. The comparisons showed 71.5% of EPIC-retrieved ALHs were within ±0.5 km of those determined from CALIOP and 74.4% of EPIC AOD retrievals fell within a ± (0.1 + 10%) envelope of MODIS retrievals. This study demonstrates the potential of EPIC measurements for retrieving global aerosol height multiple times daily, which are essential for evaluating aerosol profile simulated in climate models and for better estimating aerosol radiative effects.

Ice surface temperature retrieval from AVHRR, ATSR, and passive microwave satellite data: Algorithm development and application

NASA Technical Reports Server (NTRS)

Key, Jeff; Maslanik, James; Steffen, Konrad

1995-01-01

During the second phase project year we have made progress in the development and refinement of surface temperature retrieval algorithms and in product generation. More specifically, we have accomplished the following: (1) acquired a new advanced very high resolution radiometer (AVHRR) data set for the Beaufort Sea area spanning an entire year; (2) acquired additional along-track scanning radiometer(ATSR) data for the Arctic and Antarctic now totalling over eight months; (3) refined our AVHRR Arctic and Antarctic ice surface temperature (IST) retrieval algorithm, including work specific to Greenland; (4) developed ATSR retrieval algorithms for the Arctic and Antarctic, including work specific to Greenland; (5) developed cloud masking procedures for both AVHRR and ATSR; (6) generated a two-week bi-polar global area coverage (GAC) set of composite images from which IST is being estimated; (7) investigated the effects of clouds and the atmosphere on passive microwave 'surface' temperature retrieval algorithms; and (8) generated surface temperatures for the Beaufort Sea data set, both from AVHRR and special sensor microwave imager (SSM/I).

Medical image digital archive: a comparison of storage technologies

NASA Astrophysics Data System (ADS)

Chunn, Timothy; Hutchings, Matt

1998-07-01

A cost effective, high capacity digital archive system is one of the remaining key factors that will enable a radiology department to eliminate film as an archive medium. The ever increasing amount of digital image data is creating the need for huge archive systems that can reliably store and retrieve millions of images and hold from a few terabytes of data to possibly hundreds of terabytes. Selecting the right archive solution depends on a number of factors: capacity requirements, write and retrieval performance requirements, scaleability in capacity and performance, conformance to open standards, archive availability and reliability, security, cost, achievable benefits and cost savings, investment protection, and more. This paper addresses many of these issues. It compares and positions optical disk and magnetic tape technologies, which are the predominant archive mediums today. New technologies will be discussed, such as DVD and high performance tape. Price and performance comparisons will be made at different archive capacities, plus the effect of file size on random and pre-fetch retrieval time will be analyzed. The concept of automated migration of images from high performance, RAID disk storage devices to high capacity, NearlineR storage devices will be introduced as a viable way to minimize overall storage costs for an archive.

A novel 3D shape descriptor for automatic retrieval of anatomical structures from medical images

NASA Astrophysics Data System (ADS)

Nunes, Fátima L. S.; Bergamasco, Leila C. C.; Delmondes, Pedro H.; Valverde, Miguel A. G.; Jackowski, Marcel P.

2017-03-01

Content-based image retrieval (CBIR) aims at retrieving from a database objects that are similar to an object provided by a query, by taking into consideration a set of extracted features. While CBIR has been widely applied in the two-dimensional image domain, the retrieval of3D objects from medical image datasets using CBIR remains to be explored. In this context, the development of descriptors that can capture information specific to organs or structures is desirable. In this work, we focus on the retrieval of two anatomical structures commonly imaged by Magnetic Resonance Imaging (MRI) and Computed Tomography (CT) techniques, the left ventricle of the heart and blood vessels. Towards this aim, we developed the Area-Distance Local Descriptor (ADLD), a novel 3D local shape descriptor that employs mesh geometry information, namely facet area and distance from centroid to surface, to identify shape changes. Because ADLD only considers surface meshes extracted from volumetric medical images, it substantially diminishes the amount of data to be analyzed. A 90% precision rate was obtained when retrieving both convex (left ventricle) and non-convex structures (blood vessels), allowing for detection of abnormalities associated with changes in shape. Thus, ADLD has the potential to aid in the diagnosis of a wide range of vascular and cardiac diseases.

Mining biomedical images towards valuable information retrieval in biomedical and life sciences

PubMed Central

Ahmed, Zeeshan; Zeeshan, Saman; Dandekar, Thomas

2016-01-01

Biomedical images are helpful sources for the scientists and practitioners in drawing significant hypotheses, exemplifying approaches and describing experimental results in published biomedical literature. In last decades, there has been an enormous increase in the amount of heterogeneous biomedical image production and publication, which results in a need for bioimaging platforms for feature extraction and analysis of text and content in biomedical images to take advantage in implementing effective information retrieval systems. In this review, we summarize technologies related to data mining of figures. We describe and compare the potential of different approaches in terms of their developmental aspects, used methodologies, produced results, achieved accuracies and limitations. Our comparative conclusions include current challenges for bioimaging software with selective image mining, embedded text extraction and processing of complex natural language queries. PMID:27538578

Using complex networks towards information retrieval and diagnostics in multidimensional imaging

NASA Astrophysics Data System (ADS)

Banerjee, Soumya Jyoti; Azharuddin, Mohammad; Sen, Debanjan; Savale, Smruti; Datta, Himadri; Dasgupta, Anjan Kr; Roy, Soumen

2015-12-01

We present a fresh and broad yet simple approach towards information retrieval in general and diagnostics in particular by applying the theory of complex networks on multidimensional, dynamic images. We demonstrate a successful use of our method with the time series generated from high content thermal imaging videos of patients suffering from the aqueous deficient dry eye (ADDE) disease. Remarkably, network analyses of thermal imaging time series of contact lens users and patients upon whom Laser-Assisted in situ Keratomileusis (Lasik) surgery has been conducted, exhibit pronounced similarity with results obtained from ADDE patients. We also propose a general framework for the transformation of multidimensional images to networks for futuristic biometry. Our approach is general and scalable to other fluctuation-based devices where network parameters derived from fluctuations, act as effective discriminators and diagnostic markers.

Using complex networks towards information retrieval and diagnostics in multidimensional imaging.

PubMed

Banerjee, Soumya Jyoti; Azharuddin, Mohammad; Sen, Debanjan; Savale, Smruti; Datta, Himadri; Dasgupta, Anjan Kr; Roy, Soumen

2015-12-02

We present a fresh and broad yet simple approach towards information retrieval in general and diagnostics in particular by applying the theory of complex networks on multidimensional, dynamic images. We demonstrate a successful use of our method with the time series generated from high content thermal imaging videos of patients suffering from the aqueous deficient dry eye (ADDE) disease. Remarkably, network analyses of thermal imaging time series of contact lens users and patients upon whom Laser-Assisted in situ Keratomileusis (Lasik) surgery has been conducted, exhibit pronounced similarity with results obtained from ADDE patients. We also propose a general framework for the transformation of multidimensional images to networks for futuristic biometry. Our approach is general and scalable to other fluctuation-based devices where network parameters derived from fluctuations, act as effective discriminators and diagnostic markers.

Using complex networks towards information retrieval and diagnostics in multidimensional imaging

PubMed Central

Banerjee, Soumya Jyoti; Azharuddin, Mohammad; Sen, Debanjan; Savale, Smruti; Datta, Himadri; Dasgupta, Anjan Kr; Roy, Soumen

2015-01-01

We present a fresh and broad yet simple approach towards information retrieval in general and diagnostics in particular by applying the theory of complex networks on multidimensional, dynamic images. We demonstrate a successful use of our method with the time series generated from high content thermal imaging videos of patients suffering from the aqueous deficient dry eye (ADDE) disease. Remarkably, network analyses of thermal imaging time series of contact lens users and patients upon whom Laser-Assisted in situ Keratomileusis (Lasik) surgery has been conducted, exhibit pronounced similarity with results obtained from ADDE patients. We also propose a general framework for the transformation of multidimensional images to networks for futuristic biometry. Our approach is general and scalable to other fluctuation-based devices where network parameters derived from fluctuations, act as effective discriminators and diagnostic markers. PMID:26626047

Cirrus Cloud Optical and Microphysical Property Retrievals from eMAS During SEAC4RS Using Bi-Spectral Reflectance Measurements Within the 1.88 micron Water Vapor Absorption Band

NASA Technical Reports Server (NTRS)

Meyer, K.; Platnick, S.; Arnold, G. T.; Holz, R. E.; Veglio, P.; Yorks, J.; Wang, C.

2016-01-01

Previous bi-spectral imager retrievals of cloud optical thickness (COT) and effective particle radius (CER) based on the Nakajima and King (1990) approach, such as those of the operational MODIS cloud optical property retrieval product (MOD06), have typically paired a non-absorbing visible or near-infrared wavelength, sensitive to COT, with an absorbing shortwave or midwave infrared wavelength sensitive to CER. However, in practice it is only necessary to select two spectral channels that exhibit a strong contrast in cloud particle absorption. Here it is shown, using eMAS observations obtained during NASAs SEAC4RS field campaign, that selecting two absorbing wavelength channels within the broader 1.88 micron water vapor absorption band, namely the 1.83 and 1.93 micron channels that have sufficient differences in ice crystal single scattering albedo, can yield COT and CER retrievals for thin to moderately thick single-layer cirrus that are reasonably consistent with other solar and IR imager-based and lidar-based retrievals. A distinct advantage of this channel selection for cirrus cloud retrievals is that the below cloud water vapor absorption minimizes the surface contribution to measured cloudy TOA reflectance, in particular compared to the solar window channels used in heritage retrievals such as MOD06. This reduces retrieval uncertainty resulting from errors in the surface reflectance assumption, as well as reduces the frequency of retrieval failures for thin cirrus clouds.

Cirrus cloud optical and microphysical property retrievals from eMAS during SEAC4RS using bi-spectral reflectance measurements within the 1.88 µm water vapor absorption band

NASA Astrophysics Data System (ADS)

Meyer, Kerry; Platnick, Steven; Arnold, G. Thomas; Holz, Robert E.; Veglio, Paolo; Yorks, John; Wang, Chenxi

2016-04-01

Previous bi-spectral imager retrievals of cloud optical thickness (COT) and effective particle radius (CER) based on the Nakajima and King (1990) approach, such as those of the operational MODIS cloud optical property retrieval product (MOD06), have typically paired a non-absorbing visible or near-infrared wavelength, sensitive to COT, with an absorbing shortwave or mid-wave infrared wavelength sensitive to CER. However, in practice it is only necessary to select two spectral channels that exhibit a strong contrast in cloud particle absorption. Here it is shown, using eMAS observations obtained during NASA's SEAC4RS field campaign, that selecting two absorbing wavelength channels within the broader 1.88 µm water vapor absorption band, namely the 1.83 and 1.93 µm channels that have sufficient differences in ice crystal single scattering albedo, can yield COT and CER retrievals for thin to moderately thick single-layer cirrus that are reasonably consistent with other solar and IR imager-based and lidar-based retrievals. A distinct advantage of this channel selection for cirrus cloud retrievals is that the below-cloud water vapor absorption minimizes the surface contribution to measured cloudy top-of-atmosphere reflectance, in particular compared to the solar window channels used in heritage retrievals such as MOD06. This reduces retrieval uncertainty resulting from errors in the surface reflectance assumption and reduces the frequency of retrieval failures for thin cirrus clouds.

Comparison of k-means related clustering methods for nuclear medicine images segmentation

NASA Astrophysics Data System (ADS)

Borys, Damian; Bzowski, Pawel; Danch-Wierzchowska, Marta; Psiuk-Maksymowicz, Krzysztof

2017-03-01

In this paper, we evaluate the performance of SURF descriptor for high resolution satellite imagery (HRSI) retrieval through a BoVW model on a land-use/land-cover (LULC) dataset. Local feature approaches such as SIFT and SURF descriptors can deal with a large variation of scale, rotation and illumination of the images, providing, therefore, a better discriminative power and retrieval efficiency than global features, especially for HRSI which contain a great range of objects and spatial patterns. Moreover, we combine SURF and color features to improve the retrieval accuracy, and we propose to learn a category-specific dictionary for each image category which results in a more discriminative image representation and boosts the image retrieval performance.

Towards building high performance medical image management system for clinical trials

NASA Astrophysics Data System (ADS)

Wang, Fusheng; Lee, Rubao; Zhang, Xiaodong; Saltz, Joel

2011-03-01

Medical image based biomarkers are being established for therapeutic cancer clinical trials, where image assessment is among the essential tasks. Large scale image assessment is often performed by a large group of experts by retrieving images from a centralized image repository to workstations to markup and annotate images. In such environment, it is critical to provide a high performance image management system that supports efficient concurrent image retrievals in a distributed environment. There are several major challenges: high throughput of large scale image data over the Internet from the server for multiple concurrent client users, efficient communication protocols for transporting data, and effective management of versioning of data for audit trails. We study the major bottlenecks for such a system, propose and evaluate a solution by using a hybrid image storage with solid state drives and hard disk drives, RESTfulWeb Services based protocols for exchanging image data, and a database based versioning scheme for efficient archive of image revision history. Our experiments show promising results of our methods, and our work provides a guideline for building enterprise level high performance medical image management systems.

Selecting relevant 3D image features of margin sharpness and texture for lung nodule retrieval.

PubMed

Ferreira, José Raniery; de Azevedo-Marques, Paulo Mazzoncini; Oliveira, Marcelo Costa

2017-03-01

Lung cancer is the leading cause of cancer-related deaths in the world. Its diagnosis is a challenge task to specialists due to several aspects on the classification of lung nodules. Therefore, it is important to integrate content-based image retrieval methods on the lung nodule classification process, since they are capable of retrieving similar cases from databases that were previously diagnosed. However, this mechanism depends on extracting relevant image features in order to obtain high efficiency. The goal of this paper is to perform the selection of 3D image features of margin sharpness and texture that can be relevant on the retrieval of similar cancerous and benign lung nodules. A total of 48 3D image attributes were extracted from the nodule volume. Border sharpness features were extracted from perpendicular lines drawn over the lesion boundary. Second-order texture features were extracted from a cooccurrence matrix. Relevant features were selected by a correlation-based method and a statistical significance analysis. Retrieval performance was assessed according to the nodule's potential malignancy on the 10 most similar cases and by the parameters of precision and recall. Statistical significant features reduced retrieval performance. Correlation-based method selected 2 margin sharpness attributes and 6 texture attributes and obtained higher precision compared to all 48 extracted features on similar nodule retrieval. Feature space dimensionality reduction of 83 % obtained higher retrieval performance and presented to be a computationaly low cost method of retrieving similar nodules for the diagnosis of lung cancer.

Fast perceptual image hash based on cascade algorithm

NASA Astrophysics Data System (ADS)

Ruchay, Alexey; Kober, Vitaly; Yavtushenko, Evgeniya

2017-09-01

In this paper, we propose a perceptual image hash algorithm based on cascade algorithm, which can be applied in image authentication, retrieval, and indexing. Image perceptual hash uses for image retrieval in sense of human perception against distortions caused by compression, noise, common signal processing and geometrical modifications. The main disadvantage of perceptual hash is high time expenses. In the proposed cascade algorithm of image retrieval initializes with short hashes, and then a full hash is applied to the processed results. Computer simulation results show that the proposed hash algorithm yields a good performance in terms of robustness, discriminability, and time expenses.

Development of Wind Speed Retrieval from Cross-Polarization Chinese Gaofen-3 Synthetic Aperture Radar in Typhoons

PubMed Central

Yuan, Xinzhe; Sun, Jian; Zhou, Wei; Zhang, Qingjun

2018-01-01

The purpose of our work is to determine the feasibility and effectiveness of retrieving sea surface wind speeds from C-band cross-polarization (herein vertical-horizontal, VH) Chinese Gaofen-3 (GF-3) SAR images in typhoons. In this study, we have collected three GF-3 SAR images acquired in Global Observation (GLO) and Wide ScanSAR (WSC) mode during the summer of 2017 from the China Sea, which includes the typhoons Noru, Doksuri and Talim. These images were collocated with wind simulations at 0.12° grids from a numeric model, called the Regional Assimilation and Prediction System-Typhoon model (GRAPES-TYM). Recent research shows that GRAPES-TYM has a good performance for typhoon simulation in the China Sea. Based on the dataset, the dependence of wind speed and of radar incidence angle on normalized radar cross (NRCS) of VH-polarization GF-3 SAR have been investigated, after which an empirical algorithm for wind speed retrieval from VH-polarization GF-3 SAR was tuned. An additional four VH-polarization GF-3 SAR images in three typhoons, Noru, Hato and Talim, were investigated in order to validate the proposed algorithm. SAR-derived winds were compared with measurements from Windsat winds at 0.25° grids with wind speeds up to 40 m/s, showing a 5.5 m/s root mean square error (RMSE) of wind speed and an improved RMSE of 5.1 m/s wind speed was achieved compared with the retrieval results validated against GRAPES-TYM winds. It is concluded that the proposed algorithm is a promising potential technique for strong wind retrieval from cross-polarization GF-3 SAR images without encountering a signal saturation problem. PMID:29385068

Intelligent web image retrieval system

NASA Astrophysics Data System (ADS)

Hong, Sungyong; Lee, Chungwoo; Nah, Yunmook

2001-07-01

Recently, the web sites such as e-business sites and shopping mall sites deal with lots of image information. To find a specific image from these image sources, we usually use web search engines or image database engines which rely on keyword only retrievals or color based retrievals with limited search capabilities. This paper presents an intelligent web image retrieval system. We propose the system architecture, the texture and color based image classification and indexing techniques, and representation schemes of user usage patterns. The query can be given by providing keywords, by selecting one or more sample texture patterns, by assigning color values within positional color blocks, or by combining some or all of these factors. The system keeps track of user's preferences by generating user query logs and automatically add more search information to subsequent user queries. To show the usefulness of the proposed system, some experimental results showing recall and precision are also explained.

Chinese Herbal Medicine Image Recognition and Retrieval by Convolutional Neural Network

PubMed Central

Sun, Xin; Qian, Huinan

2016-01-01

Chinese herbal medicine image recognition and retrieval have great potential of practical applications. Several previous studies have focused on the recognition with hand-crafted image features, but there are two limitations in them. Firstly, most of these hand-crafted features are low-level image representation, which is easily affected by noise and background. Secondly, the medicine images are very clean without any backgrounds, which makes it difficult to use in practical applications. Therefore, designing high-level image representation for recognition and retrieval in real world medicine images is facing a great challenge. Inspired by the recent progress of deep learning in computer vision, we realize that deep learning methods may provide robust medicine image representation. In this paper, we propose to use the Convolutional Neural Network (CNN) for Chinese herbal medicine image recognition and retrieval. For the recognition problem, we use the softmax loss to optimize the recognition network; then for the retrieval problem, we fine-tune the recognition network by adding a triplet loss to search for the most similar medicine images. To evaluate our method, we construct a public database of herbal medicine images with cluttered backgrounds, which has in total 5523 images with 95 popular Chinese medicine categories. Experimental results show that our method can achieve the average recognition precision of 71% and the average retrieval precision of 53% over all the 95 medicine categories, which are quite promising given the fact that the real world images have multiple pieces of occluded herbal and cluttered backgrounds. Besides, our proposed method achieves the state-of-the-art performance by improving previous studies with a large margin. PMID:27258404

Robust information encryption diffractive-imaging-based scheme with special phase retrieval algorithm for a customized data container

NASA Astrophysics Data System (ADS)

Qin, Yi; Wang, Zhipeng; Wang, Hongjuan; Gong, Qiong; Zhou, Nanrun

2018-06-01

The diffractive-imaging-based encryption (DIBE) scheme has aroused wide interesting due to its compact architecture and low requirement of conditions. Nevertheless, the primary information can hardly be recovered exactly in the real applications when considering the speckle noise and potential occlusion imposed on the ciphertext. To deal with this issue, the customized data container (CDC) into DIBE is introduced and a new phase retrieval algorithm (PRA) for plaintext retrieval is proposed. The PRA, designed according to the peculiarity of the CDC, combines two key techniques from previous approaches, i.e., input-support-constraint and median-filtering. The proposed scheme can guarantee totally the reconstruction of the primary information despite heavy noise or occlusion and its effectiveness and feasibility have been demonstrated with simulation results.

Biomedical image representation approach using visualness and spatial information in a concept feature space for interactive region-of-interest-based retrieval.

PubMed

Rahman, Md Mahmudur; Antani, Sameer K; Demner-Fushman, Dina; Thoma, George R

2015-10-01

This article presents an approach to biomedical image retrieval by mapping image regions to local concepts where images are represented in a weighted entropy-based concept feature space. The term "concept" refers to perceptually distinguishable visual patches that are identified locally in image regions and can be mapped to a glossary of imaging terms. Further, the visual significance (e.g., visualness) of concepts is measured as the Shannon entropy of pixel values in image patches and is used to refine the feature vector. Moreover, the system can assist the user in interactively selecting a region-of-interest (ROI) and searching for similar image ROIs. Further, a spatial verification step is used as a postprocessing step to improve retrieval results based on location information. The hypothesis that such approaches would improve biomedical image retrieval is validated through experiments on two different data sets, which are collected from open access biomedical literature.

Biomedical image representation approach using visualness and spatial information in a concept feature space for interactive region-of-interest-based retrieval

PubMed Central

Rahman, Md. Mahmudur; Antani, Sameer K.; Demner-Fushman, Dina; Thoma, George R.

2015-01-01

Abstract. This article presents an approach to biomedical image retrieval by mapping image regions to local concepts where images are represented in a weighted entropy-based concept feature space. The term “concept” refers to perceptually distinguishable visual patches that are identified locally in image regions and can be mapped to a glossary of imaging terms. Further, the visual significance (e.g., visualness) of concepts is measured as the Shannon entropy of pixel values in image patches and is used to refine the feature vector. Moreover, the system can assist the user in interactively selecting a region-of-interest (ROI) and searching for similar image ROIs. Further, a spatial verification step is used as a postprocessing step to improve retrieval results based on location information. The hypothesis that such approaches would improve biomedical image retrieval is validated through experiments on two different data sets, which are collected from open access biomedical literature. PMID:26730398

Treelets Binary Feature Retrieval for Fast Keypoint Recognition.

PubMed

Zhu, Jianke; Wu, Chenxia; Chen, Chun; Cai, Deng

2015-10-01

Fast keypoint recognition is essential to many vision tasks. In contrast to the classification-based approaches, we directly formulate the keypoint recognition as an image patch retrieval problem, which enjoys the merit of finding the matched keypoint and its pose simultaneously. To effectively extract the binary features from each patch surrounding the keypoint, we make use of treelets transform that can group the highly correlated data together and reduce the noise through the local analysis. Treelets is a multiresolution analysis tool, which provides an orthogonal basis to reflect the geometry of the noise-free data. To facilitate the real-world applications, we have proposed two novel approaches. One is the convolutional treelets that capture the image patch information locally and globally while reducing the computational cost. The other is the higher-order treelets that reflect the relationship between the rows and columns within image patch. An efficient sub-signature-based locality sensitive hashing scheme is employed for fast approximate nearest neighbor search in patch retrieval. Experimental evaluations on both synthetic data and the real-world Oxford dataset have shown that our proposed treelets binary feature retrieval methods outperform the state-of-the-art feature descriptors and classification-based approaches.

A functional magnetic resonance imaging study of working memory abnormalities in schizophrenia.

PubMed

Johnson, Matthew R; Morris, Nicholas A; Astur, Robert S; Calhoun, Vince D; Mathalon, Daniel H; Kiehl, Kent A; Pearlson, Godfrey D

2006-07-01

Previous neuroimaging studies of working memory (WM) in schizophrenia, typically focusing on dorsolateral prefrontal cortex, yield conflicting results, possibly because of varied choice of tasks and analysis techniques. We examined neural function changes at several WM loads to derive a more complete picture of WM dysfunction in schizophrenia. We used a version of the Sternberg Item Recognition Paradigm to test WM function at five distinct loads. Eighteen schizophrenia patients and 18 matched healthy controls were scanned with functional magnetic resonance imaging at 3 Tesla. Patterns of both overactivation and underactivation in patients were observed depending on WM load. Patients' activation was generally less responsive to load changes than control subjects', and different patterns of between-group differences were observed for memory encoding and retrieval. In the specific case of successful retrieval, patients recruited additional neural circuits unused by control subjects. Behavioral effects were generally consistent with these imaging results. Differential findings of overactivation and underactivation may be attributable to patients' decreased ability to focus and allocate neural resources at task-appropriate levels. Additionally, differences between encoding and retrieval suggest that WM dysfunction may be manifested differently during the distinct phases of encoding, maintenance, and retrieval.

Complex Event Processing for Content-Based Text, Image, and Video Retrieval

DTIC Science & Technology

2016-06-01

NY): Wiley- Interscience; 2000. Feldman R, Sanger J. The text mining handbook: advanced approaches in analyzing unstructured data. New York (NY...ARL-TR-7705 ● JUNE 2016 US Army Research Laboratory Complex Event Processing for Content-Based Text , Image, and Video Retrieval...ARL-TR-7705 ● JUNE 2016 US Army Research Laboratory Complex Event Processing for Content-Based Text , Image, and Video Retrieval

Diversification of visual media retrieval results using saliency detection

NASA Astrophysics Data System (ADS)

Muratov, Oleg; Boato, Giulia; De Natale, Franesco G. B.

2013-03-01

Diversification of retrieval results allows for better and faster search. Recently there has been proposed different methods for diversification of image retrieval results mainly utilizing text information and techniques imported from natural language processing domain. However, images contain visual information that is impossible to describe in text and the use of visual features is inevitable. Visual saliency is information about the main object of an image implicitly included by humans while creating visual content. For this reason it is naturally to exploit this information for the task of diversification of the content. In this work we study whether visual saliency can be used for the task of diversification and propose a method for re-ranking image retrieval results using saliency. The evaluation has shown that the use of saliency information results in higher diversity of retrieval results.

Managing biomedical image metadata for search and retrieval of similar images.

PubMed

Korenblum, Daniel; Rubin, Daniel; Napel, Sandy; Rodriguez, Cesar; Beaulieu, Chris

2011-08-01

Radiology images are generally disconnected from the metadata describing their contents, such as imaging observations ("semantic" metadata), which are usually described in text reports that are not directly linked to the images. We developed a system, the Biomedical Image Metadata Manager (BIMM) to (1) address the problem of managing biomedical image metadata and (2) facilitate the retrieval of similar images using semantic feature metadata. Our approach allows radiologists, researchers, and students to take advantage of the vast and growing repositories of medical image data by explicitly linking images to their associated metadata in a relational database that is globally accessible through a Web application. BIMM receives input in the form of standard-based metadata files using Web service and parses and stores the metadata in a relational database allowing efficient data query and maintenance capabilities. Upon querying BIMM for images, 2D regions of interest (ROIs) stored as metadata are automatically rendered onto preview images included in search results. The system's "match observations" function retrieves images with similar ROIs based on specific semantic features describing imaging observation characteristics (IOCs). We demonstrate that the system, using IOCs alone, can accurately retrieve images with diagnoses matching the query images, and we evaluate its performance on a set of annotated liver lesion images. BIMM has several potential applications, e.g., computer-aided detection and diagnosis, content-based image retrieval, automating medical analysis protocols, and gathering population statistics like disease prevalences. The system provides a framework for decision support systems, potentially improving their diagnostic accuracy and selection of appropriate therapies.

ASIST 2001. Information in a Networked World: Harnessing the Flow. Part III: Poster Presentations.

ERIC Educational Resources Information Center

Proceedings of the ASIST Annual Meeting, 2001

2001-01-01

Topics of Poster Presentations include: electronic preprints; intranets; poster session abstracts; metadata; information retrieval; watermark images; video games; distributed information retrieval; subject domain knowledge; data mining; information theory; course development; historians' use of pictorial images; information retrieval software;…

Effects of Emotion and Emotional Valence on the Neural Correlates of Episodic Memory Search and Elaboration

PubMed Central

Ford, Jaclyn H.; Morris, John A.; Kensinger, Elizabeth A.

2015-01-01

Successful retrieval of an event includes an initial search phase in which the information is accessed and a subsequent elaboration phase in which an individual expands on event details. Traditionally, functional neuroimaging studies examining episodic memory retrieval either have not made a distinction between these two phases or have focused on the initial search process. The current study used an extended retrieval trial to compare the neural correlates of search and elaboration and to examine the effects of emotion on each phase. Prior to scanning, participants encoded positive, negative, and neutral images paired with neutral titles. After a thirty-minute delay, participants engaged in a scanned recognition task in which they viewed the neutral titles and indicated whether the title had been presented with an image during the study phase. Retrieval was divided into an initial memory search and a subsequent five-second elaboration phase. The current study identified neural differences between the search and elaboration phases, with search being associated with widespread bilateral activations across the entire cortex and elaboration primarily being associated with increased activity in the medial prefrontal cortex. The emotionality of the retrieval target was more influential during search relative to elaboration. However, valence influenced when the effect of emotion was greatest, with search engaging many more regions for positive events than negative ones, but elaboration engaging the dorsomedial prefrontal cortex more for negative events than positive events. PMID:24283491

SIFT Meets CNN: A Decade Survey of Instance Retrieval.

PubMed

Zheng, Liang; Yang, Yi; Tian, Qi

2018-05-01

In the early days, content-based image retrieval (CBIR) was studied with global features. Since 2003, image retrieval based on local descriptors (de facto SIFT) has been extensively studied for over a decade due to the advantage of SIFT in dealing with image transformations. Recently, image representations based on the convolutional neural network (CNN) have attracted increasing interest in the community and demonstrated impressive performance. Given this time of rapid evolution, this article provides a comprehensive survey of instance retrieval over the last decade. Two broad categories, SIFT-based and CNN-based methods, are presented. For the former, according to the codebook size, we organize the literature into using large/medium-sized/small codebooks. For the latter, we discuss three lines of methods, i.e., using pre-trained or fine-tuned CNN models, and hybrid methods. The first two perform a single-pass of an image to the network, while the last category employs a patch-based feature extraction scheme. This survey presents milestones in modern instance retrieval, reviews a broad selection of previous works in different categories, and provides insights on the connection between SIFT and CNN-based methods. After analyzing and comparing retrieval performance of different categories on several datasets, we discuss promising directions towards generic and specialized instance retrieval.

Results and Validation of MODIS Aerosol Retrievals Over Land and Ocean

NASA Technical Reports Server (NTRS)

Remer, Lorraine; Einaudi, Franco (Technical Monitor)

2001-01-01

The MODerate Resolution Imaging Spectroradiometer (MODIS) instrument aboard the Terra spacecraft has been retrieving aerosol parameters since late February 2000. Initial qualitative checking of the products showed very promising results including matching of land and ocean retrievals at coastlines. Using AERONET ground-based radiometers as our primary validation tool, we have established quantitative validation as well. Our results show that for most aerosol types, the MODIS products fall within the pre-launch estimated uncertainties. Surface reflectance and aerosol model assumptions appear to be sufficiently accurate for the optical thickness retrieval. Dust provides a possible exception, which may be due to non-spherical effects. Over ocean the MODIS products include information on particle size, and these parameters are also validated with AERONET retrievals.

Results and Validation of MODIS Aerosol Retrievals over Land and Ocean

NASA Technical Reports Server (NTRS)

Remer, L. A.; Kaufman, Y. J.; Tanre, D.; Ichoku, C.; Chu, D. A.; Mattoo, S.; Levy, R.; Martins, J. V.; Li, R.-R.; Einaudi, Franco (Technical Monitor)

2000-01-01

The MODerate Resolution Imaging Spectroradiometer (MODIS) instrument aboard the Terra spacecraft has been retrieving aerosol parameters since late February 2000. Initial qualitative checking of the products showed very promising results including matching of land and ocean retrievals at coastlines. Using AERONET ground-based radiometers as our primary validation tool, we have established quantitative validation as well. Our results show that for most aerosol types, the MODIS products fall within the pre-launch estimated uncertainties. Surface reflectance and aerosol model assumptions appear to be sufficiently accurate for the optical thickness retrieval. Dust provides a possible exception, which may be due to non-spherical effects. Over ocean the MODIS products include information on particle size, and these parameters are also validated with AERONET retrievals.

Observing the ExoEarth: Simulating the Retrieval of Exoplanet Parameters Using DSCOVR

NASA Astrophysics Data System (ADS)

Kane, S.; Cowan, N. B.; Domagal-Goldman, S. D.; Herman, J. R.; Robinson, T.; Stine, A.

2017-12-01

The field of exoplanets has rapidly expanded from detection to include exoplanet characterization. This has been enabled by developments such as the detection of terrestrial-sized planets and the use of transit spectroscopy to study exoplanet atmospheres. Studies of rocky planets are leading towards the direct imaging of exoplanets and the development of techniques to extract their intrinsic properties. The importance of properties such as rotation, albedo, and obliquity are significant since they inform planet formation theories and are key input parameters for Global Circulation Models used to determine surface conditions, including habitability. Thus, a complete characterization of exoplanets for understanding habitable climates requires the ability to measure these key planetary parameters. The retrieval of planetary rotation rates, albedos, and obliquities from highly undersampled imaging data can be honed using satellites designed to study the Earth's atmosphere. In this talk I will describe how the Deep Space Climate Observatory (DSCOVR) provides a unique opportunity to test such retrieval methods using data for the sunlit hemisphere of the Earth. Our methods use the high-resolution DSCOVR-EPIC images to simulate the Earth as an exoplanet, by deconvolving the images to match a variety of expected exoplanet mission requirements, and by comparing EPIC data with the cavity radiometer data from DSCOVR-NISTAR that views the Earth as a single pixel. Through this methodology, we are creating a grid of retrieval states as a function of image resolution, observing cadence, passband, etc. Our modeling of the DSCOVR data will provide an effective baseline from which to develop tools that can be applied to a variety of exoplanet imaging data.

Retrieval practice enhances the accessibility but not the quality of memory.

PubMed

Sutterer, David W; Awh, Edward

2016-06-01

Numerous studies have demonstrated that retrieval from long-term memory (LTM) can enhance subsequent memory performance, a phenomenon labeled the retrieval practice effect. However, the almost exclusive reliance on categorical stimuli in this literature leaves open a basic question about the nature of this improvement in memory performance. It has not yet been determined whether retrieval practice improves the probability of successful memory retrieval or the quality of the retrieved representation. To answer this question, we conducted three experiments using a mixture modeling approach (Zhang & Luck, 2008) that provides a measure of both the probability of recall and the quality of the recalled memories. Subjects attempted to memorize the color of 400 unique shapes. After every 10 images were presented, subjects either recalled the last 10 colors (the retrieval practice condition) by clicking on a color wheel with each shape as a retrieval cue or they participated in a control condition that involved no further presentations (Experiment 1) or restudy of the 10 shape/color associations (Experiments 2 and 3). Performance in a subsequent delayed recall test revealed a robust retrieval practice effect. Subjects recalled a significantly higher proportion of items that they had previously retrieved relative to items that were untested or that they had restudied. Interestingly, retrieval practice did not elicit any improvement in the precision of the retrieved memories. The same empirical pattern also was observed following delays of greater than 24 hours. Thus, retrieval practice increases the probability of successful memory retrieval but does not improve memory quality.

Design of Content Based Image Retrieval Scheme for Diabetic Retinopathy Images using Harmony Search Algorithm.

PubMed

Sivakamasundari, J; Natarajan, V

2015-01-01

Diabetic Retinopathy (DR) is a disorder that affects the structure of retinal blood vessels due to long-standing diabetes mellitus. Automated segmentation of blood vessel is vital for periodic screening and timely diagnosis. An attempt has been made to generate continuous retinal vasculature for the design of Content Based Image Retrieval (CBIR) application. The typical normal and abnormal retinal images are preprocessed to improve the vessel contrast. The blood vessels are segmented using evolutionary based Harmony Search Algorithm (HSA) combined with Otsu Multilevel Thresholding (MLT) method by best objective functions. The segmentation results are validated with corresponding ground truth images using binary similarity measures. The statistical, textural and structural features are obtained from the segmented images of normal and DR affected retina and are analyzed. CBIR in medical image retrieval applications are used to assist physicians in clinical decision-support techniques and research fields. A CBIR system is developed using HSA based Otsu MLT segmentation technique and the features obtained from the segmented images. Similarity matching is carried out between the features of query and database images using Euclidean Distance measure. Similar images are ranked and retrieved. The retrieval performance of CBIR system is evaluated in terms of precision and recall. The CBIR systems developed using HSA based Otsu MLT and conventional Otsu MLT methods are compared. The retrieval performance such as precision and recall are found to be 96% and 58% for CBIR system using HSA based Otsu MLT segmentation. This automated CBIR system could be recommended for use in computer assisted diagnosis for diabetic retinopathy screening.

Two-dimensional thermography image retrieval from zig-zag scanned data with TZ-SCAN

NASA Astrophysics Data System (ADS)

Okumura, Hiroshi; Yamasaki, Ryohei; Arai, Kohei

2008-10-01

TZ-SCAN is a simple and low cost thermal imaging device which consists of a single point radiation thermometer on a tripod with a pan-tilt rotator, a DC motor controller board with a USB interface, and a laptop computer for rotator control, data acquisition, and data processing. TZ-SCAN acquires a series of zig-zag scanned data and stores the data as CSV file. A 2-D thermal distribution image can be retrieved by using the second quefrency peak calculated from TZ-SCAN data. An experiment is conducted to confirm the validity of the thermal retrieval algorithm. The experimental result shows efficient accuracy for 2-D thermal distribution image retrieval.

The Influence of Spatial Resolutions on the Retrieval Accuracy of Sea Surface Wind Speed with Cross-polarized C-band SAR images

NASA Astrophysics Data System (ADS)

Zhang, K.; Han, B.; Mansaray, L. R.; Xu, X.; Guo, Q.; Jingfeng, H.

2017-12-01

Synthetic aperture radar (SAR) instruments on board satellites are valuable for high-resolution wind field mapping, especially for coastal studies. Since the launch of Sentinel-1A on April 3, 2014, followed by Sentinel-1B on April 25, 2016, large amount of C-band SAR data have been added to a growing accumulation of SAR datasets (ERS-1/2, RADARSAT-1/2, ENVISAT). These new developments are of great significance for a wide range of applications in coastal sea areas, especially for high spatial resolution wind resource assessment, in which the accuracy of retrieved wind fields is extremely crucial. Recently, it is reported that wind speeds can also be retrieved from C-band cross-polarized SAR images, which is an important complement to wind speed retrieval from co-polarization. However, there is no consensus on the optimal resolution for wind speed retrieval from cross-polarized SAR images. This paper presents a comparison strategy for investigating the influence of spatial resolutions on sea surface wind speed retrieval accuracy with cross-polarized SAR images. Firstly, for wind speeds retrieved from VV-polarized images, the optimal geophysical C-band model (CMOD) function was selected among four CMOD functions. Secondly, the most suitable C-band cross-polarized ocean (C-2PO) model was selected between two C-2POs for the VH-polarized image dataset. Then, the VH-wind speeds retrieved by the selected C-2PO were compared with the VV-polarized sea surface wind speeds retrieved using the optimal CMOD, which served as reference, at different spatial resolutions. Results show that the VH-polarized wind speed retrieval accuracy increases rapidly with the decrease in spatial resolutions from 100 m to 1000 m, with a drop in RMSE of 42%. However, the improvement in wind speed retrieval accuracy levels off with spatial resolutions decreasing from 1000 m to 5000 m. This demonstrates that the pixel spacing of 1 km may be the compromising choice for the tradeoff between the spatial resolution and wind speed retrieval accuracy with cross-polarized images obtained from RADASAT-2 fine quad polarization mode. Figs. 1 illustrate the variation of the following statistical parameters: Bias, Corr, R2, RMSE and STD as a function of spatial resolution.

A mobile unit for memory retrieval in daily life based on image and sensor processing

NASA Astrophysics Data System (ADS)

Takesumi, Ryuji; Ueda, Yasuhiro; Nakanishi, Hidenobu; Nakamura, Atsuyoshi; Kakimori, Nobuaki

2003-10-01

We developed a Mobile Unit which purpose is to support memory retrieval of daily life. In this paper, we describe the two characteristic factors of this unit. (1)The behavior classification with an acceleration sensor. (2)Extracting the difference of environment with image processing technology. In (1), By analyzing power and frequency of an acceleration sensor which turns to gravity direction, the one's activities can be classified using some techniques to walk, stay, and so on. In (2), By extracting the difference between the beginning scene and the ending scene of a stay scene with image processing, the result which is done by user is recognized as the difference of environment. Using those 2 techniques, specific scenes of daily life can be extracted, and important information at the change of scenes can be realized to record. Especially we describe the effect to support retrieving important things, such as a thing left behind and a state of working halfway.

Research of image retrieval technology based on color feature

NASA Astrophysics Data System (ADS)

Fu, Yanjun; Jiang, Guangyu; Chen, Fengying

2009-10-01

Recently, with the development of the communication and the computer technology and the improvement of the storage technology and the capability of the digital image equipment, more and more image resources are given to us than ever. And thus the solution of how to locate the proper image quickly and accurately is wanted.The early method is to set up a key word for searching in the database, but now the method has become very difficult when we search much more picture that we need. In order to overcome the limitation of the traditional searching method, content based image retrieval technology was aroused. Now, it is a hot research subject.Color image retrieval is the important part of it. Color is the most important feature for color image retrieval. Three key questions on how to make use of the color characteristic are discussed in the paper: the expression of color, the abstraction of color characteristic and the measurement of likeness based on color. On the basis, the extraction technology of the color histogram characteristic is especially discussed. Considering the advantages and disadvantages of the overall histogram and the partition histogram, a new method based the partition-overall histogram is proposed. The basic thought of it is to divide the image space according to a certain strategy, and then calculate color histogram of each block as the color feature of this block. Users choose the blocks that contain important space information, confirming the right value. The system calculates the distance between the corresponding blocks that users choosed. Other blocks merge into part overall histograms again, and the distance should be calculated. Then accumulate all the distance as the real distance between two pictures. The partition-overall histogram comprehensive utilizes advantages of two methods above, by choosing blocks makes the feature contain more spatial information which can improve performance; the distances between partition-overall histogram make rotating and translation does not change. The HSV color space is used to show color characteristic of image, which is suitable to the visual characteristic of human. Taking advance of human's feeling to color, it quantifies color sector with unequal interval, and get characteristic vector. Finally, it matches the similarity of image with the algorithm of the histogram intersection and the partition-overall histogram. Users can choose a demonstration image to show inquired vision require, and also can adjust several right value through the relevance-feedback method to obtain the best result of search.An image retrieval system based on these approaches is presented. The result of the experiments shows that the image retrieval based on partition-overall histogram can keep the space distribution information while abstracting color feature efficiently, and it is superior to the normal color histograms in precision rate while researching. The query precision rate is more than 95%. In addition, the efficient block expression will lower the complicate degree of the images to be searched, and thus the searching efficiency will be increased. The image retrieval algorithms based on the partition-overall histogram proposed in the paper is efficient and effective.

Gram-Schmidt orthonormalization for retrieval of amplitude images under sinusoidal patterns of illumination

USDA-ARS?s Scientific Manuscript database

Structured illumination using sinusoidal patterns has been utilized for optical imaging of biological tissues in biomedical research and, of horticultural products. Implementation of structured-illumination imaging relies on retrieval of amplitude images, which is conventionally achieved by a phase-...

Interactive content-based image retrieval (CBIR) computer-aided diagnosis (CADx) system for ultrasound breast masses using relevance feedback

NASA Astrophysics Data System (ADS)

Cho, Hyun-chong; Hadjiiski, Lubomir; Sahiner, Berkman; Chan, Heang-Ping; Paramagul, Chintana; Helvie, Mark; Nees, Alexis V.

2012-03-01

We designed a Content-Based Image Retrieval (CBIR) Computer-Aided Diagnosis (CADx) system to assist radiologists in characterizing masses on ultrasound images. The CADx system retrieves masses that are similar to a query mass from a reference library based on computer-extracted features that describe texture, width-to-height ratio, and posterior shadowing of a mass. Retrieval is performed with k nearest neighbor (k-NN) method using Euclidean distance similarity measure and Rocchio relevance feedback algorithm (RRF). In this study, we evaluated the similarity between the query and the retrieved masses with relevance feedback using our interactive CBIR CADx system. The similarity assessment and feedback were provided by experienced radiologists' visual judgment. For training the RRF parameters, similarities of 1891 image pairs obtained from 62 masses were rated by 3 MQSA radiologists using a 9-point scale (9=most similar). A leave-one-out method was used in training. For each query mass, 5 most similar masses were retrieved from the reference library using radiologists' similarity ratings, which were then used by RRF to retrieve another 5 masses for the same query. The best RRF parameters were chosen based on three simulated observer experiments, each of which used one of the radiologists' ratings for retrieval and relevance feedback. For testing, 100 independent query masses on 100 images and 121 reference masses on 230 images were collected. Three radiologists rated the similarity between the query and the computer-retrieved masses. Average similarity ratings without and with RRF were 5.39 and 5.64 on the training set and 5.78 and 6.02 on the test set, respectively. The average Az values without and with RRF were 0.86+/-0.03 and 0.87+/-0.03 on the training set and 0.91+/-0.03 and 0.90+/-0.03 on the test set, respectively. This study demonstrated that RRF improved the similarity of the retrieved masses.

Collection Fusion Using Bayesian Estimation of a Linear Regression Model in Image Databases on the Web.

ERIC Educational Resources Information Center

Kim, Deok-Hwan; Chung, Chin-Wan

2003-01-01

Discusses the collection fusion problem of image databases, concerned with retrieving relevant images by content based retrieval from image databases distributed on the Web. Focuses on a metaserver which selects image databases supporting similarity measures and proposes a new algorithm which exploits a probabilistic technique using Bayesian…

Autobiographical memory specificity in response to verbal and pictorial cues in clinical depression.

PubMed

Ridout, Nathan; Dritschel, Barbara; Matthews, Keith; O'Carroll, Ronan

2016-06-01

Depressed individuals have been consistently shown to exhibit problems in accessing specific memories of events from their past and instead tend to retrieve categorical summaries of events. The majority of studies examining autobiographical memory changes associated with psychopathology have tended to use word cues, but only one study to date has used images (with PTSD patients). to determine if using images to cue autobiographical memories would reduce the memory specificity deficit exhibited by patients with depression in comparison to healthy controls. Twenty-five clinically depressed patients and twenty-five healthy controls were assessed on two versions of the autobiographical memory test; cued with emotional words and images. Depressed patients retrieved significantly fewer specific memories, and a greater number of categorical, than did the controls. Controls retrieved a greater proportion of specific memories to images compared to words, whereas depressed patients retrieved a similar proportion of specific memories to both images and words. no information about the presence and severity of past trauma was collected. results suggest that the overgeneral memory style in depression generalises from verbal to pictorial cues. This is important because retrieval to images may provide a more ecologically valid test of everyday memory experiences than word-cued retrieval.. Copyright © 2016 Elsevier Ltd. All rights reserved.

A unified framework for image retrieval using keyword and visual features.

PubMed

Jing, Feng; Li, Mingling; Zhang, Hong-Jiang; Zhang, Bo

2005-07-01

In this paper, a unified image retrieval framework based on both keyword annotations and visual features is proposed. In this framework, a set of statistical models are built based on visual features of a small set of manually labeled images to represent semantic concepts and used to propagate keywords to other unlabeled images. These models are updated periodically when more images implicitly labeled by users become available through relevance feedback. In this sense, the keyword models serve the function of accumulation and memorization of knowledge learned from user-provided relevance feedback. Furthermore, two sets of effective and efficient similarity measures and relevance feedback schemes are proposed for query by keyword scenario and query by image example scenario, respectively. Keyword models are combined with visual features in these schemes. In particular, a new, entropy-based active learning strategy is introduced to improve the efficiency of relevance feedback for query by keyword. Furthermore, a new algorithm is proposed to estimate the keyword features of the search concept for query by image example. It is shown to be more appropriate than two existing relevance feedback algorithms. Experimental results demonstrate the effectiveness of the proposed framework.

Combination of image descriptors for the exploration of cultural photographic collections

NASA Astrophysics Data System (ADS)

Bhowmik, Neelanjan; Gouet-Brunet, Valérie; Bloch, Gabriel; Besson, Sylvain

2017-01-01

The rapid growth of image digitization and collections in recent years makes it challenging and burdensome to organize, categorize, and retrieve similar images from voluminous collections. Content-based image retrieval (CBIR) is immensely convenient in this context. A considerable number of local feature detectors and descriptors are present in the literature of CBIR. We propose a model to anticipate the best feature combinations for image retrieval-related applications. Several spatial complementarity criteria of local feature detectors are analyzed and then engaged in a regression framework to find the optimal combination of detectors for a given dataset and are better adapted for each given image; the proposed model is also useful to optimally fix some other parameters, such as the k in k-nearest neighbor retrieval. Three public datasets of various contents and sizes are employed to evaluate the proposal, which is legitimized by improving the quality of retrieval notably facing classical approaches. Finally, the proposed image search engine is applied to the cultural photographic collections of a French museum, where it demonstrates its added value for the exploration and promotion of these contents at different levels from their archiving up to their exhibition in or ex situ.

Image Retrieval Method for Multiscale Objects from Optical Colonoscopy Images

PubMed Central

Sakanashi, Hidenori; Takahashi, Eiichi; Murakawa, Masahiro; Aoki, Hiroshi; Takeuchi, Ken; Suzuki, Yasuo

2017-01-01

Optical colonoscopy is the most common approach to diagnosing bowel diseases through direct colon and rectum inspections. Periodic optical colonoscopy examinations are particularly important for detecting cancers at early stages while still treatable. However, diagnostic accuracy is highly dependent on both the experience and knowledge of the medical doctor. Moreover, it is extremely difficult, even for specialist doctors, to detect the early stages of cancer when obscured by inflammations of the colonic mucosa due to intractable inflammatory bowel diseases, such as ulcerative colitis. Thus, to assist the UC diagnosis, it is necessary to develop a new technology that can retrieve similar cases of diagnostic target image from cases in the past that stored the diagnosed images with various symptoms of colonic mucosa. In order to assist diagnoses with optical colonoscopy, this paper proposes a retrieval method for colonoscopy images that can cope with multiscale objects. The proposed method can retrieve similar colonoscopy images despite varying visible sizes of the target objects. Through three experiments conducted with real clinical colonoscopy images, we demonstrate that the method is able to retrieve objects of any visible size and any location at a high level of accuracy. PMID:28255295

Image Retrieval Method for Multiscale Objects from Optical Colonoscopy Images.

PubMed

Nosato, Hirokazu; Sakanashi, Hidenori; Takahashi, Eiichi; Murakawa, Masahiro; Aoki, Hiroshi; Takeuchi, Ken; Suzuki, Yasuo

2017-01-01

Optical colonoscopy is the most common approach to diagnosing bowel diseases through direct colon and rectum inspections. Periodic optical colonoscopy examinations are particularly important for detecting cancers at early stages while still treatable. However, diagnostic accuracy is highly dependent on both the experience and knowledge of the medical doctor. Moreover, it is extremely difficult, even for specialist doctors, to detect the early stages of cancer when obscured by inflammations of the colonic mucosa due to intractable inflammatory bowel diseases, such as ulcerative colitis. Thus, to assist the UC diagnosis, it is necessary to develop a new technology that can retrieve similar cases of diagnostic target image from cases in the past that stored the diagnosed images with various symptoms of colonic mucosa. In order to assist diagnoses with optical colonoscopy, this paper proposes a retrieval method for colonoscopy images that can cope with multiscale objects. The proposed method can retrieve similar colonoscopy images despite varying visible sizes of the target objects. Through three experiments conducted with real clinical colonoscopy images, we demonstrate that the method is able to retrieve objects of any visible size and any location at a high level of accuracy.

Phase retrieval by coherent modulation imaging

DOE Office of Scientific and Technical Information (OSTI.GOV)

Zhang, Fucai; Chen, Bo; Morrison, Graeme R.

Phase retrieval is a long-standing problem in imaging when only the intensity of the wavefield can be recorded. Coherent diffraction imaging (CDI) is a lensless technique that uses iterative algorithms to recover amplitude and phase contrast images from diffraction intensity data. For general samples, phase retrieval from a single diffraction pattern has been an algorithmic and experimental challenge. Here we report a method of phase retrieval that uses a known modulation of the sample exit-wave. This coherent modulation imaging (CMI) method removes inherent ambiguities of CDI and uses a reliable, rapidly converging iterative algorithm involving three planes. It works formore » extended samples, does not require tight support for convergence, and relaxes dynamic range requirements on the detector. CMI provides a robust method for imaging in materials and biological science, while its single-shot capability will benefit the investigation of dynamical processes with pulsed sources, such as X-ray free electron laser.« less

Phase retrieval by coherent modulation imaging

DOE PAGES

Zhang, Fucai; Chen, Bo; Morrison, Graeme R.; ...

2016-11-18

Phase retrieval is a long-standing problem in imaging when only the intensity of the wavefield can be recorded. Coherent diffraction imaging (CDI) is a lensless technique that uses iterative algorithms to recover amplitude and phase contrast images from diffraction intensity data. For general samples, phase retrieval from a single diffraction pattern has been an algorithmic and experimental challenge. Here we report a method of phase retrieval that uses a known modulation of the sample exit-wave. This coherent modulation imaging (CMI) method removes inherent ambiguities of CDI and uses a reliable, rapidly converging iterative algorithm involving three planes. It works formore » extended samples, does not require tight support for convergence, and relaxes dynamic range requirements on the detector. CMI provides a robust method for imaging in materials and biological science, while its single-shot capability will benefit the investigation of dynamical processes with pulsed sources, such as X-ray free electron laser.« less

Video and image retrieval beyond the cognitive level: the needs and possibilities

NASA Astrophysics Data System (ADS)

Hanjalic, Alan

2000-12-01

The worldwide research efforts in the are of image and video retrieval have concentrated so far on increasing the efficiency and reliability of extracting the elements of image and video semantics and so on improving the search and retrieval performance at the cognitive level of content abstraction. At this abstraction level, the user is searching for 'factual' or 'objective' content such as image showing a panorama of San Francisco, an outdoor or an indoor image, a broadcast news report on a defined topic, a movie dialog between the actors A and B or the parts of a basketball game showing fast breaks, steals and scores. These efforts, however, do not address the retrieval applications at the so-called affective level of content abstraction where the 'ground truth' is not strictly defined. Such applications are, for instance, those where subjectivity of the user plays the major role, e.g. the task of retrieving all images that the user 'likes most', and those that are based on 'recognizing emotions' in audiovisual data. Typical examples are searching for all images that 'radiate happiness', identifying all 'sad' movie fragments and looking for the 'romantic landscapes', 'sentimental' movie segments, 'movie highlights' or 'most exciting' moments of a sport event. This paper discusses the needs and possibilities for widening the current scope of research in the area of image and video search and retrieval in order to enable applications at the affective level of content abstraction.

Video and image retrieval beyond the cognitive level: the needs and possibilities

NASA Astrophysics Data System (ADS)

Hanjalic, Alan

2001-01-01

The worldwide research efforts in the are of image and video retrieval have concentrated so far on increasing the efficiency and reliability of extracting the elements of image and video semantics and so on improving the search and retrieval performance at the cognitive level of content abstraction. At this abstraction level, the user is searching for 'factual' or 'objective' content such as image showing a panorama of San Francisco, an outdoor or an indoor image, a broadcast news report on a defined topic, a movie dialog between the actors A and B or the parts of a basketball game showing fast breaks, steals and scores. These efforts, however, do not address the retrieval applications at the so-called affective level of content abstraction where the 'ground truth' is not strictly defined. Such applications are, for instance, those where subjectivity of the user plays the major role, e.g. the task of retrieving all images that the user 'likes most', and those that are based on 'recognizing emotions' in audiovisual data. Typical examples are searching for all images that 'radiate happiness', identifying all 'sad' movie fragments and looking for the 'romantic landscapes', 'sentimental' movie segments, 'movie highlights' or 'most exciting' moments of a sport event. This paper discusses the needs and possibilities for widening the current scope of research in the area of image and video search and retrieval in order to enable applications at the affective level of content abstraction.

Mining biomedical images towards valuable information retrieval in biomedical and life sciences.

PubMed

Ahmed, Zeeshan; Zeeshan, Saman; Dandekar, Thomas

2016-01-01

Biomedical images are helpful sources for the scientists and practitioners in drawing significant hypotheses, exemplifying approaches and describing experimental results in published biomedical literature. In last decades, there has been an enormous increase in the amount of heterogeneous biomedical image production and publication, which results in a need for bioimaging platforms for feature extraction and analysis of text and content in biomedical images to take advantage in implementing effective information retrieval systems. In this review, we summarize technologies related to data mining of figures. We describe and compare the potential of different approaches in terms of their developmental aspects, used methodologies, produced results, achieved accuracies and limitations. Our comparative conclusions include current challenges for bioimaging software with selective image mining, embedded text extraction and processing of complex natural language queries. © The Author(s) 2016. Published by Oxford University Press.

Requirements for benchmarking personal image retrieval systems

NASA Astrophysics Data System (ADS)

Bouguet, Jean-Yves; Dulong, Carole; Kozintsev, Igor; Wu, Yi

2006-01-01

It is now common to have accumulated tens of thousands of personal ictures. Efficient access to that many pictures can only be done with a robust image retrieval system. This application is of high interest to Intel processor architects. It is highly compute intensive, and could motivate end users to upgrade their personal computers to the next generations of processors. A key question is how to assess the robustness of a personal image retrieval system. Personal image databases are very different from digital libraries that have been used by many Content Based Image Retrieval Systems.1 For example a personal image database has a lot of pictures of people, but a small set of different people typically family, relatives, and friends. Pictures are taken in a limited set of places like home, work, school, and vacation destination. The most frequent queries are searched for people, and for places. These attributes, and many others affect how a personal image retrieval system should be benchmarked, and benchmarks need to be different from existing ones based on art images, or medical images for examples. The attributes of the data set do not change the list of components needed for the benchmarking of such systems as specified in2: - data sets - query tasks - ground truth - evaluation measures - benchmarking events. This paper proposed a way to build these components to be representative of personal image databases, and of the corresponding usage models.

Simultenious binary hash and features learning for image retrieval

NASA Astrophysics Data System (ADS)

Frantc, V. A.; Makov, S. V.; Voronin, V. V.; Marchuk, V. I.; Semenishchev, E. A.; Egiazarian, K. O.; Agaian, S.

2016-05-01

Content-based image retrieval systems have plenty of applications in modern world. The most important one is the image search by query image or by semantic description. Approaches to this problem are employed in personal photo-collection management systems, web-scale image search engines, medical systems, etc. Automatic analysis of large unlabeled image datasets is virtually impossible without satisfactory image-retrieval technique. It's the main reason why this kind of automatic image processing has attracted so much attention during recent years. Despite rather huge progress in the field, semantically meaningful image retrieval still remains a challenging task. The main issue here is the demand to provide reliable results in short amount of time. This paper addresses the problem by novel technique for simultaneous learning of global image features and binary hash codes. Our approach provide mapping of pixel-based image representation to hash-value space simultaneously trying to save as much of semantic image content as possible. We use deep learning methodology to generate image description with properties of similarity preservation and statistical independence. The main advantage of our approach in contrast to existing is ability to fine-tune retrieval procedure for very specific application which allow us to provide better results in comparison to general techniques. Presented in the paper framework for data- dependent image hashing is based on use two different kinds of neural networks: convolutional neural networks for image description and autoencoder for feature to hash space mapping. Experimental results confirmed that our approach has shown promising results in compare to other state-of-the-art methods.

The Effects of Surface Properties and Albedo on Methane Retrievals with the Airborne Visible/Infrared Imaging Spectrometer Next Generation (AVIRIS-NG)

NASA Astrophysics Data System (ADS)

Ayasse, A.; Thorpe, A. K.; Roberts, D. A.

2017-12-01

Atmospheric methane has increased by a factor of 2.5 since the beginning of the industrial era in response to anthropogenic emissions (Ciais et al., 2013). Although it is less abundant than carbon dioxide it is 86 time more potent on a 20 year time scale (Myhre et al., 2013) and is therefore responsible for about 20% of the total global warming induced by anthropogenic greenhouse gasses (Kirschke et al., 2013). Given the importance of methane to global climate change, monitoring and measuring methane emissions using techniques such as remote sensing is of increasing interest. Recently the Airborne Visible-Infrared Imaging Spectrometer - Next Generation (AVIRIS-NG) has proven to be a valuable instrument for quantitative mapping of methane plumes (Frankenberg et al., 2016; Thorpe et al., 2016; Thompson et al., 2015). In this study, we applied the Iterative Maximum a Posterior Differential Optical Spectroscopy (IMAP-DOAS) methane retrieval algorithm to a synthetic image with variable methane concentrations, albedo, and land cover. This allowed for characterizing retrieval performance, including potential sensitivity to variable land cover, low albedo surfaces, and surfaces known to cause spurious signals. We conclude that albedo had little influence on the IMAP-DOAS results except at very low radiance levels. Water (without sun glint) was found to be the most challenging surface for methane retrievals while hydrocarbons and some green vegetation also caused error. Understanding the effect of surface properties on methane retrievals is important given the increased use of AVIRIS-NG to map gas plumes over diverse locations and methane sources. This analysis could be expanded to include additional gas species like carbon dioxide and to further investigate gas sensitivity of proposed instruments for dedicated gas mapping from airborne and spaceborne platforms.

Texture-based approach to palmprint retrieval for personal identification

NASA Astrophysics Data System (ADS)

Li, Wenxin; Zhang, David; Xu, Z.; You, J.

2000-12-01

This paper presents a new approach to palmprint retrieval for personal identification. Three key issues in image retrieval are considered - feature selection, similarity measures and dynamic search for the best matching of the sample in the image database. We propose a texture-based method for palmprint feature representation. The concept of texture energy is introduced to define a palm print's global and local features, which are characterized with high convergence of inner-palm similarities and good dispersion of inter-palm discrimination. The search is carried out in a layered fashion: first global features are used to guide the fast selection of a small set of similar candidates from the database from the database and then local features are used to decide the final output within the candidate set. The experimental results demonstrate the effectiveness and accuracy of the proposed method.

Texture-based approach to palmprint retrieval for personal identification

NASA Astrophysics Data System (ADS)

Li, Wenxin; Zhang, David; Xu, Z.; You, J.

2001-01-01

This paper presents a new approach to palmprint retrieval for personal identification. Three key issues in image retrieval are considered - feature selection, similarity measures and dynamic search for the best matching of the sample in the image database. We propose a texture-based method for palmprint feature representation. The concept of texture energy is introduced to define a palm print's global and local features, which are characterized with high convergence of inner-palm similarities and good dispersion of inter-palm discrimination. The search is carried out in a layered fashion: first global features are used to guide the fast selection of a small set of similar candidates from the database from the database and then local features are used to decide the final output within the candidate set. The experimental results demonstrate the effectiveness and accuracy of the proposed method.

Content based image retrieval using local binary pattern operator and data mining techniques.

PubMed

Vatamanu, Oana Astrid; Frandeş, Mirela; Lungeanu, Diana; Mihalaş, Gheorghe-Ioan

2015-01-01

Content based image retrieval (CBIR) concerns the retrieval of similar images from image databases, using feature vectors extracted from images. These feature vectors globally define the visual content present in an image, defined by e.g., texture, colour, shape, and spatial relations between vectors. Herein, we propose the definition of feature vectors using the Local Binary Pattern (LBP) operator. A study was performed in order to determine the optimum LBP variant for the general definition of image feature vectors. The chosen LBP variant is then subsequently used to build an ultrasound image database, and a database with images obtained from Wireless Capsule Endoscopy. The image indexing process is optimized using data clustering techniques for images belonging to the same class. Finally, the proposed indexing method is compared to the classical indexing technique, which is nowadays widely used.

Image/text automatic indexing and retrieval system using context vector approach

NASA Astrophysics Data System (ADS)

Qing, Kent P.; Caid, William R.; Ren, Clara Z.; McCabe, Patrick

1995-11-01

Thousands of documents and images are generated daily both on and off line on the information superhighway and other media. Storage technology has improved rapidly to handle these data but indexing this information is becoming very costly. HNC Software Inc. has developed a technology for automatic indexing and retrieval of free text and images. This technique is demonstrated and is based on the concept of `context vectors' which encode a succinct representation of the associated text and features of sub-image. In this paper, we will describe the Automated Librarian System which was designed for free text indexing and the Image Content Addressable Retrieval System (ICARS) which extends the technique from the text domain into the image domain. Both systems have the ability to automatically assign indices for a new document and/or image based on the content similarities in the database. ICARS also has the capability to retrieve images based on similarity of content using index terms, text description, and user-generated images as a query without performing segmentation or object recognition.

Structure function monitor

DOEpatents

McGraw, John T [Placitas, NM; Zimmer, Peter C [Albuquerque, NM; Ackermann, Mark R [Albuquerque, NM

2012-01-24

Methods and apparatus for a structure function monitor provide for generation of parameters characterizing a refractive medium. In an embodiment, a structure function monitor acquires images of a pupil plane and an image plane and, from these images, retrieves the phase over an aperture, unwraps the retrieved phase, and analyzes the unwrapped retrieved phase. In an embodiment, analysis yields atmospheric parameters measured at spatial scales from zero to the diameter of a telescope used to collect light from a source.

Content Based Image Retrieval based on Wavelet Transform coefficients distribution

PubMed Central

Lamard, Mathieu; Cazuguel, Guy; Quellec, Gwénolé; Bekri, Lynda; Roux, Christian; Cochener, Béatrice

2007-01-01

In this paper we propose a content based image retrieval method for diagnosis aid in medical fields. We characterize images without extracting significant features by using distribution of coefficients obtained by building signatures from the distribution of wavelet transform. The research is carried out by computing signature distances between the query and database images. Several signatures are proposed; they use a model of wavelet coefficient distribution. To enhance results, a weighted distance between signatures is used and an adapted wavelet base is proposed. Retrieval efficiency is given for different databases including a diabetic retinopathy, a mammography and a face database. Results are promising: the retrieval efficiency is higher than 95% for some cases using an optimization process. PMID:18003013

A Prediction Error-driven Retrieval Procedure for Destabilizing and Rewriting Maladaptive Reward Memories in Hazardous Drinkers

PubMed Central

Das, Ravi K.; Gale, Grace; Hennessy, Vanessa; Kamboj, Sunjeev K.

2018-01-01

Maladaptive reward memories (MRMs) can become unstable following retrieval under certain conditions, allowing their modification by subsequent new learning. However, robust (well-rehearsed) and chronologically old MRMs, such as those underlying substance use disorders, do not destabilize easily when retrieved. A key determinate of memory destabilization during retrieval is prediction error (PE). We describe a retrieval procedure for alcohol MRMs in hazardous drinkers that specifically aims to maximize the generation of PE and therefore the likelihood of MRM destabilization. The procedure requires explicitly generating the expectancy of alcohol consumption and then violating this expectancy (withholding alcohol) following the presentation of a brief set of prototypical alcohol cue images (retrieval + PE). Control procedures involve presenting the same cue images, but allow alcohol to be consumed, generating minimal PE (retrieval-no PE) or generate PE without retrieval of alcohol MRMs, by presenting orange juice cues (no retrieval + PE). Subsequently, we describe a multisensory disgust-based counterconditioning procedure to probe MRM destabilization by re-writing alcohol cue-reward associations prior to reconsolidation. This procedure pairs alcohol cues with images invoking pathogen disgust and an extremely bitter-tasting solution (denatonium benzoate), generating gustatory disgust. Following retrieval + PE, but not no retrieval + PE or retrieval-no PE, counterconditioning produces evidence of MRM rewriting as indexed by lasting reductions in alcohol cue valuation, attentional capture, and alcohol craving. PMID:29364255

Propagation based phase retrieval of simulated intensity measurements using artificial neural networks

NASA Astrophysics Data System (ADS)

Kemp, Z. D. C.

2018-04-01

Determining the phase of a wave from intensity measurements has many applications in fields such as electron microscopy, visible light optics, and medical imaging. Propagation based phase retrieval, where the phase is obtained from defocused images, has shown significant promise. There are, however, limitations in the accuracy of the retrieved phase arising from such methods. Sources of error include shot noise, image misalignment, and diffraction artifacts. We explore the use of artificial neural networks (ANNs) to improve the accuracy of propagation based phase retrieval algorithms applied to simulated intensity measurements. We employ a phase retrieval algorithm based on the transport-of-intensity equation to obtain the phase from simulated micrographs of procedurally generated specimens. We then train an ANN with pairs of retrieved and exact phases, and use the trained ANN to process a test set of retrieved phase maps. The total error in the phase is significantly reduced using this method. We also discuss a variety of potential extensions to this work.

Content-based image retrieval from a database of fracture images

NASA Astrophysics Data System (ADS)

Müller, Henning; Do Hoang, Phuong Anh; Depeursinge, Adrien; Hoffmeyer, Pierre; Stern, Richard; Lovis, Christian; Geissbuhler, Antoine

2007-03-01

This article describes the use of a medical image retrieval system on a database of 16'000 fractures, selected from surgical routine over several years. Image retrieval has been a very active domain of research for several years. It was frequently proposed for the medical domain, but only few running systems were ever tested in clinical routine. For the planning of surgical interventions after fractures, x-ray images play an important role. The fractures are classified according to exact fracture location, plus whether and to which degree the fracture is damaging articulations to see how complicated a reparation will be. Several classification systems for fractures exist and the classification plus the experience of the surgeon lead in the end to the choice of surgical technique (screw, metal plate, ...). This choice is strongly influenced by the experience and knowledge of the surgeons with respect to a certain technique. Goal of this article is to describe a prototype that supplies similar cases to an example to help treatment planning and find the most appropriate technique for a surgical intervention. Our database contains over 16'000 fracture images before and after a surgical intervention. We use an image retrieval system (GNU Image Finding Tool, GIFT) to find cases/images similar to an example case currently under observation. Problems encountered are varying illumination of images as well as strong anatomic differences between patients. Regions of interest are usually small and the retrieval system needs to focus on this region. Results show that GIFT is capable of supplying similar cases, particularly when using relevance feedback, on such a large database. Usual image retrieval is based on a single image as search target but for this application we have to select images by case as similar cases need to be found and not images. A few false positive cases often remain in the results but they can be sorted out quickly by the surgeons. Image retrieval can well be used for the planning of operations by supplying similar cases. A variety of challenges has been identified and partly solved (varying luminosity, small region of interested, case-based instead of image-based). This article mainly presents a case study to identify potential benefits and problems. Several steps for improving the system have been identified as well and will be described at the end of the paper.

Surface and Atmospheric Parameter Retrieval From AVIRIS Data: The Importance of Non-Linear Effects

NASA Technical Reports Server (NTRS)

Green Robert O.; Moreno, Jose F.

1996-01-01

AVIRIS data represent a new and important approach for the retrieval of atmospheric and surface parameters from optical remote sensing data. Not only as a test for future space systems, but also as an operational airborne remote sensing system, the development of algorithms to retrieve information from AVIRIS data is an important step to these new approaches and capabilities. Many things have been learned since AVIRIS became operational, and the successive technical improvements in the hardware and the more sophisticated calibration techniques employed have increased the quality of the data to the point of almost meeting optimum user requirements. However, the potential capabilities of imaging spectrometry over the standard multispectral techniques have still not been fully demonstrated. Reasons for this are the technical difficulties in handling the data, the critical aspect of calibration for advanced retrieval methods, and the lack of proper models with which to invert the measured AVIRIS radiances in all the spectral channels. To achieve the potential of imaging spectrometry, these issues must be addressed. In this paper, an algorithm to retrieve information about both atmospheric and surface parameters from AVIRIS data, by using model inversion techniques, is described. Emphasis is put on the derivation of the model itself as well as proper inversion techniques, robust to noise in the data and an inadequate ability of the model to describe natural variability in the data. The problem of non-linear effects is addressed, as it has been demonstrated to be a major source of error in the numerical values retrieved by more simple, linear-based approaches. Non-linear effects are especially critical for the retrieval of surface parameters where both scattering and absorption effects are coupled, as well as in the cases of significant multiple-scattering contributions. However, sophisticated modeling approaches can handle such non-linear effects, which are especially important over vegetated surfaces. All the data used in this study were acquired during the 1991 Multisensor Airborne Campaign (MAC-Europe), as part of the European Field Experiment on a Desertification-threatened Area (EFEDA), carried out in Spain in June-July 1991.

SiNC: Saliency-injected neural codes for representation and efficient retrieval of medical radiographs

PubMed Central

Sajjad, Muhammad; Mehmood, Irfan; Baik, Sung Wook

2017-01-01

Medical image collections contain a wealth of information which can assist radiologists and medical experts in diagnosis and disease detection for making well-informed decisions. However, this objective can only be realized if efficient access is provided to semantically relevant cases from the ever-growing medical image repositories. In this paper, we present an efficient method for representing medical images by incorporating visual saliency and deep features obtained from a fine-tuned convolutional neural network (CNN) pre-trained on natural images. Saliency detector is employed to automatically identify regions of interest like tumors, fractures, and calcified spots in images prior to feature extraction. Neuronal activation features termed as neural codes from different CNN layers are comprehensively studied to identify most appropriate features for representing radiographs. This study revealed that neural codes from the last fully connected layer of the fine-tuned CNN are found to be the most suitable for representing medical images. The neural codes extracted from the entire image and salient part of the image are fused to obtain the saliency-injected neural codes (SiNC) descriptor which is used for indexing and retrieval. Finally, locality sensitive hashing techniques are applied on the SiNC descriptor to acquire short binary codes for allowing efficient retrieval in large scale image collections. Comprehensive experimental evaluations on the radiology images dataset reveal that the proposed framework achieves high retrieval accuracy and efficiency for scalable image retrieval applications and compares favorably with existing approaches. PMID:28771497

Near-Real Time Cloud Retrievals from Operational and Research Meteorological Satellites

NASA Technical Reports Server (NTRS)

Minnis, Patrick; Nguyen, Louis; Palilonda, Rabindra; Heck, Patrick W.; Spangenberg, Douglas A.; Doelling, David R.; Ayers, J. Kirk; Smith, William L., Jr.; Khaiyer, Mandana M.; Trepte, Qing Z.;

Image Retrieval by Color Semantics with Incomplete Knowledge.

ERIC Educational Resources Information Center

Corridoni, Jacopo M.; Del Bimbo, Alberto; Vicario, Enrico

1998-01-01

Presents a system which supports image retrieval by high-level chromatic contents, the sensations that color accordances generate on the observer. Surveys Itten's theory of color semantics and discusses image description and query specification. Presents examples of visual querying. (AEF)

Automatic visibility retrieval from thermal camera images

NASA Astrophysics Data System (ADS)

Dizerens, Céline; Ott, Beat; Wellig, Peter; Wunderle, Stefan

2017-10-01

This study presents an automatic visibility retrieval of a FLIR A320 Stationary Thermal Imager installed on a measurement tower on the mountain Lagern located in the Swiss Jura Mountains. Our visibility retrieval makes use of edges that are automatically detected from thermal camera images. Predefined target regions, such as mountain silhouettes or buildings with high thermal differences to the surroundings, are used to derive the maximum visibility distance that is detectable in the image. To allow a stable, automatic processing, our procedure additionally removes noise in the image and includes automatic image alignment to correct small shifts of the camera. We present a detailed analysis of visibility derived from more than 24000 thermal images of the years 2015 and 2016 by comparing them to (1) visibility derived from a panoramic camera image (VISrange), (2) measurements of a forward-scatter visibility meter (Vaisala FD12 working in the NIR spectra), and (3) modeled visibility values using the Thermal Range Model TRM4. Atmospheric conditions, mainly water vapor from European Center for Medium Weather Forecast (ECMWF), were considered to calculate the extinction coefficients using MODTRAN. The automatic visibility retrieval based on FLIR A320 images is often in good agreement with the retrieval from the systems working in different spectral ranges. However, some significant differences were detected as well, depending on weather conditions, thermal differences of the monitored landscape, and defined target size.

Semantics of User Interface for Image Retrieval: Possibility Theory and Learning Techniques.

ERIC Educational Resources Information Center

Crehange, M.; And Others

1989-01-01

Discusses the need for a rich semantics for the user interface in interactive image retrieval and presents two methods for building such interfaces: possibility theory applied to fuzzy data retrieval, and a machine learning technique applied to learning the user's deep need. Prototypes developed using videodisks and knowledge-based software are…

Precise and Efficient Retrieval of Captioned Images: The MARIE Project.

ERIC Educational Resources Information Center

Rowe, Neil C.

1999-01-01

The MARIE project explores knowledge-based information retrieval of captioned images of the kind found in picture libraries and on the Internet. MARIE's five-part approach exploits the idea that images are easier to understand with context, especially descriptive text near them, but it also does image analysis. Experiments show MARIE prototypes…

Cloud Retrieval Information Content Studies with the Pre-Aerosol, Cloud and ocean Ecosystem (PACE) Ocean Color Imager (OCI)

NASA Astrophysics Data System (ADS)

Coddington, Odele; Platnick, Steven; Pilewskie, Peter; Schmidt, Sebastian

2016-04-01

The NASA Pre-Aerosol, Cloud and ocean Ecosystem (PACE) Science Definition Team (SDT) report released in 2012 defined imager stability requirements for the Ocean Color Instrument (OCI) at the sub-percent level. While the instrument suite and measurement requirements are currently being determined, the PACE SDT report provided details on imager options and spectral specifications. The options for a threshold instrument included a hyperspectral imager from 350-800 nm, two near-infrared (NIR) channels, and three short wave infrared (SWIR) channels at 1240, 1640, and 2130 nm. Other instrument options include a variation of the threshold instrument with 3 additional spectral channels at 940, 1378, and 2250 nm and the inclusion of a spectral polarimeter. In this work, we present cloud retrieval information content studies of optical thickness, droplet effective radius, and thermodynamic phase to quantify the potential for continuing the low cloud climate data record established by the MOderate Resolution and Imaging Spectroradiometer (MODIS) and Visible Infrared Imaging Radiometer Suite (VIIRS) missions with the PACE OCI instrument (i.e., non-polarized cloud reflectances and in the absence of midwave and longwave infrared channels). The information content analysis is performed using the GEneralized Nonlinear Retrieval Analysis (GENRA) methodology and the Collection 6 simulated cloud reflectance data for the common MODIS/VIIRS algorithm (MODAWG) for Cloud Mask, Cloud-Top, and Optical Properties. We show that using both channels near 2 microns improves the probability of cloud phase discrimination with shortwave-only cloud reflectance retrievals. Ongoing work will extend the information content analysis, currently performed for dark ocean surfaces, to different land surface types.

Optical Disc Technology and the Cooperative Television Library.

ERIC Educational Resources Information Center

Kranch, Douglas

1989-01-01

Discusses the feasibility of individual television film libraries combining film holdings onto optical disks and developing networks that would allow online searching of, access to, and transmission of video images. It is concluded that recent advances in technology would support fast and cost effective image retrieval with no loss in video…

Novel Algorithm for Classification of Medical Images

NASA Astrophysics Data System (ADS)

Bhushan, Bharat; Juneja, Monika

2010-11-01

Content-based image retrieval (CBIR) methods in medical image databases have been designed to support specific tasks, such as retrieval of medical images. These methods cannot be transferred to other medical applications since different imaging modalities require different types of processing. To enable content-based queries in diverse collections of medical images, the retrieval system must be familiar with the current Image class prior to the query processing. Further, almost all of them deal with the DICOM imaging format. In this paper a novel algorithm based on energy information obtained from wavelet transform for the classification of medical images according to their modalities is described. For this two types of wavelets have been used and have been shown that energy obtained in either case is quite distinct for each of the body part. This technique can be successfully applied to different image formats. The results are shown for JPEG imaging format.

Three-dimensional spatiotemporal features for fast content-based retrieval of focal liver lesions.

PubMed

Roy, Sharmili; Chi, Yanling; Liu, Jimin; Venkatesh, Sudhakar K; Brown, Michael S

2014-11-01

Content-based image retrieval systems for 3-D medical datasets still largely rely on 2-D image-based features extracted from a few representative slices of the image stack. Most 2 -D features that are currently used in the literature not only model a 3-D tumor incompletely but are also highly expensive in terms of computation time, especially for high-resolution datasets. Radiologist-specified semantic labels are sometimes used along with image-based 2-D features to improve the retrieval performance. Since radiological labels show large interuser variability, are often unstructured, and require user interaction, their use as lesion characterizing features is highly subjective, tedious, and slow. In this paper, we propose a 3-D image-based spatiotemporal feature extraction framework for fast content-based retrieval of focal liver lesions. All the features are computer generated and are extracted from four-phase abdominal CT images. Retrieval performance and query processing times for the proposed framework is evaluated on a database of 44 hepatic lesions comprising of five pathological types. Bull's eye percentage score above 85% is achieved for three out of the five lesion pathologies and for 98% of query lesions, at least one same type of lesion is ranked among the top two retrieved results. Experiments show that the proposed system's query processing is more than 20 times faster than other already published systems that use 2-D features. With fast computation time and high retrieval accuracy, the proposed system has the potential to be used as an assistant to radiologists for routine hepatic tumor diagnosis.

Plant leaf chlorophyll content retrieval based on a field imaging spectroscopy system.

PubMed

Liu, Bo; Yue, Yue-Min; Li, Ru; Shen, Wen-Jing; Wang, Ke-Lin

2014-10-23

A field imaging spectrometer system (FISS; 380-870 nm and 344 bands) was designed for agriculture applications. In this study, FISS was used to gather spectral information from soybean leaves. The chlorophyll content was retrieved using a multiple linear regression (MLR), partial least squares (PLS) regression and support vector machine (SVM) regression. Our objective was to verify the performance of FISS in a quantitative spectral analysis through the estimation of chlorophyll content and to determine a proper quantitative spectral analysis method for processing FISS data. The results revealed that the derivative reflectance was a more sensitive indicator of chlorophyll content and could extract content information more efficiently than the spectral reflectance, which is more significant for FISS data compared to ASD (analytical spectral devices) data, reducing the corresponding RMSE (root mean squared error) by 3.3%-35.6%. Compared with the spectral features, the regression methods had smaller effects on the retrieval accuracy. A multivariate linear model could be the ideal model to retrieve chlorophyll information with a small number of significant wavelengths used. The smallest RMSE of the chlorophyll content retrieved using FISS data was 0.201 mg/g, a relative reduction of more than 30% compared with the RMSE based on a non-imaging ASD spectrometer, which represents a high estimation accuracy compared with the mean chlorophyll content of the sampled leaves (4.05 mg/g). Our study indicates that FISS could obtain both spectral and spatial detailed information of high quality. Its image-spectrum-in-one merit promotes the good performance of FISS in quantitative spectral analyses, and it can potentially be widely used in the agricultural sector.

Plant Leaf Chlorophyll Content Retrieval Based on a Field Imaging Spectroscopy System

PubMed Central

Liu, Bo; Yue, Yue-Min; Li, Ru; Shen, Wen-Jing; Wang, Ke-Lin

2014-01-01

A field imaging spectrometer system (FISS; 380–870 nm and 344 bands) was designed for agriculture applications. In this study, FISS was used to gather spectral information from soybean leaves. The chlorophyll content was retrieved using a multiple linear regression (MLR), partial least squares (PLS) regression and support vector machine (SVM) regression. Our objective was to verify the performance of FISS in a quantitative spectral analysis through the estimation of chlorophyll content and to determine a proper quantitative spectral analysis method for processing FISS data. The results revealed that the derivative reflectance was a more sensitive indicator of chlorophyll content and could extract content information more efficiently than the spectral reflectance, which is more significant for FISS data compared to ASD (analytical spectral devices) data, reducing the corresponding RMSE (root mean squared error) by 3.3%–35.6%. Compared with the spectral features, the regression methods had smaller effects on the retrieval accuracy. A multivariate linear model could be the ideal model to retrieve chlorophyll information with a small number of significant wavelengths used. The smallest RMSE of the chlorophyll content retrieved using FISS data was 0.201 mg/g, a relative reduction of more than 30% compared with the RMSE based on a non-imaging ASD spectrometer, which represents a high estimation accuracy compared with the mean chlorophyll content of the sampled leaves (4.05 mg/g). Our study indicates that FISS could obtain both spectral and spatial detailed information of high quality. Its image-spectrum-in-one merit promotes the good performance of FISS in quantitative spectral analyses, and it can potentially be widely used in the agricultural sector. PMID:25341439

Assessment of the UV camera sulfur dioxide retrieval for point source plumes

USGS Publications Warehouse

Dalton, M.P.; Watson, I.M.; Nadeau, P.A.; Werner, C.; Morrow, W.; Shannon, J.M.

2009-01-01

Digital cameras, sensitive to specific regions of the ultra-violet (UV) spectrum, have been employed for quantifying sulfur dioxide (SO2) emissions in recent years. The instruments make use of the selective absorption of UV light by SO2 molecules to determine pathlength concentration. Many monitoring advantages are gained by using this technique, but the accuracy and limitations have not been thoroughly investigated. The effect of some user-controlled parameters, including image exposure duration, the diameter of the lens aperture, the frequency of calibration cell imaging, and the use of the single or paired bandpass filters, have not yet been addressed. In order to clarify methodological consequences and quantify accuracy, laboratory and field experiments were conducted. Images were collected of calibration cells under varying observational conditions, and our conclusions provide guidance for enhanced image collection. Results indicate that the calibration cell response is reliably linear below 1500 ppm m, but that the response is significantly affected by changing light conditions. Exposure durations that produced maximum image digital numbers above 32 500 counts can reduce noise in plume images. Sulfur dioxide retrieval results from a coal-fired power plant plume were compared to direct sampling measurements and the results indicate that the accuracy of the UV camera retrieval method is within the range of current spectrometric methods. ?? 2009 Elsevier B.V.

Automatic classification and detection of clinically relevant images for diabetic retinopathy

NASA Astrophysics Data System (ADS)

Xu, Xinyu; Li, Baoxin

2008-03-01

We proposed a novel approach to automatic classification of Diabetic Retinopathy (DR) images and retrieval of clinically-relevant DR images from a database. Given a query image, our approach first classifies the image into one of the three categories: microaneurysm (MA), neovascularization (NV) and normal, and then it retrieves DR images that are clinically-relevant to the query image from an archival image database. In the classification stage, the query DR images are classified by the Multi-class Multiple-Instance Learning (McMIL) approach, where images are viewed as bags, each of which contains a number of instances corresponding to non-overlapping blocks, and each block is characterized by low-level features including color, texture, histogram of edge directions, and shape. McMIL first learns a collection of instance prototypes for each class that maximizes the Diverse Density function using Expectation- Maximization algorithm. A nonlinear mapping is then defined using the instance prototypes and maps every bag to a point in a new multi-class bag feature space. Finally a multi-class Support Vector Machine is trained in the multi-class bag feature space. In the retrieval stage, we retrieve images from the archival database who bear the same label with the query image, and who are the top K nearest neighbors of the query image in terms of similarity in the multi-class bag feature space. The classification approach achieves high classification accuracy, and the retrieval of clinically-relevant images not only facilitates utilization of the vast amount of hidden diagnostic knowledge in the database, but also improves the efficiency and accuracy of DR lesion diagnosis and assessment.

Retrieving high-resolution images over the Internet from an anatomical image database

NASA Astrophysics Data System (ADS)

Strupp-Adams, Annette; Henderson, Earl

1999-12-01

The Visible Human Data set is an important contribution to the national collection of anatomical images. To enhance the availability of these images, the National Library of Medicine has supported the design and development of a prototype object-oriented image database which imports, stores, and distributes high resolution anatomical images in both pixel and voxel formats. One of the key database modules is its client-server Internet interface. This Web interface provides a query engine with retrieval access to high-resolution anatomical images that range in size from 100KB for browser viewable rendered images, to 1GB for anatomical structures in voxel file formats. The Web query and retrieval client-server system is composed of applet GUIs, servlets, and RMI application modules which communicate with each other to allow users to query for specific anatomical structures, and retrieve image data as well as associated anatomical images from the database. Selected images can be downloaded individually as single files via HTTP or downloaded in batch-mode over the Internet to the user's machine through an applet that uses Netscape's Object Signing mechanism. The image database uses ObjectDesign's object-oriented DBMS, ObjectStore that has a Java interface. The query and retrieval systems has been tested with a Java-CDE window system, and on the x86 architecture using Windows NT 4.0. This paper describes the Java applet client search engine that queries the database; the Java client module that enables users to view anatomical images online; the Java application server interface to the database which organizes data returned to the user, and its distribution engine that allow users to download image files individually and/or in batch-mode.

A method of solving tilt illumination for multiple distance phase retrieval

NASA Astrophysics Data System (ADS)

Guo, Cheng; Li, Qiang; Tan, Jiubin; Liu, Shutian; Liu, Zhengjun

2018-07-01

Multiple distance phase retrieval is a technique of using a series of intensity patterns to reconstruct a complex-valued image of object. However, tilt illumination originating from the off-axis displacement of incident light significantly impairs its imaging quality. To eliminate this affection, we use cross-correlation calibration to estimate oblique angle of incident light and a Fourier-based strategy to correct tilted illumination effect. Compared to other methods, binary and biological object are both stably reconstructed in simulation and experiment. This work provides a simple but beneficial method to solve the problem of tilt illumination for lens-free multi-distance system.

Modelling Subjectivity in Visual Perception of Orientation for Image Retrieval.

ERIC Educational Resources Information Center

Sanchez, D.; Chamorro-Martinez, J.; Vila, M. A.

2003-01-01

Discussion of multimedia libraries and the need for storage, indexing, and retrieval techniques focuses on the combination of computer vision and data mining techniques to model high-level concepts for image retrieval based on perceptual features of the human visual system. Uses fuzzy set theory to measure users' assessments and to capture users'…

Neural Similarity Between Encoding and Retrieval is Related to Memory Via Hippocampal Interactions

PubMed Central

Ritchey, Maureen; Wing, Erik A.; LaBar, Kevin S.; Cabeza, Roberto

2013-01-01

A fundamental principle in memory research is that memory is a function of the similarity between encoding and retrieval operations. Consistent with this principle, many neurobiological models of declarative memory assume that memory traces are stored in cortical regions, and the hippocampus facilitates the reactivation of these traces during retrieval. The present investigation tested the novel prediction that encoding–retrieval similarity can be observed and related to memory at the level of individual items. Multivariate representational similarity analysis was applied to functional magnetic resonance imaging data collected during encoding and retrieval of emotional and neutral scenes. Memory success tracked fluctuations in encoding–retrieval similarity across frontal and posterior cortices. Importantly, memory effects in posterior regions reflected increased similarity between item-specific representations during successful recognition. Mediation analyses revealed that the hippocampus mediated the link between cortical similarity and memory success, providing crucial evidence for hippocampal–cortical interactions during retrieval. Finally, because emotional arousal is known to modulate both perceptual and memory processes, similarity effects were compared for emotional and neutral scenes. Emotional arousal was associated with enhanced similarity between encoding and retrieval patterns. These findings speak to the promise of pattern similarity measures for evaluating memory representations and hippocampal–cortical interactions. PMID:22967731

The 2010 Eyja eruption evolution by using IR satellite sensors measurements: retrieval comparison and insights into explosive volcanic processes

NASA Astrophysics Data System (ADS)

Piscini, A.; Corradini, S.; Merucci, L.; Scollo, S.

2010-12-01

The 2010 April-May Eyja eruption caused an unprecedented disruption to economic, political and cultural activities in Europe and across the world. Because of the harming effects of fine ash particles on aircrafts, many European airports were in fact closed causing millions of passengers to be stranded, and with a worldwide airline industry loss estimated of about 2.5 billion Euros. Both security and economical issues require robust and affordable volcanic cloud retrievals that may be really improved through the intercomparison among different remote sensing instruments. In this work the Thermal InfraRed (TIR) measurements of different polar and geostationary satellites instruments as the Moderate Resolution Imaging Spectroradiometer (MODIS), the Advanced Very High Resolution Radiometer (AVHRR) and the Spin Enhanced Visible and Infrared Imager (SEVIRI), have been used to retrieve the volcanic ash and SO2 in the entire eruption period over Iceland. The ash retrievals (mass, AOD and effective radius) have been carried out by means of the split window BTD technique using the channels centered around 11 and 12 micron. The least square fit procedure is used for the SO2 retrieval by using the 7.3 and 8.7 micron channels. The simulated TOA radiance Look-Up Table (LUT) needed for both the ash and SO2 column abundance retrievals have been computed using the MODTRAN 4 Radiative Transfer Model. Further, the volcanic plume column altitude and ash density have been computed and compared, when available, with ground observations. The results coming from the retrieval of different IR sensors show a good agreement over the entire eruption period. The column height, the volcanic ash and the SO2 emission trend confirm the indentified different phases occurred during the Eyja eruption. We remark that the retrieved volcanic plume evolution can give important insights into eruptive dynamics during long-lived explosive activity.

A graph-based approach for the retrieval of multi-modality medical images.

PubMed

Kumar, Ashnil; Kim, Jinman; Wen, Lingfeng; Fulham, Michael; Feng, Dagan

2014-02-01

In this paper, we address the retrieval of multi-modality medical volumes, which consist of two different imaging modalities, acquired sequentially, from the same scanner. One such example, positron emission tomography and computed tomography (PET-CT), provides physicians with complementary functional and anatomical features as well as spatial relationships and has led to improved cancer diagnosis, localisation, and staging. The challenge of multi-modality volume retrieval for cancer patients lies in representing the complementary geometric and topologic attributes between tumours and organs. These attributes and relationships, which are used for tumour staging and classification, can be formulated as a graph. It has been demonstrated that graph-based methods have high accuracy for retrieval by spatial similarity. However, naïvely representing all relationships on a complete graph obscures the structure of the tumour-anatomy relationships. We propose a new graph structure derived from complete graphs that structurally constrains the edges connected to tumour vertices based upon the spatial proximity of tumours and organs. This enables retrieval on the basis of tumour localisation. We also present a similarity matching algorithm that accounts for different feature sets for graph elements from different imaging modalities. Our method emphasises the relationships between a tumour and related organs, while still modelling patient-specific anatomical variations. Constraining tumours to related anatomical structures improves the discrimination potential of graphs, making it easier to retrieve similar images based on tumour location. We evaluated our retrieval methodology on a dataset of clinical PET-CT volumes. Our results showed that our method enabled the retrieval of multi-modality images using spatial features. Our graph-based retrieval algorithm achieved a higher precision than several other retrieval techniques: gray-level histograms as well as state-of-the-art methods such as visual words using the scale- invariant feature transform (SIFT) and relational matrices representing the spatial arrangements of objects. Copyright © 2013 Elsevier B.V. All rights reserved.

Visualizing and improving the robustness of phase retrieval algorithms

DOE PAGES

Tripathi, Ashish; Leyffer, Sven; Munson, Todd; ...

2015-06-01

Coherent x-ray diffractive imaging is a novel imaging technique that utilizes phase retrieval and nonlinear optimization methods to image matter at nanometer scales. We explore how the convergence properties of a popular phase retrieval algorithm, Fienup's HIO, behave by introducing a reduced dimensionality problem allowing us to visualize and quantify convergence to local minima and the globally optimal solution. We then introduce generalizations of HIO that improve upon the original algorithm's ability to converge to the globally optimal solution.

Visualizing and improving the robustness of phase retrieval algorithms

DOE Office of Scientific and Technical Information (OSTI.GOV)

Tripathi, Ashish; Leyffer, Sven; Munson, Todd

Coherent x-ray diffractive imaging is a novel imaging technique that utilizes phase retrieval and nonlinear optimization methods to image matter at nanometer scales. We explore how the convergence properties of a popular phase retrieval algorithm, Fienup's HIO, behave by introducing a reduced dimensionality problem allowing us to visualize and quantify convergence to local minima and the globally optimal solution. We then introduce generalizations of HIO that improve upon the original algorithm's ability to converge to the globally optimal solution.

A flower image retrieval method based on ROI feature.

PubMed

Hong, An-Xiang; Chen, Gang; Li, Jun-Li; Chi, Zhe-Ru; Zhang, Dan

2004-07-01

Flower image retrieval is a very important step for computer-aided plant species recognition. In this paper, we propose an efficient segmentation method based on color clustering and domain knowledge to extract flower regions from flower images. For flower retrieval, we use the color histogram of a flower region to characterize the color features of flower and two shape-based features sets, Centroid-Contour Distance (CCD) and Angle Code Histogram (ACH), to characterize the shape features of a flower contour. Experimental results showed that our flower region extraction method based on color clustering and domain knowledge can produce accurate flower regions. Flower retrieval results on a database of 885 flower images collected from 14 plant species showed that our Region-of-Interest (ROI) based retrieval approach using both color and shape features can perform better than a method based on the global color histogram proposed by Swain and Ballard (1991) and a method based on domain knowledge-driven segmentation and color names proposed by Das et al.(1999).

Cross-Modal Retrieval With CNN Visual Features: A New Baseline.

PubMed

Wei, Yunchao; Zhao, Yao; Lu, Canyi; Wei, Shikui; Liu, Luoqi; Zhu, Zhenfeng; Yan, Shuicheng

2017-02-01

Recently, convolutional neural network (CNN) visual features have demonstrated their powerful ability as a universal representation for various recognition tasks. In this paper, cross-modal retrieval with CNN visual features is implemented with several classic methods. Specifically, off-the-shelf CNN visual features are extracted from the CNN model, which is pretrained on ImageNet with more than one million images from 1000 object categories, as a generic image representation to tackle cross-modal retrieval. To further enhance the representational ability of CNN visual features, based on the pretrained CNN model on ImageNet, a fine-tuning step is performed by using the open source Caffe CNN library for each target data set. Besides, we propose a deep semantic matching method to address the cross-modal retrieval problem with respect to samples which are annotated with one or multiple labels. Extensive experiments on five popular publicly available data sets well demonstrate the superiority of CNN visual features for cross-modal retrieval.

Propagation of spectral characterization errors of imaging spectrometers at level-1 and its correction within a level-2 recalibration scheme

NASA Astrophysics Data System (ADS)

Vicent, Jorge; Alonso, Luis; Sabater, Neus; Miesch, Christophe; Kraft, Stefan; Moreno, Jose

2015-09-01

The uncertainties in the knowledge of the Instrument Spectral Response Function (ISRF), barycenter of the spectral channels and bandwidth / spectral sampling (spectral resolution) are important error sources in the processing of satellite imaging spectrometers within narrow atmospheric absorption bands. The exhaustive laboratory spectral characterization is a costly engineering process that differs from the instrument configuration in-flight given the harsh space environment and harmful launching phase. The retrieval schemes at Level-2 commonly assume a Gaussian ISRF, leading to uncorrected spectral stray-light effects and wrong characterization and correction of the spectral shift and smile. These effects produce inaccurate atmospherically corrected data and are propagated to the final Level-2 mission products. Within ESA's FLEX satellite mission activities, the impact of the ISRF knowledge error and spectral calibration at Level-1 products and its propagation to Level-2 retrieved chlorophyll fluorescence has been analyzed. A spectral recalibration scheme has been implemented at Level-2 reducing the errors in Level-1 products below the 10% error in retrieved fluorescence within the oxygen absorption bands enhancing the quality of the retrieved products. The work presented here shows how the minimization of the spectral calibration errors requires an effort both for the laboratory characterization and for the implementation of specific algorithms at Level-2.

Functional Heterogeneity in Posterior Parietal Cortex Across Attention and Episodic Memory Retrieval

PubMed Central

Hutchinson, J. Benjamin; Uncapher, Melina R.; Weiner, Kevin S.; Bressler, David W.; Silver, Michael A.; Preston, Alison R.; Wagner, Anthony D.

2014-01-01

While attention is critical for event memory, debate has arisen regarding the extent to which posterior parietal cortex (PPC) activation during episodic retrieval reflects engagement of PPC-mediated mechanisms of attention. Here, we directly examined the relationship between attention and memory, within and across subjects, using functional magnetic resonance imaging attention-mapping and episodic retrieval paradigms. During retrieval, 4 functionally dissociable PPC regions were identified. Specifically, 2 PPC regions positively tracked retrieval outcomes: lateral intraparietal sulcus (latIPS) indexed graded item memory strength, whereas angular gyrus (AnG) tracked recollection. By contrast, 2 other PPC regions demonstrated nonmonotonic relationships with retrieval: superior parietal lobule (SPL) tracked retrieval reaction time, consistent with a graded engagement of top-down attention, whereas temporoparietal junction displayed a complex pattern of below-baseline retrieval activity, perhaps reflecting disengagement of bottom-up attention. Analyses of retrieval effects in PPC topographic spatial attention maps (IPS0-IPS5; SPL1) revealed that IPS5 and SPL1 exhibited a nonmonotonic relationship with retrieval outcomes resembling that in the SPL region, further suggesting that SPL activation during retrieval reflects top-down attention. While demands on PPC attention mechanisms vary during retrieval attempts, the present functional parcellation of PPC indicates that 2 additional mechanisms (mediated by latIPS and AnG) positively track retrieval outcomes. PMID:23019246

Impact of differences in the solar irradiance spectrum on surface reflectance retrieval with different radiative transfer codes

NASA Technical Reports Server (NTRS)

Staenz, K.; Williams, D. J.; Fedosejevs, G.; Teillet, P. M.

1995-01-01

Surface reflectance retrieval from imaging spectrometer data as acquired with the Airborne Visible/Infrared Imaging Spectrometer (AVIRIS) has become important for quantitative analysis. In order to calculate surface reflectance from remotely measured radiance, radiative transfer codes such as 5S and MODTRAN2 play an increasing role for removal of scattering and absorption effects of the atmosphere. Accurate knowledge of the exo-atmospheric solar irradiance (E(sub 0)) spectrum at the spectral resolution of the sensor is important for this purpose. The present study investigates the impact of differences in the solar irradiance function, as implemented in a modified version of 5S (M5S), 6S, and MODTRAN2, and as proposed by Green and Gao, on the surface reflectance retrieved from AVIRIS data. Reflectance measured in situ is used as a basis of comparison.

The GRAPE aerosol retrieval algorithm

NASA Astrophysics Data System (ADS)

Thomas, G. E.; Poulsen, C. A.; Sayer, A. M.; Marsh, S. H.; Dean, S. M.; Carboni, E.; Siddans, R.; Grainger, R. G.; Lawrence, B. N.

2009-11-01

The aerosol component of the Oxford-Rutherford Aerosol and Cloud (ORAC) combined cloud and aerosol retrieval scheme is described and the theoretical performance of the algorithm is analysed. ORAC is an optimal estimation retrieval scheme for deriving cloud and aerosol properties from measurements made by imaging satellite radiometers and, when applied to cloud free radiances, provides estimates of aerosol optical depth at a wavelength of 550 nm, aerosol effective radius and surface reflectance at 550 nm. The aerosol retrieval component of ORAC has several incarnations - this paper addresses the version which operates in conjunction with the cloud retrieval component of ORAC (described by Watts et al., 1998), as applied in producing the Global Retrieval of ATSR Cloud Parameters and Evaluation (GRAPE) data-set. The algorithm is described in detail and its performance examined. This includes a discussion of errors resulting from the formulation of the forward model, sensitivity of the retrieval to the measurements and a priori constraints, and errors resulting from assumptions made about the atmospheric/surface state.

The GRAPE aerosol retrieval algorithm

NASA Astrophysics Data System (ADS)

Thomas, G. E.; Poulsen, C. A.; Sayer, A. M.; Marsh, S. H.; Dean, S. M.; Carboni, E.; Siddans, R.; Grainger, R. G.; Lawrence, B. N.

2009-04-01

The aerosol component of the Oxford-Rutherford Aerosol and Cloud (ORAC) combined cloud and aerosol retrieval scheme is described and the theoretical performance of the algorithm is analysed. ORAC is an optimal estimation retrieval scheme for deriving cloud and aerosol properties from measurements made by imaging satellite radiometers and, when applied to cloud free radiances, provides estimates of aerosol optical depth at a wavelength of 550 nm, aerosol effective radius and surface reflectance at 550 nm. The aerosol retrieval component of ORAC has several incarnations - this paper addresses the version which operates in conjunction with the cloud retrieval component of ORAC (described by Watts et al., 1998), as applied in producing the Global Retrieval of ATSR Cloud Parameters and Evaluation (GRAPE) data-set. The algorithm is described in detail and its performance examined. This includes a discussion of errors resulting from the formulation of the forward model, sensitivity of the retrieval to the measurements and a priori constraints, and errors resulting from assumptions made about the atmospheric/surface state.

An Intelligent Pictorial Information System

NASA Astrophysics Data System (ADS)

Lee, Edward T.; Chang, B.

1987-05-01

In examining the history of computer application, we discover that early computer systems were developed primarily for applications related to scientific computation, as in weather prediction, aerospace applications, and nuclear physics applications. At this stage, the computer system served as a big calculator to perform, in the main, manipulation of numbers. Then it was found that computer systems could also be used for business applications, information storage and retrieval, word processing, and report generation. The history of computer application is summarized in Table I. The complexity of pictures makes picture processing much more difficult than number and alphanumerical processing. Therefore, new techniques, new algorithms, and above all, new pictorial knowledge, [1] are needed to overcome the limitatins of existing computer systems. New frontiers in designing computer systems are the ways to handle the representation,[2,3] classification, manipulation, processing, storage, and retrieval of pictures. Especially, the ways to deal with similarity measures and the meaning of the word "approximate" and the phrase "approximate reasoning" are an important and an indispensable part of an intelligent pictorial information system. [4,5] The main objective of this paper is to investigate the mathematical foundation for the effective organization and efficient retrieval of pictures in similarity-directed pictorial databases, [6] based on similarity retrieval techniques [7] and fuzzy languages [8]. The main advantage of this approach is that similar pictures are stored logically close to each other by using quantitative similarity measures. Thus, for answering queries, the amount of picture data needed to be searched can be reduced and the retrieval time can be improved. In addition, in a pictorial database, very often it is desired to find pictures (or feature vectors, histograms, etc.) that are most similar to or most dissimilar [9] to a test picture (or feature vector). Using similarity measures, one can not only store similar pictures logically or physically close to each other in order to improve retrieval or updating efficiency, one can also use such similarity measures to answer fuzzy queries involving nonexact retrieval conditions. In this paper, similarity directed pictorial databases involving geometric figures, chromosome images, [10] leukocyte images, cardiomyopathy images, and satellite images [11] are presented as illustrative examples.

Image acquisition context: procedure description attributes for clinically relevant indexing and selective retrieval of biomedical images.

PubMed

Bidgood, W D; Bray, B; Brown, N; Mori, A R; Spackman, K A; Golichowski, A; Jones, R H; Korman, L; Dove, B; Hildebrand, L; Berg, M

1999-01-01

To support clinically relevant indexing of biomedical images and image-related information based on the attributes of image acquisition procedures and the judgments (observations) expressed by observers in the process of image interpretation. The authors introduce the notion of "image acquisition context," the set of attributes that describe image acquisition procedures, and present a standards-based strategy for utilizing the attributes of image acquisition context as indexing and retrieval keys for digital image libraries. The authors' indexing strategy is based on an interdependent message/terminology architecture that combines the Digital Imaging and Communication in Medicine (DICOM) standard, the SNOMED (Systematized Nomenclature of Human and Veterinary Medicine) vocabulary, and the SNOMED DICOM microglossary. The SNOMED DICOM microglossary provides context-dependent mapping of terminology to DICOM data elements. The capability of embedding standard coded descriptors in DICOM image headers and image-interpretation reports improves the potential for selective retrieval of image-related information. This favorably affects information management in digital libraries.

Searching for Images: The Analysis of Users' Queries for Image Retrieval in American History.

ERIC Educational Resources Information Center

Choi, Youngok; Rasmussen, Edie M.

2003-01-01

Studied users' queries for visual information in American history to identify the image attributes important for retrieval and the characteristics of users' queries for digital images, based on queries from 38 faculty and graduate students. Results of pre- and post-test questionnaires and interviews suggest principle categories of search terms.…

Retrieval of Ice Cloud Properties Using an Optimal Estimation Algorithm and MODIS Infrared Observations: 2. Retrieval Evaluation

NASA Technical Reports Server (NTRS)

Wang, Chenxi; Platnick, Steven; Zhang, Zhibo; Meyer, Kerry; Wind, Galina; Yang, Ping

2016-01-01

An infrared-based optimal estimation (OE-IR) algorithm for retrieving ice cloud properties is evaluated. Specifically, the implementation of the algorithm with MODerate resolution Imaging Spectroradiometer (MODIS) observations is assessed in comparison with the operational retrieval products from MODIS on the Aqua satellite (MYD06), Cloud-Aerosol Lidar with Orthogonal Polarization (CALIOP), and the Imaging Infrared Radiometer (IIR); the latter two instruments fly on the Cloud-Aerosol Lidar and Infrared Pathfinder Satellite Observation (CALIPSO) satellite in the Afternoon Constellation (A-Train) with Aqua. The results show that OE-IR cloud optical thickness (tau) and effective radius (r(sub eff)) retrievals perform best for ice clouds having 0.5 < tau< 7 and r(sub eff) < 50microns. For global ice clouds, the averaged retrieval uncertainties of tau and r(sub eff) are 19% and 33%, respectively. For optically thick ice clouds with tau larger than 10, however, the tau and r(sub eff) retrieval uncertainties can exceed 30% and 50%, respectively. For ice cloud top height (h), the averaged global uncertainty is 0.48km. Relatively large h uncertainty (e.g., > 1km) occurs for tau < 0.5. Analysis of 1month of the OE-IR retrievals shows large tau and r(sub eff) uncertainties in storm track regions and the southern oceans where convective clouds are frequently observed, as well as in high-latitude regions where temperature differences between the surface and cloud top are more ambiguous. Generally, comparisons between the OE-IR and the operational products show consistent tau and h retrievals. However, obvious differences between the OE-IR and the MODIS Collection 6 r(sub eff) are found.

Sensitivity Study of IROE Cloud Retrievals Using VIIRS M-Bands and Combined VIIRS/CrIS IR Observations

NASA Astrophysics Data System (ADS)

Wang, C.; Platnick, S. E.; Meyer, K.; Ackerman, S. A.; Holz, R.; Heidinger, A.

2017-12-01

The Visible Infrared Imaging Radiometer Suite (VIIRS) on board the Suomi-NPP spacecraft is considered as the next generation of instrument providing operational moderate resolution imaging capabilities after the Moderate Resolution Imaging Spectroradiometer (MODIS) on Terra and Aqua. However, cloud-top property (CTP) retrieval algorithms designed for the two instruments cannot be identical because of the absence of CO2 bands on VIIRS. In this study, we conduct a comprehensive sensitivity study of cloud retrievals utilizing a IR-Optimal Estimation (IROE) based algorithm. With a fast IR radiative transfer model, the IROE simultaneously retrieves cloud-top height (CTH), cloud optical thickness (COT), cloud effective radius (CER) and corresponding uncertainties using a set of IR bands. Three retrieval runs are implemented for this sensitivity study: retrievals using 1) three native VIIRS M-Bands at 750m resolution (8.5-, 11-, and 12-μm), 2) three native VIIRS M-Bands with spectrally integrated CO2 bands from the Cross-Track Infrared Sounder (CrIS), and 3) six MODIS IR bands (8.5-, 11-, 12-, 13.3-, 13.6-, and 13.9-μm). We select a few collocated MODIS and VIIRS granules for pixel-level comparison. Furthermore, aggregated daily and monthly cloud properties from the three runs are also compared. It shows that, the combined VIIRS/CrIS run agrees well with the MODIS-only run except for pixels near cloud edges. The VIIRS-only run is close to its counterparts when clouds are optically thick. However, for optically thin clouds, the VIIRS-only run can be readily influenced by the initial guess. Large discrepancies and uncertainties can be found for optically thin clouds from the VIIRS-only run.

Image selection system. [computerized data storage and retrieval system

NASA Technical Reports Server (NTRS)

Knutson, M. A.; Hurd, D.; Hubble, L.; Kroeck, R. M.

1974-01-01

An image selection (ISS) was developed for the NASA-Ames Research Center Earth Resources Aircraft Project. The ISS is an interactive, graphics oriented, computer retrieval system for aerial imagery. An analysis of user coverage requests and retrieval strategies is presented, followed by a complete system description. Data base structure, retrieval processors, command language, interactive display options, file structures, and the system's capability to manage sets of selected imagery are described. A detailed example of an area coverage request is graphically presented.

Histologic Analysis of Retrieved Clots in Acute Ischemic Stroke: Correlation with Stroke Etiology and Gradient-Echo MRI.

PubMed

Kim, S K; Yoon, W; Kim, T S; Kim, H S; Heo, T W; Park, M S

2015-09-01

It is unclear whether clot composition analysis is helpful to predict a stroke mechanism in acute large vessel occlusion. In addition, the relationship between early vessel signs on imaging studies and clot compositions has been poorly understood. The purpose of this study was to elucidate the relationship between clot composition and stroke etiology following mechanical thrombectomy and to investigate the effect of varied clot compositions on gradient-echo MR imaging of clots. Histopathologic analysis of retrieved clots from 37 patients with acute MCA occlusion was performed. Patients underwent gradient-echo imaging before endovascular therapy. Retrieved clots underwent semiquantitative proportion analysis to quantify red blood cells, fibrin, platelets, and white blood cells by area. Correlations between clot compositions and stroke subtypes and susceptibility vessel signs on gradient-echo imaging were assessed. Stroke etiology was classified as cardioembolism in 22 patients (59.4%), large-artery atherosclerosis in 8 (21.6%), and undetermined in 7 (18.9%). The clots from cardioembolism had a significantly higher proportion of red blood cells (37.8% versus 16.9%, P = .031) and a lower proportion of fibrin (32.3% versus 48.5%, P = .044) compared with those from large-artery atherosclerosis. The proportion of red blood cells was significantly higher in clots with a susceptibility vessel sign than in those without it (48.0% versus 1.9%, P < .001), whereas the proportions of fibrin (26.4% versus 57.0%, P < .001) and platelets (22.6% versus 36.9%, P = .011) were significantly higher in clots without a susceptibility vessel sign than those with it. The histologic composition of clots retrieved from cerebral arteries in patients with acute stroke differs between those with cardioembolism and large-artery atherosclerosis. In addition, a susceptibility vessel sign on gradient-echo imaging is strongly associated with a high proportion of red blood cells and a low proportion of fibrin and platelets in retrieved clots. © 2015 by American Journal of Neuroradiology.

Functional evaluation of telemedicine with super high definition images and B-ISDN.

PubMed

Takeda, H; Matsumura, Y; Okada, T; Kuwata, S; Komori, M; Takahashi, T; Minatom, K; Hashimoto, T; Wada, M; Fujio, Y

1998-01-01

In order to determine whether a super high definition (SHD) image running at a series of 2048 resolution x 2048 line x 60 frame/sec was capable of telemedicine, we established a filing system for medical images and two experiments for transmission of high quality images were performed. All images of various types, produced from one case of ischemic heart disease were digitized and registered into the filing system. Images consisted of plain chest x-ray, electrocardiogram, ultrasound cardiogram, cardiac scintigram, coronary angiogram, left ventriculogram and so on. All images were animated and totaled a number of 243. We prepared a graphic user interface (GUI) for image retrieval based on the medical events and modalities. Twenty one cardiac specialists evaluated quality of the SHD images to be somewhat poor compared to the original pictures but sufficient for making diagnoses, and effective as a tool for teaching and case study purposes. The system capability of simultaneously displaying several animated images was especially deemed effective in grasping comprehension of diagnosis. Efficient input methods and creating capacity of filing all produced images are future issue. Using B-ISDN network, the SHD file was prefetched to the servers at Kyoto University Hospital and BBCC (Bradband ISDN Business chance & Culture Creation) laboratory as an telemedicine experiment. Simultaneous video conference system, the control of image retrieval and pointing function made the teleconference successful in terms of high quality of medical images, quick response time and interactive data exchange.

Neural Response After a Single ECT Session During Retrieval of Emotional Self-Referent Words in Depression: A Randomized, Sham-Controlled fMRI Study.

PubMed

Miskowiak, Kamilla W; Macoveanu, Julian; Jørgensen, Martin B; Støttrup, Mette M; Ott, Caroline V; Jensen, Hans M; Jørgensen, Anders; Harmer, J; Paulson, Olaf B; Kessing, Lars V; Siebner, Hartwig R

2018-03-01

Negative neurocognitive bias is a core feature of depression that is reversed by antidepressant drug treatment. However, it is unclear whether modulation of neurocognitive bias is a common mechanism of distinct biological treatments. This randomized controlled functional magnetic resonance imaging study explored the effects of a single electroconvulsive therapy session on self-referent emotional processing. Twenty-nine patients with treatment-resistant major depressive disorder were randomized to one active or sham electroconvulsive therapy session at the beginning of their electroconvulsive therapy course in a double-blind, between-groups design. The following day, patients were given a self-referential emotional word categorization test and a free recall test. This was followed by an incidental word recognition task during whole-brain functional magnetic resonance imaging at 3T. Mood was assessed at baseline, on the functional magnetic resonance imaging day, and after 6 electroconvulsive therapy sessions. Data were complete and analyzed for 25 patients (electroconvulsive therapy: n = 14, sham: n = 11). The functional magnetic resonance imaging data were analyzed using the FMRIB Software Library randomize algorithm, and the Threshold-Free Cluster Enhancement method was used to identify significant clusters (corrected at P < .05). A single electroconvulsive therapy session had no effect on hippocampal activity during retrieval of emotional words. However, electroconvulsive therapy reduced the retrieval-specific neural response for positive words in the left frontopolar cortex. This effect occurred in the absence of differences between groups in behavioral performance or mood symptoms. The observed effect of electroconvulsive therapy on prefrontal response may reflect early facilitation of memory for positive self-referent information, which could contribute to improvements in depressive symptoms including feelings of self-worth with repeated treatments.

Quantifying Uncertainties in Land-Surface Microwave Emissivity Retrievals

NASA Technical Reports Server (NTRS)

Tian, Yudong; Peters-Lidard, Christa D.; Harrison, Kenneth W.; Prigent, Catherine; Norouzi, Hamidreza; Aires, Filipe; Boukabara, Sid-Ahmed; Furuzawa, Fumie A.; Masunaga, Hirohiko

2013-01-01

Uncertainties in the retrievals of microwaveland-surface emissivities are quantified over two types of land surfaces: desert and tropical rainforest. Retrievals from satellite-based microwave imagers, including the Special Sensor Microwave Imager, the Tropical Rainfall Measuring Mission Microwave Imager, and the Advanced Microwave Scanning Radiometer for Earth Observing System, are studied. Our results show that there are considerable differences between the retrievals from different sensors and from different groups over these two land-surface types. In addition, the mean emissivity values show different spectral behavior across the frequencies. With the true emissivity assumed largely constant over both of the two sites throughout the study period, the differences are largely attributed to the systematic and random errors inthe retrievals. Generally, these retrievals tend to agree better at lower frequencies than at higher ones, with systematic differences ranging 1%-4% (3-12 K) over desert and 1%-7% (3-20 K) over rainforest. The random errors within each retrieval dataset are in the range of 0.5%-2% (2-6 K). In particular, at 85.5/89.0 GHz, there are very large differences between the different retrieval datasets, and within each retrieval dataset itself. Further investigation reveals that these differences are most likely caused by rain/cloud contamination, which can lead to random errors up to 10-17 K under the most severe conditions.

Image retrieval for identifying house plants

NASA Astrophysics Data System (ADS)

Kebapci, Hanife; Yanikoglu, Berrin; Unal, Gozde

2010-02-01

We present a content-based image retrieval system for plant identification which is intended for providing users with a simple method to locate information about their house plants. A plant image consists of a collection of overlapping leaves and possibly flowers, which makes the problem challenging. We studied the suitability of various well-known color, texture and shape features for this problem, as well as introducing some new ones. The features are extracted from the general plant region that is segmented from the background using the max-flow min-cut technique. Results on a database of 132 different plant images show promise (in about 72% of the queries, the correct plant image is retrieved among the top-15 results).

Evaluation of contents-based image retrieval methods for a database of logos on drug tablets

NASA Astrophysics Data System (ADS)

Geradts, Zeno J.; Hardy, Huub; Poortman, Anneke; Bijhold, Jurrien

2001-02-01

In this research an evaluation has been made of the different ways of contents based image retrieval of logos of drug tablets. On a database of 432 illicitly produced tablets (mostly containing MDMA), we have compared different retrieval methods. Two of these methods were available from commercial packages, QBIC and Imatch, where the implementation of the contents based image retrieval methods are not exactly known. We compared the results for this database with the MPEG-7 shape comparison methods, which are the contour-shape, bounding box and region-based shape methods. In addition, we have tested the log polar method that is available from our own research.

Location-Driven Image Retrieval for Images Collected by a Mobile Robot

NASA Astrophysics Data System (ADS)

Tanaka, Kanji; Hirayama, Mitsuru; Okada, Nobuhiro; Kondo, Eiji

Mobile robot teleoperation is a method for a human user to interact with a mobile robot over time and distance. Successful teleoperation depends on how well images taken by the mobile robot are visualized to the user. To enhance the efficiency and flexibility of the visualization, an image retrieval system on such a robot’s image database would be very useful. The main difference of the robot’s image database from standard image databases is that various relevant images exist due to variety of viewing conditions. The main contribution of this paper is to propose an efficient retrieval approach, named location-driven approach, utilizing correlation between visual features and real world locations of images. Combining the location-driven approach with the conventional feature-driven approach, our goal can be viewed as finding an optimal classifier between relevant and irrelevant feature-location pairs. An active learning technique based on support vector machine is extended for this aim.

Multi-clues image retrieval based on improved color invariants

NASA Astrophysics Data System (ADS)

Liu, Liu; Li, Jian-Xun

2012-05-01

At present, image retrieval has a great progress in indexing efficiency and memory usage, which mainly benefits from the utilization of the text retrieval technology, such as the bag-of-features (BOF) model and the inverted-file structure. Meanwhile, because the robust local feature invariants are selected to establish BOF, the retrieval precision of BOF is enhanced, especially when it is applied to a large-scale database. However, these local feature invariants mainly consider the geometric variance of the objects in the images, and thus the color information of the objects fails to be made use of. Because of the development of the information technology and Internet, the majority of our retrieval objects is color images. Therefore, retrieval performance can be further improved through proper utilization of the color information. We propose an improved method through analyzing the flaw of shadow-shading quasi-invariant. The response and performance of shadow-shading quasi-invariant for the object edge with the variance of lighting are enhanced. The color descriptors of the invariant regions are extracted and integrated into BOF based on the local feature. The robustness of the algorithm and the improvement of the performance are verified in the final experiments.

Hypertext Image Retrieval: The Evolution of an Application.

ERIC Educational Resources Information Center

Roberts, G. Louis; Kenney, Carol E.

1991-01-01

Describes the development and implementation of a full-text image retrieval system at the Boeing Commercial Airplane Group. The conversion of card formats to a microcomputer-based system using HyperCard is described; the online system architecture is explained; and future plans are discussed, including conversion to digital images. (LRW)

Millimeter-wave Imaging Radiometer (MIR) data processing and development of water vapor retrieval algorithms

NASA Technical Reports Server (NTRS)

Chang, L. Aron

1995-01-01

This document describes the progress of the task of the Millimeter-wave Imaging Radiometer (MIR) data processing and the development of water vapor retrieval algorithms, for the second six-month performing period. Aircraft MIR data from two 1995 field experiments were collected and processed with a revised data processing software. Two revised versions of water vapor retrieval algorithm were developed, one for the execution of retrieval on a supercomputer platform, and one for using pressure as the vertical coordinate. Two implementations of incorporating products from other sensors into the water vapor retrieval system, one from the Special Sensor Microwave Imager (SSM/I), the other from the High-resolution Interferometer Sounder (HIS). Water vapor retrievals were performed for both airborne MIR data and spaceborne SSM/T-2 data, during field experiments of TOGA/COARE, CAMEX-1, and CAMEX-2. The climatology of water vapor during TOGA/COARE was examined by SSM/T-2 soundings and conventional rawinsonde.

Examining the Impact of Overlying Aerosols on the Retrieval of Cloud Optical Properties from Passive Remote Sensing

NASA Technical Reports Server (NTRS)

Coddington, O. M.; Pilewskie, P.; Redemann, J.; Platnick, S.; Russell, P. B.; Schmidt, K. S.; Gore, W. J.; Livingston, J.; Wind, G.; Vukicevic, T.

2010-01-01

Haywood et al. (2004) show that an aerosol layer above a cloud can cause a bias in the retrieved cloud optical thickness and effective radius. Monitoring for this potential bias is difficult because space ]based passive remote sensing cannot unambiguously detect or characterize aerosol above cloud. We show that cloud retrievals from aircraft measurements above cloud and below an overlying aerosol layer are a means to test this bias. The data were collected during the Intercontinental Chemical Transport Experiment (INTEX-A) study based out of Portsmouth, New Hampshire, United States, above extensive, marine stratus cloud banks affected by industrial outflow. Solar Spectral Flux Radiometer (SSFR) irradiance measurements taken along a lower level flight leg above cloud and below aerosol were unaffected by the overlying aerosol. Along upper level flight legs, the irradiance reflected from cloud top was transmitted through an aerosol layer. We compare SSFR cloud retrievals from below ]aerosol legs to satellite retrievals from the Moderate Resolution Imaging Spectroradiometer (MODIS) in order to detect an aerosol ]induced bias. In regions of small variation in cloud properties, we find that SSFR and MODIS-retrieved cloud optical thickness compares within the uncertainty range for each instrument while SSFR effective radius tend to be smaller than MODIS values (by 1-2 microns) and at the low end of MODIS uncertainty estimates. In regions of large variation in cloud properties, differences in SSFR and MODIS ]retrieved cloud optical thickness and effective radius can reach values of 10 and 10 microns, respectively. We include aerosols in forward modeling to test the sensitivity of SSFR cloud retrievals to overlying aerosol layers. We find an overlying absorbing aerosol layer biases SSFR cloud retrievals to smaller effective radii and optical thickness while nonabsorbing aerosols had no impact.

Intelligent distributed medical image management

NASA Astrophysics Data System (ADS)

Garcia, Hong-Mei C.; Yun, David Y.

1995-05-01

The rapid advancements in high performance global communication have accelerated cooperative image-based medical services to a new frontier. Traditional image-based medical services such as radiology and diagnostic consultation can now fully utilize multimedia technologies in order to provide novel services, including remote cooperative medical triage, distributed virtual simulation of operations, as well as cross-country collaborative medical research and training. Fast (efficient) and easy (flexible) retrieval of relevant images remains a critical requirement for the provision of remote medical services. This paper describes the database system requirements, identifies technological building blocks for meeting the requirements, and presents a system architecture for our target image database system, MISSION-DBS, which has been designed to fulfill the goals of Project MISSION (medical imaging support via satellite integrated optical network) -- an experimental high performance gigabit satellite communication network with access to remote supercomputing power, medical image databases, and 3D visualization capabilities in addition to medical expertise anywhere and anytime around the country. The MISSION-DBS design employs a synergistic fusion of techniques in distributed databases (DDB) and artificial intelligence (AI) for storing, migrating, accessing, and exploring images. The efficient storage and retrieval of voluminous image information is achieved by integrating DDB modeling and AI techniques for image processing while the flexible retrieval mechanisms are accomplished by combining attribute- based and content-based retrievals.

Dictionary Pruning with Visual Word Significance for Medical Image Retrieval

PubMed Central

Zhang, Fan; Song, Yang; Cai, Weidong; Hauptmann, Alexander G.; Liu, Sidong; Pujol, Sonia; Kikinis, Ron; Fulham, Michael J; Feng, David Dagan; Chen, Mei

2016-01-01

Content-based medical image retrieval (CBMIR) is an active research area for disease diagnosis and treatment but it can be problematic given the small visual variations between anatomical structures. We propose a retrieval method based on a bag-of-visual-words (BoVW) to identify discriminative characteristics between different medical images with Pruned Dictionary based on Latent Semantic Topic description. We refer to this as the PD-LST retrieval. Our method has two main components. First, we calculate a topic-word significance value for each visual word given a certain latent topic to evaluate how the word is connected to this latent topic. The latent topics are learnt, based on the relationship between the images and words, and are employed to bridge the gap between low-level visual features and high-level semantics. These latent topics describe the images and words semantically and can thus facilitate more meaningful comparisons between the words. Second, we compute an overall-word significance value to evaluate the significance of a visual word within the entire dictionary. We designed an iterative ranking method to measure overall-word significance by considering the relationship between all latent topics and words. The words with higher values are considered meaningful with more significant discriminative power in differentiating medical images. We evaluated our method on two public medical imaging datasets and it showed improved retrieval accuracy and efficiency. PMID:27688597

Dictionary Pruning with Visual Word Significance for Medical Image Retrieval.

PubMed

Zhang, Fan; Song, Yang; Cai, Weidong; Hauptmann, Alexander G; Liu, Sidong; Pujol, Sonia; Kikinis, Ron; Fulham, Michael J; Feng, David Dagan; Chen, Mei

2016-02-12

Content-based medical image retrieval (CBMIR) is an active research area for disease diagnosis and treatment but it can be problematic given the small visual variations between anatomical structures. We propose a retrieval method based on a bag-of-visual-words (BoVW) to identify discriminative characteristics between different medical images with Pruned Dictionary based on Latent Semantic Topic description. We refer to this as the PD-LST retrieval. Our method has two main components. First, we calculate a topic-word significance value for each visual word given a certain latent topic to evaluate how the word is connected to this latent topic. The latent topics are learnt, based on the relationship between the images and words, and are employed to bridge the gap between low-level visual features and high-level semantics. These latent topics describe the images and words semantically and can thus facilitate more meaningful comparisons between the words. Second, we compute an overall-word significance value to evaluate the significance of a visual word within the entire dictionary. We designed an iterative ranking method to measure overall-word significance by considering the relationship between all latent topics and words. The words with higher values are considered meaningful with more significant discriminative power in differentiating medical images. We evaluated our method on two public medical imaging datasets and it showed improved retrieval accuracy and efficiency.

Optimisation of sea surface current retrieval using a maximum cross correlation technique on modelled sea surface temperature

NASA Astrophysics Data System (ADS)

Heuzé, Céline; Eriksson, Leif; Carvajal, Gisela

2017-04-01

Using sea surface temperature from satellite images to retrieve sea surface currents is not a new idea, but so far its operational near-real time implementation has not been possible. Validation studies are too region-specific or uncertain, due to the errors induced by the images themselves. Moreover, the sensitivity of the most common retrieval method, the maximum cross correlation, to the three parameters that have to be set is unknown. Using model outputs instead of satellite images, biases induced by this method are assessed here, for four different seas of Western Europe, and the best of nine settings and eight temporal resolutions are determined. For all regions, tracking a small 5 km pattern from the first image over a large 30 km region around its original location on a second image, separated from the first image by 6 to 9 hours returned the most accurate results. Moreover, for all regions, the problem is not inaccurate results but missing results, where the velocity is too low to be picked by the retrieval. The results are consistent both with limitations caused by ocean surface current dynamics and with the available satellite technology, indicating that automated sea surface current retrieval from sea surface temperature images is feasible now, for search and rescue operations, pollution confinement or even for more energy efficient and comfortable ship navigation.

Quantitative x-ray phase-contrast imaging using a single grating of comparable pitch to sample feature size.

PubMed

Morgan, Kaye S; Paganin, David M; Siu, Karen K W

2011-01-01

The ability to quantitatively retrieve transverse phase maps during imaging by using coherent x rays often requires a precise grating or analyzer-crystal-based setup. Imaging of live animals presents further challenges when these methods require multiple exposures for image reconstruction. We present a simple method of single-exposure, single-grating quantitative phase contrast for a regime in which the grating period is much greater than the effective pixel size. A grating is used to create a high-visibility reference pattern incident on the sample, which is distorted according to the complex refractive index and thickness of the sample. The resolution, along a line parallel to the grating, is not restricted by the grating spacing, and the detector resolution becomes the primary determinant of the spatial resolution. We present a method of analysis that maps the displacement of interrogation windows in order to retrieve a quantitative phase map. Application of this analysis to the imaging of known phantoms shows excellent correspondence.

Oblivious image watermarking combined with JPEG compression

NASA Astrophysics Data System (ADS)

Chen, Qing; Maitre, Henri; Pesquet-Popescu, Beatrice

2003-06-01

For most data hiding applications, the main source of concern is the effect of lossy compression on hidden information. The objective of watermarking is fundamentally in conflict with lossy compression. The latter attempts to remove all irrelevant and redundant information from a signal, while the former uses the irrelevant information to mask the presence of hidden data. Compression on a watermarked image can significantly affect the retrieval of the watermark. Past investigations of this problem have heavily relied on simulation. It is desirable not only to measure the effect of compression on embedded watermark, but also to control the embedding process to survive lossy compression. In this paper, we focus on oblivious watermarking by assuming that the watermarked image inevitably undergoes JPEG compression prior to watermark extraction. We propose an image-adaptive watermarking scheme where the watermarking algorithm and the JPEG compression standard are jointly considered. Watermark embedding takes into consideration the JPEG compression quality factor and exploits an HVS model to adaptively attain a proper trade-off among transparency, hiding data rate, and robustness to JPEG compression. The scheme estimates the image-dependent payload under JPEG compression to achieve the watermarking bit allocation in a determinate way, while maintaining consistent watermark retrieval performance.

Retrieval Demands Adaptively Change Striatal Old/New Signals and Boost Subsequent Long-Term Memory.

PubMed

Herweg, Nora A; Sommer, Tobias; Bunzeck, Nico

2018-01-17

The striatum is a central part of the dopaminergic mesolimbic system and contributes both to the encoding and retrieval of long-term memories. In this regard, the co-occurrence of striatal novelty and retrieval success effects in independent studies underlines the structure's double duty and suggests dynamic contextual adaptation. To test this hypothesis and further investigate the underlying mechanisms of encoding and retrieval dynamics, human subjects viewed pre-familiarized scene images intermixed with new scenes and classified them as indoor versus outdoor (encoding task) or old versus new (retrieval task), while fMRI and eye tracking data were recorded. Subsequently, subjects performed a final recognition task. As hypothesized, striatal activity and pupil size reflected task-conditional salience of old and new stimuli, but, unexpectedly, this effect was not reflected in the substantia nigra and ventral tegmental area (SN/VTA), medial temporal lobe, or subsequent memory performance. Instead, subsequent memory generally benefitted from retrieval, an effect possibly driven by task difficulty and activity in a network including different parts of the striatum and SN/VTA. Our findings extend memory models of encoding and retrieval dynamics by pinpointing a specific contextual factor that differentially modulates the functional properties of the mesolimbic system. SIGNIFICANCE STATEMENT The mesolimbic system is involved in the encoding and retrieval of information but it is unclear how these two processes are achieved within the same network of brain regions. In particular, memory retrieval and novelty encoding were considered in independent studies, implying that novelty (new > old) and retrieval success (old > new) effects may co-occur in the striatum. Here, we used a common framework implicating the striatum, but not other parts of the mesolimbic system, in tracking context-dependent salience of old and new information. The current study, therefore, paves the way for a more comprehensive understanding of the functional properties of the mesolimbic system during memory encoding and retrieval. Copyright © 2018 the authors 0270-6474/18/380745-10$15.00/0.

Ketamine Disrupts Frontal and Hippocampal Contribution to Encoding and Retrieval of Episodic Memory: An fMRI Study

PubMed Central

Honey, G.D.; Honey, R.A.E.; O’Loughlin, C.; Sharar, S.R.; Kumaran, D.; Suckling, J.; Menon, D.K.; Sleator, C.; Bullmore, E.T.; Fletcher, P.C.

2012-01-01

The N-methyl-d-aspartate (NMDA) receptor antagonist ketamine produces episodic memory deficits. We used functional magnetic resonance imaging to characterize the effects of ketamine on frontal and hippocampal responses to memory encoding and retrieval in healthy volunteers using a double-blind, placebo-controlled, randomized, within-subjects comparison of two doses of intravenous ketamine. Dissociation of the effects of ketamine on encoding and retrieval processes was achieved using two study-test cycles: in the first, items were encoded prior to drug infusion and retrieval tested, during scanning, on drug; in the second, encoding was scanned on drug, and retrieval tested once ketamine plasma levels had declined. We additionally determined the interaction of ketamine with the depth of processing that occurred at encoding. A number of effects upon task-dependent activations were seen. Overall, our results suggest that left frontal activation is augmented by ketamine when elaborative semantic processing is required at encoding. In addition, successful encoding on ketamine is supplemented by additional non-verbal processing that is incidental to task demands. The effects of ketamine at retrieval are consistent with impaired access to accompanying contextual features of studied items. Our findings show that, even when overt behaviour is unimpaired, ketamine has an impact upon the recruitment of key regions in episodic memory task performance. PMID:15537676

Surface retrievals from Hyperion EO1 using a new, fast, 1D-Var based retrieval code

NASA Astrophysics Data System (ADS)

Thelen, Jean-Claude; Havemann, Stephan; Wong, Gerald

2015-05-01

We have developed a new algorithm for the simultaneous retrieval of the atmospheric profiles (temperature, humidity, ozone and aerosol) and the surface reflectance from hyperspectral radiance measurements obtained from air/space-borne, hyperspectral imagers such as Hyperion EO-1. The new scheme, proposed here, consists of a fast radiative transfer code, based on empirical orthogonal functions (EOFs), in conjunction with a 1D-Var retrieval scheme. The inclusion of an 'exact' scattering code based on spherical harmonics, allows for an accurate treatment of Rayleigh scattering and scattering by aerosols, water droplets and ice-crystals, thus making it possible to also retrieve cloud and aerosol optical properties, although here we will concentrate on non-cloudy scenes. We successfully tested this new approach using hyperspectral images taken by Hyperion EO-1, an experimental pushbroom imaging spectrometer operated by NASA.

MARs Color Imager (MARCI) Daily Global Ozone Column Mapping from the Mars Reconnaissance Orbiter (MRO): A Survey of 2006-2010 Results

NASA Astrophysics Data System (ADS)

Clancy, R. T.; Wolff, M. J.; Malin, M. C.; Cantor, B. A.

2010-12-01

MARCI UV band imaging photometry within (260nm) and outside (320nm) the Hartley ozone band absorption supports daily global mapping of Mars ozone column abundances. Key retrieval issues include accurate UV radiometric calibrations, detailed specifications of surface and atmospheric background reflectance (surface albedo, atmospheric Raleigh and dust scattering/absorption), and simultaneous cloud retrievals. The implementation of accurate radiative transfer (RT) treatments of these processes has been accomplished (Wolff et al., 2010) such that daily global mapping retrievals for Mars ozone columns have been completed for the 2006-2010 period of MARCI global imaging. Ozone retrievals are most accurate for high column abundances associated with mid-to-high latitude regions during fall, winter, and spring seasons. We present a survey of these MARCI ozone column retrievals versus season, latitude, longitude, and year.

A selective deficit in imageable concepts: a window to the organization of the conceptual system

PubMed Central

Gvion, Aviah; Friedmann, Naama

2013-01-01

Nissim, a 64 years old Hebrew-speaking man who sustained an ischemic infarct in the left occipital lobe, exhibited an intriguing pattern. He could hold a deep and fluent conversation about abstract and complex issues, such as the social risks in unemployment, but failed to retrieve imageable words such as ball, spoon, carrot, or giraffe. A detailed study of the words he could and could not retrieve, in tasks of picture naming, tactile naming, and naming to definition, indicated that whereas he was able to retrieve abstract words, he had severe difficulties when trying to retrieve imageable words. The same dissociation also applied for proper names—he could retrieve names of people who have no visual image attached to their representation (such as the son of the biblical Abraham), but could not name people who had a visual image (such as his own son, or Barack Obama). When he tried to produce imageable words, he mainly produced perseverations and empty speech, and some semantic paraphasias. He did not produce perseverations when he tried to retrieve abstract words. This suggests that perseverations may occur when the phonological production system produces a word without proper activation in the semantic lexicon. Nissim evinced a similar dissociation in comprehension—he could understand abstract words and sentences but failed to understand sentences with imageable words, and to match spoken imageable words to pictures or to semantically related imageable words. He was able to understand proverbs with imageable literal meaning but abstract figurative meaning. His comprehension was impaired also in tasks of semantic associations of pictures, pointing to a conceptual, rather than lexical source of the deficit. His visual perception as well as his phonological input and output lexicons and buffers (assessed by auditory lexical decision, word and sentence repetition, and writing to dictation) were intact, supporting a selective conceptual system impairment. He was able to retrieve gestures for objects and pictures he saw, indicating that his access to concepts often sufficed for the activation of the motoric information but did not suffice for access to the entry in the semantic lexicon. These results show that imageable concepts can be selectively impaired, and shed light on the organization of conceptual-semantic system. PMID:23785321

A selective deficit in imageable concepts: a window to the organization of the conceptual system.

PubMed

Gvion, Aviah; Friedmann, Naama

2013-01-01

Nissim, a 64 years old Hebrew-speaking man who sustained an ischemic infarct in the left occipital lobe, exhibited an intriguing pattern. He could hold a deep and fluent conversation about abstract and complex issues, such as the social risks in unemployment, but failed to retrieve imageable words such as ball, spoon, carrot, or giraffe. A detailed study of the words he could and could not retrieve, in tasks of picture naming, tactile naming, and naming to definition, indicated that whereas he was able to retrieve abstract words, he had severe difficulties when trying to retrieve imageable words. The same dissociation also applied for proper names-he could retrieve names of people who have no visual image attached to their representation (such as the son of the biblical Abraham), but could not name people who had a visual image (such as his own son, or Barack Obama). When he tried to produce imageable words, he mainly produced perseverations and empty speech, and some semantic paraphasias. He did not produce perseverations when he tried to retrieve abstract words. This suggests that perseverations may occur when the phonological production system produces a word without proper activation in the semantic lexicon. Nissim evinced a similar dissociation in comprehension-he could understand abstract words and sentences but failed to understand sentences with imageable words, and to match spoken imageable words to pictures or to semantically related imageable words. He was able to understand proverbs with imageable literal meaning but abstract figurative meaning. His comprehension was impaired also in tasks of semantic associations of pictures, pointing to a conceptual, rather than lexical source of the deficit. His visual perception as well as his phonological input and output lexicons and buffers (assessed by auditory lexical decision, word and sentence repetition, and writing to dictation) were intact, supporting a selective conceptual system impairment. He was able to retrieve gestures for objects and pictures he saw, indicating that his access to concepts often sufficed for the activation of the motoric information but did not suffice for access to the entry in the semantic lexicon. These results show that imageable concepts can be selectively impaired, and shed light on the organization of conceptual-semantic system.

Knowledge supports memory retrieval through familiarity, not recollection.

PubMed

Wang, Wei-Chun; Brashier, Nadia M; Wing, Erik A; Marsh, Elizabeth J; Cabeza, Roberto

2018-05-01

Semantic memory, or general knowledge of the world, guides learning and supports the formation and retrieval of new episodic memories. Behavioral evidence suggests that this knowledge effect is supported by recollection-a more controlled form of memory retrieval generally accompanied by contextual details-to a greater degree than familiarity-a more automatic form of memory retrieval generally absent of contextual details. In the current study, we used functional magnetic resonance imaging (fMRI) to investigate the role that regions associated with recollection and familiarity play in retrieving recent instances of known (e.g., The Summer Olympic Games are held four years apart) and unknown (e.g., A flaky deposit found in port bottles is beeswing) statements. Our results revealed a surprising pattern: Episodic retrieval of known statements recruited regions associated with familiarity, but not recollection. Instead, retrieval of unknown statements recruited regions associated with recollection. These data, in combination with quicker reaction times for the retrieval of known than unknown statements, suggest that known statements can be successfully retrieved on the basis of familiarity, whereas unknown statements were retrieved on the basis of recollection. Our results provide insight into how knowledge influences episodic retrieval and demonstrate the role of neuroimaging in providing insights into cognitive processes in the absence of explicit behavioral responses. Copyright © 2018 Elsevier Ltd. All rights reserved.

Measuring Gap Fraction, Element Clumping Index and LAI in Sierra Forest Stands Using a Full-Waveform Ground-Based Lidar

NASA Technical Reports Server (NTRS)

Zhao, Feng; Strahler, Alan H.; Crystal L. Schaaf; Yao, Tian; Yang, Xiaoyuan; Wang, Zhuosen; Schull, Mitchell A.; Roman, Miguel O.; Woodcock, Curtis E.; Olofsson, Pontus;

Experiments on sparsity assisted phase retrieval of phase objects

NASA Astrophysics Data System (ADS)

Gaur, Charu; Lochab, Priyanka; Khare, Kedar

2017-05-01

Iterative phase retrieval algorithms such as the Gerchberg-Saxton method and the Fienup hybrid input-output method are known to suffer from the twin image stagnation problem, particularly when the solution to be recovered is complex valued and has centrosymmetric support. Recently we showed that the twin image stagnation problem can be addressed using image sparsity ideas (Gaur et al 2015 J. Opt. Soc. Am. A 32 1922). In this work we test this sparsity assisted phase retrieval method with experimental single shot Fourier transform intensity data frames corresponding to phase objects displayed on a spatial light modulator. The standard iterative phase retrieval algorithms are combined with an image sparsity based penalty in an adaptive manner. Illustrations for both binary and continuous phase objects are provided. It is observed that image sparsity constraint has an important role to play in obtaining meaningful phase recovery without encountering the well-known stagnation problems. The results are valuable for enabling single shot coherent diffraction imaging of phase objects for applications involving illumination wavelengths over a wide range of electromagnetic spectrum.

Facilitating medical information search using Google Glass connected to a content-based medical image retrieval system.

PubMed

Widmer, Antoine; Schaer, Roger; Markonis, Dimitrios; Muller, Henning

2014-01-01

Wearable computing devices are starting to change the way users interact with computers and the Internet. Among them, Google Glass includes a small screen located in front of the right eye, a camera filming in front of the user and a small computing unit. Google Glass has the advantage to provide online services while allowing the user to perform tasks with his/her hands. These augmented glasses uncover many useful applications, also in the medical domain. For example, Google Glass can easily provide video conference between medical doctors to discuss a live case. Using these glasses can also facilitate medical information search by allowing the access of a large amount of annotated medical cases during a consultation in a non-disruptive fashion for medical staff. In this paper, we developed a Google Glass application able to take a photo and send it to a medical image retrieval system along with keywords in order to retrieve similar cases. As a preliminary assessment of the usability of the application, we tested the application under three conditions (images of the skin; printed CT scans and MRI images; and CT and MRI images acquired directly from an LCD screen) to explore whether using Google Glass affects the accuracy of the results returned by the medical image retrieval system. The preliminary results show that despite minor problems due to the relative stability of the Google Glass, images can be sent to and processed by the medical image retrieval system and similar images are returned to the user, potentially helping in the decision making process.

Is the bang worth the buck? A RAID performance study

NASA Technical Reports Server (NTRS)

Hauser, Susan E.; Berman, Lewis E.; Thoma, George R.

1996-01-01

Expecting a high data delivery rate as well as data protection, the Lister Hill National Center for Biomedical Communications procured a RAID system to house image files for image delivery applications. A study was undertaken to determine the configuration of the RAID system that would provide for the fastest retrieval of image files. Average retrieval times with single and with concurrent users were measured for several stripe widths and several numbers of disks for RAID levels 0, 0+1 and 5. These are compared to each other and to average retrieval times for non-RAID configurations of the same hardware. Although the study in ongoing, a few conclusions have emerged regarding the tradeoffs among the different configurations with respect to file retrieval speed and cost.

Greater Working Memory Load Results in Greater Medial Temporal Activity at Retrieval

PubMed Central

Quiroz, Yakeel T.; Hasselmo, Michael E.; Stern, Chantal E.

2009-01-01

Most functional magnetic resonance imaging (fMRI) studies examining working memory (WM) load have focused on the prefrontal cortex (PFC) and have demonstrated increased prefrontal activity with increased load. Here we examined WM load effects in the medial temporal lobe (MTL) using an fMRI Sternberg task with novel complex visual scenes. Trials consisted of 3 sequential events: 1) sample presentation (encoding), 2) delay period (maintenance), and 3) probe period (retrieval). During sample encoding, subjects saw either 2 or 4 pictures consecutively. During retrieval, subjects indicated whether the probe picture matched one of the sample pictures. Results revealed that activity in the left anterior hippocampal formation, bilateral retrosplenial area, and left amygdala was greater at retrieval for trials with larger memory load, whereas activity in the PFC was greater at encoding for trials with larger memory load. There was no load effect during the delay. When encoding, maintenance, and retrieval periods were compared with fixation, activity was present in the hippocampal body/tail and fusiform gyrus bilaterally during encoding and retrieval, but not maintenance. Bilateral dorsolateral prefrontal activity was present during maintenance, but not during encoding or retrieval. The results support models of WM predicting that activity in the MTL should be modulated by WM load. PMID:19224975

New approaches to removing cloud shadows and evaluating the 380 nm surface reflectance for improved aerosol optical thickness retrievals from the GOSAT/TANSO-Cloud and Aerosol Imager

NASA Astrophysics Data System (ADS)

Fukuda, Satoru; Nakajima, Teruyuki; Takenaka, Hideaki; Higurashi, Akiko; Kikuchi, Nobuyuki; Nakajima, Takashi Y.; Ishida, Haruma

2013-12-01

satellite aerosol retrieval algorithm was developed to utilize a near-ultraviolet band of the Greenhouse gases Observing SATellite/Thermal And Near infrared Sensor for carbon Observation (GOSAT/TANSO)-Cloud and Aerosol Imager (CAI). At near-ultraviolet wavelengths, the surface reflectance over land is smaller than that at visible wavelengths. Therefore, it is thought possible to reduce retrieval error by using the near-ultraviolet spectral region. In the present study, we first developed a cloud shadow detection algorithm that uses first and second minimum reflectances of 380 nm and 680 nm based on the difference in Rayleigh scattering contribution for these two bands. Then, we developed a new surface reflectance correction algorithm, the modified Kaufman method, which uses minimum reflectance data at 680 nm and the NDVI to estimate the surface reflectance at 380 nm. This algorithm was found to be particularly effective at reducing the aerosol effect remaining in the 380 nm minimum reflectance; this effect has previously proven difficult to remove owing to the infrequent sampling rate associated with the three-day recursion period of GOSAT and the narrow CAI swath of 1000 km. Finally, we applied these two algorithms to retrieve aerosol optical thicknesses over a land area. Our results exhibited better agreement with sun-sky radiometer observations than results obtained using a simple surface reflectance correction technique using minimum radiances.

Wavelet optimization for content-based image retrieval in medical databases.

PubMed

Quellec, G; Lamard, M; Cazuguel, G; Cochener, B; Roux, C

2010-04-01

We propose in this article a content-based image retrieval (CBIR) method for diagnosis aid in medical fields. In the proposed system, images are indexed in a generic fashion, without extracting domain-specific features: a signature is built for each image from its wavelet transform. These image signatures characterize the distribution of wavelet coefficients in each subband of the decomposition. A distance measure is then defined to compare two image signatures and thus retrieve the most similar images in a database when a query image is submitted by a physician. To retrieve relevant images from a medical database, the signatures and the distance measure must be related to the medical interpretation of images. As a consequence, we introduce several degrees of freedom in the system so that it can be tuned to any pathology and image modality. In particular, we propose to adapt the wavelet basis, within the lifting scheme framework, and to use a custom decomposition scheme. Weights are also introduced between subbands. All these parameters are tuned by an optimization procedure, using the medical grading of each image in the database to define a performance measure. The system is assessed on two medical image databases: one for diabetic retinopathy follow up and one for screening mammography, as well as a general purpose database. Results are promising: a mean precision of 56.50%, 70.91% and 96.10% is achieved for these three databases, when five images are returned by the system. Copyright 2009 Elsevier B.V. All rights reserved.

X-Ray Phase Imaging for Breast Cancer Detection

DTIC Science & Technology

2012-09-01

the Gerchberg-Saxton algorithm in the Fresnel diffraction regime, and is much more robust against image noise than the TIE-based method. For details...developed efficient coding with the software modules for the image registration, flat-filed correction , and phase retrievals. In addition, we...X, Liu H. 2010. Performance analysis of the attenuation-partition based iterative phase retrieval algorithm for in-line phase-contrast imaging

Retrieval of the thickness of undeformed sea ice from C-band compact polarimetric SAR images

NASA Astrophysics Data System (ADS)

Zhang, X.; Dierking, W.; Zhang, J.; Meng, J. M.; Lang, H. T.

2015-10-01

In this paper we introduce a parameter for the retrieval of the thickness of undeformed first-year sea ice that is specifically adapted to compact polarimetric SAR images. The parameter is denoted as "CP-Ratio". In model simulations we investigated the sensitivity of CP-Ratio to the dielectric constant, thickness, surface roughness, and incidence angle. From the results of the simulations we deduced optimal conditions for the thickness retrieval. On the basis of C-band CTLR SAR data, which were generated from Radarsat-2 quad-polarization images acquired jointly with helicopter-borne sea ice thickness measurements in the region of the Sea of Labrador, we tested empirical equations for thickness retrieval. An exponential fit between CP-Ratio and ice thickness provides the most reliable results. Based on a validation using other compact polarimetric SAR images from the same region we found a root mean square (rms) error of 8 cm and a maximum correlation coefficient of 0.92 for the retrieval procedure when applying it on level ice of 0.9 m mean thickness.

Active learning methods for interactive image retrieval.

PubMed

Gosselin, Philippe Henri; Cord, Matthieu

2008-07-01

Active learning methods have been considered with increased interest in the statistical learning community. Initially developed within a classification framework, a lot of extensions are now being proposed to handle multimedia applications. This paper provides algorithms within a statistical framework to extend active learning for online content-based image retrieval (CBIR). The classification framework is presented with experiments to compare several powerful classification techniques in this information retrieval context. Focusing on interactive methods, active learning strategy is then described. The limitations of this approach for CBIR are emphasized before presenting our new active selection process RETIN. First, as any active method is sensitive to the boundary estimation between classes, the RETIN strategy carries out a boundary correction to make the retrieval process more robust. Second, the criterion of generalization error to optimize the active learning selection is modified to better represent the CBIR objective of database ranking. Third, a batch processing of images is proposed. Our strategy leads to a fast and efficient active learning scheme to retrieve sets of online images (query concept). Experiments on large databases show that the RETIN method performs well in comparison to several other active strategies.

PCI bus content-addressable-memory (CAM) implementation on FPGA for pattern recognition/image retrieval in a distributed environment

NASA Astrophysics Data System (ADS)

Megherbi, Dalila B.; Yan, Yin; Tanmay, Parikh; Khoury, Jed; Woods, C. L.

2004-11-01

Recently surveillance and Automatic Target Recognition (ATR) applications are increasing as the cost of computing power needed to process the massive amount of information continues to fall. This computing power has been made possible partly by the latest advances in FPGAs and SOPCs. In particular, to design and implement state-of-the-Art electro-optical imaging systems to provide advanced surveillance capabilities, there is a need to integrate several technologies (e.g. telescope, precise optics, cameras, image/compute vision algorithms, which can be geographically distributed or sharing distributed resources) into a programmable system and DSP systems. Additionally, pattern recognition techniques and fast information retrieval, are often important components of intelligent systems. The aim of this work is using embedded FPGA as a fast, configurable and synthesizable search engine in fast image pattern recognition/retrieval in a distributed hardware/software co-design environment. In particular, we propose and show a low cost Content Addressable Memory (CAM)-based distributed embedded FPGA hardware architecture solution with real time recognition capabilities and computing for pattern look-up, pattern recognition, and image retrieval. We show how the distributed CAM-based architecture offers a performance advantage of an order-of-magnitude over RAM-based architecture (Random Access Memory) search for implementing high speed pattern recognition for image retrieval. The methods of designing, implementing, and analyzing the proposed CAM based embedded architecture are described here. Other SOPC solutions/design issues are covered. Finally, experimental results, hardware verification, and performance evaluations using both the Xilinx Virtex-II and the Altera Apex20k are provided to show the potential and power of the proposed method for low cost reconfigurable fast image pattern recognition/retrieval at the hardware/software co-design level.

Uncertainties in Cloud Phase and Optical Thickness Retrievals from the Earth Polychromatic Imaging Camera (EPIC)

NASA Technical Reports Server (NTRS)

Meyer, Kerry; Yang, Yuekui; Platnick, Steven

2016-01-01

This paper presents an investigation of the expected uncertainties of a single channel cloud optical thickness (COT) retrieval technique, as well as a simple cloud-temperature-threshold-based thermodynamic phase approach, in support of the Deep Space Climate Observatory (DSCOVR) mission. DSCOVR cloud products will be derived from Earth Polychromatic Imaging Camera (EPIC) observations in the ultraviolet and visible spectra. Since EPIC is not equipped with a spectral channel in the shortwave or mid-wave infrared that is sensitive to cloud effective radius (CER), COT will be inferred from a single visible channel with the assumption of appropriate CER values for liquid and ice phase clouds. One month of Aqua MODIS daytime granules from April 2005 is selected for investigating cloud phase sensitivity, and a subset of these granules that has similar EPIC sun-view geometry is selected for investigating COT uncertainties. EPIC COT retrievals are simulated with the same algorithm as the operational MODIS cloud products (MOD06), except using fixed phase-dependent CER values. Uncertainty estimates are derived by comparing the single channel COT retrievals with the baseline bi-spectral MODIS retrievals. Results show that a single channel COT retrieval is feasible for EPIC. For ice clouds, single channel retrieval errors are minimal (less than 2 percent) due to the particle- size insensitivity of the assumed ice crystal (i.e., severely roughened aggregate of hexagonal columns) scattering properties at visible wavelengths, while for liquid clouds the error is mostly limited to within 10 percent, although for thin clouds (COT less than 2) the error can be higher. Potential uncertainties in EPIC cloud masking and cloud temperature retrievals are not considered in this study.

Uncertainties in cloud phase and optical thickness retrievals from the Earth Polychromatic Imaging Camera (EPIC)

PubMed Central

Meyer, Kerry; Yang, Yuekui; Platnick, Steven

2018-01-01

This paper presents an investigation of the expected uncertainties of a single channel cloud optical thickness (COT) retrieval technique, as well as a simple cloud temperature threshold based thermodynamic phase approach, in support of the Deep Space Climate Observatory (DSCOVR) mission. DSCOVR cloud products will be derived from Earth Polychromatic Imaging Camera (EPIC) observations in the ultraviolet and visible spectra. Since EPIC is not equipped with a spectral channel in the shortwave or mid-wave infrared that is sensitive to cloud effective radius (CER), COT will be inferred from a single visible channel with the assumption of appropriate CER values for liquid and ice phase clouds. One month of Aqua MODIS daytime granules from April 2005 is selected for investigating cloud phase sensitivity, and a subset of these granules that has similar EPIC sun-view geometry is selected for investigating COT uncertainties. EPIC COT retrievals are simulated with the same algorithm as the operational MODIS cloud products (MOD06), except using fixed phase-dependent CER values. Uncertainty estimates are derived by comparing the single channel COT retrievals with the baseline bi-spectral MODIS retrievals. Results show that a single channel COT retrieval is feasible for EPIC. For ice clouds, single channel retrieval errors are minimal (< 2%) due to the particle size insensitivity of the assumed ice crystal (i.e., severely roughened aggregate of hexagonal columns) scattering properties at visible wavelengths, while for liquid clouds the error is mostly limited to within 10%, although for thin clouds (COT < 2) the error can be higher. Potential uncertainties in EPIC cloud masking and cloud temperature retrievals are not considered in this study. PMID:29619116

Uncertainties in cloud phase and optical thickness retrievals from the Earth Polychromatic Imaging Camera (EPIC).

PubMed

Meyer, Kerry; Yang, Yuekui; Platnick, Steven

2016-01-01

This paper presents an investigation of the expected uncertainties of a single channel cloud optical thickness (COT) retrieval technique, as well as a simple cloud temperature threshold based thermodynamic phase approach, in support of the Deep Space Climate Observatory (DSCOVR) mission. DSCOVR cloud products will be derived from Earth Polychromatic Imaging Camera (EPIC) observations in the ultraviolet and visible spectra. Since EPIC is not equipped with a spectral channel in the shortwave or mid-wave infrared that is sensitive to cloud effective radius (CER), COT will be inferred from a single visible channel with the assumption of appropriate CER values for liquid and ice phase clouds. One month of Aqua MODIS daytime granules from April 2005 is selected for investigating cloud phase sensitivity, and a subset of these granules that has similar EPIC sun-view geometry is selected for investigating COT uncertainties. EPIC COT retrievals are simulated with the same algorithm as the operational MODIS cloud products (MOD06), except using fixed phase-dependent CER values. Uncertainty estimates are derived by comparing the single channel COT retrievals with the baseline bi-spectral MODIS retrievals. Results show that a single channel COT retrieval is feasible for EPIC. For ice clouds, single channel retrieval errors are minimal (< 2%) due to the particle size insensitivity of the assumed ice crystal (i.e., severely roughened aggregate of hexagonal columns) scattering properties at visible wavelengths, while for liquid clouds the error is mostly limited to within 10%, although for thin clouds (COT < 2) the error can be higher. Potential uncertainties in EPIC cloud masking and cloud temperature retrievals are not considered in this study.

Medical Image Retrieval Using Multi-Texton Assignment.

PubMed

Tang, Qiling; Yang, Jirong; Xia, Xianfu

2018-02-01

In this paper, we present a multi-texton representation method for medical image retrieval, which utilizes the locality constraint to encode each filter bank response within its local-coordinate system consisting of the k nearest neighbors in texton dictionary and subsequently employs spatial pyramid matching technique to implement feature vector representation. Comparison with the traditional nearest neighbor assignment followed by texton histogram statistics method, our strategies reduce the quantization errors in mapping process and add information about the spatial layout of texton distributions and, thus, increase the descriptive power of the image representation. We investigate the effects of different parameters on system performance in order to choose the appropriate ones for our datasets and carry out experiments on the IRMA-2009 medical collection and the mammographic patch dataset. The extensive experimental results demonstrate that the proposed method has superior performance.

High red blood cell composition in clots is associated with successful recanalization during intra-arterial thrombectomy.

PubMed

Shin, Jong Wook; Jeong, Hye Seon; Kwon, Hyon-Jo; Song, Kyu Sang; Kim, Jei

2018-01-01

We evaluated the composition of individual clots retrieved during intra-arterial thrombectomy in relation to recanalization success, stroke subtype, and the presence of clot signs on initial brain images. We analyzed clot and interventional data from 145 retrieval trials performed for 37 patients (69.5±14.0 years, 20 men, large artery atherosclerosis, n = 7; cardioembolism, n = 22; undetermined etiology, n = 8) who had undergone intra-arterial thrombectomy. Rates of clot retrieval and successful recanalization (Arterial Occlusive Lesion score of 2-3) for separate retrieval trials were evaluated. The area occupied by red blood cell (RBC), fibrin/platelets, and white blood cell (WBC) was measured from digitized images of hematoxylin-eosin stained clots. Compositional differences were compared according to recanalization success, stroke subtype, and the presence of hyperdense clot sign on initial computed tomography and/or blooming artifact on magnetic resonance image. Of the 145 total retrieval trials (3.4±2.4 times per patient), clot was retrieved in 93 trials (64%), while recanalization was successful in 73 (50%). Fibrin/platelets (63%) occupied the greatest area in retrieved clots, followed by RBCs (33%) and WBCs (4%). Clots retrieved from successful recanalization exhibited higher RBC composition (37%) than those retrieved from non-recanalization trials (20%, p = 0.001). RBC composition was higher in cardioembolic stroke (38%) rather than large artery atherosclerosis (23%) and undetermined etiology (26%, p = 0.01). Clots exhibiting clot signs (40%) had higher RBC composition than those without clot signs (19%, p = 0.001). RBC-rich clots were associated with successful recanalization of intra-arterial thrombectomy, cardioembolic stroke, and the presence of clot-signs on initial brain images.

High red blood cell composition in clots is associated with successful recanalization during intra-arterial thrombectomy

PubMed Central

Shin, Jong Wook; Jeong, Hye Seon; Kwon, Hyon-Jo; Song, Kyu Sang

2018-01-01

We evaluated the composition of individual clots retrieved during intra-arterial thrombectomy in relation to recanalization success, stroke subtype, and the presence of clot signs on initial brain images. We analyzed clot and interventional data from 145 retrieval trials performed for 37 patients (69.5±14.0 years, 20 men, large artery atherosclerosis, n = 7; cardioembolism, n = 22; undetermined etiology, n = 8) who had undergone intra-arterial thrombectomy. Rates of clot retrieval and successful recanalization (Arterial Occlusive Lesion score of 2–3) for separate retrieval trials were evaluated. The area occupied by red blood cell (RBC), fibrin/platelets, and white blood cell (WBC) was measured from digitized images of hematoxylin-eosin stained clots. Compositional differences were compared according to recanalization success, stroke subtype, and the presence of hyperdense clot sign on initial computed tomography and/or blooming artifact on magnetic resonance image. Of the 145 total retrieval trials (3.4±2.4 times per patient), clot was retrieved in 93 trials (64%), while recanalization was successful in 73 (50%). Fibrin/platelets (63%) occupied the greatest area in retrieved clots, followed by RBCs (33%) and WBCs (4%). Clots retrieved from successful recanalization exhibited higher RBC composition (37%) than those retrieved from non-recanalization trials (20%, p = 0.001). RBC composition was higher in cardioembolic stroke (38%) rather than large artery atherosclerosis (23%) and undetermined etiology (26%, p = 0.01). Clots exhibiting clot signs (40%) had higher RBC composition than those without clot signs (19%, p = 0.001). RBC-rich clots were associated with successful recanalization of intra-arterial thrombectomy, cardioembolic stroke, and the presence of clot-signs on initial brain images. PMID:29782513

Content based image retrieval for matching images of improvised explosive devices in which snake initialization is viewed as an inverse problem

NASA Astrophysics Data System (ADS)

Acton, Scott T.; Gilliam, Andrew D.; Li, Bing; Rossi, Adam

2008-02-01

Improvised explosive devices (IEDs) are common and lethal instruments of terrorism, and linking a terrorist entity to a specific device remains a difficult task. In the effort to identify persons associated with a given IED, we have implemented a specialized content based image retrieval system to search and classify IED imagery. The system makes two contributions to the art. First, we introduce a shape-based matching technique exploiting shape, color, and texture (wavelet) information, based on novel vector field convolution active contours and a novel active contour initialization method which treats coarse segmentation as an inverse problem. Second, we introduce a unique graph theoretic approach to match annotated printed circuit board images for which no schematic or connectivity information is available. The shape-based image retrieval method, in conjunction with the graph theoretic tool, provides an efficacious system for matching IED images. For circuit imagery, the basic retrieval mechanism has a precision of 82.1% and the graph based method has a precision of 98.1%. As of the fall of 2007, the working system has processed over 400,000 case images.

Positive emotion can protect against source memory impairment.

PubMed

MacKenzie, Graham; Powell, Tim F; Donaldson, David I

2015-01-01

Despite widespread belief that memory is enhanced by emotion, evidence also suggests that emotion can impair memory. Here we test predictions inspired by object-based binding theory, which states that memory enhancement or impairment depends on the nature of the information to be retrieved. We investigated emotional memory in the context of source retrieval, using images of scenes that were negative, neutral or positive in valence. At study each scene was paired with a colour and during retrieval participants reported the source colour for recognised scenes. Critically, we isolated effects of valence by equating stimulus arousal across conditions. In Experiment 1 colour borders surrounded scenes at study: memory impairment was found for both negative and positive scenes. Experiment 2 used colours superimposed over scenes at study: valence affected source retrieval, with memory impairment for negative scenes only. These findings challenge current theories of emotional memory by showing that emotion can impair memory for both intrinsic and extrinsic source information, even when arousal is equated between emotional and neutral stimuli, and by dissociating the effects of positive and negative emotion on episodic memory retrieval.

The effect of spatial resolution upon cloud optical property retrievals. I - Optical thickness

NASA Technical Reports Server (NTRS)

Feind, Rand E.; Christopher, Sundar A.; Welch, Ronald M.

1992-01-01

High spectral and spatial resolution Airborne Visible/Infrared Imaging Spectrometer (AVIRIS) imagery is used to study the effects of spatial resolution upon fair weather cumulus cloud optical thickness retrievals. As a preprocessing step, a variation of the Gao and Goetz three-band ratio technique is used to discriminate clouds from the background. The combination of the elimination of cloud shadow pixels and using the first derivative of the histogram allows for accurate cloud edge discrimination. The data are progressively degraded from 20 m to 960 m spatial resolution. The results show that retrieved cloud area increases with decreasing spatial resolution. The results also show that there is a monotonic decrease in retrieved cloud optical thickness with decreasing spatial resolution. It is also demonstrated that the use of a single, monospectral reflectance threshold is inadequate for identifying cloud pixels in fair weather cumulus scenes and presumably in any inhomogeneous cloud field. Cloud edges have a distribution of reflectance thresholds. The incorrect identification of cloud edges significantly impacts the accurate retrieval of cloud optical thickness values.

Three-dimensional imaging using phase retrieval with two focus planes

NASA Astrophysics Data System (ADS)

Ilovitsh, Tali; Ilovitsh, Asaf; Weiss, Aryeh; Meir, Rinat; Zalevsky, Zeev

2016-03-01

This work presents a technique for a full 3D imaging of biological samples tagged with gold-nanoparticles (GNPs) using only two images, rather than many images per volume as is currently needed for 3D optical sectioning microscopy. The proposed approach is based on the Gerchberg-Saxton (GS) phase retrieval algorithm. The reconstructed field is free space propagated to all other focus planes using post processing, and the 2D z-stack is merged to create a 3D image of the sample with high fidelity. Because we propose to apply the phase retrieving on nano particles, the regular ambiguities typical to the Gerchberg-Saxton algorithm, are eliminated. In addition, since the method requires the capturing of two images only, it can be suitable for 3D live cell imaging. The proposed concept is presented and validated both on simulated data as well as experimentally.

Automated search and retrieval of information from imaged documents using optical correlation techniques

NASA Astrophysics Data System (ADS)

Stalcup, Bruce W.; Dennis, Phillip W.; Dydyk, Robert B.

1999-10-01

Litton PRC and Litton Data Systems Division are developing a system, the Imaged Document Optical Correlation and Conversion System (IDOCCS), to provide a total solution to the problem of managing and retrieving textual and graphic information from imaged document archives. At the heart of IDOCCS, optical correlation technology provides the search and retrieval of information from imaged documents. IDOCCS can be used to rapidly search for key words or phrases within the imaged document archives. In addition, IDOCCS can automatically compare an input document with the archived database to determine if it is a duplicate, thereby reducing the overall resources required to maintain and access the document database. Embedded graphics on imaged pages can also be exploited; e.g., imaged documents containing an agency's seal or logo can be singled out. In this paper, we present a description of IDOCCS as well as preliminary performance results and theoretical projections.

Multilayered Clouds Identification and Retrieval for CERES Using MODIS

NASA Technical Reports Server (NTRS)

Sun-Mack, Sunny; Minnis, Patrick; Chen, Yan; Yi, Yuhong; Huang, Jainping; Lin, Bin; Fan, Alice; Gibson, Sharon; Chang, Fu-Lung

2006-01-01

Traditionally, analyses of satellite data have been limited to interpreting the radiances in terms of single layer clouds. Generally, this results in significant errors in the retrieved properties for multilayered cloud systems. Two techniques for detecting overlapped clouds and retrieving the cloud properties using satellite data are explored to help address the need for better quantification of cloud vertical structure. The first technique was developed using multispectral imager data with secondary imager products (infrared brightness temperature differences, BTD). The other method uses microwave (MWR) data. The use of BTD, the 11-12 micrometer brightness temperature difference, in conjunction with tau, the retrieved visible optical depth, was suggested by Kawamoto et al. (2001) and used by Pavlonis et al. (2004) as a means to detect multilayered clouds. Combining visible (VIS; 0.65 micrometer) and infrared (IR) retrievals of cloud properties with microwave (MW) retrievals of cloud water temperature Tw and liquid water path LWP retrieved from satellite microwave imagers appears to be a fruitful approach for detecting and retrieving overlapped clouds (Lin et al., 1998, Ho et al., 2003, Huang et al., 2005). The BTD method is limited to optically thin cirrus over low clouds, while the MWR method is limited to ocean areas only. With the availability of VIS and IR data from the Moderate Resolution Imaging Spectroradiometer (MODIS) and MW data from the Advanced Microwave Scanning Radiometer EOS (AMSR-E), both on Aqua, it is now possible to examine both approaches simultaneously. This paper explores the use of the BTD method as applied to MODIS and AMSR-E data taken from the Aqua satellite over non-polar ocean surfaces.

A Method for Retrieving Ground Flash Fraction from Satellite Lightning Imager Data

NASA Technical Reports Server (NTRS)

Koshak, William J.

2009-01-01

A general theory for retrieving the fraction of ground flashes in N lightning observed by a satellite-based lightning imager is provided. An "exponential model" is applied as a physically reasonable constraint to describe the measured optical parameter distributions, and population statistics (i.e., mean, variance) are invoked to add additional constraints to the retrieval process. The retrieval itself is expressed in terms of a Bayesian inference, and the Maximum A Posteriori (MAP) solution is obtained. The approach is tested by performing simulated retrievals, and retrieval error statistics are provided. The ability to retrieve ground flash fraction has important benefits to the atmospheric chemistry community. For example, using the method to partition the existing satellite global lightning climatology into separate ground and cloud flash climatologies will improve estimates of lightning nitrogen oxides (NOx) production; this in turn will improve both regional air quality and global chemistry/climate model predictions.

Content-based image retrieval by matching hierarchical attributed region adjacency graphs

NASA Astrophysics Data System (ADS)

Fischer, Benedikt; Thies, Christian J.; Guld, Mark O.; Lehmann, Thomas M.

2004-05-01

Content-based image retrieval requires a formal description of visual information. In medical applications, all relevant biological objects have to be represented by this description. Although color as the primary feature has proven successful in publicly available retrieval systems of general purpose, this description is not applicable to most medical images. Additionally, it has been shown that global features characterizing the whole image do not lead to acceptable results in the medical context or that they are only suitable for specific applications. For a general purpose content-based comparison of medical images, local, i.e. regional features that are collected on multiple scales must be used. A hierarchical attributed region adjacency graph (HARAG) provides such a representation and transfers image comparison to graph matching. However, building a HARAG from an image requires a restriction in size to be computationally feasible while at the same time all visually plausible information must be preserved. For this purpose, mechanisms for the reduction of the graph size are presented. Even with a reduced graph, the problem of graph matching remains NP-complete. In this paper, the Similarity Flooding approach and Hopfield-style neural networks are adapted from the graph matching community to the needs of HARAG comparison. Based on synthetic image material build from simple geometric objects, all visually similar regions were matched accordingly showing the framework's general applicability to content-based image retrieval of medical images.

Digital adaptive optics confocal microscopy based on iterative retrieval of optical aberration from a guidestar hologram

PubMed Central

Liu, Changgeng; Thapa, Damber; Yao, Xincheng

2017-01-01

Guidestar hologram based digital adaptive optics (DAO) is one recently emerging active imaging modality. It records each complex distorted line field reflected or scattered from the sample by an off-axis digital hologram, measures the optical aberration from a separate off-axis digital guidestar hologram, and removes the optical aberration from the distorted line fields by numerical processing. In previously demonstrated DAO systems, the optical aberration was directly retrieved from the guidestar hologram by taking its Fourier transform and extracting the phase term. For the direct retrieval method (DRM), when the sample is not coincident with the guidestar focal plane, the accuracy of the optical aberration retrieved by DRM undergoes a fast decay, leading to quality deterioration of corrected images. To tackle this problem, we explore here an image metrics-based iterative method (MIM) to retrieve the optical aberration from the guidestar hologram. Using an aberrated objective lens and scattering samples, we demonstrate that MIM can improve the accuracy of the retrieved aberrations from both focused and defocused guidestar holograms, compared to DRM, to improve the robustness of the DAO. PMID:28380937

Measurement of tag confidence in user generated contents retrieval

NASA Astrophysics Data System (ADS)

Lee, Sihyoung; Min, Hyun-Seok; Lee, Young Bok; Ro, Yong Man

2009-01-01

As online image sharing services are becoming popular, the importance of correctly annotated tags is being emphasized for precise search and retrieval. Tags created by user along with user-generated contents (UGC) are often ambiguous due to the fact that some tags are highly subjective and visually unrelated to the image. They cause unwanted results to users when image search engines rely on tags. In this paper, we propose a method of measuring tag confidence so that one can differentiate confidence tags from noisy tags. The proposed tag confidence is measured from visual semantics of the image. To verify the usefulness of the proposed method, experiments were performed with UGC database from social network sites. Experimental results showed that the image retrieval performance with confidence tags was increased.

Adaptation of reference volumes for correlation-based digital holographic particle tracking

NASA Astrophysics Data System (ADS)

Hesseling, Christina; Peinke, Joachim; Gülker, Gerd

2018-04-01

Numerically reconstructed reference volumes tailored to particle images are used for particle position detection by means of three-dimensional correlation. After a first tracking of these positions, the experimentally recorded particle images are retrieved as a posteriori knowledge about the particle images in the system. This knowledge is used for a further refinement of the detected positions. A transparent description of the individual algorithm steps including the results retrieved with experimental data complete the paper. The work employs extraordinarily small particles, smaller than the pixel pitch of the camera sensor. It is the first approach known to the authors that combines numerical knowledge about particle images and particle images retrieved from the experimental system to an iterative particle tracking approach for digital holographic particle tracking velocimetry.

Optical Thickness and Effective Radius Retrievals of Liquid Water Clouds over Ice and Snow Surface

NASA Technical Reports Server (NTRS)

Platnick, S.; King, M. D.; Tsay, S.-C.; Arnold, G. T.; Gerber, H.; Hobbs, P. V.; Rangno, A.

1999-01-01

Cloud optical thickness and effective radius retrievals from solar reflectance measurements traditionally depend on a combination of spectral channels that are absorbing and non-absorbing for liquid water droplets. Reflectances in non-absorbing channels (e.g., 0.67, 0.86 micrometer bands) are largely dependent on cloud optical thickness, while longer wavelength absorbing channels (1.6, 2.1, and 3.7 micrometer window bands) provide cloud particle size information. Retrievals are complicated by the presence of an underlying ice/snow surface. At the shorter wavelengths, sea ice is both bright and highly variable, significantly increasing cloud retrieval uncertainty. However, reflectances at the longer wavelengths are relatively small and may be comparable to that of dark open water. Sea ice spectral albedos derived from Cloud Absorption Radiometer (CAR) measurements during April 1992 and June 1995 Arctic field deployments are used to illustrate these statements. A modification to the traditional retrieval technique is devised. The new algorithm uses a combination of absorbing spectral channels for which the snow/ice albedo is relatively small. Using this approach, preliminary retrievals have been made with the MODIS Airborne Simulator (MAS) imager flown aboard the NASA ER-2 during FIRE-ACE. Data from coordinated ER-2 and University of Washington CV-580 aircraft observations of liquid water stratus clouds on June 3 and June 6, 1998 have been examined. Size retrievals are compared with in situ cloud profile measurements of effective radius made with the CV-580 PMS FSSP probe, and optical thickness retrievals are compared with extinction profiles derived from the Gerber Scientific "g-meter" probe. MAS retrievals are shown to be in good agreement with the in situ measurements.

Aerosol Optical Retrieval and Surface Reflectance from Airborne Remote Sensing Data over Land

PubMed Central

Bassani, Cristiana; Cavalli, Rosa Maria; Pignatti, Stefano

2010-01-01

Quantitative analysis of atmospheric optical properties and surface reflectance can be performed by applying radiative transfer theory in the Atmosphere-Earth coupled system, for the atmospheric correction of hyperspectral remote sensing data. This paper describes a new physically-based algorithm to retrieve the aerosol optical thickness at 550nm (τ550) and the surface reflectance (ρ) from airborne acquired data in the atmospheric window of the Visible and Near-Infrared (VNIR) range. The algorithm is realized in two modules. Module A retrieves τ550 with a minimization algorithm, then Module B retrieves the surface reflectance ρ for each pixel of the image. The method was tested on five remote sensing images acquired by an airborne sensor under different geometric conditions to evaluate the reliability of the method. The results, τ550 and ρ, retrieved from each image were validated with field data contemporaneously acquired by a sun-sky radiometer and a spectroradiometer, respectively. Good correlation index, r, and low root mean square deviations, RMSD, were obtained for the τ550 retrieved by Module A (r2 = 0.75, RMSD = 0.08) and the ρ retrieved by Module B (r2 ≤ 0.9, RMSD ≤ 0.003). Overall, the results are encouraging, indicating that the method is reliable for optical atmospheric studies and the atmospheric correction of airborne hyperspectral images. The method does not require additional at-ground measurements about at-ground reflectance of the reference pixel and aerosol optical thickness. PMID:22163558

Interpretation of multi-wavelength-retrieved cloud droplet effective radii in terms of cloud vertical inhomogeneity based on water cloud simulations using a spectral-bin microphysics cloud model

NASA Astrophysics Data System (ADS)

Matsui, T. N.; Suzuki, K.; Nakajima, T. Y.; Matsumae, Y.

2011-12-01

Clouds play an import role in energy balance and climate changes of the Earth. IPCC AR4, however, pointed out that cloud feedback is still the large source of uncertainty in climate estimates. In the recent decade, the new satellites with the active instruments (e.g. Cloudsat) represented a new epoch in earth observations. The active remote sensing is powerful for illustrating the vertical structures of clouds, but the passive remote sensing from satellite images also contribute to better understating of cloud system. For instance, Nakajima et al. (2010a) and Suzuki et al. (2010) illustrated transition of cloud growth, from cloud droplet to drizzle to rain, using the combine analysis of the cloud droplet size retrieved from passive images (MODIS) and the reflectivity profiles from Cloudsat. Furthermore, EarthCARE that is a new satellite launched years later is composed of not only the active but also passive instruments for the combined analysis. On the other hands, the methods to retrieve the advanced information of cloud properties are also required because many imagers have been operated and are now planned (e.g. GCOM-C/SGLI), and have the advantages such as wide observation width and more observation channels. Cloud droplet effective radius (CDR) and cloud optical thickness (COT) can be retrieved using a non-water-absorbing band (e.g. 0.86μm) and a water-absorbing band (1.6, 2.1, 3.7μm) of imagers under the assumptions such as the log-normal droplet size distribution and the plane-parallel cloud structure. However, the differences between three retrieved CDRs using 1.6, 2.1 or 3.7μm (R16, R21 and R37) are found in the satellite observations. Several studies pointed out that vertical/horizontal inhomogeneity of cloud structure, difference of penetration depth of water-absorbing bands, multi-modal droplet distribution and/or 3-D radiative transfer effect cause the CDR differences. In other words, the advanced information of clouds may lie hidden in the differences. Nakajima et al. (2010b) investigated the impact of the differences sensitivities to particle size and the penetration depth in an attempt to explain the CDR differences found in by using a simple two-layer cloud model with the bi-modal size distribution functions. Their results showed the sensitivity differences between 1.6, 2.1 and 3.7μm bands to droplet sizes and their vertical stratification. In this study, we further investigate the impact of the vertical inhomogeneity structure including the drizzle by using a spectral-bin microphysics cloud model. We apply the 1-D radiative transfer computation to the numerical cloud fields generated by the cloud model, and retrieve the CDRs from the reflectances thus simulated at each band. We then compare the statistics of these retrieved CDRs with the CDRs obtained from MODIS observations and derive the sensitivity functions of the retrieved CDRs to the particle size and the optical depth from the sets of the droplet distribution functions predicted by the model and the retrieved CDRs. This study is an attempt to interpret the CDR differences in terms of the cloud vertical structure and the cloud particle growth processes.

Penalized maximum likelihood reconstruction for x-ray differential phase-contrast tomography

DOE Office of Scientific and Technical Information (OSTI.GOV)

Brendel, Bernhard, E-mail: bernhard.brendel@philips.com; Teuffenbach, Maximilian von; Noël, Peter B.

2016-01-15

Purpose: The purpose of this work is to propose a cost function with regularization to iteratively reconstruct attenuation, phase, and scatter images simultaneously from differential phase contrast (DPC) acquisitions, without the need of phase retrieval, and examine its properties. Furthermore this reconstruction method is applied to an acquisition pattern that is suitable for a DPC tomographic system with continuously rotating gantry (sliding window acquisition), overcoming the severe smearing in noniterative reconstruction. Methods: We derive a penalized maximum likelihood reconstruction algorithm to directly reconstruct attenuation, phase, and scatter image from the measured detector values of a DPC acquisition. The proposed penaltymore » comprises, for each of the three images, an independent smoothing prior. Image quality of the proposed reconstruction is compared to images generated with FBP and iterative reconstruction after phase retrieval. Furthermore, the influence between the priors is analyzed. Finally, the proposed reconstruction algorithm is applied to experimental sliding window data acquired at a synchrotron and results are compared to reconstructions based on phase retrieval. Results: The results show that the proposed algorithm significantly increases image quality in comparison to reconstructions based on phase retrieval. No significant mutual influence between the proposed independent priors could be observed. Further it could be illustrated that the iterative reconstruction of a sliding window acquisition results in images with substantially reduced smearing artifacts. Conclusions: Although the proposed cost function is inherently nonconvex, it can be used to reconstruct images with less aliasing artifacts and less streak artifacts than reconstruction methods based on phase retrieval. Furthermore, the proposed method can be used to reconstruct images of sliding window acquisitions with negligible smearing artifacts.« less

BIRAM: a content-based image retrieval framework for medical images

NASA Astrophysics Data System (ADS)

Moreno, Ramon A.; Furuie, Sergio S.

2006-03-01

In the medical field, digital images are becoming more and more important for diagnostics and therapy of the patients. At the same time, the development of new technologies has increased the amount of image data produced in a hospital. This creates a demand for access methods that offer more than text-based queries for retrieval of the information. In this paper is proposed a framework for the retrieval of medical images that allows the use of different algorithms for the search of medical images by similarity. The framework also enables the search for textual information from an associated medical report and DICOM header information. The proposed system can be used for support of clinical decision making and is intended to be integrated with an open source picture, archiving and communication systems (PACS). The BIRAM has the following advantages: (i) Can receive several types of algorithms for image similarity search; (ii) Allows the codification of the report according to a medical dictionary, improving the indexing of the information and retrieval; (iii) The algorithms can be selectively applied to images with the appropriated characteristics, for instance, only in magnetic resonance images. The framework was implemented in Java language using a MS Access 97 database. The proposed framework can still be improved, by the use of regions of interest (ROI), indexing with slim-trees and integration with a PACS Server.

Complex dark-field contrast and its retrieval in x-ray phase contrast imaging implemented with Talbot interferometry.

PubMed

Yang, Yi; Tang, Xiangyang

2014-10-01

Under the existing theoretical framework of x-ray phase contrast imaging methods implemented with Talbot interferometry, the dark-field contrast refers to the reduction in interference fringe visibility due to small-angle x-ray scattering of the subpixel microstructures of an object to be imaged. This study investigates how an object's subpixel microstructures can also affect the phase of the intensity oscillations. Instead of assuming that the object's subpixel microstructures distribute in space randomly, the authors' theoretical derivation starts by assuming that an object's attenuation projection and phase shift vary at a characteristic size that is not smaller than the period of analyzer grating G₂ and a characteristic length dc. Based on the paraxial Fresnel-Kirchhoff theory, the analytic formulae to characterize the zeroth- and first-order Fourier coefficients of the x-ray irradiance recorded at each detector cell are derived. Then the concept of complex dark-field contrast is introduced to quantify the influence of the object's microstructures on both the interference fringe visibility and the phase of intensity oscillations. A method based on the phase-attenuation duality that holds for soft tissues and high x-ray energies is proposed to retrieve the imaginary part of the complex dark-field contrast for imaging. Through computer simulation study with a specially designed numerical phantom, they evaluate and validate the derived analytic formulae and the proposed retrieval method. Both theoretical analysis and computer simulation study show that the effect of an object's subpixel microstructures on x-ray phase contrast imaging method implemented with Talbot interferometry can be fully characterized by a complex dark-field contrast. The imaginary part of complex dark-field contrast quantifies the influence of the object's subpixel microstructures on the phase of intensity oscillations. Furthermore, at relatively high energies, for soft tissues it can be retrieved for imaging with a method based on the phase-attenuation duality. The analytic formulae derived in this work to characterize the complex dark-field contrast in x-ray phase contrast imaging method implemented with Talbot interferometry are of significance, which may initiate more activities in the research and development of x-ray differential phase contrast imaging for extensive biomedical applications.

A fully automatic end-to-end method for content-based image retrieval of CT scans with similar liver lesion annotations.

PubMed

Spanier, A B; Caplan, N; Sosna, J; Acar, B; Joskowicz, L

2018-01-01

The goal of medical content-based image retrieval (M-CBIR) is to assist radiologists in the decision-making process by retrieving medical cases similar to a given image. One of the key interests of radiologists is lesions and their annotations, since the patient treatment depends on the lesion diagnosis. Therefore, a key feature of M-CBIR systems is the retrieval of scans with the most similar lesion annotations. To be of value, M-CBIR systems should be fully automatic to handle large case databases. We present a fully automatic end-to-end method for the retrieval of CT scans with similar liver lesion annotations. The input is a database of abdominal CT scans labeled with liver lesions, a query CT scan, and optionally one radiologist-specified lesion annotation of interest. The output is an ordered list of the database CT scans with the most similar liver lesion annotations. The method starts by automatically segmenting the liver in the scan. It then extracts a histogram-based features vector from the segmented region, learns the features' relative importance, and ranks the database scans according to the relative importance measure. The main advantages of our method are that it fully automates the end-to-end querying process, that it uses simple and efficient techniques that are scalable to large datasets, and that it produces quality retrieval results using an unannotated CT scan. Our experimental results on 9 CT queries on a dataset of 41 volumetric CT scans from the 2014 Image CLEF Liver Annotation Task yield an average retrieval accuracy (Normalized Discounted Cumulative Gain index) of 0.77 and 0.84 without/with annotation, respectively. Fully automatic end-to-end retrieval of similar cases based on image information alone, rather that on disease diagnosis, may help radiologists to better diagnose liver lesions.

Optical information authentication using compressed double-random-phase-encoded images and quick-response codes.

PubMed

Wang, Xiaogang; Chen, Wen; Chen, Xudong

2015-03-09

In this paper, we develop a new optical information authentication system based on compressed double-random-phase-encoded images and quick-response (QR) codes, where the parameters of optical lightwave are used as keys for optical decryption and the QR code is a key for verification. An input image attached with QR code is first optically encoded in a simplified double random phase encoding (DRPE) scheme without using interferometric setup. From the single encoded intensity pattern recorded by a CCD camera, a compressed double-random-phase-encoded image, i.e., the sparse phase distribution used for optical decryption, is generated by using an iterative phase retrieval technique with QR code. We compare this technique to the other two methods proposed in literature, i.e., Fresnel domain information authentication based on the classical DRPE with holographic technique and information authentication based on DRPE and phase retrieval algorithm. Simulation results show that QR codes are effective on improving the security and data sparsity of optical information encryption and authentication system.

Parallel Regulation of Memory and Emotion Supports the Suppression of Intrusive Memories

PubMed Central

Anderson, Michael C.

2017-01-01

Intrusive memories often take the form of distressing images that emerge into a person's awareness, unbidden. A fundamental goal of clinical neuroscience is to understand the mechanisms allowing people to control these memory intrusions and reduce their emotional impact. Mnemonic control engages a right frontoparietal network that interrupts episodic retrieval by modulating hippocampal activity; less is known, however, about how this mechanism contributes to affect regulation. Here we report evidence in humans (males and females) that stopping episodic retrieval to suppress an unpleasant image triggers parallel inhibition of mnemonic and emotional content. Using fMRI, we found that regulation of both mnemonic and emotional content was driven by a shared frontoparietal inhibitory network and was predicted by a common profile of medial temporal lobe downregulation involving the anterior hippocampus and the amygdala. Critically, effective connectivity analysis confirmed that reduced amygdala activity was not merely an indirect consequence of hippocampal suppression; rather, both the hippocampus and the amygdala were targeted by a top-down inhibitory control signal originating from the dorsolateral prefrontal cortex. This negative coupling was greater when unwanted memories intruded into awareness and needed to be purged. Together, these findings support the broad principle that retrieval suppression is achieved by regulating hippocampal processes in tandem with domain-specific brain regions involved in reinstating specific content, in an activity-dependent fashion. SIGNIFICANCE STATEMENT Upsetting events sometimes trigger intrusive images that cause distress and that may contribute to psychiatric disorders. People often respond to intrusions by suppressing their retrieval, excluding them from awareness. Here we examined whether suppressing aversive images might also alter emotional responses to them, and the mechanisms underlying such changes. We found that the better people were at suppressing intrusions, the more it reduced their emotional responses to suppressed images. These dual effects on memory and emotion originated from a common right prefrontal cortical mechanism that downregulated the hippocampus and amygdala in parallel. Thus, suppressing intrusions affected emotional content. Importantly, participants who did not suppress intrusions well showed increased negative affect, suggesting that suppression deficits render people vulnerable to psychiatric disorders. PMID:28559378

Hurricane Imaging Radiometer Wind Speed and Rain Rate Retrievals during the 2010 GRIP Flight Experiment

NASA Technical Reports Server (NTRS)

Sahawneh, Saleem; Farrar, Spencer; Johnson, James; Jones, W. Linwood; Roberts, Jason; Biswas, Sayak; Cecil, Daniel

2014-01-01

Microwave remote sensing observations of hurricanes, from NOAA and USAF hurricane surveillance aircraft, provide vital data for hurricane research and operations, for forecasting the intensity and track of tropical storms. The current operational standard for hurricane wind speed and rain rate measurements is the Stepped Frequency Microwave Radiometer (SFMR), which is a nadir viewing passive microwave airborne remote sensor. The Hurricane Imaging Radiometer, HIRAD, will extend the nadir viewing SFMR capability to provide wide swath images of wind speed and rain rate, while flying on a high altitude aircraft. HIRAD was first flown in the Genesis and Rapid Intensification Processes, GRIP, NASA hurricane field experiment in 2010. This paper reports on geophysical retrieval results and provides hurricane images from GRIP flights. An overview of the HIRAD instrument and the radiative transfer theory based, wind speed/rain rate retrieval algorithm is included. Results are presented for hurricane wind speed and rain rate for Earl and Karl, with comparison to collocated SFMR retrievals and WP3D Fuselage Radar images for validation purposes.

Improving Concept-Based Web Image Retrieval by Mixing Semantically Similar Greek Queries

ERIC Educational Resources Information Center

Lazarinis, Fotis

2008-01-01

Purpose: Image searching is a common activity for web users. Search engines offer image retrieval services based on textual queries. Previous studies have shown that web searching is more demanding when the search is not in English and does not use a Latin-based language. The aim of this paper is to explore the behaviour of the major search…

Liquid water path retrieval using the lowest frequency channels of Fengyun-3C Microwave Radiation Imager (MWRI)

NASA Astrophysics Data System (ADS)

Tang, Fei; Zou, Xiaolei

2017-12-01

The Microwave Radiation Imager (MWRI) on board Chinese Fengyun-3 (FY-3) satellites provides measurements at 10.65, 18.7, 23.8, 36.5, and 89.0 GHz with both horizontal and vertical polarization channels. Brightness temperature measurements of those channels with their central frequencies higher than 19 GHz from satellite-based microwave imager radiometers had traditionally been used to retrieve cloud liquid water path (LWP) over ocean. The results show that the lowest frequency channels are the most appropriate for retrieving LWP when its values are large. Therefore, a modified LWP retrieval algorithm is developed for retrieving LWP of different magnitudes involving not only the high frequency channels but also the lowest frequency channels of FY-3 MWRI. The theoretical estimates of the LWP retrieval errors are between 0.11 and 0.06 mm for 10.65- and 18.7-GHz channels and between 0.02 and 0.04 mm for 36.5- and 89.0-GHz channels. It is also shown that the brightness temperature observations at 10.65 GHz can be utilized to better retrieve the LWP greater than 3 mm in the eyewall region of Super Typhoon Neoguri (2014). The spiral structure of clouds within and around Typhoon Neoguri can be well captured by combining the LWP retrievals from different frequency channels.

A method for retrieving vertical ozone profiles from limb scattered measurements

NASA Astrophysics Data System (ADS)

Wang, Zijun; Chen, Shengbo; Yang, Chunyan; Jin, Lihua

2011-10-01

A two-step method is employed in this study to retrieve vertical ozone profiles using scattered measurements from the limb of the atmosphere. The combination of the Differential Optical Absorption Spectroscopy (DOAS) and the Multiplicative Algebraic Reconstruction Technique (MART) is proposed. First, the limb radiance, measured over a range of tangent heights, is processed using the DOAS technique to recover the effective column densities of atmospheric ozone. Second, these effective column densities along the lines of sight (LOSs) are inverted using the MART coupled with a forward model SCIATRAN (radiative transfer model for SCIAMACHY) to derive the ozone profiles. This method is applied to Optical Spectrograph and Infra Red Imager System (OSIRIS) radiance, using the wavelength windows 571-617 nm. Vertical ozone profiles between 10 and 48 km are derived with a vertical resolution of 1 km. The results illustrate a good agreement with the cloud-free coincident SCanning Imaging Absorption spectroMeter for Atmospheric CHartographY (SCIAMACHY) ozone measurements, with deviations less than ±10% (±5% for altitudes from 17 to 47 km). Furthermore, sensitivities of retrieved ozone to aerosol, cloud parameters and NO2 concentration are also investigated.

Near-Real Time Satellite-Retrieved Cloud and Surface Properties for Weather and Aviation Safety Applications

NASA Technical Reports Server (NTRS)

Minnis, Patrick; Smith, William L., Jr.; Bedka, Kristopher M.; Nguyen, Louis; Palikonda, Rabindra; Hong, Gang; Trepte, Qing Z.; Chee, Thad; Scarino, Benjamin; Spangenberg, Douglas A.;

Near-Real Time Satellite-Retrieved Cloud and Surface Properties for Weather and Aviation Safety Applications

NASA Astrophysics Data System (ADS)

Minnis, P.; Smith, W., Jr.; Bedka, K. M.; Nguyen, L.; Palikonda, R.; Hong, G.; Trepte, Q.; Chee, T.; Scarino, B. R.; Spangenberg, D.; Sun-Mack, S.; Fleeger, C.; Ayers, J. K.; Chang, F. L.; Heck, P. W.

2014-12-01

Cloud properties determined from satellite imager radiances provide a valuable source of information for nowcasting and weather forecasting. In recent years, it has been shown that assimilation of cloud top temperature, optical depth, and total water path can increase the accuracies of weather analyses and forecasts. Aircraft icing conditions can be accurately diagnosed in near-real time (NRT) retrievals of cloud effective particle size, phase, and water path, providing valuable data for pilots. NRT retrievals of surface skin temperature can also be assimilated in numerical weather prediction models to provide more accurate representations of solar heating and longwave cooling at the surface, where convective initiation. These and other applications are being exploited more frequently as the value of NRT cloud data become recognized. At NASA Langley, cloud properties and surface skin temperature are being retrieved in near-real time globally from both geostationary (GEO) and low-earth orbiting (LEO) satellite imagers for weather model assimilation and nowcasting for hazards such as aircraft icing. Cloud data from GEO satellites over North America are disseminated through NCEP, while those data and global LEO and GEO retrievals are disseminated from a Langley website. This paper presents an overview of the various available datasets, provides examples of their application, and discusses the use of the various datasets downstream. Future challenges and areas of improvement are also presented.

Retrieval of the thickness of undeformed sea ice from simulated C-band compact polarimetric SAR images

NASA Astrophysics Data System (ADS)

Zhang, Xi; Dierking, Wolfgang; Zhang, Jie; Meng, Junmin; Lang, Haitao

2016-07-01

In this paper we introduce a parameter for the retrieval of the thickness of undeformed first-year sea ice that is specifically adapted to compact polarimetric (CP) synthetic aperture radar (SAR) images. The parameter is denoted as the "CP ratio". In model simulations we investigated the sensitivity of the CP ratio to the dielectric constant, ice thickness, ice surface roughness, and radar incidence angle. From the results of the simulations we deduced optimal sea ice conditions and radar incidence angles for the ice thickness retrieval. C-band SAR data acquired over the Labrador Sea in circular transmit and linear receive (CTLR) mode were generated from RADARSAT-2 quad-polarization images. In comparison with results from helicopter-borne measurements, we tested different empirical equations for the retrieval of ice thickness. An exponential fit between the CP ratio and ice thickness provides the most reliable results. Based on a validation using other compact polarimetric SAR images from the same region, we found a root mean square (rms) error of 8 cm and a maximum correlation coefficient of 0.94 for the retrieval procedure when applying it to level ice between 0.1 and 0.8 m thick.

Phase retrieval on broadband and under-sampled images for the JWST testbed telescope

NASA Astrophysics Data System (ADS)

Smith, J. Scott; Aronstein, David L.; Dean, Bruce H.; Acton, D. Scott

2009-08-01

The James Webb Space Telescope (JWST) consists of an optical telescope element (OTE) that sends light to five science instruments. The initial steps for commissioning the telescope are performed with the Near-Infrared Camera (NIRCam) instrument, but low-order optical aberrations in the remaining science instruments must be determined (using phase retrieval) in order to ensure good performance across the entire field of view. These remaining instruments were designed to collect science data, and not to serve as wavefront sensors. Thus, the science cameras are not ideal phase-retrieval imagers for several reasons: they record under-sampled data and have a limited range of diversity defocus, and only one instrument has an internal, narrowband filter. To address these issues, we developed the capability of sensing these aberrations using an extension of image-based iterative-transform phase retrieval called Variable Sampling Mapping (VSM). The results show that VSM-based phase retrieval is capable of sensing low-order aberrations to a few nm RMS from images that are consistent with the non-ideal conditions expected during JWST multi-field commissioning. The algorithm is validated using data collected from the JWST Testbed Telescope (TBT).

Conjugate gradient method for phase retrieval based on the Wirtinger derivative.

PubMed

Wei, Zhun; Chen, Wen; Qiu, Cheng-Wei; Chen, Xudong

2017-05-01

A conjugate gradient Wirtinger flow (CG-WF) algorithm for phase retrieval is proposed in this paper. It is shown that, compared with recently reported Wirtinger flow and its modified methods, the proposed CG-WF algorithm is able to dramatically accelerate the convergence rate while keeping the dominant computational cost of each iteration unchanged. We numerically illustrate the effectiveness of our method in recovering 1D Gaussian signals and 2D natural color images under both Gaussian and coded diffraction pattern models.

Imaging episodic memory: implications for cognitive theories and phenomena.

PubMed

Nyberg, L

1999-01-01

Functional neuroimaging studies are beginning to identify neuroanatomical correlates of various cognitive functions. This paper presents results relevant to several theories and phenomena of episodic memory, including component processes of episodic retrieval, encoding specificity, inhibition, item versus source memory, encoding-retrieval overlap, and the picture-superiority effect. Overall, by revealing specific activation patterns, the results provide support for existing theoretical views and they add some unique information which may be important to consider in future attempts to develop cognitive theories of episodic memory.

Phase retrieval of images using Gaussian radial bases.

PubMed

Trahan, Russell; Hyland, David

2013-12-20

Here, the possibility of a noniterative solution to the phase retrieval problem is explored. A new look is taken at the phase retrieval problem that reveals that knowledge of a diffraction pattern's frequency components is enough to recover the image without projective iterations. This occurs when the image is formed using Gaussian bases that give the convenience of a continuous Fourier transform existing in a compact form where square pixels do not. The Gaussian bases are appropriate when circular apertures are used to detect the diffraction pattern because of their optical transfer functions, as discussed briefly. An algorithm is derived that is capable of recovering an image formed by Gaussian bases from only the Fourier transform's modulus, without background constraints. A practical example is shown.

Multivariate analysis: A statistical approach for computations

NASA Astrophysics Data System (ADS)

Michu, Sachin; Kaushik, Vandana

2014-10-01

Multivariate analysis is a type of multivariate statistical approach commonly used in, automotive diagnosis, education evaluating clusters in finance etc and more recently in the health-related professions. The objective of the paper is to provide a detailed exploratory discussion about factor analysis (FA) in image retrieval method and correlation analysis (CA) of network traffic. Image retrieval methods aim to retrieve relevant images from a collected database, based on their content. The problem is made more difficult due to the high dimension of the variable space in which the images are represented. Multivariate correlation analysis proposes an anomaly detection and analysis method based on the correlation coefficient matrix. Anomaly behaviors in the network include the various attacks on the network like DDOs attacks and network scanning.

Combining semantic technologies with a content-based image retrieval system - Preliminary considerations

NASA Astrophysics Data System (ADS)

Chmiel, P.; Ganzha, M.; Jaworska, T.; Paprzycki, M.

2017-10-01

Nowadays, as a part of systematic growth of volume, and variety, of information that can be found on the Internet, we observe also dramatic increase in sizes of available image collections. There are many ways to help users browsing / selecting images of interest. One of popular approaches are Content-Based Image Retrieval (CBIR) systems, which allow users to search for images that match their interests, expressed in the form of images (query by example). However, we believe that image search and retrieval could take advantage of semantic technologies. We have decided to test this hypothesis. Specifically, on the basis of knowledge captured in the CBIR, we have developed a domain ontology of residential real estate (detached houses, in particular). This allows us to semantically represent each image (and its constitutive architectural elements) represented within the CBIR. The proposed ontology was extended to capture not only the elements resulting from image segmentation, but also "spatial relations" between them. As a result, a new approach to querying the image database (semantic querying) has materialized, thus extending capabilities of the developed system.

Space Images for NASA JPL Android Version

NASA Technical Reports Server (NTRS)

Nelson, Jon D.; Gutheinz, Sandy C.; Strom, Joshua R.; Arca, Jeremy M.; Perez, Martin; Boggs, Karen; Stanboli, Alice

2013-01-01

This software addresses the demand for easily accessible NASA JPL images and videos by providing a user friendly and simple graphical user interface that can be run via the Android platform from any location where Internet connection is available. This app is complementary to the iPhone version of the application. A backend infrastructure stores, tracks, and retrieves space images from the JPL Photojournal and Institutional Communications Web server, and catalogs the information into a streamlined rating infrastructure. This system consists of four distinguishing components: image repository, database, server-side logic, and Android mobile application. The image repository contains images from various JPL flight projects. The database stores the image information as well as the user rating. The server-side logic retrieves the image information from the database and categorizes each image for display. The Android mobile application is an interfacing delivery system that retrieves the image information from the server for each Android mobile device user. Also created is a reporting and tracking system for charting and monitoring usage. Unlike other Android mobile image applications, this system uses the latest emerging technologies to produce image listings based directly on user input. This allows for countless combinations of images returned. The backend infrastructure uses industry-standard coding and database methods, enabling future software improvement and technology updates. The flexibility of the system design framework permits multiple levels of display possibilities and provides integration capabilities. Unique features of the software include image/video retrieval from a selected set of categories, image Web links that can be shared among e-mail users, sharing to Facebook/Twitter, marking as user's favorites, and image metadata searchable for instant results.

Atmospheric correction of short-wave hyperspectral imagery using a fast, full-scattering 1DVar retrieval scheme

NASA Astrophysics Data System (ADS)

Thelen, J.-C.; Havemann, S.; Taylor, J. P.

2012-06-01

Here, we present a new prototype algorithm for the simultaneous retrieval of the atmospheric profiles (temperature, humidity, ozone and aerosol) and the surface reflectance from hyperspectral radiance measurements obtained from air/space-borne, hyperspectral imagers such as the 'Airborne Visible/Infrared Imager (AVIRIS) or Hyperion on board of the Earth Observatory 1. The new scheme, proposed here, consists of a fast radiative transfer code, based on empirical orthogonal functions (EOFs), in conjunction with a 1D-Var retrieval scheme. The inclusion of an 'exact' scattering code based on spherical harmonics, allows for an accurate treatment of Rayleigh scattering and scattering by aerosols, water droplets and ice-crystals, thus making it possible to also retrieve cloud and aerosol optical properties, although here we will concentrate on non-cloudy scenes. We successfully tested this new approach using two hyperspectral images taken by AVIRIS, a whiskbroom imaging spectrometer operated by the NASA Jet Propulsion Laboratory.

Phase Retrieval Using a Genetic Algorithm on the Systematic Image-Based Optical Alignment Testbed

NASA Technical Reports Server (NTRS)

Taylor, Jaime R.

2003-01-01

NASA s Marshall Space Flight Center s Systematic Image-Based Optical Alignment (SIBOA) Testbed was developed to test phase retrieval algorithms and hardware techniques. Individuals working with the facility developed the idea of implementing phase retrieval by breaking the determination of the tip/tilt of each mirror apart from the piston motion (or translation) of each mirror. Presented in this report is an algorithm that determines the optimal phase correction associated only with the piston motion of the mirrors. A description of the Phase Retrieval problem is first presented. The Systematic Image-Based Optical Alignment (SIBOA) Testbeb is then described. A Discrete Fourier Transform (DFT) is necessary to transfer the incoming wavefront (or estimate of phase error) into the spatial frequency domain to compare it with the image. A method for reducing the DFT to seven scalar/matrix multiplications is presented. A genetic algorithm is then used to search for the phase error. The results of this new algorithm on a test problem are presented.

Fast large-scale object retrieval with binary quantization

NASA Astrophysics Data System (ADS)

Zhou, Shifu; Zeng, Dan; Shen, Wei; Zhang, Zhijiang; Tian, Qi

2015-11-01

The objective of large-scale object retrieval systems is to search for images that contain the target object in an image database. Where state-of-the-art approaches rely on global image representations to conduct searches, we consider many boxes per image as candidates to search locally in a picture. In this paper, a feature quantization algorithm called binary quantization is proposed. In binary quantization, a scale-invariant feature transform (SIFT) feature is quantized into a descriptive and discriminative bit-vector, which allows itself to adapt to the classic inverted file structure for box indexing. The inverted file, which stores the bit-vector and box ID where the SIFT feature is located inside, is compact and can be loaded into the main memory for efficient box indexing. We evaluate our approach on available object retrieval datasets. Experimental results demonstrate that the proposed approach is fast and achieves excellent search quality. Therefore, the proposed approach is an improvement over state-of-the-art approaches for object retrieval.

Memory-effect based deconvolution microscopy for super-resolution imaging through scattering media

NASA Astrophysics Data System (ADS)

Edrei, Eitan; Scarcelli, Giuliano

2016-09-01

High-resolution imaging through turbid media is a fundamental challenge of optical sciences that has attracted a lot of attention in recent years for its wide range of potential applications. Here, we demonstrate that the resolution of imaging systems looking behind a highly scattering medium can be improved below the diffraction-limit. To achieve this, we demonstrate a novel microscopy technique enabled by the optical memory effect that uses a deconvolution image processing and thus it does not require iterative focusing, scanning or phase retrieval procedures. We show that this newly established ability of direct imaging through turbid media provides fundamental and practical advantages such as three-dimensional refocusing and unambiguous object reconstruction.

Memory-effect based deconvolution microscopy for super-resolution imaging through scattering media.

PubMed

Edrei, Eitan; Scarcelli, Giuliano

2016-09-16

High-resolution imaging through turbid media is a fundamental challenge of optical sciences that has attracted a lot of attention in recent years for its wide range of potential applications. Here, we demonstrate that the resolution of imaging systems looking behind a highly scattering medium can be improved below the diffraction-limit. To achieve this, we demonstrate a novel microscopy technique enabled by the optical memory effect that uses a deconvolution image processing and thus it does not require iterative focusing, scanning or phase retrieval procedures. We show that this newly established ability of direct imaging through turbid media provides fundamental and practical advantages such as three-dimensional refocusing and unambiguous object reconstruction.

An end to end secure CBIR over encrypted medical database.

PubMed

Bellafqira, Reda; Coatrieux, Gouenou; Bouslimi, Dalel; Quellec, Gwenole

2016-08-01

In this paper, we propose a new secure content based image retrieval (SCBIR) system adapted to the cloud framework. This solution allows a physician to retrieve images of similar content within an outsourced and encrypted image database, without decrypting them. Contrarily to actual CBIR approaches in the encrypted domain, the originality of the proposed scheme stands on the fact that the features extracted from the encrypted images are themselves encrypted. This is achieved by means of homomorphic encryption and two non-colluding servers, we however both consider as honest but curious. In that way an end to end secure CBIR process is ensured. Experimental results carried out on a diabetic retinopathy database encrypted with the Paillier cryptosystem indicate that our SCBIR achieves retrieval performance as good as if images were processed in their non-encrypted form.

Quantifying Vegetation Biophysical Variables from Imaging Spectroscopy Data: A Review on Retrieval Methods

NASA Astrophysics Data System (ADS)

Verrelst, Jochem; Malenovský, Zbyněk; Van der Tol, Christiaan; Camps-Valls, Gustau; Gastellu-Etchegorry, Jean-Philippe; Lewis, Philip; North, Peter; Moreno, Jose

2018-06-01

An unprecedented spectroscopic data stream will soon become available with forthcoming Earth-observing satellite missions equipped with imaging spectroradiometers. This data stream will open up a vast array of opportunities to quantify a diversity of biochemical and structural vegetation properties. The processing requirements for such large data streams require reliable retrieval techniques enabling the spatiotemporally explicit quantification of biophysical variables. With the aim of preparing for this new era of Earth observation, this review summarizes the state-of-the-art retrieval methods that have been applied in experimental imaging spectroscopy studies inferring all kinds of vegetation biophysical variables. Identified retrieval methods are categorized into: (1) parametric regression, including vegetation indices, shape indices and spectral transformations; (2) nonparametric regression, including linear and nonlinear machine learning regression algorithms; (3) physically based, including inversion of radiative transfer models (RTMs) using numerical optimization and look-up table approaches; and (4) hybrid regression methods, which combine RTM simulations with machine learning regression methods. For each of these categories, an overview of widely applied methods with application to mapping vegetation properties is given. In view of processing imaging spectroscopy data, a critical aspect involves the challenge of dealing with spectral multicollinearity. The ability to provide robust estimates, retrieval uncertainties and acceptable retrieval processing speed are other important aspects in view of operational processing. Recommendations towards new-generation spectroscopy-based processing chains for operational production of biophysical variables are given.

Automatic Detection of Galaxy Type From Datasets of Galaxies Image Based on Image Retrieval Approach.

PubMed

Abd El Aziz, Mohamed; Selim, I M; Xiong, Shengwu

2017-06-30

This paper presents a new approach for the automatic detection of galaxy morphology from datasets based on an image-retrieval approach. Currently, there are several classification methods proposed to detect galaxy types within an image. However, in some situations, the aim is not only to determine the type of galaxy within the queried image, but also to determine the most similar images for query image. Therefore, this paper proposes an image-retrieval method to detect the type of galaxies within an image and return with the most similar image. The proposed method consists of two stages, in the first stage, a set of features is extracted based on shape, color and texture descriptors, then a binary sine cosine algorithm selects the most relevant features. In the second stage, the similarity between the features of the queried galaxy image and the features of other galaxy images is computed. Our experiments were performed using the EFIGI catalogue, which contains about 5000 galaxies images with different types (edge-on spiral, spiral, elliptical and irregular). We demonstrate that our proposed approach has better performance compared with the particle swarm optimization (PSO) and genetic algorithm (GA) methods.

[PACS: storage and retrieval of digital radiological image data].

PubMed

Wirth, S; Treitl, M; Villain, S; Lucke, A; Nissen-Meyer, S; Mittermaier, I; Pfeifer, K-J; Reiser, M

2005-08-01

Efficient handling of both picture archiving and retrieval is a crucial factor when new PACS installations as well as technical upgrades are planned. For a large PACS installation for 200 actual studies, the number, modality,and body region of available priors were evaluated. In addition, image access time of 100 CT studies from hard disk (RAID), magneto-optic disk (MOD), and tape archives (TAPE) were accessed. For current examinations priors existed in 61.1% with an averaged quantity of 7.7 studies. Thereof 56.3% were within 0-3 months, 84.9% within 12 months, 91.7% within 24 months, and 96.2% within 36 months. On average, access to images from the hard disk cache was more than 100 times faster then from MOD or TAPE. Since only PACS RAID provides online image access, at least current imaging of the past 12 months should be available from cache. An accurate prefetching mechanism facilitates effective use of the expensive online cache area. For that, however, close interaction of PACS, RIS, and KIS is an indispensable prerequisite.

Active imaging with the aids of polarization retrieve in turbid media system

NASA Astrophysics Data System (ADS)

Tao, Qiangqiang; Sun, Yongxuan; Shen, Fei; Xu, Qiang; Gao, Jun; Guo, Zhongyi

2016-01-01

We propose a novel active imaging based on the polarization retrieve (PR) method in turbid media system. In our simulations, the Monte Carlo (MC) algorithm has been used to investigate the scattering process between the incident photons and the scattering particles, and the visually concordant object but with different polarization characteristics in different regions, has been selected as the original target that is placed in the turbid media. Under linearly and circularly polarized illuminations, the simulation results demonstrate that the corresponding polarization properties can provide additional information for the imaging, and the contrast of the polarization image can also be enhanced greatly compared to the simplex intensity image in the turbid media. Besides, the polarization image adjusted by the PR method can further enhance the visibility and contrast. In addition, by PR imaging method, with the increasing particles' size in Mie's scale, the visibility can be enhanced, because of the increased forward scattering effect. In general, in the same circumstance, the circular polarization images can offer a better contrast and visibility than that of linear ones. The results indicate that the PR imaging method is more applicable to the scattering media system with relatively larger particles such as aerosols, heavy fog, cumulus, and seawater, as well as to biological tissues and blood media.

Effect of emotional valence on retrieval-related recapitulation of encoding activity in the ventral visual stream

PubMed Central

Kark, Sarah M.; Kensinger, Elizabeth A.

2015-01-01

While prior work has shown greater retrieval-related reactivation in the ventral visual stream for emotional stimuli compared to neutral stimuli, the effects of valence on retrieval-related recapitulation of successful encoding processes (Dm effects) have yet to be investigated. Here, seventeen participants (aged 19–35) studied line drawings of negative, positive, or neutral images followed immediately by the complete photo. After a 20-minute delay, participants performed a challenging recognition memory test, distinguishing the studied line drawing outlines from novel ones. First, results replicated earlier work by demonstrating that negative and positive hits elicited greater ventral occipito-temporal cortex (VOTC) activity than neutral hits during both encoding and retrieval. Moreover, the amount of activation in portions of the VOTC correlated with the magnitude of participants’ emotional memory enhancement. Second, results revealed significant retrieval-related recapitulation of Dm effects (Hits > Misses) in VOTC (anterior inferior temporal gyri) only for negative stimuli. Third, connectivity between the amygdala and fusiform gyrus during the encoding of negative stimuli increased the likelihood of fusiform activation during successful retrieval. Together, these results suggest that recapitulation in posterior VOTC reflects memory for the affective dimension of the stimuli (Emotional Hits > Neutral Hits) and the magnitude of activation in some of these regions is related to superior emotional memory. Moreover, for negative stimuli, recapitulation in more anterior portions of the VOTC is greater for remembered than forgotten items. The current study offers new evidence for effects of emotion on recapitulation of activity and functional connectivity in support of memory. PMID:26459096

Effect of emotional valence on retrieval-related recapitulation of encoding activity in the ventral visual stream.

PubMed

Kark, Sarah M; Kensinger, Elizabeth A

2015-11-01

While prior work has shown greater retrieval-related reactivation in the ventral visual stream for emotional stimuli compared to neutral stimuli, the effects of valence on retrieval-related recapitulation of successful encoding processes (Dm effects) have yet to be investigated. Here, seventeen participants (aged 19-35) studied line drawings of negative, positive, or neutral images followed immediately by the complete photo. After a 20-min delay, participants performed a challenging recognition memory test, distinguishing the studied line drawing outlines from novel ones. First, results replicated earlier work by demonstrating that negative and positive hits elicited greater ventral occipito-temporal cortex (VOTC) activity than neutral hits during both encoding and retrieval. Moreover, the amount of activation in portions of the VOTC correlated with the magnitude of participants' emotional memory enhancement. Second, results revealed significant retrieval-related recapitulation of Dm effects (Hits>Misses) in VOTC (anterior inferior temporal gyri) only for negative stimuli. Third, connectivity between the amygdala and fusiform gyrus during the encoding of negative stimuli increased the likelihood of fusiform activation during successful retrieval. Together, these results suggest that recapitulation in posterior VOTC reflects memory for the affective dimension of the stimuli (Emotional Hits>Neutral Hits) and the magnitude of activation in some of these regions is related to superior emotional memory. Moreover, for negative stimuli, recapitulation in more anterior portions of the VOTC is greater for remembered than forgotten items. The current study offers new evidence for effects of emotion on recapitulation of activity and functional connectivity in support of memory. Copyright © 2015 Elsevier Ltd. All rights reserved.

Phase-step retrieval for tunable phase-shifting algorithms

NASA Astrophysics Data System (ADS)

Ayubi, Gastón A.; Duarte, Ignacio; Perciante, César D.; Flores, Jorge L.; Ferrari, José A.

2017-12-01

Phase-shifting (PS) is a well-known technique for phase retrieval in interferometry, with applications in deflectometry and 3D-profiling, which requires a series of intensity measurements with certain phase-steps. Usually the phase-steps are evenly spaced, and its knowledge is crucial for the phase retrieval. In this work we present a method to extract the phase-step between consecutive interferograms. We test the proposed technique with images corrupted by additive noise. The results were compared with other known methods. We also present experimental results showing the performance of the method when spatial filters are applied to the interferograms and the effect that they have on their relative phase-steps.

Synergistic Instance-Level Subspace Alignment for Fine-Grained Sketch-Based Image Retrieval.

PubMed

Li, Ke; Pang, Kaiyue; Song, Yi-Zhe; Hospedales, Timothy M; Xiang, Tao; Zhang, Honggang

2017-08-25

We study the problem of fine-grained sketch-based image retrieval. By performing instance-level (rather than category-level) retrieval, it embodies a timely and practical application, particularly with the ubiquitous availability of touchscreens. Three factors contribute to the challenging nature of the problem: (i) free-hand sketches are inherently abstract and iconic, making visual comparisons with photos difficult, (ii) sketches and photos are in two different visual domains, i.e. black and white lines vs. color pixels, and (iii) fine-grained distinctions are especially challenging when executed across domain and abstraction-level. To address these challenges, we propose to bridge the image-sketch gap both at the high-level via parts and attributes, as well as at the low-level, via introducing a new domain alignment method. More specifically, (i) we contribute a dataset with 304 photos and 912 sketches, where each sketch and image is annotated with its semantic parts and associated part-level attributes. With the help of this dataset, we investigate (ii) how strongly-supervised deformable part-based models can be learned that subsequently enable automatic detection of part-level attributes, and provide pose-aligned sketch-image comparisons. To reduce the sketch-image gap when comparing low-level features, we also (iii) propose a novel method for instance-level domain-alignment, that exploits both subspace and instance-level cues to better align the domains. Finally (iv) these are combined in a matching framework integrating aligned low-level features, mid-level geometric structure and high-level semantic attributes. Extensive experiments conducted on our new dataset demonstrate effectiveness of the proposed method.

A genome-wide supported variant in CACNA1C influences hippocampal activation during episodic memory encoding and retrieval.

PubMed

Krug, Axel; Witt, Stephanie H; Backes, Heidelore; Dietsche, Bruno; Nieratschker, Vanessa; Shah, N Jon; Nöthen, Markus M; Rietschel, Marcella; Kircher, Tilo

2014-03-01

The alpha 1C subunit of the L-type voltage-gated calcium channel (CACNA1C) gene is one of the best replicated susceptibility loci for bipolar disorder, schizophrenia and major depression. It is involved in learning, memory and brain plasticity. Genetic studies using functional magnetic resonance imaging (fMRI) reported evidence of association with the CACNA1C single nucleotide polymorphism rs1006737 with functional correlates of episodic memory encoding and retrieval, especially activations in the hippocampus. These results, however, are inconsistent with regard to the magnitude and directionality of effect. In the present study, brain activation was measured with fMRI during an episodic memory encoding and retrieval task using neutral faces in two independent samples of 94 and 111 healthy subjects, respectively. Within whole brain analyses, a main effect of genotype emerged mainly in the right hippocampus during encoding as well as retrieval within the first sample: Carriers of the minor allele (A) exhibited lower activations compared to G/G allele carriers. This effect could be replicated within the second sample, however, only for the retrieval condition. The results strengthen findings that rs1006737 is associated with neural systems related to memory processes in hippocampal regions which are detectable in healthy subjects.

Optical properties of aerosol contaminated cloud derived from MODIS instrument

NASA Astrophysics Data System (ADS)

Mei, Linlu; Rozanov, Vladimir; Lelli, Luca; Vountas, Marco; Burrows, John P.

2016-04-01

The presence of absorbing aerosols above/within cloud can reduce the amount of up-welling radiation in visible (VIS) and short-wave infrared and darken the spectral reflectance when compared with a spectrum of a clean cloud observed by satellite instruments (Jethva et al., 2013). Cloud properties retrieval for aerosol contaminated cases is a great challenge. Even small additional injection of aerosol particles into clouds in the cleanest regions of Earth's atmosphere will cause significant effect on those clouds and on climate forcing (Koren et al., 2014; Rosenfeld et al., 2014) because the micro-physical cloud process are non-linear with respect to the aerosol loading. The current cloud products like Moderate Resolution Imaging Spectroradiometer (MODIS) ignoring the aerosol effect for the retrieval, which may cause significant error in the satellite-derived cloud properties. In this paper, a new cloud properties retrieval method, considering aerosol effect, based on the weighting-function (WF) method, is presented. The retrieval results shows that the WF retrieved cloud properties (e.g COT) agrees quite well with MODIS COT product for relative clear atmosphere (AOT ≤ 0.4) while there is a large difference for large aerosol loading. The MODIS COT product is underestimated for at least 2 - 3 times for AOT>0.4, and this underestimation increases with the increase of AOT.

Document Indexing for Image-Based Optical Information Systems.

ERIC Educational Resources Information Center

Thiel, Thomas J.; And Others

1991-01-01

Discussion of image-based information retrieval systems focuses on indexing. Highlights include computerized information retrieval; multimedia optical systems; optical mass storage and personal computers; and a case study that describes an optical disk system which was developed to preserve, access, and disseminate military documents. (19…

Embedding intensity image into a binary hologram with strong noise resistant capability

NASA Astrophysics Data System (ADS)

Zhuang, Zhaoyong; Jiao, Shuming; Zou, Wenbin; Li, Xia

2017-11-01

A digital hologram can be employed as a host image for image watermarking applications to protect information security. Past research demonstrates that a gray level intensity image can be embedded into a binary Fresnel hologram by error diffusion method or bit truncation coding method. However, the fidelity of the retrieved watermark image from binary hologram is generally not satisfactory, especially when the binary hologram is contaminated with noise. To address this problem, we propose a JPEG-BCH encoding method in this paper. First, we employ the JPEG standard to compress the intensity image into a binary bit stream. Next, we encode the binary bit stream with BCH code to obtain error correction capability. Finally, the JPEG-BCH code is embedded into the binary hologram. By this way, the intensity image can be retrieved with high fidelity by a BCH-JPEG decoder even if the binary hologram suffers from serious noise contamination. Numerical simulation results show that the image quality of retrieved intensity image with our proposed method is superior to the state-of-the-art work reported.

Retrieval of long and short lists from long term memory: a functional magnetic resonance imaging study with human subjects.

PubMed

Zysset, S; Müller, K; Lehmann, C; Thöne-Otto, A I; von Cramon, D Y

2001-11-13

Previous studies have shown that reaction time in an item-recognition task with both short and long lists is a quadratic function of list length. This suggests that either different memory retrieval processes are implied for short and long lists or an adaptive process is involved. An event-related functional magnetic resonance imaging study with nine subjects and list lengths varying between 3 and 18 words was conducted to identify the underlying neuronal structures of retrieval from long and short lists. For the retrieval and processing of word-lists a single fronto-parietal network, including premotor, left prefrontal, left precuneal and left parietal regions, was activated. With increasing list length, no additional regions became involved in retrieving information from long-term memory, suggesting that not necessarily different, but highly adaptive retrieval processes are involved.

Set-relevance determines the impact of distractors on episodic memory retrieval.

PubMed

Kwok, Sze Chai; Shallice, Tim; Macaluso, Emiliano

2014-09-01

We investigated the interplay between stimulus-driven attention and memory retrieval with a novel interference paradigm that engaged both systems concurrently on each trial. Participants encoded a 45-min movie on Day 1 and, on Day 2, performed a temporal order judgment task during fMRI. Each retrieval trial comprised three images presented sequentially, and the task required participants to judge the temporal order of the first and the last images ("memory probes") while ignoring the second image, which was task irrelevant ("attention distractor"). We manipulated the content relatedness and the temporal proximity between the distractor and the memory probes, as well as the temporal distance between two probes. Behaviorally, short temporal distances between the probes led to reduced retrieval performance. Distractors that at encoding were temporally close to the first probe image reduced these costs, specifically when the distractor was content unrelated to the memory probes. The imaging results associated the distractor probe temporal proximity with activation of the right ventral attention network. By contrast, the precuneus was activated for high-content relatedness between distractors and probes and in trials including a short distance between the two memory probes. The engagement of the right ventral attention network by specific types of distractors suggests a link between stimulus-driven attention control and episodic memory retrieval, whereas the activation pattern of the precuneus implicates this region in memory search within knowledge/content-based hierarchies.

ALISEO on MIOSat: an imaging interferometer for earth observation

NASA Astrophysics Data System (ADS)

Barducci, A.; Castagnoli, F.; Castellini, G.; Guzzi, D.; Marcoionni, P.; Pippi, I.

2017-11-01

The Italian Space Agency (ASI) decided to perform an low cost Earth observation mission based on a new mini satellite named MIOsat which will carry various technological payloads. Among them an imaging interferometer designed and now ready to be assembled and tested by our Institute. The instrument, named ALISEO (Aerospace Leap-frog Imaging Stationary interferometer for Earth Observation), operates in the common-path Sagnac configuration, and it does not utilize any moving part to scan the phase delays between the two interfering beams. The sensor acquires target images modulated by a pattern of autocorrelation functions of the energy coming from each scene pixel, and the resulting fringe pattern remains spatially fixed with respect to the instrument's field-of-view. The complete interferogram of each target location is retrieved by introducing a relative source-observer motion, which allows any image pixels to be observed under different viewing-angles and experience discrete path differences. The paper describes the main characteristics of the imaging interferometer as well as the overall optical configuration and the electronics layout. Moreover some theoretical issues concerning sampling theory in "common path" imaging interferometry are investigated. The experimental activity performed in laboratory is presented and its outcomes are analysed. Particularly, a set of measurements has been carried out using both standard (certificate) reflectance tiles and natural samples of different volcanic rocks. An algorithm for raw data pre-processing aimed at retrieving the at-sensor radiance spectrum is introduced and its performance is addressed by taking into account various issues such as dark signal subtraction, spectral instrument response compensation, effects of vignetting, and Fourier backtransform. Finally, examples of retrieved absolute reflectance of several samples are sketched at different wavelengths.

Satellite aerosol retrieval using dark target algorithm by coupling BRDF effect over AERONET site

NASA Astrophysics Data System (ADS)

Yang, Leiku; Xue, Yong; Guang, Jie; Li, Chi

2012-11-01

For most satellite aerosol retrieval algorithms even for multi-angle instrument, the simple forward model (FM) based on Lambertian surface assumption is employed to simulate top of the atmosphere (TOA) spectral reflectance, which does not fully consider the surface bi-directional reflectance functions (BRDF) effect. The approximating forward model largely simplifies the radiative transfer model, reduces the size of the look-up tables, and creates faster algorithm. At the same time, it creates systematic biases in the aerosol optical depth (AOD) retrieval. AOD product from the Moderate Resolution Imaging Spectro-radiometer (MODIS) data based on the dark target algorithm is considered as one of accurate satellite aerosol products at present. Though it performs well at a global scale, uncertainties are still found on regional in a lot of studies. The Lambertian surface assumpiton employed in the retrieving algorithm may be one of the uncertain factors. In this study, we first use radiative transfer simulations over dark target to assess the uncertainty to what extent is introduced from the Lambertian surface assumption. The result shows that the uncertainties of AOD retrieval could reach up to ±0.3. Then the Lambertian FM (L_FM) and the BRDF FM (BRDF_FM) are respectively employed in AOD retrieval using dark target algorithm from MODARNSS (MODIS/Terra and MODIS/Aqua Atmosphere Aeronet Subsetting Product) data over Beijing AERONET site. The validation shows that accuracy in AOD retrieval has been improved by employing the BRDF_FM accounting for the surface BRDF effect, the regression slope of scatter plots with retrieved AOD against AEROENET AOD increases from 0.7163 (for L_FM) to 0.7776 (for BRDF_FM) and the intercept decreases from 0.0778 (for L_FM) to 0.0627 (for BRDF_FM).

Discrepancy Between ASTER- and MODIS- Derived Land Surface Temperatures: Terrain Effects

PubMed Central

Liu, Yuanbo; Noumi, Yousuke; Yamaguchi, Yasushi

2009-01-01

The MODerate resolution Imaging Spectroradiometer (MODIS) and the Advanced Spaceborne Thermal Emission Reflection Radiometer (ASTER) are onboard the same satellite platform NASA TERRA. Both MODIS and ASTER offer routine retrieval of land surface temperatures (LSTs), and the ASTER- and MODIS-retrieved LST products have been used worldwide. Because a large fraction of the earth surface consists of mountainous areas, variations in elevation, terrain slope and aspect angles can cause biases in the retrieved LSTs. However, terrain-induced effects are generally neglected in most satellite retrievals, which may generate discrepancy between ASTER and MODIS LSTs. In this paper, we reported the terrain effects on the LST discrepancy with a case examination over a relief area at the Loess Plateau of China. Results showed that the terrain-induced effects were not major, but nevertheless important for the total LST discrepancy. A large local slope did not necessarily lead to a large LST discrepancy. The angle of emitted radiance was more important than the angle of local slope in generating the LST discrepancy. Specifically, the conventional terrain correction may be unsuitable for densely vegetated areas. The distribution of ASTER-to-MODIS emissivity suggested that the terrain correction was included in the generalized split window (GSW) based approach used to rectify MODIS LSTs. Further study should include the classification-induced uncertainty in emissivity for reliable use of satellite-retrieved LSTs over relief areas. PMID:22399955

A Comparison of Foliage Profiles in the Sierra National Forest Obtained with a Full-Waveform Under-Canopy EVI Lidar System with the Foliage Profiles Obtained with an Airborne Full-Waveform LVIS Lidar System

NASA Technical Reports Server (NTRS)

Zhao, Feng; Yang, Xiaoyuan; Strahler, Alan H.; Schaaf, Crystal L.; Yao, Tian; Wang, Zhuosen; Roman, Miguel O.; Woodcock, Curtis E.; Ni-Meister, Wenge; Jupp, David L. B.;

Storage and retrieval properties of dual codes for pictures and words in recognition memory.

PubMed

Snodgrass, J G; McClure, P

1975-09-01

Storage and retrieval properties of pictures and words were studied within a recognition memory paradigm. Storage was manipulated by instructing subjects either to image or to verbalize to both picture and word stimuli during the study sequence. Retrieval was manipulated by representing a proportion of the old picture and word items in their opposite form during the recognition test (i.e., some old pictures were tested with their corresponding words and vice versa). Recognition performance for pictures was identical under the two instructional conditions, whereas recognition performance for words was markedly superior under the imagery instruction condition. It was suggested that subjects may engage in dual coding of simple pictures naturally, regardless of instructions, whereas dual coding of words may occur only under imagery instructions. The form of the test item had no effect on recognition performance for either type of stimulus and under either instructional condition. However, change of form of the test item markedly reduced item-by-item correlations between the two instructional conditions. It is tentatively proposed that retrieval is required in recognition, but that the effect of a form change is simply to make the retrieval process less consistent, not less efficient.

Cortical reinstatement and the confidence and accuracy of source memory.

PubMed

Thakral, Preston P; Wang, Tracy H; Rugg, Michael D

2015-04-01

Cortical reinstatement refers to the overlap between neural activity elicited during the encoding and the subsequent retrieval of an episode, and is held to reflect retrieved mnemonic content. Previous findings have demonstrated that reinstatement effects reflect the quality of retrieved episodic information as this is operationalized by the accuracy of source memory judgments. The present functional magnetic resonance imaging (fMRI) study investigated whether reinstatement-related activity also co-varies with the confidence of accurate source judgments. Participants studied pictures of objects along with their visual or spoken names. At test, they first discriminated between studied and unstudied pictures and then, for each picture judged as studied, they also judged whether it had been paired with a visual or auditory name, using a three-point confidence scale. Accuracy of source memory judgments- and hence the quality of the source-specifying information--was greater for high than for low confidence judgments. Modality-selective retrieval-related activity (reinstatement effects) also co-varied with the confidence of the corresponding source memory judgment. The findings indicate that the quality of the information supporting accurate judgments of source memory is indexed by the relative magnitude of content-selective, retrieval-related neural activity. Copyright © 2015 Elsevier Inc. All rights reserved.

An algorithm for estimating aerosol optical depth from HIMAWARI-8 data over Ocean

NASA Astrophysics Data System (ADS)

Lee, Kwon Ho

2016-04-01

The paper presents currently developing algorithm for aerosol detection and retrieval over ocean for the next generation geostationary satellite, HIMAWARI-8. Enhanced geostationary remote sensing observations are now enables for aerosol retrieval of dust, smoke, and ash, which began a new era of geostationary aerosol observations. Sixteen channels of the Advanced HIMAWARI Imager (AHI) onboard HIMAWARI-8 offer capabilities for aerosol remote sensing similar to those currently provided by the Moderate Resolution Imaging Spectroradiometer (MODIS). Aerosols were estimated in detection processing from visible and infrared channel radiances, and in retrieval processing using the inversion-optimization of satellite-observed radiances with those calculated from radiative transfer model. The retrievals are performed operationally every ten minutes for pixel sizes of ~8 km. The algorithm currently under development uses a multichannel approach to estimate the effective radius, aerosol optical depth (AOD) simultaneously. The instantaneous retrieved AOD is evaluated by the MODIS level 2 operational aerosol products (C006), and the daily retrieved AOD was compared with ground-based measurements from the AERONET databases. The results show that the detection of aerosol and estimated AOD are in good agreement with the MODIS data and ground measurements with a correlation coefficient of ˜0.90 and a bias of 4%. These results suggest that the proposed method applied to the HIMAWARI-8 satellite data can accurately estimate continuous AOD. Acknowledgments This work was supported by "Development of Geostationary Meteorological Satellite Ground Segment(NMSC-2014-01)" program funded by National Meteorological Satellite Centre(NMSC) of Korea Meteorological Administration(KMA).

Mutual information based feature selection for medical image retrieval

NASA Astrophysics Data System (ADS)

Zhi, Lijia; Zhang, Shaomin; Li, Yan

2018-04-01

In this paper, authors propose a mutual information based method for lung CT image retrieval. This method is designed to adapt to different datasets and different retrieval task. For practical applying consideration, this method avoids using a large amount of training data. Instead, with a well-designed training process and robust fundamental features and measurements, the method in this paper can get promising performance and maintain economic training computation. Experimental results show that the method has potential practical values for clinical routine application.

Developing a comprehensive system for content-based retrieval of image and text data from a national survey

NASA Astrophysics Data System (ADS)

Antani, Sameer K.; Natarajan, Mukil; Long, Jonathan L.; Long, L. Rodney; Thoma, George R.

2005-04-01

The article describes the status of our ongoing R&D at the U.S. National Library of Medicine (NLM) towards the development of an advanced multimedia database biomedical information system that supports content-based image retrieval (CBIR). NLM maintains a collection of 17,000 digitized spinal X-rays along with text survey data from the Second National Health and Nutritional Examination Survey (NHANES II). These data serve as a rich data source for epidemiologists and researchers of osteoarthritis and musculoskeletal diseases. It is currently possible to access these through text keyword queries using our Web-based Medical Information Retrieval System (WebMIRS). CBIR methods developed specifically for biomedical images could offer direct visual searching of these images by means of example image or user sketch. We are building a system which supports hybrid queries that have text and image-content components. R&D goals include developing algorithms for robust image segmentation for localizing and identifying relevant anatomy, labeling the segmented anatomy based on its pathology, developing suitable indexing and similarity matching methods for images and image features, and associating the survey text information for query and retrieval along with the image data. Some highlights of the system developed in MATLAB and Java are: use of a networked or local centralized database for text and image data; flexibility to incorporate new research work; provides a means to control access to system components under development; and use of XML for structured reporting. The article details the design, features, and algorithms in this third revision of this prototype system, CBIR3.

Remote sensing of cirrus cloud vertical size profile using MODIS data

NASA Astrophysics Data System (ADS)

Wang, Xingjuan; Liou, K. N.; Ou, Steve S. C.; Mace, G. G.; Deng, M.

2009-05-01

This paper describes an algorithm for inferring cirrus cloud top and cloud base effective particle sizes and cloud optical thickness from the Moderate Resolution Imaging Spectroradiometer (MODIS) 0.645, 1.64 and 2.13, and 3.75 μm band reflectances/radiances. This approach uses a successive minimization method based on a look-up library of precomputed reflectances/radiances from an adding-doubling radiative transfer program, subject to corrections for Rayleigh scattering at the 0.645 μm band, above-cloud water vapor absorption, and 3.75 μm thermal emission. The algorithmic accuracy and limitation of the retrieval method were investigated by synthetic retrievals subject to the instrument noise and the perturbation of input parameters. The retrieval algorithm was applied to three MODIS cirrus scenes over the Atmospheric Radiation Measurement Program's southern Great Plain site, north central China, and northeast Asia. The reliability of retrieved cloud optical thicknesses and mean effective particle sizes was evaluated by comparison with MODIS cloud products and qualitatively good correlations were obtained for all three cases, indicating that the performance of the vertical sizing algorithm is comparable with the MODIS retrieval program. Retrieved cloud top and cloud base ice crystal effective sizes were also compared with those derived from the collocated ground-based millimeter wavelength cloud radar for the first case and from the Cloud Profiling Radar onboard CloudSat for the other two cases. Differences between retrieved and radar-derived cloud properties are discussed in light of assumptions made in the collocation process and limitations in radar remote sensing characteristics.

Grating-based x-ray differential phase contrast imaging with twin peaks in phase-stepping curves—phase retrieval and dewrapping

DOE Office of Scientific and Technical Information (OSTI.GOV)

Yang, Yi; Xie, Huiqiao; Tang, Xiangyang, E-mail: xiangyang.tang@emory.edu

Purpose: X-ray differential phase contrast CT implemented with Talbot interferometry employs phase-stepping to extract information of x-ray attenuation, phase shift, and small-angle scattering. Since inaccuracy may exist in the absorption grating G{sub 2} due to an imperfect fabrication, the effective period of G{sub 2} can be as large as twice the nominal period, leading to a phenomenon of twin peaks that differ remarkably in their heights. In this work, the authors investigate how to retrieve and dewrap the phase signal from the phase-stepping curve (PSC) with the feature of twin peaks for x-ray phase contrast imaging. Methods: Based on themore » paraxial Fresnel–Kirchhoff theory, the analytical formulae to characterize the phenomenon of twin peaks in the PSC are derived. Then an approach to dewrap the retrieved phase signal by jointly using the phases of the first- and second-order Fourier components is proposed. Through an experimental investigation using a prototype x-ray phase contrast imaging system implemented with Talbot interferometry, the authors evaluate and verify the derived analytic formulae and the proposed approach for phase retrieval and dewrapping. Results: According to theoretical analysis, the twin-peak phenomenon in PSC is a consequence of combined effects, including the inaccuracy in absorption grating G{sub 2}, mismatch between phase grating and x-ray source spectrum, and finite size of x-ray tube’s focal spot. The proposed approach is experimentally evaluated by scanning a phantom consisting of organic materials and a lab mouse. The preliminary data show that compared to scanning G{sub 2} over only one single nominal period and correcting the measured phase signal with an intuitive phase dewrapping method that is being used in the field, stepping G{sub 2} over twice its nominal period and dewrapping the measured phase signal with the proposed approach can significantly improve the quality of x-ray differential phase contrast imaging in both radiograph and CT. Conclusions: Using the phase retrieval and dewrapping methods proposed to deal with the phenomenon of twin peaks in PSCs and phase wrapping, the performance of grating-based x-ray differential phase contrast radiography and CT can be significantly improved.« less

Coloured computational imaging with single-pixel detectors based on a 2D discrete cosine transform

NASA Astrophysics Data System (ADS)

Liu, Bao-Lei; Yang, Zhao-Hua; Liu, Xia; Wu, Ling-An

2017-02-01

We propose and demonstrate a computational imaging technique that uses structured illumination based on a two-dimensional discrete cosine transform to perform imaging with a single-pixel detector. A scene is illuminated by a projector with two sets of orthogonal patterns, then by applying an inverse cosine transform to the spectra obtained from the single-pixel detector a full-colour image is retrieved. This technique can retrieve an image from sub-Nyquist measurements, and the background noise is easily cancelled to give excellent image quality. Moreover, the experimental set-up is very simple.

A secure online image trading system for untrusted cloud environments.

PubMed

Munadi, Khairul; Arnia, Fitri; Syaryadhi, Mohd; Fujiyoshi, Masaaki; Kiya, Hitoshi

2015-01-01

In conventional image trading systems, images are usually stored unprotected on a server, rendering them vulnerable to untrusted server providers and malicious intruders. This paper proposes a conceptual image trading framework that enables secure storage and retrieval over Internet services. The process involves three parties: an image publisher, a server provider, and an image buyer. The aim is to facilitate secure storage and retrieval of original images for commercial transactions, while preventing untrusted server providers and unauthorized users from gaining access to true contents. The framework exploits the Discrete Cosine Transform (DCT) coefficients and the moment invariants of images. Original images are visually protected in the DCT domain, and stored on a repository server. Small representation of the original images, called thumbnails, are generated and made publicly accessible for browsing. When a buyer is interested in a thumbnail, he/she sends a query to retrieve the visually protected image. The thumbnails and protected images are matched using the DC component of the DCT coefficients and the moment invariant feature. After the matching process, the server returns the corresponding protected image to the buyer. However, the image remains visually protected unless a key is granted. Our target application is the online market, where publishers sell their stock images over the Internet using public cloud servers.

The MVACS Robotic Arm Camera

NASA Astrophysics Data System (ADS)

Keller, H. U.; Hartwig, H.; Kramm, R.; Koschny, D.; Markiewicz, W. J.; Thomas, N.; Fernades, M.; Smith, P. H.; Reynolds, R.; Lemmon, M. T.; Weinberg, J.; Marcialis, R.; Tanner, R.; Boss, B. J.; Oquest, C.; Paige, D. A.

2001-08-01

The Robotic Arm Camera (RAC) is one of the key instruments newly developed for the Mars Volatiles and Climate Surveyor payload of the Mars Polar Lander. This lightweight instrument employs a front lens with variable focus range and takes images at distances from 11 mm (image scale 1:1) to infinity. Color images with a resolution of better than 50 μm can be obtained to characterize the Martian soil. Spectral information of nearby objects is retrieved through illumination with blue, green, and red lamp sets. The design and performance of the camera are described in relation to the science objectives and operation. The RAC uses the same CCD detector array as the Surface Stereo Imager and shares the readout electronics with this camera. The RAC is mounted at the wrist of the Robotic Arm and can characterize the contents of the scoop, the samples of soil fed to the Thermal Evolved Gas Analyzer, the Martian surface in the vicinity of the lander, and the interior of trenches dug out by the Robotic Arm. It can also be used to take panoramic images and to retrieve stereo information with an effective baseline surpassing that of the Surface Stereo Imager by about a factor of 3.

A content-based retrieval of mammographic masses using the curvelet descriptor

NASA Astrophysics Data System (ADS)

Narváez, Fabian; Díaz, Gloria; Gómez, Francisco; Romero, Eduardo

2012-03-01

Computer-aided diagnosis (CAD) that uses content based image retrieval (CBIR) strategies has became an important research area. This paper presents a retrieval strategy that automatically recovers mammography masses from a virtual repository of mammographies. Unlike other approaches, we do not attempt to segment masses but instead we characterize the regions previously selected by an expert. These regions are firstly curvelet transformed and further characterized by approximating the marginal curvelet subband distribution with a generalized gaussian density (GGD). The content based retrieval strategy searches similar regions in a database using the Kullback-Leibler divergence as the similarity measure between distributions. The effectiveness of the proposed descriptor was assessed by comparing the automatically assigned label with a ground truth available in the DDSM database.1 A total of 380 masses with different shapes, sizes and margins were used for evaluation, resulting in a mean average precision rate of 89.3% and recall rate of 75.2% for the retrieval task.

Phase Retrieval on Undersampled Data from the Thermal Infrared Sensor (TIRS)

NASA Technical Reports Server (NTRS)

Bolcar, Matthew R.; Mentzell, Eric

2011-01-01

Phase retrieval was applied to under-sampled data from a thermal infrared imaging system to estimate defocus across the field of view (FOV). We compare phase retrieval estimated values to those obtained using an independent technique.

Re-engaging with the past: recapitulation of encoding operations during episodic retrieval

PubMed Central

Morcom, Alexa M.

2014-01-01

Recollection of events is accompanied by selective reactivation of cortical regions which responded to specific sensory and cognitive dimensions of the original events. This reactivation is thought to reflect the reinstatement of stored memory representations and therefore to reflect memory content, but it may also reveal processes which support both encoding and retrieval. The present study used event-related functional magnetic resonance imaging to investigate whether regions selectively engaged in encoding face and scene context with studied words are also re-engaged when the context is later retrieved. As predicted, encoding face and scene context with visually presented words elicited activity in distinct, context-selective regions. Retrieval of face and scene context also re-engaged some of the regions which had shown successful encoding effects. However, this recapitulation of encoding activity did not show the same context selectivity observed at encoding. Successful retrieval of both face and scene context re-engaged regions which had been associated with encoding of the other type of context, as well as those associated with encoding the same type of context. This recapitulation may reflect retrieval attempts which are not context-selective, but use shared retrieval cues to re-engage encoding operations in service of recollection. PMID:24904386

Translation position determination in ptychographic coherent diffraction imaging.

PubMed

Zhang, Fucai; Peterson, Isaac; Vila-Comamala, Joan; Diaz, Ana; Berenguer, Felisa; Bean, Richard; Chen, Bo; Menzel, Andreas; Robinson, Ian K; Rodenburg, John M

2013-06-03

Accurate knowledge of translation positions is essential in ptychography to achieve a good image quality and the diffraction limited resolution. We propose a method to retrieve and correct position errors during the image reconstruction iterations. Sub-pixel position accuracy after refinement is shown to be achievable within several tens of iterations. Simulation and experimental results for both optical and X-ray wavelengths are given. The method improves both the quality of the retrieved object image and relaxes the position accuracy requirement while acquiring the diffraction patterns.

Methods for coherent lensless imaging and X-ray wavefront measurements

NASA Astrophysics Data System (ADS)

Guizar Sicairos, Manuel

X-ray diffractive imaging is set apart from other high-resolution imaging techniques (e.g. scanning electron or atomic force microscopy) for its high penetration depth, which enables tomographic 3D imaging of thick samples and buried structures. Furthermore, using short x-ray pulses, it enables the capability to take ultrafast snapshots, giving a unique opportunity to probe nanoscale dynamics at femtosecond time scales. In this thesis we present improvements to phase retrieval algorithms, assess their performance through numerical simulations, and develop new methods for both imaging and wavefront measurement. Building on the original work by Faulkner and Rodenburg, we developed an improved reconstruction algorithm for phase retrieval with transverse translations of the object relative to the illumination beam. Based on gradient-based nonlinear optimization, this algorithm is capable of estimating the object, and at the same time refining the initial knowledge of the incident illumination and the object translations. The advantages of this algorithm over the original iterative transform approach are shown through numerical simulations. Phase retrieval has already shown substantial success in wavefront sensing at optical wavelengths. Although in principle the algorithms can be used at any wavelength, in practice the focus-diversity mechanism that makes optical phase retrieval robust is not practical to implement for x-rays. In this thesis we also describe the novel application of phase retrieval with transverse translations to the problem of x-ray wavefront sensing. This approach allows the characterization of the complex-valued x-ray field in-situ and at-wavelength and has several practical and algorithmic advantages over conventional focused beam measurement techniques. A few of these advantages include improved robustness through diverse measurements, reconstruction from far-field intensity measurements only, and significant relaxation of experimental requirements over other beam characterization approaches. Furthermore, we show that a one-dimensional version of this technique can be used to characterize an x-ray line focus produced by a cylindrical focusing element. We provide experimental demonstrations of the latter at hard x-ray wavelengths, where we have characterized the beams focused by a kinoform lens and an elliptical mirror. In both experiments the reconstructions exhibited good agreement with independent measurements, and in the latter a small mirror misalignment was inferred from the phase retrieval reconstruction. These experiments pave the way for the application of robust phase retrieval algorithms for in-situ alignment and performance characterization of x-ray optics for nanofocusing. We also present a study on how transverse translations help with the well-known uniqueness problem of one-dimensional phase retrieval. We also present a novel method for x-ray holography that is capable of reconstructing an image using an off-axis extended reference in a non-iterative computation, greatly generalizing an earlier approach by Podorov et al. The approach, based on the numerical application of derivatives on the field autocorrelation, was developed from first mathematical principles. We conducted a thorough theoretical study to develop technical and intuitive understanding of this technique and derived sufficient separation conditions required for an artifact-free reconstruction. We studied the effects of missing information in the Fourier domain, and of an imperfect reference, and we provide a signal-to-noise ratio comparison with the more traditional approach of Fourier transform holography. We demonstrated this new holographic approach through proof-of-principle optical experiments and later experimentally at soft x-ray wavelengths, where we compared its performance to Fourier transform holography, iterative phase retrieval and state-of-the-art zone-plate x-ray imaging techniques (scanning and full-field). Finally, we present a demonstration of the technique using a single 20 fs pulse from a high-harmonic table-top source. Holography with an extended reference is shown to provide fast, good quality images that are robust to noise and artifacts that arise from missing information due to a beam stop. (Abstract shortened by UMI.)

Genetic Algorithm Phase Retrieval for the Systematic Image-Based Optical Alignment Testbed

NASA Technical Reports Server (NTRS)

Taylor, Jaime; Rakoczy, John; Steincamp, James

2003-01-01

Phase retrieval requires calculation of the real-valued phase of the pupil fimction from the image intensity distribution and characteristics of an optical system. Genetic 'algorithms were used to solve two one-dimensional phase retrieval problem. A GA successfully estimated the coefficients of a polynomial expansion of the phase when the number of coefficients was correctly specified. A GA also successfully estimated the multiple p h e s of a segmented optical system analogous to the seven-mirror Systematic Image-Based Optical Alignment (SIBOA) testbed located at NASA s Marshall Space Flight Center. The SIBOA testbed was developed to investigate phase retrieval techniques. Tiphilt and piston motions of the mirrors accomplish phase corrections. A constant phase over each mirror can be achieved by an independent tip/tilt correction: the phase Conection term can then be factored out of the Discrete Fourier Tranform (DFT), greatly reducing computations.

DOLPHIn—Dictionary Learning for Phase Retrieval

NASA Astrophysics Data System (ADS)

Tillmann, Andreas M.; Eldar, Yonina C.; Mairal, Julien

2016-12-01

We propose a new algorithm to learn a dictionary for reconstructing and sparsely encoding signals from measurements without phase. Specifically, we consider the task of estimating a two-dimensional image from squared-magnitude measurements of a complex-valued linear transformation of the original image. Several recent phase retrieval algorithms exploit underlying sparsity of the unknown signal in order to improve recovery performance. In this work, we consider such a sparse signal prior in the context of phase retrieval, when the sparsifying dictionary is not known in advance. Our algorithm jointly reconstructs the unknown signal - possibly corrupted by noise - and learns a dictionary such that each patch of the estimated image can be sparsely represented. Numerical experiments demonstrate that our approach can obtain significantly better reconstructions for phase retrieval problems with noise than methods that cannot exploit such "hidden" sparsity. Moreover, on the theoretical side, we provide a convergence result for our method.

Large Scale Hierarchical K-Means Based Image Retrieval With MapReduce

DTIC Science & Technology

2014-03-27

hadoop distributed file system: Architecture and design, 2007. [10] G. Bradski. Dr. Dobb’s Journal of Software Tools, 2000. [11] Terry Costlow. Big data ...million images running on 20 virtual machines are shown. 15. SUBJECT TERMS Image Retrieval, MapReduce, Hierarchical K-Means, Big Data , Hadoop U U U UU 87...13 2.1.1.2 HDFS Data Representation . . . . . . . . . . . . . . . . 14 2.1.1.3 Hadoop Engine

Memory retrieval of smoking-related images induce greater insula activation as revealed by an fMRI based delayed matching to sample task

PubMed Central

Janes, AC; Ross, RS; Farmer, S; Frederick, BB; Nickerson, L; Lukas, SE; Stern, CE

2013-01-01

Nicotine dependence is a chronic and difficult to treat disorder. While environmental stimuli associated with smoking precipitate craving and relapse, it is unknown whether smoking cues are cognitively processed differently than neutral stimuli. To evaluate working memory differences between smoking-related and neutral stimuli, we conducted a delay-match-to-sample (DMS) task concurrently with functional magnetic resonance imaging (fMRI) in nicotine dependent participants. The DMS task evaluates brain activation during the encoding, maintenance, and retrieval phases of working memory. Smoking images induced significantly more subjective craving, and greater midline cortical activation during encoding in comparison to neutral stimuli that were similar in content yet lacked a smoking component. The insula, which is involved in maintaining nicotine dependence, was active during the successful retrieval of previously viewed smoking vs. neutral images. In contrast, neutral images required more prefrontal cortex-mediated active maintenance during the maintenance period. These findings indicate that distinct brain regions are involved in the different phases of working memory for smoking-related vs. neutral images. Importantly the results implicate the insula in the retrieval of smoking-related stimuli, which is relevant given the insula’s emerging role in addiction. PMID:24261848

Memory retrieval of smoking-related images induce greater insula activation as revealed by an fMRI-based delayed matching to sample task.

PubMed

Janes, Amy C; Ross, Robert S; Farmer, Stacey; Frederick, Blaise B; Nickerson, Lisa D; Lukas, Scott E; Stern, Chantal E

2015-03-01

Nicotine dependence is a chronic and difficult to treat disorder. While environmental stimuli associated with smoking precipitate craving and relapse, it is unknown whether smoking cues are cognitively processed differently than neutral stimuli. To evaluate working memory differences between smoking-related and neutral stimuli, we conducted a delay-match-to-sample (DMS) task concurrently with functional magnetic resonance imaging (fMRI) in nicotine-dependent participants. The DMS task evaluates brain activation during the encoding, maintenance and retrieval phases of working memory. Smoking images induced significantly more subjective craving, and greater midline cortical activation during encoding in comparison to neutral stimuli that were similar in content yet lacked a smoking component. The insula, which is involved in maintaining nicotine dependence, was active during the successful retrieval of previously viewed smoking versus neutral images. In contrast, neutral images required more prefrontal cortex-mediated active maintenance during the maintenance period. These findings indicate that distinct brain regions are involved in the different phases of working memory for smoking-related versus neutral images. Importantly, the results implicate the insula in the retrieval of smoking-related stimuli, which is relevant given the insula's emerging role in addiction. © 2013 Society for the Study of Addiction.

Phase retrieval and 3D imaging in gold nanoparticles based fluorescence microscopy (Conference Presentation)

NASA Astrophysics Data System (ADS)

Ilovitsh, Tali; Ilovitsh, Asaf; Weiss, Aryeh M.; Meir, Rinat; Zalevsky, Zeev

2017-02-01

Optical sectioning microscopy can provide highly detailed three dimensional (3D) images of biological samples. However, it requires acquisition of many images per volume, and is therefore time consuming, and may not be suitable for live cell 3D imaging. We propose the use of the modified Gerchberg-Saxton phase retrieval algorithm to enable full 3D imaging of gold nanoparticles tagged sample using only two images. The reconstructed field is free space propagated to all other focus planes using post processing, and the 2D z-stack is merged to create a 3D image of the sample with high fidelity. Because we propose to apply the phase retrieving on nano particles, the regular ambiguities typical to the Gerchberg-Saxton algorithm, are eliminated. The proposed concept is then further enhanced also for tracking of single fluorescent particles within a three dimensional (3D) cellular environment based on image processing algorithms that can significantly increases localization accuracy of the 3D point spread function in respect to regular Gaussian fitting. All proposed concepts are validated both on simulated data as well as experimentally.

Content-based image retrieval for interstitial lung diseases using classification confidence

NASA Astrophysics Data System (ADS)

Dash, Jatindra Kumar; Mukhopadhyay, Sudipta; Prabhakar, Nidhi; Garg, Mandeep; Khandelwal, Niranjan

2013-02-01

Content Based Image Retrieval (CBIR) system could exploit the wealth of High-Resolution Computed Tomography (HRCT) data stored in the archive by finding similar images to assist radiologists for self learning and differential diagnosis of Interstitial Lung Diseases (ILDs). HRCT findings of ILDs are classified into several categories (e.g. consolidation, emphysema, ground glass, nodular etc.) based on their texture like appearances. Therefore, analysis of ILDs is considered as a texture analysis problem. Many approaches have been proposed for CBIR of lung images using texture as primitive visual content. This paper presents a new approach to CBIR for ILDs. The proposed approach makes use of a trained neural network (NN) to find the output class label of query image. The degree of confidence of the NN classifier is analyzed using Naive Bayes classifier that dynamically takes a decision on the size of the search space to be used for retrieval. The proposed approach is compared with three simple distance based and one classifier based texture retrieval approaches. Experimental results show that the proposed technique achieved highest average percentage precision of 92.60% with lowest standard deviation of 20.82%.

Cortisol disrupts the neural correlates of extinction recall.

PubMed

Kinner, Valerie L; Merz, Christian J; Lissek, Silke; Wolf, Oliver T

2016-06-01

The renewal effect describes the recovery of extinguished responses that may occur after a change in context and indicates that extinction memory retrieval is sometimes prone to failure. Stress hormones have been implicated to modulate extinction processes, with mostly impairing effects on extinction retrieval. However, the neurobiological mechanisms mediating stress effects on extinction memory remain elusive. In this functional magnetic resonance imaging study, we investigated the effects of cortisol administration on the neural correlates of extinction memory retrieval in a predictive learning task. In this task, participants were required to predict whether certain food stimuli were associated with stomach trouble when presented in two different contexts. A two-day renewal paradigm was applied in which an association was acquired in context A and subsequently extinguished in context B. On the following day, participants received either cortisol or placebo 40min before extinction memory retrieval was tested in both contexts. Behaviorally, cortisol impaired the retrieval of extinguished associations when presented in the extinction context. On the neural level, this effect was characterized by a reduced context differentiation for the extinguished stimulus in the ventromedial prefrontal cortex, but only in men. In the placebo group, ventromedial prefrontal cortex was functionally connected to the left cerebellum, the anterior cingulate and the right anterior parahippocampal gyrus to express extinction memory. This functional crosstalk was reduced under cortisol. These findings illustrate that the stress hormone cortisol disrupts ventromedial prefrontal cortex functioning and its communication with other brain regions implicated in extinction memory. Copyright © 2016 Elsevier Inc. All rights reserved.

Infrared Retrievals of Ice Cloud Properties and Uncertainties with an Optimal Estimation Retrieval Method

NASA Astrophysics Data System (ADS)

Wang, C.; Platnick, S. E.; Meyer, K.; Zhang, Z.

2014-12-01

We developed an optimal estimation (OE)-based method using infrared (IR) observations to retrieve ice cloud optical thickness (COT), cloud effective radius (CER), and cloud top height (CTH) simultaneously. The OE-based retrieval is coupled with a fast IR radiative transfer model (RTM) that simulates observations of different sensors, and corresponding Jacobians in cloudy atmospheres. Ice cloud optical properties are calculated using the MODIS Collection 6 (C6) ice crystal habit (severely roughened hexagonal column aggregates). The OE-based method can be applied to various IR space-borne and airborne sensors, such as the Moderate Resolution Imaging Spectroradiometer (MODIS) and the enhanced MODIS Airborne Simulator (eMAS), by optimally selecting IR bands with high information content. Four major error sources (i.e., the measurement error, fast RTM error, model input error, and pre-assumed ice crystal habit error) are taken into account in our OE retrieval method. We show that measurement error and fast RTM error have little impact on cloud retrievals, whereas errors from the model input and pre-assumed ice crystal habit significantly increase retrieval uncertainties when the cloud is optically thin. Comparisons between the OE-retrieved ice cloud properties and other operational cloud products (e.g., the MODIS C6 and CALIOP cloud products) are shown.

Improvement of Aerosol Optical Depth Retrieval over Hong Kong from a Geostationary Meteorological Satellite Using Critical Reflectance with Background Optical Depth Correction

NASA Technical Reports Server (NTRS)

Kim, Mijin; Kim, Jhoon; Wong, Man Sing; Yoon, Jongmin; Lee, Jaehwa; Wu, Dong L.; Chan, P.W.; Nichol, Janet E.; Chung, Chu-Yong; Ou, Mi-Lim

2014-01-01

Despite continuous efforts to retrieve aerosol optical depth (AOD) using a conventional 5-channelmeteorological imager in geostationary orbit, the accuracy in urban areas has been poorer than other areas primarily due to complex urban surface properties and mixed aerosol types from different emission sources. The two largest error sources in aerosol retrieval have been aerosol type selection and surface reflectance. In selecting the aerosol type from a single visible channel, the season-dependent aerosol optical properties were adopted from longterm measurements of Aerosol Robotic Network (AERONET) sun-photometers. With the aerosol optical properties obtained fromthe AERONET inversion data, look-up tableswere calculated by using a radiative transfer code: the Second Simulation of the Satellite Signal in the Solar Spectrum (6S). Surface reflectance was estimated using the clear sky composite method, awidely used technique for geostationary retrievals. Over East Asia, the AOD retrieved from the Meteorological Imager showed good agreement, although the values were affected by cloud contamination errors. However, the conventional retrieval of the AOD over Hong Kong was largely underestimated due to the lack of information on the aerosol type and surface properties. To detect spatial and temporal variation of aerosol type over the area, the critical reflectance method, a technique to retrieve single scattering albedo (SSA), was applied. Additionally, the background aerosol effect was corrected to improve the accuracy of the surface reflectance over Hong Kong. The AOD retrieved froma modified algorithmwas compared to the collocated data measured by AERONET in Hong Kong. The comparison showed that the new aerosol type selection using the critical reflectance and the corrected surface reflectance significantly improved the accuracy of AODs in Hong Kong areas,with a correlation coefficient increase from0.65 to 0.76 and a regression line change from tMI [basic algorithm] = 0.41tAERONET + 0.16 to tMI [new algorithm] = 0.70tAERONET + 0.01.

Dual pathways to prospective remembering

PubMed Central

McDaniel, Mark A.; Umanath, Sharda; Einstein, Gilles O.; Waldum, Emily R.

2015-01-01

According to the multiprocess framework (McDaniel and Einstein, 2000), the cognitive system can support prospective memory (PM) retrieval through two general pathways. One pathway depends on top–down attentional control processes that maintain activation of the intention and/or monitor the environment for the triggering or target cues that indicate that the intention should be executed. A second pathway depends on (bottom–up) spontaneous retrieval processes, processes that are often triggered by a PM target cue; critically, spontaneous retrieval is assumed not to require monitoring or active maintenance of the intention. Given demand characteristics associated with experimental settings, however, participants are often inclined to monitor, thereby potentially masking discovery of bottom–up spontaneous retrieval processes. In this article, we discuss parameters of laboratory PM paradigms to discourage monitoring and review recent behavioral evidence from such paradigms that implicate spontaneous retrieval in PM. We then re-examine the neuro-imaging evidence from the lens of the multiprocess framework and suggest some critical modifications to existing neuro-cognitive interpretations of the neuro-imaging results. These modifications illuminate possible directions and refinements for further neuro-imaging investigations of PM. PMID:26236213

An improved real time image detection system for elephant intrusion along the forest border areas.

PubMed

Sugumar, S J; Jayaparvathy, R

2014-01-01

Human-elephant conflict is a major problem leading to crop damage, human death and injuries caused by elephants, and elephants being killed by humans. In this paper, we propose an automated unsupervised elephant image detection system (EIDS) as a solution to human-elephant conflict in the context of elephant conservation. The elephant's image is captured in the forest border areas and is sent to a base station via an RF network. The received image is decomposed using Haar wavelet to obtain multilevel wavelet coefficients, with which we perform image feature extraction and similarity match between the elephant query image and the database image using image vision algorithms. A GSM message is sent to the forest officials indicating that an elephant has been detected in the forest border and is approaching human habitat. We propose an optimized distance metric to improve the image retrieval time from the database. We compare the optimized distance metric with the popular Euclidean and Manhattan distance methods. The proposed optimized distance metric retrieves more images with lesser retrieval time than the other distance metrics which makes the optimized distance method more efficient and reliable.

Interactive classification and content-based retrieval of tissue images

NASA Astrophysics Data System (ADS)

Aksoy, Selim; Marchisio, Giovanni B.; Tusk, Carsten; Koperski, Krzysztof

2002-11-01

We describe a system for interactive classification and retrieval of microscopic tissue images. Our system models tissues in pixel, region and image levels. Pixel level features are generated using unsupervised clustering of color and texture values. Region level features include shape information and statistics of pixel level feature values. Image level features include statistics and spatial relationships of regions. To reduce the gap between low-level features and high-level expert knowledge, we define the concept of prototype regions. The system learns the prototype regions in an image collection using model-based clustering and density estimation. Different tissue types are modeled using spatial relationships of these regions. Spatial relationships are represented by fuzzy membership functions. The system automatically selects significant relationships from training data and builds models which can also be updated using user relevance feedback. A Bayesian framework is used to classify tissues based on these models. Preliminary experiments show that the spatial relationship models we developed provide a flexible and powerful framework for classification and retrieval of tissue images.

Assessment of imaging quality in magnified phase CT of human bone tissue at the nanoscale

NASA Astrophysics Data System (ADS)

Yu, Boliang; Langer, Max; Pacureanu, Alexandra; Gauthier, Remy; Follet, Helene; Mitton, David; Olivier, Cecile; Cloetens, Peter; Peyrin, Francoise

2017-10-01

Bone properties at all length scales have a major impact on the fracture risk in disease such as osteoporosis. However, quantitative 3D data on bone tissue at the cellular scale are still rare. Here we propose to use magnified X-ray phase nano-CT to quantify bone ultra-structure in human bone, on the new setup developed on the beamline ID16A at the ESRF, Grenoble. Obtaining 3D images requires the application of phase retrieval prior to tomographic reconstruction. Phase retrieval is an ill-posed problem for which various approaches have been developed. Since image quality has a strong impact on the further quantification of bone tissue, our aim here is to evaluate different phase retrieval methods for imaging bone samples at the cellular scale. Samples from femurs of female donors were scanned using magnified phase nano-CT at voxel sizes of 120 and 30 nm with an energy of 33 keV. Four CT scans at varying sample-to-detector distances were acquired for each sample. We evaluated three phase retrieval methods adapted to these conditions: Paganin's method at single distance, Paganin's method extended to multiple distances, and the contrast transfer function (CTF) approach for pure phase objects. These methods were used as initialization to an iterative refinement step. Our results based on visual and quantitative assessment show that the use of several distances (as opposed to single one) clearly improves image quality and the two multi-distance phase retrieval methods give similar results. First results on the segmentation of osteocyte lacunae and canaliculi from such images are presented.

Robust digital image inpainting algorithm in the wireless environment

NASA Astrophysics Data System (ADS)

Karapetyan, G.; Sarukhanyan, H. G.; Agaian, S. S.

2014-05-01

Image or video inpainting is the process/art of retrieving missing portions of an image without introducing undesirable artifacts that are undetectable by an ordinary observer. An image/video can be damaged due to a variety of factors, such as deterioration due to scratches, laser dazzling effects, wear and tear, dust spots, loss of data when transmitted through a channel, etc. Applications of inpainting include image restoration (removing laser dazzling effects, dust spots, date, text, time, etc.), image synthesis (texture synthesis), completing panoramas, image coding, wireless transmission (recovery of the missing blocks), digital culture protection, image de-noising, fingerprint recognition, and film special effects and production. Most inpainting methods can be classified in two key groups: global and local methods. Global methods are used for generating large image regions from samples while local methods are used for filling in small image gaps. Each method has its own advantages and limitations. For example, the global inpainting methods perform well on textured image retrieval, whereas the classical local methods perform poorly. In addition, some of the techniques are computationally intensive; exceeding the capabilities of most currently used mobile devices. In general, the inpainting algorithms are not suitable for the wireless environment. This paper presents a new and efficient scheme that combines the advantages of both local and global methods into a single algorithm. Particularly, it introduces a blind inpainting model to solve the above problems by adaptively selecting support area for the inpainting scheme. The proposed method is applied to various challenging image restoration tasks, including recovering old photos, recovering missing data on real and synthetic images, and recovering the specular reflections in endoscopic images. A number of computer simulations demonstrate the effectiveness of our scheme and also illustrate the main properties and implementation steps of the presented algorithm. Furthermore, the simulation results show that the presented method is among the state-of-the-art and compares favorably against many available methods in the wireless environment. Robustness in the wireless environment with respect to the shape of the manually selected "marked" region is also illustrated. Currently, we are working on the expansion of this work to video and 3-D data.

Three-dimensional propagation in near-field tomographic X-ray phase retrieval

DOE Office of Scientific and Technical Information (OSTI.GOV)

Ruhlandt, Aike, E-mail: aruhlan@gwdg.de; Salditt, Tim

An extension of phase retrieval algorithms for near-field X-ray (propagation) imaging to three dimensions is presented, enhancing the quality of the reconstruction by exploiting previously unused three-dimensional consistency constraints. This paper presents an extension of phase retrieval algorithms for near-field X-ray (propagation) imaging to three dimensions, enhancing the quality of the reconstruction by exploiting previously unused three-dimensional consistency constraints. The approach is based on a novel three-dimensional propagator and is derived for the case of optically weak objects. It can be easily implemented in current phase retrieval architectures, is computationally efficient and reduces the need for restrictive prior assumptions, resultingmore » in superior reconstruction quality.« less

Comparing fusion techniques for the ImageCLEF 2013 medical case retrieval task.

PubMed

G Seco de Herrera, Alba; Schaer, Roger; Markonis, Dimitrios; Müller, Henning

2015-01-01

Retrieval systems can supply similar cases with a proven diagnosis to a new example case under observation to help clinicians during their work. The ImageCLEFmed evaluation campaign proposes a framework where research groups can compare case-based retrieval approaches. This paper focuses on the case-based task and adds results of the compound figure separation and modality classification tasks. Several fusion approaches are compared to identify the approaches best adapted to the heterogeneous data of the task. Fusion of visual and textual features is analyzed, demonstrating that the selection of the fusion strategy can improve the best performance on the case-based retrieval task. Copyright © 2014 Elsevier Ltd. All rights reserved.

Pictures, images, and recollective experience.

PubMed

Dewhurst, S A; Conway, M A

1994-09-01

Five experiments investigated the influence of picture processing on recollective experience in recognition memory. Subjects studied items that differed in visual or imaginal detail, such as pictures versus words and high-imageability versus low-imageability words, and performed orienting tasks that directed processing either toward a stimulus as a word or toward a stimulus as a picture or image. Standard effects of imageability (e.g., the picture superiority effect and memory advantages following imagery) were obtained only in recognition judgments that featured recollective experience and were eliminated or reversed when recognition was not accompanied by recollective experience. It is proposed that conscious recollective experience in recognition memory is cued by attributes of retrieved memories such as sensory-perceptual attributes and records of cognitive operations performed at encoding.

Variable Sampling Mapping

NASA Technical Reports Server (NTRS)

Smith, Jeffrey, S.; Aronstein, David L.; Dean, Bruce H.; Lyon, Richard G.

2012-01-01

The performance of an optical system (for example, a telescope) is limited by the misalignments and manufacturing imperfections of the optical elements in the system. The impact of these misalignments and imperfections can be quantified by the phase variations imparted on light traveling through the system. Phase retrieval is a methodology for determining these variations. Phase retrieval uses images taken with the optical system and using a light source of known shape and characteristics. Unlike interferometric methods, which require an optical reference for comparison, and unlike Shack-Hartmann wavefront sensors that require special optical hardware at the optical system's exit pupil, phase retrieval is an in situ, image-based method for determining the phase variations of light at the system s exit pupil. Phase retrieval can be used both as an optical metrology tool (during fabrication of optical surfaces and assembly of optical systems) and as a sensor used in active, closed-loop control of an optical system, to optimize performance. One class of phase-retrieval algorithms is the iterative transform algorithm (ITA). ITAs estimate the phase variations by iteratively enforcing known constraints in the exit pupil and at the detector, determined from modeled or measured data. The Variable Sampling Mapping (VSM) technique is a new method for enforcing these constraints in ITAs. VSM is an open framework for addressing a wide range of issues that have previously been considered detrimental to high-accuracy phase retrieval, including undersampled images, broadband illumination, images taken at or near best focus, chromatic aberrations, jitter or vibration of the optical system or detector, and dead or noisy detector pixels. The VSM is a model-to-data mapping procedure. In VSM, fully sampled electric fields at multiple wavelengths are modeled inside the phase-retrieval algorithm, and then these fields are mapped to intensities on the light detector, using the properties of the detector and optical system, for comparison with measured data. Ultimately, this model-to-data mapping procedure enables a more robust and accurate way of incorporating the exit-pupil and image detector constraints, which are fundamental to the general class of ITA phase retrieval algorithms.

4D reconstruction of the past: the image retrieval and 3D model construction pipeline

NASA Astrophysics Data System (ADS)

Hadjiprocopis, Andreas; Ioannides, Marinos; Wenzel, Konrad; Rothermel, Mathias; Johnsons, Paul S.; Fritsch, Dieter; Doulamis, Anastasios; Protopapadakis, Eftychios; Kyriakaki, Georgia; Makantasis, Kostas; Weinlinger, Guenther; Klein, Michael; Fellner, Dieter; Stork, Andre; Santos, Pedro

2014-08-01

One of the main characteristics of the Internet era we are living in, is the free and online availability of a huge amount of data. This data is of varied reliability and accuracy and exists in various forms and formats. Often, it is cross-referenced and linked to other data, forming a nexus of text, images, animation and audio enabled by hypertext and, recently, by the Web3.0 standard. Our main goal is to enable historians, architects, archaeolo- gists, urban planners and affiliated professionals to reconstruct views of historical monuments from thousands of images floating around the web. This paper aims to provide an update of our progress in designing and imple- menting a pipeline for searching, filtering and retrieving photographs from Open Access Image Repositories and social media sites and using these images to build accurate 3D models of archaeological monuments as well as enriching multimedia of cultural / archaeological interest with metadata and harvesting the end products to EU- ROPEANA. We provide details of how our implemented software searches and retrieves images of archaeological sites from Flickr and Picasa repositories as well as strategies on how to filter the results, on two levels; a) based on their built-in metadata including geo-location information and b) based on image processing and clustering techniques. We also describe our implementation of a Structure from Motion pipeline designed for producing 3D models using the large collection of 2D input images (>1000) retrieved from Internet Repositories.

Optical asymmetric watermarking using modified wavelet fusion and diffractive imaging

NASA Astrophysics Data System (ADS)

Mehra, Isha; Nishchal, Naveen K.

2015-05-01

In most of the existing image encryption algorithms the generated keys are in the form of a noise like distribution with a uniform distributed histogram. However, the noise like distribution is an apparent sign indicating the presence of the keys. If the keys are to be transferred through some communication channels, then this may lead to a security problem. This is because; the noise like features may easily catch people's attention and bring more attacks. To address this problem it is required to transfer the keys to some other meaningful images to disguise the attackers. The watermarking schemes are complementary to image encryption schemes. In most of the iterative encryption schemes, support constraints play an important role of the keys in order to decrypt the meaningful data. In this article, we have transferred the support constraints which are generated by axial translation of CCD camera using amplitude-, and phase- truncation approach, into different meaningful images. This has been done by developing modified fusion technique in wavelet transform domain. The second issue is, in case, the meaningful images are caught by the attacker then how to solve the copyright protection. To resolve this issue, watermark detection plays a crucial role. For this purpose, it is necessary to recover the original image using the retrieved watermarks/support constraints. To address this issue, four asymmetric keys have been generated corresponding to each watermarked image to retrieve the watermarks. For decryption, an iterative phase retrieval algorithm is applied to extract the plain-texts from corresponding retrieved watermarks.

A Guide to Microforms and Microform Retrieval Equipment.

ERIC Educational Resources Information Center

McKay, Mark, Ed.

As used in this handbook, microform retrieval equipment is defined as any device that is used to locate, enlarge, and display microform images or that produces enlarged hard copy from the images. Only equipment widely available in the United States has been included. The first chapter provides information about the most widely and generally used…

Grid-Independent Compressive Imaging and Fourier Phase Retrieval

ERIC Educational Resources Information Center

Liao, Wenjing

2013-01-01

This dissertation is composed of two parts. In the first part techniques of band exclusion(BE) and local optimization(LO) are proposed to solve linear continuum inverse problems independently of the grid spacing. The second part is devoted to the Fourier phase retrieval problem. Many situations in optics, medical imaging and signal processing call…

Unified modeling language and design of a case-based retrieval system in medical imaging.

PubMed Central

LeBozec, C.; Jaulent, M. C.; Zapletal, E.; Degoulet, P.

1998-01-01

One goal of artificial intelligence research into case-based reasoning (CBR) systems is to develop approaches for designing useful and practical interactive case-based environments. Explaining each step of the design of the case-base and of the retrieval process is critical for the application of case-based systems to the real world. We describe herein our approach to the design of IDEM--Images and Diagnosis from Examples in Medicine--a medical image case-based retrieval system for pathologists. Our approach is based on the expressiveness of an object-oriented modeling language standard: the Unified Modeling Language (UML). We created a set of diagrams in UML notation illustrating the steps of the CBR methodology we used. The key aspect of this approach was selecting the relevant objects of the system according to user requirements and making visualization of cases and of the components of the case retrieval process. Further evaluation of the expressiveness of the design document is required but UML seems to be a promising formalism, improving the communication between the developers and users. Images Figure 6 Figure 7 PMID:9929346

Using deep learning for content-based medical image retrieval

NASA Astrophysics Data System (ADS)

Sun, Qinpei; Yang, Yuanyuan; Sun, Jianyong; Yang, Zhiming; Zhang, Jianguo

2017-03-01

Content-Based medical image retrieval (CBMIR) is been highly active research area from past few years. The retrieval performance of a CBMIR system crucially depends on the feature representation, which have been extensively studied by researchers for decades. Although a variety of techniques have been proposed, it remains one of the most challenging problems in current CBMIR research, which is mainly due to the well-known "semantic gap" issue that exists between low-level image pixels captured by machines and high-level semantic concepts perceived by human[1]. Recent years have witnessed some important advances of new techniques in machine learning. One important breakthrough technique is known as "deep learning". Unlike conventional machine learning methods that are often using "shallow" architectures, deep learning mimics the human brain that is organized in a deep architecture and processes information through multiple stages of transformation and representation. This means that we do not need to spend enormous energy to extract features manually. In this presentation, we propose a novel framework which uses deep learning to retrieval the medical image to improve the accuracy and speed of a CBIR in integrated RIS/PACS.

A Solar Reflectance Method for Retrieving Cloud Optical Thickness and Droplet Size Over Snow and Ice Surfaces

NASA Technical Reports Server (NTRS)

Platnick, S.; Li, J. Y.; King, M. D.; Gerber, H.; Hobbs, P. V.

1999-01-01

Cloud optical thickness and effective radius retrievals from solar reflectance measurements are traditionally implemented using a combination of spectral channels that are absorbing and non-absorbing for water particles. Reflectances in non-absorbing channels (e.g., 0.67, 0.86, 1.2 micron spectral window bands) are largely dependent on cloud optical thickness, while longer wavelength absorbing channels (1.6, 2. 1, and 3.7 micron window bands) provide cloud particle size information. Cloud retrievals over ice and snow surfaces present serious difficulties. At the shorter wavelengths, ice is bright and highly variable, both characteristics acting to significantly increase cloud retrieval uncertainty. In contrast, reflectances at the longer wavelengths are relatively small and may be comparable to that of dark open water. A modification to the traditional cloud retrieval technique is devised. The new algorithm uses only a combination of absorbing spectral channels for which the snow/ice albedo is relatively small. Using this approach, retrievals have been made with the MODIS Airborne Simulator (MAS) imager flown aboard the NASA ER-2 from May - June 1998 during the Arctic FIRE-ACE field deployment. Data from several coordinated ER-2 and University of Washington CV-580 in situ aircraft observations of liquid water stratus clouds are examined. MAS retrievals of optical thickness, droplet effective radius, and liquid water path are shown to be in good agreement with the in situ measurements. The initial success of the technique has implications for future operational satellite cloud retrieval algorithms in polar and wintertime regions.

Beam tracking approach for single–shot retrieval of absorption, refraction, and dark-field signals with laboratory  x-ray sources

DOE Office of Scientific and Technical Information (OSTI.GOV)

Vittoria, Fabio A., E-mail: fabio.vittoria.12@ucl.ac.uk; Diemoz, Paul C.; Olivo, Alessandro

We present the translation of the beam tracking approach for x-ray phase-contrast and dark-field imaging, recently demonstrated using synchrotron radiation, to a laboratory setup. A single absorbing mask is used before the sample, and a local Gaussian interpolation of the beam at the detector is used to extract absorption, refraction, and dark–field signals from a single exposure of the sample. Multiple exposures can be acquired when high resolution is needed, as shown here. A theoretical analysis of the effect of polychromaticity on the retrieved signals, and of the artifacts this might cause when existing retrieval methods are used, is alsomore » discussed.« less

Enabling search over encrypted multimedia databases

NASA Astrophysics Data System (ADS)

Lu, Wenjun; Swaminathan, Ashwin; Varna, Avinash L.; Wu, Min

2009-02-01

Performing information retrieval tasks while preserving data confidentiality is a desirable capability when a database is stored on a server maintained by a third-party service provider. This paper addresses the problem of enabling content-based retrieval over encrypted multimedia databases. Search indexes, along with multimedia documents, are first encrypted by the content owner and then stored onto the server. Through jointly applying cryptographic techniques, such as order preserving encryption and randomized hash functions, with image processing and information retrieval techniques, secure indexing schemes are designed to provide both privacy protection and rank-ordered search capability. Retrieval results on an encrypted color image database and security analysis of the secure indexing schemes under different attack models show that data confidentiality can be preserved while retaining very good retrieval performance. This work has promising applications in secure multimedia management.

Application of Vorob'ev's asymptotic solution to retrieval of the structural characteristics Cn2 from BSA-lidar data

NASA Astrophysics Data System (ADS)

Razenkov, I. A.

2017-11-01

Micro pulse lasers have allowed solution of some technical problems and design of a specialized aerosol lidar capable of recording backscattering amplification (BSA) in a turbulent atmosphere (2014) by now. The BSA-lidar has two receiving channels, one of which is affected by a turbulence. The measurement result is the ratio of echo signals, i.e., the coefficient of backscattering amplification. The problem of lidar data inversion and retrieval of "optical" turbulence parameters was recently solved by V.V. Vorob'ev theoretically (2016). A lidar experiment was organized for testing the solution, and the asymptotic solution was applied to echo signals, which allowed estimating the daily behavior of the structural characteristics Cn 2 along a horizontal 2-km path. The experiment was accompanied by parallel independent measurements of Cn 2 by an image jitter sensor along the same path. It was shown experimentally that the Vorob'ev solution is applicable to Cn 2 retrieval from BSA-lidar data if β0 2<=3 for β0 2>3, the saturation of the amplification effect and a decrease in the experimental data with respect to calculation results are observed. The coefficient of correlation between the retrieved structural characteristics Cn 2 of the lidar and jitter sensor is 0.8-0.9. The Cn 2 values retrieved from lidar signals turned out to be 20-40% lower than the Cn 2 values of the image jitter sensor.

Sensitivity of Marine Warm Cloud Retrieval Statistics to Algorithm Choices: Examples from MODIS Collection 6

NASA Technical Reports Server (NTRS)

Platnick, Steven; Wind, Galina; Zhang, Zhibo; Ackerman, Steven A.; Maddux, Brent

2012-01-01

The optical and microphysical structure of warm boundary layer marine clouds is of fundamental importance for understanding a variety of cloud radiation and precipitation processes. With the advent of MODIS (Moderate Resolution Imaging Spectroradiometer) on the NASA EOS Terra and Aqua platforms, simultaneous global/daily 1km retrievals of cloud optical thickness and effective particle size are provided, as well as the derived water path. In addition, the cloud product (MOD06/MYD06 for MODIS Terra and Aqua, respectively) provides separate effective radii results using the l.6, 2.1, and 3.7 m spectral channels. Cloud retrieval statistics are highly sensitive to how a pixel identified as being "notclear" by a cloud mask (e.g., the MOD35/MYD35 product) is determined to be useful for an optical retrieval based on a 1-D cloud model. The Collection 5 MODIS retrieval algorithm removed pixels associated with cloud'edges as well as ocean pixels with partly cloudy elements in the 250m MODIS cloud mask - part of the so-called Clear Sky Restoral (CSR) algorithm. Collection 6 attempts retrievals for those two pixel populations, but allows a user to isolate or filter out the populations via CSR pixel-level Quality Assessment (QA) assignments. In this paper, using the preliminary Collection 6 MOD06 product, we present global and regional statistical results of marine warm cloud retrieval sensitivities to the cloud edge and 250m partly cloudy pixel populations. As expected, retrievals for these pixels are generally consistent with a breakdown of the ID cloud model. While optical thickness for these suspect pixel populations may have some utility for radiative studies, the retrievals should be used with extreme caution for process and microphysical studies.

Enterprise utilization of "always on-line" diagnostic study archive.

PubMed

McEnery, Kevin W; Suitor, Charles T; Thompson, Stephen K; Shepard, Jeffrey S; Murphy, William A

2002-01-01

To meet demands for enterprise image distribution, an "always on-line" image storage archive architecture was implemented before soft copy interpretation. It was presumed that instant availability of historical diagnostic studies would elicit a substantial utilization. Beginning November 1, 2000 an enterprise distribution archive was activated (Stentor, SanFrancisco, CA). As of August 8, 2001, 83,052 studies were available for immediate access without the need for retrieval from long-term archive. Image storage and retrieval logs for the period from June 12, 2001 to August 8, 2001 were analyzed. A total of 41,337 retrieval requests were noted for the 83,052 studies available as August 8, 2001. Computed radiography represented 16.8% of retrieval requests; digital radiography, 16.9%; computed tomography (CT), 44.5%; magnetic resonance (MR), 19.2%; and ultrasonography, 2.6%. A total of 51.5% of study retrievals were for studies less than 72 hours old. Study requests for cases greater than 100 days old represented 9.9% of all accessions, 9.7% of CT accessions, and 15.4% of MR accessions. Utilization of the archive indicates a substantial proportion of study retrievals for studies less than 72 hours after study completion. However, significant interest in historical CT and MR examinations was shown.

Artifacts in magnetic spirals retrieved by transport of intensity equation (TIE)

NASA Astrophysics Data System (ADS)

Cui, J.; Yao, Y.; Shen, X.; Wang, Y. G.; Yu, R. C.

2018-05-01

The artifacts in the magnetic structures reconstructed from Lorentz transmission electron microscopy (LTEM) images with TIE method have been analyzed in detail. The processing for the simulated images of Bloch and Neel spirals indicated that the improper parameters in TIE may overestimate the high frequency information and induce some false features in the retrieved images. The specimen tilting will further complicate the analysis of the images because the LTEM image contrast is not the result of the magnetization distribution within the specimen but the integral projection pattern of the magnetic induction filling the entire space including the specimen.

Theory of the amplitude-phase retrieval in any linear-transform system and its applications

NASA Astrophysics Data System (ADS)

Yang, Guozhen; Gu, Ben-Yuan; Dong, Bi-Zhen

1992-12-01

This paper is a summary of the theory of the amplitude-phase retrieval problem in any linear transform system and its applications based on our previous works in the past decade. We describe the general statement on the amplitude-phase retrieval problem in an imaging system and derive a set of equations governing the amplitude-phase distribution in terms of the rigorous mathematical derivation. We then show that, by using these equations and an iterative algorithm, a variety of amplitude-phase problems can be successfully handled. We carry out the systematic investigations and comprehensive numerical calculations to demonstrate the utilization of this new algorithm in various transform systems. For instance, we have achieved the phase retrieval from two intensity measurements in an imaging system with diffraction loss (non-unitary transform), both theoretically and experimentally, and the recovery of model real image from its Hartley-transform modulus only in one and two dimensional cases. We discuss the achievement of the phase retrieval problem from a single intensity only based on the sampling theorem and our algorithm. We also apply this algorithm to provide an optimal design of the phase-adjusted plate for a phase-adjustment focusing laser accelerator and a design approach of single phase-only element for implementing optical interconnect. In order to closely simulate the really measured data, we examine the reconstruction of image from its spectral modulus corrupted by a random noise in detail. The results show that the convergent solution can always be obtained and the quality of the recovered image is satisfactory. We also indicated the relationship and distinction between our algorithm and the original Gerchberg- Saxton algorithm. From these studies, we conclude that our algorithm shows great capability to deal with the comprehensive phase-retrieval problems in the imaging system and the inverse problem in solid state physics. It may open a new way to solve important inverse source problems extensively appearing in physics.

Terahertz imaging with compressed sensing and phase retrieval.

PubMed

Chan, Wai Lam; Moravec, Matthew L; Baraniuk, Richard G; Mittleman, Daniel M

2008-05-01

We describe a novel, high-speed pulsed terahertz (THz) Fourier imaging system based on compressed sensing (CS), a new signal processing theory, which allows image reconstruction with fewer samples than traditionally required. Using CS, we successfully reconstruct a 64 x 64 image of an object with pixel size 1.4 mm using a randomly chosen subset of the 4096 pixels, which defines the image in the Fourier plane, and observe improved reconstruction quality when we apply phase correction. For our chosen image, only about 12% of the pixels are required for reassembling the image. In combination with phase retrieval, our system has the capability to reconstruct images with only a small subset of Fourier amplitude measurements and thus has potential application in THz imaging with cw sources.

Secret shared multiple-image encryption based on row scanning compressive ghost imaging and phase retrieval in the Fresnel domain

NASA Astrophysics Data System (ADS)

Li, Xianye; Meng, Xiangfeng; Wang, Yurong; Yang, Xiulun; Yin, Yongkai; Peng, Xiang; He, Wenqi; Dong, Guoyan; Chen, Hongyi

2017-09-01

A multiple-image encryption method is proposed that is based on row scanning compressive ghost imaging, (t, n) threshold secret sharing, and phase retrieval in the Fresnel domain. In the encryption process, after wavelet transform and Arnold transform of the target image, the ciphertext matrix can be first detected using a bucket detector. Based on a (t, n) threshold secret sharing algorithm, the measurement key used in the row scanning compressive ghost imaging can be decomposed and shared into two pairs of sub-keys, which are then reconstructed using two phase-only mask (POM) keys with fixed pixel values, placed in the input plane and transform plane 2 of the phase retrieval scheme, respectively; and the other POM key in the transform plane 1 can be generated and updated by the iterative encoding of each plaintext image. In each iteration, the target image acts as the input amplitude constraint in the input plane. During decryption, each plaintext image possessing all the correct keys can be successfully decrypted by measurement key regeneration, compression algorithm reconstruction, inverse wavelet transformation, and Fresnel transformation. Theoretical analysis and numerical simulations both verify the feasibility of the proposed method.

Learning binary code via PCA of angle projection for image retrieval

NASA Astrophysics Data System (ADS)

Yang, Fumeng; Ye, Zhiqiang; Wei, Xueqi; Wu, Congzhong

2018-01-01

With benefits of low storage costs and high query speeds, binary code representation methods are widely researched for efficiently retrieving large-scale data. In image hashing method, learning hashing function to embed highdimensions feature to Hamming space is a key step for accuracy retrieval. Principal component analysis (PCA) technical is widely used in compact hashing methods, and most these hashing methods adopt PCA projection functions to project the original data into several dimensions of real values, and then each of these projected dimensions is quantized into one bit by thresholding. The variances of different projected dimensions are different, and with real-valued projection produced more quantization error. To avoid the real-valued projection with large quantization error, in this paper we proposed to use Cosine similarity projection for each dimensions, the angle projection can keep the original structure and more compact with the Cosine-valued. We used our method combined the ITQ hashing algorithm, and the extensive experiments on the public CIFAR-10 and Caltech-256 datasets validate the effectiveness of the proposed method.

Empirical Corrections for MISR Calibration Temporal Trends, Point-Spread Function, Flat-Fielding, and Ghosting

NASA Astrophysics Data System (ADS)

Limbacher, J.; Kahn, R. A.

2015-12-01

MISR aerosol optical depth retrievals are fairly robust to small radiometric calibration artifacts, due to the multi-angle observations. However, even small errors in the MISR calibration, especially structured artifacts in the imagery, have a disproportionate effect on the retrieval of aerosol properties from these data. Using MODIS, POLDER-3, AERONET, MAN, and MISR lunar images, we diagnose and correct various calibration and radiometric artifacts found in the MISR radiance (Level 1) data, using empirical image analysis. The calibration artifacts include temporal trends in MISR top-of-atmosphere reflectance at relatively stable desert sites and flat-fielding artifacts detected by comparison to MODIS over bright, low-contrast scenes. The radiometric artifacts include ghosting (as compared to MODIS, POLDER-3, and forward model results) and point-spread function mischaracterization (using the MISR lunar data and MODIS). We minimize the artifacts to the extent possible by parametrically modeling the artifacts and then removing them from the radiance (reflectance) data. Validation is performed using non-training scenes (reflectance comparison), and also by using the MISR Research Aerosol retrieval algorithm results compared to MAN and AERONET.

An analysis of errors in special sensor microwave imager evaporation estimates over the global oceans

NASA Technical Reports Server (NTRS)

Esbensen, S. K.; Chelton, D. B.; Vickers, D.; Sun, J.

1993-01-01

The method proposed by Liu (1984) is used to estimate monthly averaged evaporation over the global oceans from 1 yr of special sensor microwave imager (SDSM/I) data. Intercomparisons involving SSM/I and in situ data are made over a wide range of oceanic conditions during August 1987 and February 1988 to determine the source of errors in the evaporation estimates. The most significant spatially coherent evaporation errors are found to come from estimates of near-surface specific humidity, q. Systematic discrepancies of over 2 g/kg are found in the tropics, as well as in the middle and high latitudes. The q errors are partitioned into contributions from the parameterization of q in terms of the columnar water vapor, i.e., the Liu q/W relationship, and from the retrieval algorithm for W. The effects of W retrieval errors are found to be smaller over most of the global oceans and due primarily to the implicitly assumed vertical structures of temperature and specific humidity on which the physically based SSM/I retrievals of W are based.

Semantics-Based Intelligent Indexing and Retrieval of Digital Images - A Case Study

NASA Astrophysics Data System (ADS)

Osman, Taha; Thakker, Dhavalkumar; Schaefer, Gerald

The proliferation of digital media has led to a huge interest in classifying and indexing media objects for generic search and usage. In particular, we are witnessing colossal growth in digital image repositories that are difficult to navigate using free-text search mechanisms, which often return inaccurate matches as they typically rely on statistical analysis of query keyword recurrence in the image annotation or surrounding text. In this chapter we present a semantically enabled image annotation and retrieval engine that is designed to satisfy the requirements of commercial image collections market in terms of both accuracy and efficiency of the retrieval process. Our search engine relies on methodically structured ontologies for image annotation, thus allowing for more intelligent reasoning about the image content and subsequently obtaining a more accurate set of results and a richer set of alternatives matchmaking the original query. We also show how our well-analysed and designed domain ontology contributes to the implicit expansion of user queries as well as presenting our initial thoughts on exploiting lexical databases for explicit semantic-based query expansion.

Color Based Bags-of-Emotions

NASA Astrophysics Data System (ADS)

Solli, Martin; Lenz, Reiner

In this paper we describe how to include high level semantic information, such as aesthetics and emotions, into Content Based Image Retrieval. We present a color-based emotion-related image descriptor that can be used for describing the emotional content of images. The color emotion metric used is derived from psychophysical experiments and based on three variables: activity, weight and heat. It was originally designed for single-colors, but recent research has shown that the same emotion estimates can be applied in the retrieval of multi-colored images. Here we describe a new approach, based on the assumption that perceived color emotions in images are mainly affected by homogenous regions, defined by the emotion metric, and transitions between regions. RGB coordinates are converted to emotion coordinates, and for each emotion channel, statistical measurements of gradient magnitudes within a stack of low-pass filtered images are used for finding interest points corresponding to homogeneous regions and transitions between regions. Emotion characteristics are derived for patches surrounding each interest point, and saved in a bag-of-emotions, that, for instance, can be used for retrieving images based on emotional content.

Generating descriptive visual words and visual phrases for large-scale image applications.

PubMed

Zhang, Shiliang; Tian, Qi; Hua, Gang; Huang, Qingming; Gao, Wen

2011-09-01

Bag-of-visual Words (BoWs) representation has been applied for various problems in the fields of multimedia and computer vision. The basic idea is to represent images as visual documents composed of repeatable and distinctive visual elements, which are comparable to the text words. Notwithstanding its great success and wide adoption, visual vocabulary created from single-image local descriptors is often shown to be not as effective as desired. In this paper, descriptive visual words (DVWs) and descriptive visual phrases (DVPs) are proposed as the visual correspondences to text words and phrases, where visual phrases refer to the frequently co-occurring visual word pairs. Since images are the carriers of visual objects and scenes, a descriptive visual element set can be composed by the visual words and their combinations which are effective in representing certain visual objects or scenes. Based on this idea, a general framework is proposed for generating DVWs and DVPs for image applications. In a large-scale image database containing 1506 object and scene categories, the visual words and visual word pairs descriptive to certain objects or scenes are identified and collected as the DVWs and DVPs. Experiments show that the DVWs and DVPs are informative and descriptive and, thus, are more comparable with the text words than the classic visual words. We apply the identified DVWs and DVPs in several applications including large-scale near-duplicated image retrieval, image search re-ranking, and object recognition. The combination of DVW and DVP performs better than the state of the art in large-scale near-duplicated image retrieval in terms of accuracy, efficiency and memory consumption. The proposed image search re-ranking algorithm: DWPRank outperforms the state-of-the-art algorithm by 12.4% in mean average precision and about 11 times faster in efficiency.

Evaluation of applicability of high-resolution multiangle imaging photo-polarimetric observations for aerosol atmospheric correction

NASA Astrophysics Data System (ADS)

Kalashnikova, Olga; Garay, Michael; Xu, Feng; Diner, David; Seidel, Felix

2016-07-01

Multiangle spectro-polarimetric measurements have been advocated as an additional tool for better understanding and quantifying the aerosol properties needed for atmospheric correction for ocean color retrievals. The central concern of this work is the assessment of the effects of absorbing aerosol properties on remote sensing reflectance measurement uncertainty caused by neglecting UV-enhanced absorption of carbonaceous particles and by not accounting for dust nonsphericity. In addition, we evaluate the polarimetric sensitivity of absorbing aerosol properties in light of measurement uncertainties achievable for the next generation of multi-angle polarimetric imaging instruments, and demonstrate advantages and disadvantages of wavelength selection in the UV/VNIR range. In this work a vector Markov Chain radiative transfer code including bio-optical models was used to quantitatively evaluate in water leaving radiances between atmospheres containing realistic UV-enhanced and non-spherical aerosols and the SEADAS carbonaceous and dust-like aerosol models. The phase matrices for the spherical smoke particles were calculated using a standard Mie code, while those for non-spherical dust particles were calculated using the numerical approach developed for modeling dust for the AERONET network of ground-based sunphotometers. As a next step, we have developed a retrieval code that employs a coupled Markov Chain (MC) and adding/doubling radiative transfer method for joint retrieval of aerosol properties and water leaving radiance from Airborne Multiangle SpectroPolarimetric Imager-1 (AirMSPI-1) polarimetric observations. The AirMSPI-1 instrument has been flying aboard the NASA ER-2 high altitude aircraft since October 2010. AirMSPI typically acquires observations of a target area at 9 view angles between ±67° at 10 m resolution. AirMSPI spectral channels are centered at 355, 380, 445, 470, 555, 660, and 865 nm, with 470, 660, and 865 reporting linear polarization. We tested prototype retrievals by comparing the retrieved aerosol concentration, size distribution, water-leaving radiance, and chlorophyll concentrations from Airborne Multiangle SpectroPolarimetric Imager-1 (AirMSPI-1) observations to values reported by the USC SeaPRISM AERONET-OC site off the coast of California. The retrieval was then applied to a variety of costal regions in California to evaluate variability in the water-leaving radiance under different atmospheric conditions. We will present results, and will discuss algorithm sensitivity and potential applications for future space-borne coastal monitoring.

Development of a generalized algorithm of satellite remote sensing using multi-wavelength and multi-pixel information (MWP method) for aerosol properties by satellite-borne imager

NASA Astrophysics Data System (ADS)

Hashimoto, M.; Nakajima, T.; Morimoto, S.; Takenaka, H.

2014-12-01

We have developed a new satellite remote sensing algorithm to retrieve the aerosol optical characteristics using multi-wavelength and multi-pixel information of satellite imagers (MWP method). In this algorithm, the inversion method is a combination of maximum a posteriori (MAP) method (Rodgers, 2000) and the Phillips-Twomey method (Phillips, 1962; Twomey, 1963) as a smoothing constraint for the state vector. Furthermore, with the progress of computing technique, this method has being combined with the direct radiation transfer calculation numerically solved by each iteration step of the non-linear inverse problem, without using LUT (Look Up Table) with several constraints.Retrieved parameters in our algorithm are aerosol optical properties, such as aerosol optical thickness (AOT) of fine and coarse mode particles, a volume soot fraction in fine mode particles, and ground surface albedo of each observed wavelength. We simultaneously retrieve all the parameters that characterize pixels in each of horizontal sub-domains consisting the target area. Then we successively apply the retrieval method to all the sub-domains in the target area.We conducted numerical tests for the retrieval of aerosol properties and ground surface albedo for GOSAT/CAI imager data to test the algorithm for the land area. The result of the experiment showed that AOTs of fine mode and coarse mode, soot fraction and ground surface albedo are successfully retrieved within expected accuracy. We discuss the accuracy of the algorithm for various land surface types. Then, we applied this algorithm to GOSAT/CAI imager data, and we compared retrieved and surface-observed AOTs at the CAI pixel closest to an AERONET (Aerosol Robotic Network) or SKYNET site in each region. Comparison at several sites in urban area indicated that AOTs retrieved by our method are in agreement with surface-observed AOT within ±0.066.Our future work is to extend the algorithm for analysis of AGEOS-II/GLI and GCOM/C-SGLI data.

Material classification and automatic content enrichment of images using supervised learning and knowledge bases

NASA Astrophysics Data System (ADS)

Mallepudi, Sri Abhishikth; Calix, Ricardo A.; Knapp, Gerald M.

2011-02-01

In recent years there has been a rapid increase in the size of video and image databases. Effective searching and retrieving of images from these databases is a significant current research area. In particular, there is a growing interest in query capabilities based on semantic image features such as objects, locations, and materials, known as content-based image retrieval. This study investigated mechanisms for identifying materials present in an image. These capabilities provide additional information impacting conditional probabilities about images (e.g. objects made of steel are more likely to be buildings). These capabilities are useful in Building Information Modeling (BIM) and in automatic enrichment of images. I2T methodologies are a way to enrich an image by generating text descriptions based on image analysis. In this work, a learning model is trained to detect certain materials in images. To train the model, an image dataset was constructed containing single material images of bricks, cloth, grass, sand, stones, and wood. For generalization purposes, an additional set of 50 images containing multiple materials (some not used in training) was constructed. Two different supervised learning classification models were investigated: a single multi-class SVM classifier, and multiple binary SVM classifiers (one per material). Image features included Gabor filter parameters for texture, and color histogram data for RGB components. All classification accuracy scores using the SVM-based method were above 85%. The second model helped in gathering more information from the images since it assigned multiple classes to the images. A framework for the I2T methodology is presented.

Characterizing the Retrieval of Cloud Optical Thickness and Droplet Effective Radius to Overlying Aerosols Using a General Inverse Theory Approach

NASA Astrophysics Data System (ADS)

Coddington, O.; Pilewskie, P.; Schmidt, S.

2013-12-01

The upwelling shortwave irradiance measured by the airborne Solar Spectral Flux Radiometer (SSFR) flying above a cloud and aerosol layer is influenced by the properties of the cloud and aerosol particles below, just as would the radiance measured from satellite. Unlike satellite measurements, those from aircraft provide the unique capability to fly a lower-level leg above the cloud, yet below the aerosol layer, to characterize the extinction of the aerosol layer and account for its impact on the measured cloud albedo. Previous work [Coddington et al., 2010] capitalized on this opportunity to test the effects of aerosol particles (or more appropriately, the effects of neglecting aerosols in forward modeling calculations) on cloud retrievals using data obtained during the Intercontinental Chemical Transport Experiment/Intercontinental Transport and Chemical Transformation of anthropogenic pollution (INTEX-A/ITCT) study. This work showed aerosols can cause a systematic bias in the cloud retrieval and that such a bias would need to be distinguished from a true aerosol indirect effect (i.e. the brightening of a cloud due to aerosol effects on cloud microphysics) as theorized by Haywood et al., [2004]. The effects of aerosols on clouds are typically neglected in forward modeling calculations because their pervasiveness, variable microphysical properties, loading, and lifetimes makes forward modeling calculations under all possible combinations completely impractical. Using a general inverse theory technique, which propagates separate contributions from measurement and forward modeling errors into probability distributions of retrieved cloud optical thickness and droplet effective radius, we have demonstrated how the aerosol presence can be introduced as a spectral systematic error in the distributions of the forward modeling solutions. The resultant uncertainty and bias in cloud properties induced by the aerosols is identified by the shape and peak of the posteriori retrieval distributions. In this work, we apply this general inverse theory approach to extend our analysis of the spectrally-dependent impacts of overlying aerosols on cloud properties over a broad range in cloud optical thickness and droplet effective radius. We investigate the relative impacts of this error source and compare and contrast results to biases and uncertainties in cloud properties induced by varying surface conditions (ocean, land, snow). We perform the analysis for two different measurement accuracies (3% and 0.3%) that are typical of current passive imagers, such as the Moderate Resolution Imaging Spectroradiometer (MODIS) [Platnick et al., 2003], and that are expected for future passive imagers, such as the HyperSpectral Imager for Climate Science (HySICS) [Kopp et al., 2010]. Coddington, O., P. Pilewskie, et al., 2010, J. Geophys. Res., 115, doi: 10.1029/2009JD012829. Haywood, J. M., S. R. Osborne, and S. J. Abel, 2004, Q. J. R. Meteorol. Soc., 130, 779-800. Kopp, G., et al., 2010, Hyperspectral Imagery Radiometry Improvements for Visible and Near-Infrared Climate Studies, paper presented at 2010 Earth Science Technology Forum, Arlington, VA, USA. Platnick, S., et al., 2003, IEEE Trans. Geosci. Remote Sens., 41(2), 459- 473.

anisotropic microseismic focal mechanism inversion by waveform imaging matching

NASA Astrophysics Data System (ADS)

Wang, L.; Chang, X.; Wang, Y.; Xue, Z.

2016-12-01

The focal mechanism is one of the most important parameters in source inversion, for both natural earthquakes and human-induced seismic events. It has been reported to be useful for understanding stress distribution and evaluating the fracturing effect. The conventional focal mechanism inversion method picks the first arrival waveform of P wave. This method assumes the source as a Double Couple (DC) type and the media isotropic, which is usually not the case for induced seismic focal mechanism inversion. For induced seismic events, the inappropriate source and media model in inversion processing, by introducing ambiguity or strong simulation errors, will seriously reduce the inversion effectiveness. First, the focal mechanism contains significant non-DC source type. Generally, the source contains three components: DC, isotropic (ISO) and the compensated linear vector dipole (CLVD), which makes focal mechanisms more complicated. Second, the anisotropy of media will affect travel time and waveform to generate inversion bias. The common way to describe focal mechanism inversion is based on moment tensor (MT) inversion which can be decomposed into the combination of DC, ISO and CLVD components. There are two ways to achieve MT inversion. The wave-field migration method is applied to achieve moment tensor imaging. This method can construct elements imaging of MT in 3D space without picking the first arrival, but the retrieved MT value is influenced by imaging resolution. The full waveform inversion is employed to retrieve MT. In this method, the source position and MT can be reconstructed simultaneously. However, this method needs vast numerical calculation. Moreover, the source position and MT also influence each other in the inversion process. In this paper, the waveform imaging matching (WIM) method is proposed, which combines source imaging with waveform inversion for seismic focal mechanism inversion. Our method uses the 3D tilted transverse isotropic (TTI) elastic wave equation to approximate wave propagating in anisotropic media. First, a source imaging procedure is employed to obtain the source position. Second, we refine a waveform inversion algorithm to retrieve MT. We also use a microseismic data set recorded in surface acquisition to test our method.

Retrieval of subvisual cirrus cloud optical thickness from limb-scatter measurements

NASA Astrophysics Data System (ADS)

Wiensz, J. T.; Degenstein, D. A.; Lloyd, N. D.; Bourassa, A. E.

2013-01-01

We present a technique for estimating the optical thickness of subvisual cirrus clouds detected by OSIRIS (Optical Spectrograph and Infrared Imaging System), a limb-viewing satellite instrument that measures scattered radiances from the UV to the near-IR. The measurement set is composed of a ratio of limb radiance profiles at two wavelengths that indicates the presence of cloud-scattering regions. Cross-sections and phase functions from an in situ database are used to simulate scattering by cloud-particles. With appropriate configurations discussed in this paper, the SASKTRAN successive-orders of scatter radiative transfer model is able to simulate accurately the in-cloud radiances from OSIRIS. Configured in this way, the model is used with a multiplicative algebraic reconstruction technique (MART) to retrieve the cloud extinction profile for an assumed effective cloud particle size. The sensitivity of these retrievals to key auxiliary model parameters is shown, and it is shown that the retrieved extinction profile, for an assumed effective cloud particle size, models well the measured in-cloud radiances from OSIRIS. The greatest sensitivity of the retrieved optical thickness is to the effective cloud particle size. Since OSIRIS has an 11-yr record of subvisual cirrus cloud detections, the work described in this manuscript provides a very useful method for providing a long-term global record of the properties of these clouds.

4-D cloud properties from passive satellite data and applications to resolve the flight icing threat to aircraft

NASA Astrophysics Data System (ADS)

Smith, William L., Jr.

The threat for aircraft icing in clouds is a significant hazard that routinely impacts aviation operations. Accurate diagnoses and forecasts of aircraft icing conditions requires identifying the location and vertical distribution of clouds with super-cooled liquid water (SLW) droplets, as well as the characteristics of the droplet size distribution. Traditional forecasting methods rely on guidance from numerical models and conventional observations, neither of which currently resolve cloud properties adequately on the optimal scales needed for aviation. Satellite imagers provide measurements over large areas with high spatial resolution that can be interpreted to identify the locations and characteristics of clouds, including features associated with adverse weather and storms. This thesis develops new techniques for interpreting cloud products derived from satellite data to infer the flight icing threat to aircraft in a wide range of cloud conditions. For unobscured low clouds, the icing threat is determined using empirical relationships developed from correlations between satellite imager retrievals of liquid water path and droplet size with icing conditions reported by pilots (PIREPS). For deep ice over water cloud systems, ice and liquid water content profiles are derived by using the imager cloud properties to constrain climatological information on cloud vertical structure and water phase obtained apriori from radar and lidar observations, and from cloud model analyses. Retrievals of the SLW content embedded within overlapping clouds are mapped to the icing threat using guidance from an airfoil modeling study. Compared to PIREPS, the satellite icing detection and intensity accuracies are found to be about 90% and 70%, respectively. Mean differences between the imager IWC retrievals with those from CloudSat and Calipso are less than 30%. This level of closure in the cloud water budget can only be achieved by correcting for errors in the imager retrievals due to the simplifying but poor assumption that deep optically thick clouds are single-phase and vertically homogeneous. When applied to geostationary satellite data, the profiling method provides a real-time characterization of clouds in 4-D. This research should improve the utility of satellite imager data for quantitatively diagnosing and predicting clouds and their effects in weather and climate applications.

Effects of context and word class on lexical retrieval in Chinese speakers with anomic aphasia.

PubMed

Law, Sam-Po; Kong, Anthony Pak-Hin; Lai, Loretta Wing-Shan; Lai, Christy

2015-01-01

Differences in processing nouns and verbs have been investigated intensely in psycholinguistics and neuropsychology in past decades. However, the majority of studies examining retrieval of these word classes have involved tasks of single word stimuli or responses. While the results have provided rich information for addressing issues about grammatical class distinctions, it is unclear whether they have adequate ecological validity for understanding lexical retrieval in connected speech which characterizes daily verbal communication. Previous investigations comparing retrieval of nouns and verbs in single word production and connected speech have reported either discrepant performance between the two contexts with presence of word class dissociation in picture naming but absence in connected speech, or null effects of word class. In addition, word finding difficulties have been found to be less severe in connected speech than picture naming. However, these studies have failed to match target stimuli of the two word classes and between tasks on psycholinguistic variables known to affect performance in response latency and/or accuracy. The present study compared lexical retrieval of nouns and verbs in picture naming and connected speech from picture description, procedural description, and story-telling among 19 Chinese speakers with anomic aphasia and their age, gender, and education matched healthy controls, to understand the influence of grammatical class on word production across speech contexts when target items were balanced for confounding variables between word classes and tasks. Elicitation of responses followed the protocol of the AphasiaBank consortium (http://talkbank.org/AphasiaBank/). Target words for confrontation naming were based on well-established naming tests, while those for narrative were drawn from a large database of normal speakers. Selected nouns and verbs in the two contexts were matched for age-of-acquisition (AoA) and familiarity. Influence of imageability was removed through statistical control. When AoA and familiarity were balanced, nouns were retrieved better than verbs, and performance was higher in picture naming than connected speech. When imageability was further controlled for, only the effect of task remained significant. The absence of word class effects when confounding variables are controlled for is similar to many previous reports; however, the pattern of better word retrieval in naming is rare but compatible with the account that processing demands are higher in narrative than naming. The overall findings have strongly suggested the importance of including connected speech tasks in any language assessment and evaluation of language rehabilitation of individuals with aphasia.

Effects of context and word class on lexical retrieval in Chinese speakers with anomic aphasia

PubMed Central

Law, Sam-Po; Kong, Anthony Pak-Hin; Lai, Loretta Wing-Shan; Lai, Christy

2014-01-01

Background Differences in processing nouns and verbs have been investigated intensely in psycholinguistics and neuropsychology in past decades. However, the majority of studies examining retrieval of these word classes have involved tasks of single word stimuli or responses. While the results have provided rich information for addressing issues about grammatical class distinctions, it is unclear whether they have adequate ecological validity for understanding lexical retrieval in connected speech which characterizes daily verbal communication. Previous investigations comparing retrieval of nouns and verbs in single word production and connected speech have reported either discrepant performance between the two contexts with presence of word class dissociation in picture naming but absence in connected speech, or null effects of word class. In addition, word finding difficulties have been found to be less severe in connected speech than picture naming. However, these studies have failed to match target stimuli of the two word classes and between tasks on psycholinguistic variables known to affect performance in response latency and/or accuracy. Aims The present study compared lexical retrieval of nouns and verbs in picture naming and connected speech from picture description, procedural description, and story-telling among 19 Chinese speakers with anomic aphasia and their age, gender, and education matched healthy controls, to understand the influence of grammatical class on word production across speech contexts when target items were balanced for confounding variables between word classes and tasks. Methods & Procedures Elicitation of responses followed the protocol of the AphasiaBank consortium (http://talkbank.org/AphasiaBank/). Target words for confrontation naming were based on well-established naming tests, while those for narrative were drawn from a large database of normal speakers. Selected nouns and verbs in the two contexts were matched for age-of-acquisition (AoA) and familiarity. Influence of imageability was removed through statistical control. Outcomes & Results When AoA and familiarity were balanced, nouns were retrieved better than verbs, and performance was higher in picture naming than connected speech. When imageability was further controlled for, only the effect of task remained significant. Conclusions The absence of word class effects when confounding variables are controlled for is similar to many previous reports; however, the pattern of better word retrieval in naming is rare but compatible with the account that processing demands are higher in narrative than naming. The overall findings have strongly suggested the importance of including connected speech tasks in any language assessment and evaluation of language rehabilitation of individuals with aphasia. PMID:25505810

Storage and retrieval of digital images in dermatology.

PubMed

Bittorf, A; Krejci-Papa, N C; Diepgen, T L

1995-11-01

Differential diagnosis in dermatology relies on the interpretation of visual information in the form of clinical and histopathological images. Up until now, reference images have had to be retrieved from textbooks and/or appropriate journals. To overcome inherent limitations of those storage media with respect to the number of images stored, display, and search parameters available, we designed a computer-based database of digitized dermatologic images. Images were taken from the photo archive of the Dermatological Clinic of the University of Erlangen. A database was designed using the Entity-Relationship approach. It was implemented on a PC-Windows platform using MS Access* and MS Visual Basic®. As WWW-server a Sparc 10 workstation was used with the CERN Hypertext-Transfer-Protocol-Daemon (httpd) 3.0 pre 6 software running. For compressed storage on a hard drive, a quality factor of 60 allowed on-screen differential diagnosis and corresponded to a compression factor of 1:35 for clinical images and 1:40 for histopathological images. Hierarchical keys of clinical or histopathological criteria permitted multi-criteria searches. A script using the Common Gateway Interface (CGI) enabled remote search and image retrieval via the World-Wide-Web (W3). A dermatologic image database, featurig clinical and histopathological images was constructed which allows for multi-parameter searches and world-wide remote access.

An improved TV caption image binarization method

NASA Astrophysics Data System (ADS)

Jiang, Mengdi; Cheng, Jianghua; Chen, Minghui; Ku, Xishu

2018-04-01

TV Video caption image binarization has important influence on semantic video retrieval. An improved binarization method for caption image is proposed in this paper. In order to overcome the shortcomings of ghost and broken strokes problems of traditional Niblack method, the method has considered the global information of the images and the local information of the images. First, Tradition Otsu and Niblack thresholds are used for initial binarization. Second, we introduced the difference between maximum and minimum values in the local window as a third threshold to generate two images. Finally, with a logic AND operation of the two images, great results were obtained. The experiment results prove that the proposed method is reliable and effective.

Unsupervised universal steganalyzer for high-dimensional steganalytic features

NASA Astrophysics Data System (ADS)

Hou, Xiaodan; Zhang, Tao

2016-11-01

The research in developing steganalytic features has been highly successful. These features are extremely powerful when applied to supervised binary classification problems. However, they are incompatible with unsupervised universal steganalysis because the unsupervised method cannot distinguish embedding distortion from varying levels of noises caused by cover variation. This study attempts to alleviate the problem by introducing similarity retrieval of image statistical properties (SRISP), with the specific aim of mitigating the effect of cover variation on the existing steganalytic features. First, cover images with some statistical properties similar to those of a given test image are searched from a retrieval cover database to establish an aided sample set. Then, unsupervised outlier detection is performed on a test set composed of the given test image and its aided sample set to determine the type (cover or stego) of the given test image. Our proposed framework, called SRISP-aided unsupervised outlier detection, requires no training. Thus, it does not suffer from model mismatch mess. Compared with prior unsupervised outlier detectors that do not consider SRISP, the proposed framework not only retains the universality but also exhibits superior performance when applied to high-dimensional steganalytic features.

The Effect of Stimulus Valence on Lexical Retrieval in Younger and Older Adults.

PubMed

Blackett, Deena Schwen; Harnish, Stacy M; Lundine, Jennifer P; Zezinka, Alexandra; Healy, Eric W

2017-07-12

Although there is evidence that emotional valence of stimuli impacts lexical processes, there is limited work investigating its specific impact on lexical retrieval. The current study aimed to determine the degree to which emotional valence of pictured stimuli impacts naming latencies in healthy younger and older adults. Eighteen healthy younger adults and 18 healthy older adults named positive, negative, and neutral images, and reaction time was measured. Reaction times for positive and negative images were significantly longer than reaction times for neutral images. Reaction times for positive and negative images were not significantly different. Whereas older adults demonstrated significantly longer naming latencies overall than younger adults, the discrepancy in latency with age was far greater when naming emotional pictures. Emotional arousal of pictures appears to impact naming latency in younger and older adults. We hypothesize that the increase in naming latency for emotional stimuli is the result of a necessary disengagement of attentional resources from the emotional images prior to completion of the naming task. We propose that this process may affect older adults disproportionately due to a decline in attentional resources as part of normal aging, combined with a greater attentional preference for emotional stimuli.

Coupled binary embedding for large-scale image retrieval.

PubMed

Zheng, Liang; Wang, Shengjin; Tian, Qi

2014-08-01

Visual matching is a crucial step in image retrieval based on the bag-of-words (BoW) model. In the baseline method, two keypoints are considered as a matching pair if their SIFT descriptors are quantized to the same visual word. However, the SIFT visual word has two limitations. First, it loses most of its discriminative power during quantization. Second, SIFT only describes the local texture feature. Both drawbacks impair the discriminative power of the BoW model and lead to false positive matches. To tackle this problem, this paper proposes to embed multiple binary features at indexing level. To model correlation between features, a multi-IDF scheme is introduced, through which different binary features are coupled into the inverted file. We show that matching verification methods based on binary features, such as Hamming embedding, can be effectively incorporated in our framework. As an extension, we explore the fusion of binary color feature into image retrieval. The joint integration of the SIFT visual word and binary features greatly enhances the precision of visual matching, reducing the impact of false positive matches. Our method is evaluated through extensive experiments on four benchmark datasets (Ukbench, Holidays, DupImage, and MIR Flickr 1M). We show that our method significantly improves the baseline approach. In addition, large-scale experiments indicate that the proposed method requires acceptable memory usage and query time compared with other approaches. Further, when global color feature is integrated, our method yields competitive performance with the state-of-the-arts.

Texture-specific bag of visual words model and spatial cone matching-based method for the retrieval of focal liver lesions using multiphase contrast-enhanced CT images.

PubMed

Xu, Yingying; Lin, Lanfen; Hu, Hongjie; Wang, Dan; Zhu, Wenchao; Wang, Jian; Han, Xian-Hua; Chen, Yen-Wei

2018-01-01

The bag of visual words (BoVW) model is a powerful tool for feature representation that can integrate various handcrafted features like intensity, texture, and spatial information. In this paper, we propose a novel BoVW-based method that incorporates texture and spatial information for the content-based image retrieval to assist radiologists in clinical diagnosis. This paper presents a texture-specific BoVW method to represent focal liver lesions (FLLs). Pixels in the region of interest (ROI) are classified into nine texture categories using the rotation-invariant uniform local binary pattern method. The BoVW-based features are calculated for each texture category. In addition, a spatial cone matching (SCM)-based representation strategy is proposed to describe the spatial information of the visual words in the ROI. In a pilot study, eight radiologists with different clinical experience performed diagnoses for 20 cases with and without the top six retrieved results. A total of 132 multiphase computed tomography volumes including five pathological types were collected. The texture-specific BoVW was compared to other BoVW-based methods using the constructed dataset of FLLs. The results show that our proposed model outperforms the other three BoVW methods in discriminating different lesions. The SCM method, which adds spatial information to the orderless BoVW model, impacted the retrieval performance. In the pilot trial, the average diagnosis accuracy of the radiologists was improved from 66 to 80% using the retrieval system. The preliminary results indicate that the texture-specific features and the SCM-based BoVW features can effectively characterize various liver lesions. The retrieval system has the potential to improve the diagnostic accuracy and the confidence of the radiologists.

Internally Consistent MODIS Estimate of Aerosol Clear-Sky Radiative Effect Over the Global Oceans

NASA Technical Reports Server (NTRS)

Remer, Lorraine A.; Kaufman, Yoram J.

2004-01-01

Modern satellite remote sensing, and in particular the MODerate resolution Imaging Spectroradiometer (MODIS), offers a measurement-based pathway to estimate global aerosol radiative effects and aerosol radiative forcing. Over the Oceans, MODIS retrieves the total aerosol optical thickness, but also reports which combination of the 9 different aerosol models was used to obtain the retrieval. Each of the 9 models is characterized by a size distribution and complex refractive index, which through Mie calculations correspond to a unique set of single scattering albedo, assymetry parameter and spectral extinction for each model. The combination of these sets of optical parameters weighted by the optical thickness attributed to each model in the retrieval produces the best fit to the observed radiances at the top of the atmosphere. Thus the MODIS Ocean aerosol retrieval provides us with (1) An observed distribution of global aerosol loading, and (2) An internally-consistent, observed, distribution of aerosol optical models that when used in combination will best represent the radiances at the top of the atmosphere. We use these two observed global distributions to initialize the column climate model by Chou and Suarez to calculate the aerosol radiative effect at top of the atmosphere and the radiative efficiency of the aerosols over the global oceans. We apply the analysis to 3 years of MODIS retrievals from the Terra satellite and produce global and regional, seasonally varying, estimates of aerosol radiative effect over the clear-sky oceans.

Development of an Aerosol Opacity Retrieval Algorithm for Use with Multi-Angle Land Surface Images

NASA Technical Reports Server (NTRS)

Diner, D.; Paradise, S.; Martonchik, J.

1994-01-01

In 1998, the Multi-angle Imaging SpectroRadiometer (MISR) will fly aboard the EOS-AM1 spacecraft. MISR will enable unique methods for retrieving the properties of atmospheric aerosols, by providing global imagery of the Earth at nine viewing angles in four visible and near-IR spectral bands. As part of the MISR algorithm development, theoretical methods of analyzing multi-angle, multi-spectral data are being tested using images acquired by the airborne Advanced Solid-State Array Spectroradiometer (ASAS). In this paper we derive a method to be used over land surfaces for retrieving the change in opacity between spectral bands, which can then be used in conjunction with an aerosol model to derive a bound on absolute opacity.

Visual object imagery and autobiographical memory: Object Imagers are better at remembering their personal past.

PubMed

Vannucci, Manila; Pelagatti, Claudia; Chiorri, Carlo; Mazzoni, Giuliana

2016-01-01

In the present study we examined whether higher levels of object imagery, a stable characteristic that reflects the ability and preference in generating pictorial mental images of objects, facilitate involuntary and voluntary retrieval of autobiographical memories (ABMs). Individuals with high (High-OI) and low (Low-OI) levels of object imagery were asked to perform an involuntary and a voluntary ABM task in the laboratory. Results showed that High-OI participants generated more involuntary and voluntary ABMs than Low-OI, with faster retrieval times. High-OI also reported more detailed memories compared to Low-OI and retrieved memories as visual images. Theoretical implications of these findings for research on voluntary and involuntary ABMs are discussed.

Estimating Missing Features to Improve Multimedia Information Retrieval

DOE Office of Scientific and Technical Information (OSTI.GOV)

Bagherjeiran, A; Love, N S; Kamath, C

Retrieval in a multimedia database usually involves combining information from different modalities of data, such as text and images. However, all modalities of the data may not be available to form the query. The retrieval results from such a partial query are often less than satisfactory. In this paper, we present an approach to complete a partial query by estimating the missing features in the query. Our experiments with a database of images and their associated captions show that, with an initial text-only query, our completion method has similar performance to a full query with both image and text features.more » In addition, when we use relevance feedback, our approach outperforms the results obtained using a full query.« less

Fourier ptychographic reconstruction using Poisson maximum likelihood and truncated Wirtinger gradient.

PubMed

Bian, Liheng; Suo, Jinli; Chung, Jaebum; Ou, Xiaoze; Yang, Changhuei; Chen, Feng; Dai, Qionghai

2016-06-10

Fourier ptychographic microscopy (FPM) is a novel computational coherent imaging technique for high space-bandwidth product imaging. Mathematically, Fourier ptychographic (FP) reconstruction can be implemented as a phase retrieval optimization process, in which we only obtain low resolution intensity images corresponding to the sub-bands of the sample's high resolution (HR) spatial spectrum, and aim to retrieve the complex HR spectrum. In real setups, the measurements always suffer from various degenerations such as Gaussian noise, Poisson noise, speckle noise and pupil location error, which would largely degrade the reconstruction. To efficiently address these degenerations, we propose a novel FP reconstruction method under a gradient descent optimization framework in this paper. The technique utilizes Poisson maximum likelihood for better signal modeling, and truncated Wirtinger gradient for effective error removal. Results on both simulated data and real data captured using our laser-illuminated FPM setup show that the proposed method outperforms other state-of-the-art algorithms. Also, we have released our source code for non-commercial use.

Multimodal Deep Autoencoder for Human Pose Recovery.

PubMed

Hong, Chaoqun; Yu, Jun; Wan, Jian; Tao, Dacheng; Wang, Meng

2015-12-01

Video-based human pose recovery is usually conducted by retrieving relevant poses using image features. In the retrieving process, the mapping between 2D images and 3D poses is assumed to be linear in most of the traditional methods. However, their relationships are inherently non-linear, which limits recovery performance of these methods. In this paper, we propose a novel pose recovery method using non-linear mapping with multi-layered deep neural network. It is based on feature extraction with multimodal fusion and back-propagation deep learning. In multimodal fusion, we construct hypergraph Laplacian with low-rank representation. In this way, we obtain a unified feature description by standard eigen-decomposition of the hypergraph Laplacian matrix. In back-propagation deep learning, we learn a non-linear mapping from 2D images to 3D poses with parameter fine-tuning. The experimental results on three data sets show that the recovery error has been reduced by 20%-25%, which demonstrates the effectiveness of the proposed method.

Remote sensing of cloud droplet size distributions in DC3 with the UMBC-LACO Rainbow Polarimetric Imager (RPI)

NASA Astrophysics Data System (ADS)

Buczkowski, S.; Martins, J.; Fernandez-Borda, R.; Cieslak, D.; Hall, J.

2013-12-01

The UMBC Rainbow Polarimetric Imager is a small form factor VIS imaging polarimeter suitable for use on a number of platforms. An optical system based on a Phillips prism with three Bayer filter color detectors, each detecting a separate polarization state, allows simultaneous detection of polarization and spectral information. A Mueller matrix-like calibration scheme corrects for polarization artifacts in the optical train and allows retrieval of the polarization state of incoming light to better than 0.5%. Coupled with wide field of view optics (~90°), RPI can capture images of cloudbows over a wide range of aircraft headings and solar zenith angles for retrieval of cloud droplet size distribution (DSD) parameters. In May-June 2012, RPI was flown in a nadir port on the NASA DC-8 during the DC3 field campaign. We will show examples of cloudbow DSD parameter retrievals from the campaign to demonstrate the efficacy of such a system to terrestrial atmospheric remote sensing. RPI image from DC3 06/15/2012 flight. Left panel is raw image from the RPI 90° camera. Middle panel is Stokes 'q' parameter retrieved from full three camera dataset. Right panel is a horizontal cut in 'q' through the glory. Both middle and right panels clearly show cloudbow features which can be fit to infer cloud DSD parameters.

Image-Based Airborne LiDAR Point Cloud Encoding for 3d Building Model Retrieval

NASA Astrophysics Data System (ADS)

Chen, Yi-Chen; Lin, Chao-Hung

2016-06-01

With the development of Web 2.0 and cyber city modeling, an increasing number of 3D models have been available on web-based model-sharing platforms with many applications such as navigation, urban planning, and virtual reality. Based on the concept of data reuse, a 3D model retrieval system is proposed to retrieve building models similar to a user-specified query. The basic idea behind this system is to reuse these existing 3D building models instead of reconstruction from point clouds. To efficiently retrieve models, the models in databases are compactly encoded by using a shape descriptor generally. However, most of the geometric descriptors in related works are applied to polygonal models. In this study, the input query of the model retrieval system is a point cloud acquired by Light Detection and Ranging (LiDAR) systems because of the efficient scene scanning and spatial information collection. Using Point clouds with sparse, noisy, and incomplete sampling as input queries is more difficult than that by using 3D models. Because that the building roof is more informative than other parts in the airborne LiDAR point cloud, an image-based approach is proposed to encode both point clouds from input queries and 3D models in databases. The main goal of data encoding is that the models in the database and input point clouds can be consistently encoded. Firstly, top-view depth images of buildings are generated to represent the geometry surface of a building roof. Secondly, geometric features are extracted from depth images based on height, edge and plane of building. Finally, descriptors can be extracted by spatial histograms and used in 3D model retrieval system. For data retrieval, the models are retrieved by matching the encoding coefficients of point clouds and building models. In experiments, a database including about 900,000 3D models collected from the Internet is used for evaluation of data retrieval. The results of the proposed method show a clear superiority over related methods.

DOE Office of Scientific and Technical Information (OSTI.GOV)

Zhang, R; Jee, K; Sharp, G

Purpose: Proton radiography, which images the patients with the same type of particles that they are to be treated with, is a promising approach for image guidance and range uncertainties reduction. This study aimed to realize quality proton radiography by measuring dose rate functions (DRF) in time domain using a single flat panel and retrieve water equivalent path length (WEPL) from them. Methods: An amorphous silicon flat panel (PaxScan™ 4030CB, Varian Medical Systems, Inc., Palo Alto, CA) was placed behind phantoms to measure DRFs from a proton beam modulated by the modulator wheel. To retrieve WEPL and RSP, calibration modelsmore » based on the intensity of DRFs only, root mean square (RMS) of DRFs only and the intensity weighted RMS were tested. The quality of obtained WEPL images (in terms of spatial resolution and level of details) and the accuracy of WEPL were compared. Results: RSPs for most of the Gammex phantom inserts were retrieved within ± 1% errors by calibration models based on the RMS and intensity weighted RMS. The mean percentage error for all inserts was reduced from 1.08% to 0.75% by matching intensity in the calibration model. In specific cases such as the insert with a titanium rod, the calibration model based on RMS only fails while the that based on intensity weighted RMS is still valid. The quality of retrieved WEPL images were significantly improved for calibration models including intensity matching. Conclusion: For the first time, a flat panel, which is readily available in the beamline for image guidance, was tested to acquire quality proton radiography with WEPL accurately retrieved from it. This technique is promising to be applied for image-guided proton therapy as well as patient specific RSP determination to reduce uncertainties of beam ranges.« less

Content-based unconstrained color logo and trademark retrieval with color edge gradient co-occurrence histograms

NASA Astrophysics Data System (ADS)

Phan, Raymond; Androutsos, Dimitrios

2008-01-01

In this paper, we present a logo and trademark retrieval system for unconstrained color image databases that extends the Color Edge Co-occurrence Histogram (CECH) object detection scheme. We introduce more accurate information to the CECH, by virtue of incorporating color edge detection using vector order statistics. This produces a more accurate representation of edges in color images, in comparison to the simple color pixel difference classification of edges as seen in the CECH. Our proposed method is thus reliant on edge gradient information, and as such, we call this the Color Edge Gradient Co-occurrence Histogram (CEGCH). We use this as the main mechanism for our unconstrained color logo and trademark retrieval scheme. Results illustrate that the proposed retrieval system retrieves logos and trademarks with good accuracy, and outperforms the CECH object detection scheme with higher precision and recall.

Indexing the medical open access literature for textual and content-based visual retrieval.

PubMed

Eggel, Ivan; Müller, Henning

2010-01-01

Over the past few years an increasing amount of scientific journals have been created in an open access format. Particularly in the medical field the number of openly accessible journals is enormous making a wide body of knowledge available for analysis and retrieval. Part of the trend towards open access publications can be linked to funding bodies such as the NIH¹ (National Institutes of Health) and the Swiss National Science Foundation (SNF²) requiring funded projects to make all articles of funded research available publicly. This article describes an approach to make part of the knowledge of open access journals available for retrieval including the textual information but also the images contained in the articles. For this goal all articles of 24 journals related to medical informatics and medical imaging were crawled from the web pages of BioMed Central. Text and images of the PDF (Portable Document Format) files were indexed separately and a web-based retrieval interface allows for searching via keyword queries or by visual similarity queries. Starting point for a visual similarity query can be an image on the local hard disk that is uploaded or any image found via the textual search. Search for similar documents is also possible.

The GUI OPAC: Approach with Caution.

ERIC Educational Resources Information Center

Hildreth, Charles R.

1995-01-01

Discusses the graphical user interface (GUI) online public access catalog (OPAC), a user interface that uses images to represent options. Topics include user interface design for information retrieval; designing effective bibliographic displays, including subject headings; two design principles; and what GUIs can bring to OPACs. (LRW)

Neural mechanism underlying autobiographical memory modulated by remoteness and emotion

NASA Astrophysics Data System (ADS)

Ge, Ruiyang; Fu, Yan; Wang, DaHua; Yao, Li; Long, Zhiying

2012-03-01

Autobiographical memory is the ability to recollect past events from one's own life. Both emotional tone and memory remoteness can influence autobiographical memory retrieval along the time axis of one's life. Although numerous studies have been performed to investigate brain regions involved in retrieving processes of autobiographical memory, the effect of emotional tone and memory age on autobiographical memory retrieval remains to be clarified. Moreover, whether the involvement of hippocampus in consolidation of autobiographical events is time dependent or independent has been controversial. In this study, we investigated the effect of memory remoteness (factor1: recent and remote) and emotional valence (factor2: positive and negative) on neural correlates underlying autobiographical memory by using functional magnetic resonance imaging (fMRI) technique. Although all four conditions activated some common regions known as "core" regions in autobiographical memory retrieval, there are some other regions showing significantly different activation for recent versus remote and positive versus negative memories. In particular, we found that bilateral hippocampal regions were activated in the four conditions regardless of memory remoteness and emotional valence. Thus, our study confirmed some findings of previous studies and provided further evidence to support the multi-trace theory which believes that the role of hippocampus involved in autobiographical memory retrieval is time-independent and permanent in memory consolidation.

Safety and Effectiveness of the Denali Inferior Vena Cava Filter: Intermediate Follow-Up Results.

PubMed

Reis, Stephen P; Kovoor, Jerry; Sutphin, Patrick D; Toomay, Seth; Trimmer, Clayton; Pillai, Anil; Reddick, Mark; Kalva, Sanjeeva P

2016-08-01

The purpose of the study is to evaluate the clinical safety and effectiveness of the Denali (Bard, Tempe, Arizona) retrievable inferior vena cava (IVC) filter. In this retrospective study, authors reviewed the data of Denali IVC filters placed at their institution between 2013 and 2015. The clinical presentation, indications, and procedure-related complications during placement and retrieval were evaluated. The frequency of post filter pulmonary embolism (PE) and filter-related complications was assessed. Denali filters were placed in 87 patients (47 males; mean age: 56 years). Twenty patients presented with PE, 45 with deep vein thrombosis (DVT), and 21 with both PE and DVT, 1 filter was placed prophylactically before surgery. Indications for filter placement included contraindications to anticoagulation (AC; n = 80), failure of AC (n = 4), and complications of AC (n = 3). No patients had PE on follow-up imaging after filter placement. Retrieval was attempted in 31 patients after a mean period of 125 days (range: 34-324 days). The filter was successfully removed in 31 (100%) patients. Follow-up imaging, available in 71 (82%) patients (range: 2-538 days), demonstrated penetration of 15 legs in 5 patients, caval thrombus in 3, 1 resulting in caval occlusion, <15° filter tilt in 5, and no leg fractures or crossed legs. The Denali filter is safe during deployment and readily retrievable. The overall safety following deployment is similar to those reported in the literature, and the incidence of filter fractures and migration appears to be less than the previous generation of Bard devices. © The Author(s) 2016.

Changes in the TRMM Version 7 Space/Time Averaged Level 3 Data Products Based on GPROF TMI Swath-Based Precipitation Retrievals

NASA Technical Reports Server (NTRS)

Stocker, Erich; Kelley, Owen; Kummerow, Christian; Chou, Joyce; Woltz, Lawrence

2010-01-01

TRMM has three level 3 (space/time averaged) data products that aggregate level 2 TRMM Microwave Imager (TMI) GPROF precipitation retrievals. These three products are TRMM 3A12, which is a monthly accumulation of 2A12 the GPROF swath retrieval product; TRMM 3B31, which is a monthly accumulation of 2A12 and 2B31 the combined retrieval product that uses both Precipitation Radar (PR) and TMI data; and 3G68 and its variants, which provide hourly retrievals for TMI, PR and combined. The 3G68 products are packaged as daily files but provide hourly information at 0.5 deg x 0.5 deg resolution globally, 0.25 deg x 0.25 deg globally, or 0.1 deg x 0.1 deg over Africa, Australia and South America. This paper will present early information of the changes in the v7 TMI GPROF level 2 retrievals that have an impact on the level 3 accumulations. This paper provides an analysis of the effect the 2A12 GPROF changes have on 3G68 products. In addition, it provides a comparison between the TRMM level 3 products that use the TMI GPROF swath retrievals.

A New 1DVAR Retrieval for AMSR2 and GMI: Validation and Sensitivites

NASA Astrophysics Data System (ADS)

Duncan, D.; Kummerow, C. D.

2015-12-01

A new non-raining retrieval has been developed for microwave imagers and applied to the GMI and AMSR2 sensors. With the Community Radiative Transfer Model (CRTM) as the forward model for the physical retrieval, a 1-dimensional variational method finds the atmospheric state which minimizes the difference between observed and simulated brightness temperatures. A key innovation of the algorithm development is a method to calculate the sensor error covariance matrix that is specific to the forward model employed and includes off-diagonal elements, allowing the algorithm to handle various forward models and sensors with little cross-talk. The water vapor profile is resolved by way of empirical orthogonal functions (EOFs) and then summed to get total precipitable water (TPW). Validation of retrieved 10m wind speed, TPW, and sea surface temperature (SST) is performed via comparison with buoys and radiosondes as well as global models and other remotely sensed products. In addition to the validation, sensitivity experiments investigate the impact of ancillary data on the under-constrained retrieval, a concern for climate data records that strive to be independent of model biases. The introduction of model analysis data is found to aid the algorithm most at high frequency channels and affect TPW retrievals, whereas wind and cloud water retrievals show little effect from ingesting further ancillary data.

High-resolution fluorescence imaging for red and far-red SIF retrieval at leaf and canopy scales

NASA Astrophysics Data System (ADS)

Albert, L.; Alonso, L.; Cushman, K.; Kellner, J. R.

2017-12-01

New commercial-off-the-shelf imaging spectrometers promise the combination of high spatial and spectral resolution needed to retrieve solar induced fluorescence (SIF) at multiple wavelengths for individual plants and even individual leaves from low-altitude airborne or ground-based platforms. Data from these instruments could provide insight into the status of the photosynthetic apparatus at scales of space and time not observable from high-altitude and space-based platforms, and could support calibration and validation activities of current and forthcoming space missions to quantify SIF (OCO-2, OCO-3, FLEX, and GEOCARB). High-spectral resolution enables SIF retrieval from regions of strong telluric absorption by molecular oxygen, and also within numerous solar Fraunhofer lines in atmospheric windows not obscured by oxygen or water absorptions. Here we evaluate algorithms for SIF retrieval using a commercial-off-the-shelf diffraction-grating imaging spectrometer with a spectral sampling interval of 0.05 nm and a FWHM < 0.2 nm throughout the 670 - 780 nm range. We demonstrate the tradeoffs between spatial resolution and signal-to-noise ratio using frame stacking and binning, and evaluate the consequences of these tradeoffs for SIF retrieval using three approaches: (1) oxygen-A and B retrieval; (2) retrieval based exclusively on solar Fraunhofer lines outside regions of telluric gas absorption; and (3) a retrieval based on the combination of these approaches. We evaluate the quality of these methods by comparison with coincident SIF spectra of leaves measured using a hand-held field spectrometer and short-pass filters that block incoming light at wavelengths > 650 or 700 nm. These filters enable a direct measurement of SIF emission > 650 or 700 nm that serves as a benchmark against which retrievals from reflectance spectra can be evaluated. We repeated this comparison between leaf-level SIF emission spectra and retrieved SIF emission spectra for leaves treated with drought stress and an herbicide (DCMU) that inhibits electron transfer from QA to QB of PSII.

Impacts of Cross-Platform Vicarious Calibration on the Deep Blue Aerosol Retrievals for Moderate Resolution Imaging Spectroradiometer Aboard Terra

NASA Technical Reports Server (NTRS)

Jeong, Myeong-Jae; Hsu, N. Christina; Kwiatkowska, Ewa J.; Franz, Bryan A.; Meister, Gerhard; Salustro, Clare E.

2012-01-01

The retrieval of aerosol properties from spaceborne sensors requires highly accurate and precise radiometric measurements, thus placing stringent requirements on sensor calibration and characterization. For the Terra/Moderate Resolution Imaging Spedroradiometer (MODIS), the characteristics of the detectors of certain bands, particularly band 8 [(B8); 412 nm], have changed significantly over time, leading to increased calibration uncertainty. In this paper, we explore a possibility of utilizing a cross-calibration method developed for characterizing the Terral MODIS detectors in the ocean bands by the National Aeronautics and Space Administration Ocean Biology Processing Group to improve aerosol retrieval over bright land surfaces. We found that the Terra/MODIS B8 reflectance corrected using the cross calibration method resulted in significant improvements for the retrieved aerosol optical thickness when compared with that from the Multi-angle Imaging Spectroradiometer, Aqua/MODIS, and the Aerosol Robotic Network. The method reported in this paper is implemented for the operational processing of the Terra/MODIS Deep Blue aerosol products.

Elaboration versus suppression of cued memories: influence of memory recall instruction and success on parietal lobe, default network, and hippocampal activity.

PubMed

Gimbel, Sarah I; Brewer, James B

2014-01-01

Functional imaging studies of episodic memory retrieval consistently report task-evoked and memory-related activity in the medial temporal lobe, default network and parietal lobe subregions. Associated components of memory retrieval, such as attention-shifts, search, retrieval success, and post-retrieval processing also influence regional activity, but these influences remain ill-defined. To better understand how top-down control affects the neural bases of memory retrieval, we examined how regional activity responses were modulated by task goals during recall success or failure. Specifically, activity was examined during memory suppression, recall, and elaborative recall of paired-associates. Parietal lobe was subdivided into dorsal (BA 7), posterior ventral (BA 39), and anterior ventral (BA 40) regions, which were investigated separately to examine hypothesized distinctions in sub-regional functional responses related to differential attention-to-memory and memory strength. Top-down suppression of recall abolished memory strength effects in BA 39, which showed a task-negative response, and BA 40, which showed a task-positive response. The task-negative response in default network showed greater negatively-deflected signal for forgotten pairs when task goals required recall. Hippocampal activity was task-positive and was influenced by memory strength only when task goals required recall. As in previous studies, we show a memory strength effect in parietal lobe and hippocampus, but we show that this effect is top-down controlled and sensitive to whether the subject is trying to suppress or retrieve a memory. These regions are all implicated in memory recall, but their individual activity patterns show distinct memory-strength-related responses when task goals are varied. In parietal lobe, default network, and hippocampus, top-down control can override the commonly identified effects of memory strength.

Elaboration versus Suppression of Cued Memories: Influence of Memory Recall Instruction and Success on Parietal Lobe, Default Network, and Hippocampal Activity

PubMed Central

Gimbel, Sarah I.; Brewer, James B.

2014-01-01

Functional imaging studies of episodic memory retrieval consistently report task-evoked and memory-related activity in the medial temporal lobe, default network and parietal lobe subregions. Associated components of memory retrieval, such as attention-shifts, search, retrieval success, and post-retrieval processing also influence regional activity, but these influences remain ill-defined. To better understand how top-down control affects the neural bases of memory retrieval, we examined how regional activity responses were modulated by task goals during recall success or failure. Specifically, activity was examined during memory suppression, recall, and elaborative recall of paired-associates. Parietal lobe was subdivided into dorsal (BA 7), posterior ventral (BA 39), and anterior ventral (BA 40) regions, which were investigated separately to examine hypothesized distinctions in sub-regional functional responses related to differential attention-to-memory and memory strength. Top-down suppression of recall abolished memory strength effects in BA 39, which showed a task-negative response, and BA 40, which showed a task-positive response. The task-negative response in default network showed greater negatively-deflected signal for forgotten pairs when task goals required recall. Hippocampal activity was task-positive and was influenced by memory strength only when task goals required recall. As in previous studies, we show a memory strength effect in parietal lobe and hippocampus, but we show that this effect is top-down controlled and sensitive to whether the subject is trying to suppress or retrieve a memory. These regions are all implicated in memory recall, but their individual activity patterns show distinct memory-strength-related responses when task goals are varied. In parietal lobe, default network, and hippocampus, top-down control can override the commonly identified effects of memory strength. PMID:24586492

Timing the state of light with anomalous dispersion and a gradient echo memory

NASA Astrophysics Data System (ADS)

Clark, Jeremy B.

We study the effects of anomalous dispersion on the continuous-variable entanglement of EPR states (generated using four-wave mixing in 85 Rb) by sending one part of the state through a fast-light medium and measuring the state's quantum mutual information. We observe an advance in the maximum of the quantum mutual information between modes. In contrast, due to uncorrelated noise added by a small phase-insensitive gain, we do not observe any statistically significant advance in the leading edge of the mutual information. We also study the storage and retrieval of multiplexed optical signals in a Gradient Echo Memory (GEM) at relevant four-wave mixing frequencies in 85Rb. Temporal multiplexing capabilities are demonstrated by storing multiple classical images in the memory simultaneously and observing the expected first-in last-out order of recall without obvious cross-talk. We also develop a technique wherein selected portions of an image written into the memory can be spatially targeted for readout and erasure on demand. The effect of diffusion on the quality of the recalled images is characterized. Our results indicate that Raman-based atomic memories may serve as a flexible platform for the storage and retrieval of multiplexed optical signals.

Integrated approach to multimodal media content analysis

NASA Astrophysics Data System (ADS)

Zhang, Tong; Kuo, C.-C. Jay

1999-12-01

In this work, we present a system for the automatic segmentation, indexing and retrieval of audiovisual data based on the combination of audio, visual and textural content analysis. The video stream is demultiplexed into audio, image and caption components. Then, a semantic segmentation of the audio signal based on audio content analysis is conducted, and each segment is indexed as one of the basic audio types. The image sequence is segmented into shots based on visual information analysis, and keyframes are extracted from each shot. Meanwhile, keywords are detected from the closed caption. Index tables are designed for both linear and non-linear access to the video. It is shown by experiments that the proposed methods for multimodal media content analysis are effective. And that the integrated framework achieves satisfactory results for video information filtering and retrieval.

Hierarchical content-based image retrieval by dynamic indexing and guided search

NASA Astrophysics Data System (ADS)

You, Jane; Cheung, King H.; Liu, James; Guo, Linong

2003-12-01

This paper presents a new approach to content-based image retrieval by using dynamic indexing and guided search in a hierarchical structure, and extending data mining and data warehousing techniques. The proposed algorithms include: a wavelet-based scheme for multiple image feature extraction, the extension of a conventional data warehouse and an image database to an image data warehouse for dynamic image indexing, an image data schema for hierarchical image representation and dynamic image indexing, a statistically based feature selection scheme to achieve flexible similarity measures, and a feature component code to facilitate query processing and guide the search for the best matching. A series of case studies are reported, which include a wavelet-based image color hierarchy, classification of satellite images, tropical cyclone pattern recognition, and personal identification using multi-level palmprint and face features.

Content Recognition and Context Modeling for Document Analysis and Retrieval

ERIC Educational Resources Information Center

Zhu, Guangyu

2009-01-01

The nature and scope of available documents are changing significantly in many areas of document analysis and retrieval as complex, heterogeneous collections become accessible to virtually everyone via the web. The increasing level of diversity presents a great challenge for document image content categorization, indexing, and retrieval.…

Image Engine: an object-oriented multimedia database for storing, retrieving and sharing medical images and text.

PubMed Central

Lowe, H. J.

1993-01-01

This paper describes Image Engine, an object-oriented, microcomputer-based, multimedia database designed to facilitate the storage and retrieval of digitized biomedical still images, video, and text using inexpensive desktop computers. The current prototype runs on Apple Macintosh computers and allows network database access via peer to peer file sharing protocols. Image Engine supports both free text and controlled vocabulary indexing of multimedia objects. The latter is implemented using the TView thesaurus model developed by the author. The current prototype of Image Engine uses the National Library of Medicine's Medical Subject Headings (MeSH) vocabulary (with UMLS Meta-1 extensions) as its indexing thesaurus. PMID:8130596

Phase object retrieval through scattering medium

NASA Astrophysics Data System (ADS)

Zhao, Ming; Zhao, Meijing; Wu, Houde; Xu, Wenhai

2018-05-01

Optical imaging through a scattering medium has been an interesting and important research topic, especially in the field of biomedical imaging. However, it is still a challenging task due to strong scattering. This paper proposes to recover the phase object behind the scattering medium from one single-shot speckle intensity image using calibrated transmission matrices (TMs). We construct the forward model as a non-linear mapping, since the intensity image loses the phase information, and then a generalized phase retrieval algorithm is employed to recover the hidden object. Moreover, we show that a phase object can be reconstructed with a small portion of the speckle image captured by the camera. The simulation is performed to demonstrate our scheme and test its performance. Finally, a real experiment is set up, we measure the TMs from the scattering medium, and then use it to reconstruct the hidden object. We show that a phase object of size 32 × 32 is retrieved from 150 × 150 speckle grains, which is only 1/50 of the speckles area. We believe our proposed method can benefit the community of imaging through the scattering medium.

Case retrieval in medical databases by fusing heterogeneous information.

PubMed

Quellec, Gwénolé; Lamard, Mathieu; Cazuguel, Guy; Roux, Christian; Cochener, Béatrice

2011-01-01

A novel content-based heterogeneous information retrieval framework, particularly well suited to browse medical databases and support new generation computer aided diagnosis (CADx) systems, is presented in this paper. It was designed to retrieve possibly incomplete documents, consisting of several images and semantic information, from a database; more complex data types such as videos can also be included in the framework. The proposed retrieval method relies on image processing, in order to characterize each individual image in a document by their digital content, and information fusion. Once the available images in a query document are characterized, a degree of match, between the query document and each reference document stored in the database, is defined for each attribute (an image feature or a metadata). A Bayesian network is used to recover missing information if need be. Finally, two novel information fusion methods are proposed to combine these degrees of match, in order to rank the reference documents by decreasing relevance for the query. In the first method, the degrees of match are fused by the Bayesian network itself. In the second method, they are fused by the Dezert-Smarandache theory: the second approach lets us model our confidence in each source of information (i.e., each attribute) and take it into account in the fusion process for a better retrieval performance. The proposed methods were applied to two heterogeneous medical databases, a diabetic retinopathy database and a mammography screening database, for computer aided diagnosis. Precisions at five of 0.809 ± 0.158 and 0.821 ± 0.177, respectively, were obtained for these two databases, which is very promising.

Aerosol Optical Depth Retrievals from High-Resolution Commercial Satellite Imagery Over Areas of High Surface Reflectance

DTIC Science & Technology

2006-06-01

angle Imaging SpectroRadiometer MODIS Moderate Resolution Imaging Spectroradiometer NGA National Geospatial Intelligence Agency POI Principles of...and µ , the cosine of the viewing zenith angle and the effect of the variation of each of these variables on total optical depth. Extraterrestrial ...Eq. (34). Additionally, solar zenith angle also plays a role in the third term on the RHS of Eq. (34) by modifying extraterrestrial spectral solar

Effect of Threat on Right dlPFC Activity during Behavioral Pattern Separation

PubMed Central

Hsiung, Abigail; Ernst, Monique; Grillon, Christian

2017-01-01

It has long been established that individuals with anxiety disorders tend to overgeneralize attributes of fearful stimuli to nonfearful stimuli, but there is little mechanistic understanding of the neural system that supports overgeneralization. To address this gap in our knowledge, this study examined effect of experimentally induced anxiety in humans on generalization using the behavioral pattern separation (BPS) paradigm. Healthy subjects of both sexes encoded and retrieved novel objects during periods of safety and threat of unpredictable shocks while we recorded brain activity with fMRI. During retrieval, subjects were instructed to differentiate among new, old, and altered images. We hypothesized that the hippocampus and dorsolateral prefrontal cortex (dlPFC) would play a key role in the effect of anxiety on BPS. The dlPFC, but not the hippocampus, showed increased activity for altered images compared with old images when retrieval occurred during periods of threat compared with safety. In addition, accuracy for altered items retrieved during threat was correlated with dlPFC activity. Together, these results suggest that overgeneralization in anxiety patients may be mediated by an inability to recruit the dlPFC, which mediates the cognitive control needed to overcome anxiety and differentiate between old and altered items during periods of threat. SIGNIFICANCE STATEMENT Anxiety and posttraumatic stress disorder patients generalize fear to nonfearful fear stimuli, making it difficult to regulate anxiety. Understanding how anxiety affects generalization is key to understanding the overgeneralization experienced by these patients. We examined this relationship in healthy subjects by studying how threat of shock affects neural responses to previously encountered stimuli. Although previous studies point to hippocampal involvement, we found that threat affected activity in the dorsolateral prefrontal cortex (dlPFC), rather than the hippocampus, when subjects encountered slightly altered versions of the previously encountered items. Importantly, this dlPFC activity predicted performance for these items. Together, these results suggest that the dlPFC is important for discrimination during elevated anxiety and that overgeneralization may reflect a deficit in dlPFC-mediated cognitive control. PMID:28842415

Out-of-Sample Extrapolation utilizing Semi-Supervised Manifold Learning (OSE-SSL): Content Based Image Retrieval for Histopathology Images

PubMed Central

Sparks, Rachel; Madabhushi, Anant

2016-01-01

Content-based image retrieval (CBIR) retrieves database images most similar to the query image by (1) extracting quantitative image descriptors and (2) calculating similarity between database and query image descriptors. Recently, manifold learning (ML) has been used to perform CBIR in a low dimensional representation of the high dimensional image descriptor space to avoid the curse of dimensionality. ML schemes are computationally expensive, requiring an eigenvalue decomposition (EVD) for every new query image to learn its low dimensional representation. We present out-of-sample extrapolation utilizing semi-supervised ML (OSE-SSL) to learn the low dimensional representation without recomputing the EVD for each query image. OSE-SSL incorporates semantic information, partial class label, into a ML scheme such that the low dimensional representation co-localizes semantically similar images. In the context of prostate histopathology, gland morphology is an integral component of the Gleason score which enables discrimination between prostate cancer aggressiveness. Images are represented by shape features extracted from the prostate gland. CBIR with OSE-SSL for prostate histology obtained from 58 patient studies, yielded an area under the precision recall curve (AUPRC) of 0.53 ± 0.03 comparatively a CBIR with Principal Component Analysis (PCA) to learn a low dimensional space yielded an AUPRC of 0.44 ± 0.01. PMID:27264985

The effect of scene context on episodic object recognition: parahippocampal cortex mediates memory encoding and retrieval success.

PubMed

Hayes, Scott M; Nadel, Lynn; Ryan, Lee

2007-01-01

Previous research has investigated intentional retrieval of contextual information and contextual influences on object identification and word recognition, yet few studies have investigated context effects in episodic memory for objects. To address this issue, unique objects embedded in a visually rich scene or on a white background were presented to participants. At test, objects were presented either in the original scene or on a white background. A series of behavioral studies with young adults demonstrated a context shift decrement (CSD)-decreased recognition performance when context is changed between encoding and retrieval. The CSD was not attenuated by encoding or retrieval manipulations, suggesting that binding of object and context may be automatic. A final experiment explored the neural correlates of the CSD, using functional Magnetic Resonance Imaging. Parahippocampal cortex (PHC) activation (right greater than left) during incidental encoding was associated with subsequent memory of objects in the context shift condition. Greater activity in right PHC was also observed during successful recognition of objects previously presented in a scene. Finally, a subset of regions activated during scene encoding, such as bilateral PHC, was reactivated when the object was presented on a white background at retrieval. Although participants were not required to intentionally retrieve contextual information, the results suggest that PHC may reinstate visual context to mediate successful episodic memory retrieval. The CSD is attributed to automatic and obligatory binding of object and context. The results suggest that PHC is important not only for processing of scene information, but also plays a role in successful episodic memory encoding and retrieval. These findings are consistent with the view that spatial information is stored in the hippocampal complex, one of the central tenets of Multiple Trace Theory. (c) 2007 Wiley-Liss, Inc.

Updates to the QBIC system

NASA Astrophysics Data System (ADS)

Niblack, Carlton W.; Zhu, Xiaoming; Hafner, James L.; Breuel, Tom; Ponceleon, Dulce B.; Petkovic, Dragutin; Flickner, Myron D.; Upfal, Eli; Nin, Sigfredo I.; Sull, Sanghoon; Dom, Byron E.; Yeo, Boon-Lock; Srinivasan, Savitha; Zivkovic, Dan; Penner, Mike

1997-12-01

QBICTM (Query By Image Content) is a set of technologies and associated software that allows a user to search, browse, and retrieve image, graphic, and video data from large on-line collections. This paper discusses current research directions of the QBIC project such as indexing for high-dimensional multimedia data, retrieval of gray level images, and storyboard generation suitable for video. It describes aspects of QBIC software including scripting tools, application interfaces, and available GUIs, and gives examples of applications and demonstration systems using it.

Comparison of a single-view and a double-view aerosol optical depth retrieval algorithm

NASA Astrophysics Data System (ADS)

Henderson, Bradley G.; Chylek, Petr

2003-11-01

We compare the results of a single-view and a double-view aerosol optical depth (AOD) retrieval algorithm applied to image pairs acquired over NASA Stennis Space Center, Mississippi. The image data were acquired by the Department of Energy's (DOE) Multispectral Thermal Imager (MTI), a pushbroom satellite imager with 15 bands from the visible to the thermal infrared. MTI has the ability to acquire imagery in pairs in which the first image is a near-nadir view and the second image is off-nadir with a zenith angle of approximately 60°. A total of 15 image pairs were used in the analysis. For a given image pair, AOD retrieval is performed twice---once using a single-view algorithm applied to the near-nadir image, then again using a double-view algorithm. Errors for both retrievals are computed by comparing the results to AERONET AOD measurements obtained at the same time and place. The single-view algorithm showed an RMS error about the mean of 0.076 in AOD units, whereas the double-view algorithm showed a modest improvement with an RMS error of 0.06. The single-view errors show a positive bias which is presumed to be a result of the empirical relationship used to determine ground reflectance in the visible. A plot of AOD error of the double-view algorithm versus time shows a noticeable trend which is interpreted to be a calibration drift. When this trend is removed, the RMS error of the double-view algorithm drops to 0.030. The single-view algorithm qualitatively appears to perform better during the spring and summer whereas the double-view algorithm seems to be less sensitive to season.

Retrieval and classification of food images.

PubMed

Farinella, Giovanni Maria; Allegra, Dario; Moltisanti, Marco; Stanco, Filippo; Battiato, Sebastiano

2016-10-01

Automatic food understanding from images is an interesting challenge with applications in different domains. In particular, food intake monitoring is becoming more and more important because of the key role that it plays in health and market economies. In this paper, we address the study of food image processing from the perspective of Computer Vision. As first contribution we present a survey of the studies in the context of food image processing from the early attempts to the current state-of-the-art methods. Since retrieval and classification engines able to work on food images are required to build automatic systems for diet monitoring (e.g., to be embedded in wearable cameras), we focus our attention on the aspect of the representation of the food images because it plays a fundamental role in the understanding engines. The food retrieval and classification is a challenging task since the food presents high variableness and an intrinsic deformability. To properly study the peculiarities of different image representations we propose the UNICT-FD1200 dataset. It was composed of 4754 food images of 1200 distinct dishes acquired during real meals. Each food plate is acquired multiple times and the overall dataset presents both geometric and photometric variabilities. The images of the dataset have been manually labeled considering 8 categories: Appetizer, Main Course, Second Course, Single Course, Side Dish, Dessert, Breakfast, Fruit. We have performed tests employing different representations of the state-of-the-art to assess the related performances on the UNICT-FD1200 dataset. Finally, we propose a new representation based on the perceptual concept of Anti-Textons which is able to encode spatial information between Textons outperforming other representations in the context of food retrieval and Classification. Copyright © 2016 Elsevier Ltd. All rights reserved.

Fostering Learners' Metacognitive Skills of Keyword Reformulation in Image Seeking by Location-Based Hierarchical Navigation

ERIC Educational Resources Information Center

Liu, Ming-Chi; Huang, Yueh-Min; Kinshuk; Wen, Dunwei

2013-01-01

It is critical that students learn how to retrieve useful information in hypermedia environments, a task that is often especially difficult when it comes to image retrieval, as little text feedback is given that allows them to reformulate keywords they need to use. This situation may make students feel disorientated while attempting image…

Properties of the water column and bottom derived from Airborne Visible Infrared Imaging Spectrometer (AVIRIS) data

NASA Astrophysics Data System (ADS)

Lee, Zhongping; Carder, Kendall L.; Chen, Robert F.; Peacock, Thomas G.

2001-06-01

Using Airborne Visible Infrared Imaging Spectrometer (AVIRIS) data as an example, we show in this study that the properties of the water column and bottom of a large, shallow area can be adequately retrieved using a model-driven optimization technique. The simultaneously derived properties include bottom depth, bottom albedo, and water absorption and backscattering coefficients, which in turn could be used to derive concentrations of chlorophyll, dissolved organic matter, and suspended sediments in the water column. The derived bottom depths were compared with a bathymetry chart and a boat survey and were found to agree very well. Also, the derived bottom albedo image shows clear spatial patterns, with end-members consistent with sand and seagrass. The image of absorption and backscattering coefficients indicates that the water is quite horizontally mixed. Without bottom corrections, chlorophyll a retrievals were ˜50 mg m-3, while the retrievals after bottom corrections were tenfold less, approximating real values. These results suggest that the model and approach used work very well for the retrieval of subsurface properties of shallow-water environments even for rather turbid environments like Tampa Bay, Florida.

View subspaces for indexing and retrieval of 3D models

NASA Astrophysics Data System (ADS)

Dutagaci, Helin; Godil, Afzal; Sankur, Bülent; Yemez, Yücel

2010-02-01

View-based indexing schemes for 3D object retrieval are gaining popularity since they provide good retrieval results. These schemes are coherent with the theory that humans recognize objects based on their 2D appearances. The viewbased techniques also allow users to search with various queries such as binary images, range images and even 2D sketches. The previous view-based techniques use classical 2D shape descriptors such as Fourier invariants, Zernike moments, Scale Invariant Feature Transform-based local features and 2D Digital Fourier Transform coefficients. These methods describe each object independent of others. In this work, we explore data driven subspace models, such as Principal Component Analysis, Independent Component Analysis and Nonnegative Matrix Factorization to describe the shape information of the views. We treat the depth images obtained from various points of the view sphere as 2D intensity images and train a subspace to extract the inherent structure of the views within a database. We also show the benefit of categorizing shapes according to their eigenvalue spread. Both the shape categorization and data-driven feature set conjectures are tested on the PSB database and compared with the competitor view-based 3D shape retrieval algorithms.