Multimodality hard-x-ray imaging of a chromosome with nanoscale spatial resolution

DOE Office of Scientific and Technical Information (OSTI.GOV)

Yan, Hanfei; Nazaretski, Evgeny; Lauer, Kenneth R.

Here, we developed a scanning hard x-ray microscope using a new class of x-ray nano-focusing optic called a multilayer Laue lens and imaged a chromosome with nanoscale spatial resolution. The combination of the hard x-ray's superior penetration power, high sensitivity to elemental composition, high spatial-resolution and quantitative analysis creates a unique tool with capabilities that other microscopy techniques cannot provide. Using this microscope, we simultaneously obtained absorption-, phase-, and fluorescence-contrast images of Pt-stained human chromosome samples. The high spatial-resolution of the microscope and its multi-modality imaging capabilities enabled us to observe the internal ultra-structures of a thick chromosome without sectioningmore » it.« less

Hybrid label-free multiphoton and optoacoustic microscopy (MPOM)

NASA Astrophysics Data System (ADS)

Soliman, Dominik; Tserevelakis, George J.; Omar, Murad; Ntziachristos, Vasilis

2015-07-01

Many biological applications require a simultaneous observation of different anatomical features. However, unless potentially harmful staining of the specimens is employed, individual microscopy techniques do generally not provide multi-contrast capabilities. We present a hybrid microscope integrating optoacoustic microscopy and multiphoton microscopy, including second-harmonic generation, into a single device. This combined multiphoton and optoacoustic microscope (MPOM) offers visualization of a broad range of structures by employing different contrast mechanisms and at the same time enables pure label-free imaging of biological systems. We investigate the relative performance of the two microscopy modalities and demonstrate their multi-contrast abilities through the label-free imaging of a zebrafish larva ex vivo, simultaneously visualizing muscles and pigments. This hybrid microscopy application bears great potential for developmental biology studies, enabling more comprehensive information to be obtained from biological specimens without the necessity of staining.

Topology optimized design of functionally graded piezoelectric ultrasonic transducers

NASA Astrophysics Data System (ADS)

Rubio, Wilfredo Montealegre; Buiochi, Flávio; Adamowski, Julio Cezar; Silva, Emílio C. N.

2010-01-01

This work presents a new approach to systematically design piezoelectric ultrasonic transducers based on Topology Optimization Method (TOM) and Functionally Graded Material (FGM) concepts. The main goal is to find the optimal material distribution of Functionally Graded Piezoelectric Ultrasonic Transducers, to achieve the following requirements: (i) the transducer must be designed to have a multi-modal or uni-modal frequency response, which defines the kind of generated acoustic wave, either short pulse or continuous wave, respectively; (ii) the transducer is required to oscillate in a thickness extensional mode or piston-like mode, aiming at acoustic wave generation applications. Two kinds of piezoelectric materials are mixed for producing the FGM transducer. Material type 1 represents a PZT-5A piezoelectric ceramic and material type 2 represents a PZT-5H piezoelectric ceramic. To illustrate the proposed method, two Functionally Graded Piezoelectric Ultrasonic Transducers are designed. The TOM has shown to be a useful tool for designing Functionally Graded Piezoelectric Ultrasonic Transducers with uni-modal or multi-modal dynamic behavior.

Preparation and characterization of alginate based-fluorescent magnetic nanoparticles for fluorescence/magnetic resonance multimodal imaging applications

NASA Astrophysics Data System (ADS)

Kwon, Yong-Su; Choi, Kee-Bong; Lim, Hyungjun; Lee, Sunghwi; Lee, Jae-Jong

2018-06-01

Simple and versatile methodologies have been reported that customize the surface of superparamagnetic iron oxide (SPIO) nanoparticles and impart additional fluorescence capabilities to these contrast agents. Herein, we present the rational design, synthesis, characterization, and biological applications of a new magnetic-based fluorescent probe. The dual modality imaging protocol was developed by labeling fluorophore with alginate natural polymers that have excellent biocompatibility and biodegradability, and using gelification method to form nanocomposites containing SPIO. The formation of alginate-based fluorescent magnetic (AFM) nanoparticles was observed in spherical and elliptical forms with a diameter of less than 500 nm by a transmission electron microscope (TEM). The fluorescent wavelength band in the range of 560 nm was also confirmed in the UV–visible spectrophotometer. In this study, we demonstrate that the multi-tasking design of AFM nanoparticles provides an ideal platform for building balanced dual-image probes of magnetic resonance imaging and optical imaging.

3D multi-scale FCN with random modality voxel dropout learning for Intervertebral Disc Localization and Segmentation from Multi-modality MR Images.

PubMed

Li, Xiaomeng; Dou, Qi; Chen, Hao; Fu, Chi-Wing; Qi, Xiaojuan; Belavý, Daniel L; Armbrecht, Gabriele; Felsenberg, Dieter; Zheng, Guoyan; Heng, Pheng-Ann

2018-04-01

Intervertebral discs (IVDs) are small joints that lie between adjacent vertebrae. The localization and segmentation of IVDs are important for spine disease diagnosis and measurement quantification. However, manual annotation is time-consuming and error-prone with limited reproducibility, particularly for volumetric data. In this work, our goal is to develop an automatic and accurate method based on fully convolutional networks (FCN) for the localization and segmentation of IVDs from multi-modality 3D MR data. Compared with single modality data, multi-modality MR images provide complementary contextual information, which contributes to better recognition performance. However, how to effectively integrate such multi-modality information to generate accurate segmentation results remains to be further explored. In this paper, we present a novel multi-scale and modality dropout learning framework to locate and segment IVDs from four-modality MR images. First, we design a 3D multi-scale context fully convolutional network, which processes the input data in multiple scales of context and then merges the high-level features to enhance the representation capability of the network for handling the scale variation of anatomical structures. Second, to harness the complementary information from different modalities, we present a random modality voxel dropout strategy which alleviates the co-adaption issue and increases the discriminative capability of the network. Our method achieved the 1st place in the MICCAI challenge on automatic localization and segmentation of IVDs from multi-modality MR images, with a mean segmentation Dice coefficient of 91.2% and a mean localization error of 0.62 mm. We further conduct extensive experiments on the extended dataset to validate our method. We demonstrate that the proposed modality dropout strategy with multi-modality images as contextual information improved the segmentation accuracy significantly. Furthermore, experiments conducted on extended data collected from two different time points demonstrate the efficacy of our method on tracking the morphological changes in a longitudinal study. Copyright © 2018 Elsevier B.V. All rights reserved.

Correlative imaging across microscopy platforms using the fast and accurate relocation of microscopic experimental regions (FARMER) method

NASA Astrophysics Data System (ADS)

Huynh, Toan; Daddysman, Matthew K.; Bao, Ying; Selewa, Alan; Kuznetsov, Andrey; Philipson, Louis H.; Scherer, Norbert F.

2017-05-01

Imaging specific regions of interest (ROIs) of nanomaterials or biological samples with different imaging modalities (e.g., light and electron microscopy) or at subsequent time points (e.g., before and after off-microscope procedures) requires relocating the ROIs. Unfortunately, relocation is typically difficult and very time consuming to achieve. Previously developed techniques involve the fabrication of arrays of features, the procedures for which are complex, and the added features can interfere with imaging the ROIs. We report the Fast and Accurate Relocation of Microscopic Experimental Regions (FARMER) method, which only requires determining the coordinates of 3 (or more) conspicuous reference points (REFs) and employs an algorithm based on geometric operators to relocate ROIs in subsequent imaging sessions. The 3 REFs can be quickly added to various regions of a sample using simple tools (e.g., permanent markers or conductive pens) and do not interfere with the ROIs. The coordinates of the REFs and the ROIs are obtained in the first imaging session (on a particular microscope platform) using an accurate and precise encoded motorized stage. In subsequent imaging sessions, the FARMER algorithm finds the new coordinates of the ROIs (on the same or different platforms), using the coordinates of the manually located REFs and the previously recorded coordinates. FARMER is convenient, fast (3-15 min/session, at least 10-fold faster than manual searches), accurate (4.4 μm average error on a microscope with a 100x objective), and precise (almost all errors are <8 μm), even with deliberate rotating and tilting of the sample well beyond normal repositioning accuracy. We demonstrate this versatility by imaging and re-imaging a diverse set of samples and imaging methods: live mammalian cells at different time points; fixed bacterial cells on two microscopes with different imaging modalities; and nanostructures on optical and electron microscopes. FARMER can be readily adapted to any imaging system with an encoded motorized stage and can facilitate multi-session and multi-platform imaging experiments in biology, materials science, photonics, and nanoscience.

Multi Modal Anticipation in Fuzzy Space

NASA Astrophysics Data System (ADS)

Asproth, Viveca; Holmberg, Stig C.; Hâkansson, Anita

2006-06-01

We are all stakeholders in the geographical space, which makes up our common living and activity space. This means that a careful, creative, and anticipatory planning, design, and management of that space will be of paramount importance for our sustained life on earth. Here it is shown that the quality of such planning could be significantly increased with help of a computer based modelling and simulation tool. Further, the design and implementation of such a tool ought to be guided by the conceptual integration of some core concepts like anticipation and retardation, multi modal system modelling, fuzzy space modelling, and multi actor interaction.

WE-H-206-02: Recent Advances in Multi-Modality Molecular Imaging of Small Animals

DOE Office of Scientific and Technical Information (OSTI.GOV)

Tsui, B.

Lihong V. Wang: Photoacoustic tomography (PAT), combining non-ionizing optical and ultrasonic waves via the photoacoustic effect, provides in vivo multiscale functional, metabolic, and molecular imaging. Broad applications include imaging of the breast, brain, skin, esophagus, colon, vascular system, and lymphatic system in humans or animals. Light offers rich contrast but does not penetrate biological tissue in straight paths as x-rays do. Consequently, high-resolution pure optical imaging (e.g., confocal microscopy, two-photon microscopy, and optical coherence tomography) is limited to penetration within the optical diffusion limit (∼1 mm in the skin). Ultrasonic imaging, on the contrary, provides fine spatial resolution but suffersmore » from both poor contrast in early-stage tumors and strong speckle artifacts. In PAT, pulsed laser light penetrates tissue and generates a small but rapid temperature rise, which induces emission of ultrasonic waves due to thermoelastic expansion. The ultrasonic waves, orders of magnitude less scattering than optical waves, are then detected to form high-resolution images of optical absorption at depths up to 7 cm, conquering the optical diffusion limit. PAT is the only modality capable of imaging across the length scales of organelles, cells, tissues, and organs (up to whole-body small animals) with consistent contrast. This rapidly growing technology promises to enable multiscale biological research and accelerate translation from microscopic laboratory discoveries to macroscopic clinical practice. PAT may also hold the key to label-free early detection of cancer by in vivo quantification of hypermetabolism, the quintessential hallmark of malignancy. Learning Objectives: To understand the contrast mechanism of PAT To understand the multiscale applications of PAT Benjamin M. W. Tsui: Multi-modality molecular imaging instrumentation and techniques have been major developments in small animal imaging that has contributed significantly to biomedical research during the past decade. The initial development was an extension of clinical PET/CT and SPECT/CT from human to small animals and combine the unique functional information obtained from PET and SPECT with anatomical information provided by the CT in registered multi-modality images. The requirements to image a mouse whose size is an order of magnitude smaller than that of a human have spurred advances in new radiation detector technologies, novel imaging system designs and special image reconstruction and processing techniques. Examples are new detector materials and designs with high intrinsic resolution, multi-pinhole (MPH) collimator design for much improved resolution and detection efficiency compared to the conventional collimator designs in SPECT, 3D high-resolution and artifact-free MPH and sparse-view image reconstruction techniques, and iterative image reconstruction methods with system response modeling for resolution recovery and image noise reduction for much improved image quality. The spatial resolution of PET and SPECT has improved from ∼6–12 mm to ∼1 mm a few years ago to sub-millimeter today. A recent commercial small animal SPECT system has achieved a resolution of ∼0.25 mm which surpasses that of a state-of-art PET system whose resolution is limited by the positron range. More recently, multimodality SA PET/MRI and SPECT/MRI systems have been developed in research laboratories. Also, multi-modality SA imaging systems that include other imaging modalities such as optical and ultrasound are being actively pursued. In this presentation, we will provide a review of the development, recent advances and future outlook of multi-modality molecular imaging of small animals. Learning Objectives: To learn about the two major multi-modality molecular imaging techniques of small animals. To learn about the spatial resolution achievable by the molecular imaging systems for small animal today. To learn about the new multi-modality imaging instrumentation and techniques that are being developed. Sang Hyun Cho; X-ray fluorescence (XRF) imaging, such as x-ray fluorescence computed tomography (XFCT), offers unique capabilities for accurate identification and quantification of metals within the imaging objects. As a result, it has emerged as a promising quantitative imaging modality in recent years, especially in conjunction with metal-based imaging probes. This talk will familiarize the audience with the basic principles of XRF/XFCT imaging. It will also cover the latest development of benchtop XFCT technology. Additionally, the use of metallic nanoparticles such as gold nanoparticles, in conjunction with benchtop XFCT, will be discussed within the context of preclinical multimodal multiplexed molecular imaging. Learning Objectives: To learn the basic principles of XRF/XFCT imaging To learn the latest advances in benchtop XFCT development for preclinical imaging Funding support received from NIH and DOD; Funding support received from GE Healthcare; Funding support received from Siemens AX; Patent royalties received from GE Healthcare; L. Wang, Funding Support: NIH; COI: Microphotoacoustics; S. Cho, Yes: ;NIH/NCI grant R01CA155446 DOD/PCRP grant W81XWH-12-1-0198.« less

Wave analysis of a plenoptic system and its applications

NASA Astrophysics Data System (ADS)

Shroff, Sapna A.; Berkner, Kathrin

2013-03-01

Traditional imaging systems directly image a 2D object plane on to the sensor. Plenoptic imaging systems contain a lenslet array at the conventional image plane and a sensor at the back focal plane of the lenslet array. In this configuration the data captured at the sensor is not a direct image of the object. Each lenslet effectively images the aperture of the main imaging lens at the sensor. Therefore the sensor data retains angular light-field information which can be used for a posteriori digital computation of multi-angle images and axially refocused images. If a filter array, containing spectral filters or neutral density or polarization filters, is placed at the pupil aperture of the main imaging lens, then each lenslet images the filters on to the sensor. This enables the digital separation of multiple filter modalities giving single snapshot, multi-modal images. Due to the diversity of potential applications of plenoptic systems, their investigation is increasing. As the application space moves towards microscopes and other complex systems, and as pixel sizes become smaller, the consideration of diffraction effects in these systems becomes increasingly important. We discuss a plenoptic system and its wave propagation analysis for both coherent and incoherent imaging. We simulate a system response using our analysis and discuss various applications of the system response pertaining to plenoptic system design, implementation and calibration.

The effectiveness of multi modal representation text books to improve student's scientific literacy of senior high school students

NASA Astrophysics Data System (ADS)

Zakiya, Hanifah; Sinaga, Parlindungan; Hamidah, Ida

2017-05-01

The results of field studies showed the ability of science literacy of students was still low. One root of the problem lies in the books used in learning is not oriented toward science literacy component. This study focused on the effectiveness of the use of textbook-oriented provisioning capability science literacy by using multi modal representation. The text books development method used Design Representational Approach Learning to Write (DRALW). Textbook design which was applied to the topic of "Kinetic Theory of Gases" is implemented in XI grade students of high school learning. Effectiveness is determined by consideration of the effect and the normalized percentage gain value, while the hypothesis was tested using Independent T-test. The results showed that the textbooks which were developed using multi-mode representation science can improve the literacy skills of students. Based on the size of the effect size textbooks developed with representation multi modal was found effective in improving students' science literacy skills. The improvement was occurred in all the competence and knowledge of scientific literacy. The hypothesis testing showed that there was a significant difference on the ability of science literacy between class that uses textbooks with multi modal representation and the class that uses the regular textbook used in schools.

Sex in the Curriculum: The Effect of a Multi-Modal Sexual History-Taking Module on Medical Student Skills

ERIC Educational Resources Information Center

Lindau, Stacy Tessler; Goodrich, Katie G.; Leitsch, Sara A.; Cook, Sandy

2008-01-01

Purpose: The objective of this study was to determine the effect of a multi-modal curricular intervention designed to teach sexual history-taking skills to medical students. The Association of Professors of Gynecology and Obstetrics, the National Board of Medical Examiners, and others, have identified sexual history-taking as a learning objective…

A multimodal image sensor system for identifying water stress in grapevines

NASA Astrophysics Data System (ADS)

Zhao, Yong; Zhang, Qin; Li, Minzan; Shao, Yongni; Zhou, Jianfeng; Sun, Hong

2012-11-01

Water stress is one of the most common limitations of fruit growth. Water is the most limiting resource for crop growth. In grapevines, as well as in other fruit crops, fruit quality benefits from a certain level of water deficit which facilitates to balance vegetative and reproductive growth and the flow of carbohydrates to reproductive structures. A multi-modal sensor system was designed to measure the reflectance signature of grape plant surfaces and identify different water stress levels in this paper. The multi-modal sensor system was equipped with one 3CCD camera (three channels in R, G, and IR). The multi-modal sensor can capture and analyze grape canopy from its reflectance features, and identify the different water stress levels. This research aims at solving the aforementioned problems. The core technology of this multi-modal sensor system could further be used as a decision support system that combines multi-modal sensory data to improve plant stress detection and identify the causes of stress. The images were taken by multi-modal sensor which could output images in spectral bands of near-infrared, green and red channel. Based on the analysis of the acquired images, color features based on color space and reflectance features based on image process method were calculated. The results showed that these parameters had the potential as water stress indicators. More experiments and analysis are needed to validate the conclusion.

Fluorescence multi-scale endoscopy and its applications in the study and diagnosis of gastro-intestinal diseases: set-up design and software implementation

NASA Astrophysics Data System (ADS)

Gómez-García, Pablo Aurelio; Arranz, Alicia; Fresno, Manuel; Desco, Manuel; Mahmood, Umar; Vaquero, Juan José; Ripoll, Jorge

2015-06-01

Endoscopy is frequently used in the diagnosis of several gastro-intestinal pathologies as Crohn disease, ulcerative colitis or colorectal cancer. It has great potential as a non-invasive screening technique capable of detecting suspicious alterations in the intestinal mucosa, such as inflammatory processes. However, these early lesions usually cannot be detected with conventional endoscopes, due to lack of cellular detail and the absence of specific markers. Due to this lack of specificity, the development of new endoscopy technologies, which are able to show microscopic changes in the mucosa structure, are necessary. We here present a confocal endomicroscope, which in combination with a wide field fluorescence endoscope offers fast and specific macroscopic information through the use of activatable probes and a detailed analysis at cellular level of the possible altered tissue areas. This multi-modal and multi-scale imaging module, compatible with commercial endoscopes, combines near-infrared fluorescence (NIRF) measurements (enabling specific imaging of markers of disease and prognosis) and confocal endomicroscopy making use of a fiber bundle, providing a cellular level resolution. The system will be used in animal models exhibiting gastro-intestinal diseases in order to analyze the use of potential diagnostic markers in colorectal cancer. In this work, we present in detail the set-up design and the software implementation in order to obtain simultaneous RGB/NIRF measurements and short confocal scanning times.

A prototype hand-held tri-modal instrument for in vivo ultrasound, photoacoustic, and fluorescence imaging

NASA Astrophysics Data System (ADS)

Kang, Jeeun; Chang, Jin Ho; Wilson, Brian C.; Veilleux, Israel; Bai, Yanhui; DaCosta, Ralph; Kim, Kang; Ha, Seunghan; Lee, Jong Gun; Kim, Jeong Seok; Lee, Sang-Goo; Kim, Sun Mi; Lee, Hak Jong; Ahn, Young Bok; Han, Seunghee; Yoo, Yangmo; Song, Tai-Kyong

2015-03-01

Multi-modality imaging is beneficial for both preclinical and clinical applications as it enables complementary information from each modality to be obtained in a single procedure. In this paper, we report the design, fabrication, and testing of a novel tri-modal in vivo imaging system to exploit molecular/functional information from fluorescence (FL) and photoacoustic (PA) imaging as well as anatomical information from ultrasound (US) imaging. The same ultrasound transducer was used for both US and PA imaging, bringing the pulsed laser light into a compact probe by fiberoptic bundles. The FL subsystem is independent of the acoustic components but the front end that delivers and collects the light is physically integrated into the same probe. The tri-modal imaging system was implemented to provide each modality image in real time as well as co-registration of the images. The performance of the system was evaluated through phantom and in vivo animal experiments. The results demonstrate that combining the modalities does not significantly compromise the performance of each of the separate US, PA, and FL imaging techniques, while enabling multi-modality registration. The potential applications of this novel approach to multi-modality imaging range from preclinical research to clinical diagnosis, especially in detection/localization and surgical guidance of accessible solid tumors.

WE-H-206-03: Promises and Challenges of Benchtop X-Ray Fluorescence CT (XFCT) for Quantitative in Vivo Imaging

DOE Office of Scientific and Technical Information (OSTI.GOV)

Cho, S.

Lihong V. Wang: Photoacoustic tomography (PAT), combining non-ionizing optical and ultrasonic waves via the photoacoustic effect, provides in vivo multiscale functional, metabolic, and molecular imaging. Broad applications include imaging of the breast, brain, skin, esophagus, colon, vascular system, and lymphatic system in humans or animals. Light offers rich contrast but does not penetrate biological tissue in straight paths as x-rays do. Consequently, high-resolution pure optical imaging (e.g., confocal microscopy, two-photon microscopy, and optical coherence tomography) is limited to penetration within the optical diffusion limit (∼1 mm in the skin). Ultrasonic imaging, on the contrary, provides fine spatial resolution but suffersmore » from both poor contrast in early-stage tumors and strong speckle artifacts. In PAT, pulsed laser light penetrates tissue and generates a small but rapid temperature rise, which induces emission of ultrasonic waves due to thermoelastic expansion. The ultrasonic waves, orders of magnitude less scattering than optical waves, are then detected to form high-resolution images of optical absorption at depths up to 7 cm, conquering the optical diffusion limit. PAT is the only modality capable of imaging across the length scales of organelles, cells, tissues, and organs (up to whole-body small animals) with consistent contrast. This rapidly growing technology promises to enable multiscale biological research and accelerate translation from microscopic laboratory discoveries to macroscopic clinical practice. PAT may also hold the key to label-free early detection of cancer by in vivo quantification of hypermetabolism, the quintessential hallmark of malignancy. Learning Objectives: To understand the contrast mechanism of PAT To understand the multiscale applications of PAT Benjamin M. W. Tsui: Multi-modality molecular imaging instrumentation and techniques have been major developments in small animal imaging that has contributed significantly to biomedical research during the past decade. The initial development was an extension of clinical PET/CT and SPECT/CT from human to small animals and combine the unique functional information obtained from PET and SPECT with anatomical information provided by the CT in registered multi-modality images. The requirements to image a mouse whose size is an order of magnitude smaller than that of a human have spurred advances in new radiation detector technologies, novel imaging system designs and special image reconstruction and processing techniques. Examples are new detector materials and designs with high intrinsic resolution, multi-pinhole (MPH) collimator design for much improved resolution and detection efficiency compared to the conventional collimator designs in SPECT, 3D high-resolution and artifact-free MPH and sparse-view image reconstruction techniques, and iterative image reconstruction methods with system response modeling for resolution recovery and image noise reduction for much improved image quality. The spatial resolution of PET and SPECT has improved from ∼6–12 mm to ∼1 mm a few years ago to sub-millimeter today. A recent commercial small animal SPECT system has achieved a resolution of ∼0.25 mm which surpasses that of a state-of-art PET system whose resolution is limited by the positron range. More recently, multimodality SA PET/MRI and SPECT/MRI systems have been developed in research laboratories. Also, multi-modality SA imaging systems that include other imaging modalities such as optical and ultrasound are being actively pursued. In this presentation, we will provide a review of the development, recent advances and future outlook of multi-modality molecular imaging of small animals. Learning Objectives: To learn about the two major multi-modality molecular imaging techniques of small animals. To learn about the spatial resolution achievable by the molecular imaging systems for small animal today. To learn about the new multi-modality imaging instrumentation and techniques that are being developed. Sang Hyun Cho; X-ray fluorescence (XRF) imaging, such as x-ray fluorescence computed tomography (XFCT), offers unique capabilities for accurate identification and quantification of metals within the imaging objects. As a result, it has emerged as a promising quantitative imaging modality in recent years, especially in conjunction with metal-based imaging probes. This talk will familiarize the audience with the basic principles of XRF/XFCT imaging. It will also cover the latest development of benchtop XFCT technology. Additionally, the use of metallic nanoparticles such as gold nanoparticles, in conjunction with benchtop XFCT, will be discussed within the context of preclinical multimodal multiplexed molecular imaging. Learning Objectives: To learn the basic principles of XRF/XFCT imaging To learn the latest advances in benchtop XFCT development for preclinical imaging Funding support received from NIH and DOD; Funding support received from GE Healthcare; Funding support received from Siemens AX; Patent royalties received from GE Healthcare; L. Wang, Funding Support: NIH; COI: Microphotoacoustics; S. Cho, Yes: ;NIH/NCI grant R01CA155446 DOD/PCRP grant W81XWH-12-1-0198.« less

WE-H-206-01: Photoacoustic Tomography: Multiscale Imaging From Organelles to Patients by Ultrasonically Beating the Optical Diffusion Limit

DOE Office of Scientific and Technical Information (OSTI.GOV)

Wang, L.

Lihong V. Wang: Photoacoustic tomography (PAT), combining non-ionizing optical and ultrasonic waves via the photoacoustic effect, provides in vivo multiscale functional, metabolic, and molecular imaging. Broad applications include imaging of the breast, brain, skin, esophagus, colon, vascular system, and lymphatic system in humans or animals. Light offers rich contrast but does not penetrate biological tissue in straight paths as x-rays do. Consequently, high-resolution pure optical imaging (e.g., confocal microscopy, two-photon microscopy, and optical coherence tomography) is limited to penetration within the optical diffusion limit (∼1 mm in the skin). Ultrasonic imaging, on the contrary, provides fine spatial resolution but suffersmore » from both poor contrast in early-stage tumors and strong speckle artifacts. In PAT, pulsed laser light penetrates tissue and generates a small but rapid temperature rise, which induces emission of ultrasonic waves due to thermoelastic expansion. The ultrasonic waves, orders of magnitude less scattering than optical waves, are then detected to form high-resolution images of optical absorption at depths up to 7 cm, conquering the optical diffusion limit. PAT is the only modality capable of imaging across the length scales of organelles, cells, tissues, and organs (up to whole-body small animals) with consistent contrast. This rapidly growing technology promises to enable multiscale biological research and accelerate translation from microscopic laboratory discoveries to macroscopic clinical practice. PAT may also hold the key to label-free early detection of cancer by in vivo quantification of hypermetabolism, the quintessential hallmark of malignancy. Learning Objectives: To understand the contrast mechanism of PAT To understand the multiscale applications of PAT Benjamin M. W. Tsui: Multi-modality molecular imaging instrumentation and techniques have been major developments in small animal imaging that has contributed significantly to biomedical research during the past decade. The initial development was an extension of clinical PET/CT and SPECT/CT from human to small animals and combine the unique functional information obtained from PET and SPECT with anatomical information provided by the CT in registered multi-modality images. The requirements to image a mouse whose size is an order of magnitude smaller than that of a human have spurred advances in new radiation detector technologies, novel imaging system designs and special image reconstruction and processing techniques. Examples are new detector materials and designs with high intrinsic resolution, multi-pinhole (MPH) collimator design for much improved resolution and detection efficiency compared to the conventional collimator designs in SPECT, 3D high-resolution and artifact-free MPH and sparse-view image reconstruction techniques, and iterative image reconstruction methods with system response modeling for resolution recovery and image noise reduction for much improved image quality. The spatial resolution of PET and SPECT has improved from ∼6–12 mm to ∼1 mm a few years ago to sub-millimeter today. A recent commercial small animal SPECT system has achieved a resolution of ∼0.25 mm which surpasses that of a state-of-art PET system whose resolution is limited by the positron range. More recently, multimodality SA PET/MRI and SPECT/MRI systems have been developed in research laboratories. Also, multi-modality SA imaging systems that include other imaging modalities such as optical and ultrasound are being actively pursued. In this presentation, we will provide a review of the development, recent advances and future outlook of multi-modality molecular imaging of small animals. Learning Objectives: To learn about the two major multi-modality molecular imaging techniques of small animals. To learn about the spatial resolution achievable by the molecular imaging systems for small animal today. To learn about the new multi-modality imaging instrumentation and techniques that are being developed. Sang Hyun Cho; X-ray fluorescence (XRF) imaging, such as x-ray fluorescence computed tomography (XFCT), offers unique capabilities for accurate identification and quantification of metals within the imaging objects. As a result, it has emerged as a promising quantitative imaging modality in recent years, especially in conjunction with metal-based imaging probes. This talk will familiarize the audience with the basic principles of XRF/XFCT imaging. It will also cover the latest development of benchtop XFCT technology. Additionally, the use of metallic nanoparticles such as gold nanoparticles, in conjunction with benchtop XFCT, will be discussed within the context of preclinical multimodal multiplexed molecular imaging. Learning Objectives: To learn the basic principles of XRF/XFCT imaging To learn the latest advances in benchtop XFCT development for preclinical imaging Funding support received from NIH and DOD; Funding support received from GE Healthcare; Funding support received from Siemens AX; Patent royalties received from GE Healthcare; L. Wang, Funding Support: NIH; COI: Microphotoacoustics; S. Cho, Yes: ;NIH/NCI grant R01CA155446 DOD/PCRP grant W81XWH-12-1-0198.« less

WE-H-206-00: Advances in Preclinical Imaging

DOE Office of Scientific and Technical Information (OSTI.GOV)

NONE

Lihong V. Wang: Photoacoustic tomography (PAT), combining non-ionizing optical and ultrasonic waves via the photoacoustic effect, provides in vivo multiscale functional, metabolic, and molecular imaging. Broad applications include imaging of the breast, brain, skin, esophagus, colon, vascular system, and lymphatic system in humans or animals. Light offers rich contrast but does not penetrate biological tissue in straight paths as x-rays do. Consequently, high-resolution pure optical imaging (e.g., confocal microscopy, two-photon microscopy, and optical coherence tomography) is limited to penetration within the optical diffusion limit (∼1 mm in the skin). Ultrasonic imaging, on the contrary, provides fine spatial resolution but suffersmore » from both poor contrast in early-stage tumors and strong speckle artifacts. In PAT, pulsed laser light penetrates tissue and generates a small but rapid temperature rise, which induces emission of ultrasonic waves due to thermoelastic expansion. The ultrasonic waves, orders of magnitude less scattering than optical waves, are then detected to form high-resolution images of optical absorption at depths up to 7 cm, conquering the optical diffusion limit. PAT is the only modality capable of imaging across the length scales of organelles, cells, tissues, and organs (up to whole-body small animals) with consistent contrast. This rapidly growing technology promises to enable multiscale biological research and accelerate translation from microscopic laboratory discoveries to macroscopic clinical practice. PAT may also hold the key to label-free early detection of cancer by in vivo quantification of hypermetabolism, the quintessential hallmark of malignancy. Learning Objectives: To understand the contrast mechanism of PAT To understand the multiscale applications of PAT Benjamin M. W. Tsui: Multi-modality molecular imaging instrumentation and techniques have been major developments in small animal imaging that has contributed significantly to biomedical research during the past decade. The initial development was an extension of clinical PET/CT and SPECT/CT from human to small animals and combine the unique functional information obtained from PET and SPECT with anatomical information provided by the CT in registered multi-modality images. The requirements to image a mouse whose size is an order of magnitude smaller than that of a human have spurred advances in new radiation detector technologies, novel imaging system designs and special image reconstruction and processing techniques. Examples are new detector materials and designs with high intrinsic resolution, multi-pinhole (MPH) collimator design for much improved resolution and detection efficiency compared to the conventional collimator designs in SPECT, 3D high-resolution and artifact-free MPH and sparse-view image reconstruction techniques, and iterative image reconstruction methods with system response modeling for resolution recovery and image noise reduction for much improved image quality. The spatial resolution of PET and SPECT has improved from ∼6–12 mm to ∼1 mm a few years ago to sub-millimeter today. A recent commercial small animal SPECT system has achieved a resolution of ∼0.25 mm which surpasses that of a state-of-art PET system whose resolution is limited by the positron range. More recently, multimodality SA PET/MRI and SPECT/MRI systems have been developed in research laboratories. Also, multi-modality SA imaging systems that include other imaging modalities such as optical and ultrasound are being actively pursued. In this presentation, we will provide a review of the development, recent advances and future outlook of multi-modality molecular imaging of small animals. Learning Objectives: To learn about the two major multi-modality molecular imaging techniques of small animals. To learn about the spatial resolution achievable by the molecular imaging systems for small animal today. To learn about the new multi-modality imaging instrumentation and techniques that are being developed. Sang Hyun Cho; X-ray fluorescence (XRF) imaging, such as x-ray fluorescence computed tomography (XFCT), offers unique capabilities for accurate identification and quantification of metals within the imaging objects. As a result, it has emerged as a promising quantitative imaging modality in recent years, especially in conjunction with metal-based imaging probes. This talk will familiarize the audience with the basic principles of XRF/XFCT imaging. It will also cover the latest development of benchtop XFCT technology. Additionally, the use of metallic nanoparticles such as gold nanoparticles, in conjunction with benchtop XFCT, will be discussed within the context of preclinical multimodal multiplexed molecular imaging. Learning Objectives: To learn the basic principles of XRF/XFCT imaging To learn the latest advances in benchtop XFCT development for preclinical imaging Funding support received from NIH and DOD; Funding support received from GE Healthcare; Funding support received from Siemens AX; Patent royalties received from GE Healthcare; L. Wang, Funding Support: NIH; COI: Microphotoacoustics; S. Cho, Yes: ;NIH/NCI grant R01CA155446 DOD/PCRP grant W81XWH-12-1-0198.« less

Big data sharing and analysis to advance research in post-traumatic epilepsy.

PubMed

Duncan, Dominique; Vespa, Paul; Pitkanen, Asla; Braimah, Adebayo; Lapinlampi, Nina; Toga, Arthur W

2018-06-01

We describe the infrastructure and functionality for a centralized preclinical and clinical data repository and analytic platform to support importing heterogeneous multi-modal data, automatically and manually linking data across modalities and sites, and searching content. We have developed and applied innovative image and electrophysiology processing methods to identify candidate biomarkers from MRI, EEG, and multi-modal data. Based on heterogeneous biomarkers, we present novel analytic tools designed to study epileptogenesis in animal model and human with the goal of tracking the probability of developing epilepsy over time. Copyright © 2017. Published by Elsevier Inc.

Multi-Modalities Sensor Science

DTIC Science & Technology

2015-02-28

enhanced multi-mode sensor science. bio -sensing, cross-discipling, multi-physics, nano-technology sailing He +46-8790 8465 1 Final Report for SOARD Project...spectroscopy, nano-technology, biophotonics and multi-physics modeling to produce adaptable bio -nanostructure enhanced multi-mode sensor science. 1...adaptable bio -nanostructure enhanced multi-mode sensor science. The accomplishments includes 1) A General Method for Designing a Radome to Enhance

Human factors evaluation of the effectiveness of multi-modality displays in advanced traveler information systems

DOT National Transportation Integrated Search

1999-12-01

To achieve the goals for Advanced Traveler Information Systems (ATIS), significant information will necessarily be provided to the driver. A primary ATIS design issue is the display modality (i.e., visual, auditory, or the combination) selected for p...

Rational chemical design of the next generation of molecular imaging probes based on physics and biology: mixing modalities, colors and signals

PubMed Central

Longmire, Michelle R.; Ogawa, Mikako; Choyke, Peter L.

2012-01-01

In recent years, numerous in vivo molecular imaging probes have been developed. As a consequence, much has been published on the design and synthesis of molecular imaging probes focusing on each modality, each type of material, or each target disease. More recently, second generation molecular imaging probes with unique, multi-functional, or multiplexed characteristics have been designed. This critical review focuses on (i) molecular imaging using combinations of modalities and signals that employ the full range of the electromagnetic spectra, (ii) optimized chemical design of molecular imaging probes for in vivo kinetics based on biology and physiology across a range of physical sizes, (iii) practical examples of second generation molecular imaging probes designed to extract complementary data from targets using multiple modalities, color, and comprehensive signals (277 references). PMID:21607237

Composite PET and MRI for accurate localization and metabolic modeling: a very useful tool for research and clinic

NASA Astrophysics Data System (ADS)

Bidaut, Luc M.

1991-06-01

In order to help in analyzing PET data and really take advantage of their metabolic content, a system was designed and implemented to align and process data from various medical imaging modalities, particularly (but not only) for brain studies. Although this system is for now mostly used for anatomical localization, multi-modality ROIs and pharmaco-kinetic modeling, more multi-modality protocols will be implemented in the future, not only to help in PET reconstruction data correction and semi-automated ROI definition, but also for helping in improving diagnostic accuracy along with surgery and therapy planning.

Validation of a new modal performance measure for flexible controllers design

DOE Office of Scientific and Technical Information (OSTI.GOV)

Simo, J.B.; Tahan, S.A.; Kamwa, I.

1996-05-01

A new modal performance measure for power system stabilizer (PSS) optimization is proposed in this paper. The new method is based on modifying the square envelopes of oscillating modes, in order to take into account their damping ratios while minimizing the performance index. This criteria is applied to flexible controllers optimal design, on a multi-input-multi-output (MIMO) reduced-order model of a prototype power system. The multivariable model includes four generators, each having one input and one output. Linear time-response simulation and transient stability analysis with a nonlinear package confirm the superiority of the proposed criteria and illustrate its effectiveness in decentralizedmore » control.« less

Robust energy-absorbing compensators for the ACTEX II test article

NASA Astrophysics Data System (ADS)

Blaurock, Carl A.; Miller, David W.; Nye, Ted

1995-05-01

The paper addresses the problem of satellite solar panel vibration. A multi-layer vibration control scheme is investigated using a flight test article. Key issues in the active control portion are presented in the paper. The paper discusses the primary control design drivers, which are the time variations in modal frequencies due to configuration and thermal changes. A local control design approach is investigated, but found to be unworkable due to sensor/actuator non-collocation. An alternate design process uses linear robust control techniques, by describing the modal shifts as uncertainties. Multiple modal design, alpha- shifted multiple model, and a feedthrough compensation scheme are examined. Ground and simulation tests demonstrate that the resulting controllers provide significant vibration reduction in the presence of expected system variations.

In vivo time-serial multi-modality optical imaging in a mouse model of ovarian tumorigenesis

PubMed Central

Watson, Jennifer M; Marion, Samuel L; Rice, Photini F; Bentley, David L; Besselsen, David G; Utzinger, Urs; Hoyer, Patricia B; Barton, Jennifer K

2014-01-01

Identification of the early microscopic changes associated with ovarian cancer may lead to development of a diagnostic test for high-risk women. In this study we use optical coherence tomography (OCT) and multiphoton microscopy (MPM) (collecting both two photon excited fluorescence [TPEF] and second harmonic generation [SHG]) to image mouse ovaries in vivo at multiple time points. We demonstrate the feasibility of imaging mouse ovaries in vivo during a long-term survival study and identify microscopic changes associated with early tumor development. These changes include alterations in tissue microstructure, as seen by OCT, alterations in cellular fluorescence and morphology, as seen by TPEF, and remodeling of collagen structure, as seen by SHG. These results suggest that a combined OCT-MPM system may be useful for early detection of ovarian cancer. PMID:24145178

Multi-Modal Traveler Information System - Corridor User Needs and Data Exchange Elements

DOT National Transportation Integrated Search

1997-07-30

Intended as a resource for the members of the GCM Deployment Committee, : Architecture Communication and Information Work Group, project managers, system : designers, system developers and system integrators, this Working Paper supports : the design,...

MRMC analysis of agreement studies

NASA Astrophysics Data System (ADS)

Gallas, Brandon D.; Anam, Amrita; Chen, Weijie; Wunderlich, Adam; Zhang, Zhiwei

2016-03-01

The purpose of this work is to present and evaluate methods based on U-statistics to compare intra- or inter-reader agreement across different imaging modalities. We apply these methods to multi-reader multi-case (MRMC) studies. We measure reader-averaged agreement and estimate its variance accounting for the variability from readers and cases (an MRMC analysis). In our application, pathologists (readers) evaluate patient tissue mounted on glass slides (cases) in two ways. They evaluate the slides on a microscope (reference modality) and they evaluate digital scans of the slides on a computer display (new modality). In the current work, we consider concordance as the agreement measure, but many of the concepts outlined here apply to other agreement measures. Concordance is the probability that two readers rank two cases in the same order. Concordance can be estimated with a U-statistic and thus it has some nice properties: it is unbiased, asymptotically normal, and its variance is given by an explicit formula. Another property of a U-statistic is that it is symmetric in its inputs; it doesn't matter which reader is listed first or which case is listed first, the result is the same. Using this property and a few tricks while building the U-statistic kernel for concordance, we get a mathematically tractable problem and efficient software. Simulations show that our variance and covariance estimates are unbiased.

An Assemblable, Multi-Angle Fluorescence and Ellipsometric Microscope

PubMed Central

Nguyen, Victoria; Rizzo, John

2016-01-01

We introduce a multi-functional microscope for research laboratories that have significant cost and space limitations. The microscope pivots around the sample, operating in upright, inverted, side-on and oblique geometries. At these geometries it is able to perform bright-field, fluorescence and qualitative ellipsometric imaging. It is the first single instrument in the literature to be able to perform all of these functionalities. The system can be assembled by two undergraduate students from a provided manual in less than a day, from off-the-shelf and 3D printed components, which together cost approximately $16k at 2016 market prices. We include a highly specified assembly manual, a summary of design methodologies, and all associated 3D-printing files in hopes that the utility of the design outlives the current component market. This open design approach prepares readers to customize the instrument to specific needs and applications. We also discuss how to select household LEDs as low-cost light sources for fluorescence microscopy. We demonstrate the utility of the microscope in varied geometries and functionalities, with particular emphasis on studying hydrated, solid-supported lipid films and wet biological samples. PMID:27907008

Optical diffraction tomography with fully and partially coherent illumination in high numerical aperture label-free microscopy [Invited].

PubMed

Soto, Juan M; Rodrigo, José A; Alieva, Tatiana

2018-01-01

Quantitative label-free imaging is an important tool for the study of living microorganisms that, during the last decade, has attracted wide attention from the optical community. Optical diffraction tomography (ODT) is probably the most relevant technique for quantitative label-free 3D imaging applied in wide-field microscopy in the visible range. The ODT is usually performed using spatially coherent light illumination and specially designed holographic microscopes. Nevertheless, the ODT is also compatible with partially coherent illumination and can be realized in conventional wide-field microscopes by applying refocusing techniques, as it has been recently demonstrated. Here, we compare these two ODT modalities, underlining their pros and cons and discussing the optical setups for their implementation. In particular, we pay special attention to a system that is compatible with a conventional wide-field microscope that can be used for both ODT modalities. It consists of two easily attachable modules: the first for sample illumination engineering based on digital light processing technology; the other for focus scanning by using an electrically driven tunable lens. This hardware allows for a programmable selection of the wavelength and the illumination design, and provides fast data acquisition as well. Its performance is experimentally demonstrated in the case of ODT with partially coherent illumination providing speckle-free 3D quantitative imaging.

Design of magnetic and fluorescent nanoparticles for in vivo MR and NIRF cancer imaging

NASA Astrophysics Data System (ADS)

Key, Jaehong

One big challenge for cancer treatment is that it has many errors in detection of cancers in the early stages before metastasis occurs. Using a current imaging modality, the detection of small tumors having potential metastasis is still very difficult. Thus, the development of multi-component nanoparticles (NPs) for dual modality cancer imaging is invaluable. The multi-component NPs can be an alternative to overcome the limitations from an imaging modality. For example, the multi-component NPs can visualize small tumors in both magnetic resonance imaging (MRI) and near infrared fluorescence (NIRF) imaging, which can help find the location of the tumors deep inside the body using MRI and subsequently guide surgeons to delineate the margin of tumors using highly sensitive NIRF imaging during a surgical operation. In this dissertation, we demonstrated the potential of the MRI and NIRF dual-modality NPs for skin and bladder cancer imaging. The multi-component NPs consisted of glycol chitosan, superparamagnetic iron oxide, NIRF dye, and cancer targeting peptides. We characterized the NPs and evaluated them with tumor bearing mice as well as various cancer cells. The findings of this research will contribute to the development of cancer diagnostic imaging and it can also be extensively applied to drug delivery system and fluorescence-guided surgical removal of cancer.

Brain-based decoding of mentally imagined film clips and sounds reveals experience-based information patterns in film professionals.

PubMed

de Borst, Aline W; Valente, Giancarlo; Jääskeläinen, Iiro P; Tikka, Pia

2016-04-01

In the perceptual domain, it has been shown that the human brain is strongly shaped through experience, leading to expertise in highly-skilled professionals. What has remained unclear is whether specialization also shapes brain networks underlying mental imagery. In our fMRI study, we aimed to uncover modality-specific mental imagery specialization of film experts. Using multi-voxel pattern analysis we decoded from brain activity of professional cinematographers and sound designers whether they were imagining sounds or images of particular film clips. In each expert group distinct multi-voxel patterns, specific for the modality of their expertise, were found during classification of imagery modality. These patterns were mainly localized in the occipito-temporal and parietal cortex for cinematographers and in the auditory cortex for sound designers. We also found generalized patterns across perception and imagery that were distinct for the two expert groups: they involved frontal cortex for the cinematographers and temporal cortex for the sound designers. Notably, the mental representations of film clips and sounds of cinematographers contained information that went beyond modality-specificity. We were able to successfully decode the implicit presence of film genre from brain activity during mental imagery in cinematographers. The results extend existing neuroimaging literature on expertise into the domain of mental imagery and show that experience in visual versus auditory imagery can alter the representation of information in modality-specific association cortices. Copyright © 2016 Elsevier Inc. All rights reserved.

IMAGES: A digital computer program for interactive modal analysis and gain estimation for eigensystem synthesis

NASA Technical Reports Server (NTRS)

Jones, R. L.

1984-01-01

An interactive digital computer program for modal analysis and gain estimation for eigensystem synthesis was written. Both mathematical and operation considerations are described; however, the mathematical presentation is limited to those concepts essential to the operational capability of the program. The program is capable of both modal and spectral synthesis of multi-input control systems. It is user friendly, has scratchpad capability and dynamic memory, and can be used to design either state or output feedback systems.

Multi-Modal Traveler Information System - Gateway Design Options

DOT National Transportation Integrated Search

1997-05-19

The purpose of this working paper is to provide insight into the options that are available from which to design the Gateway Traveler Information System (TIS). This working paper will discuss each option in a general manner without becoming overly te...

Extending Whole Slide Imaging: Color Darkfield Internal Reflection Illumination (DIRI) for Biological Applications

PubMed Central

Namiki, Kana; Miyawaki, Atsushi; Ishikawa, Takuji

2017-01-01

Whole slide imaging (WSI) is a useful tool for multi-modal imaging, and in our work, we have often combined WSI with darkfield microscopy. However, traditional darkfield microscopy cannot use a single condenser to support high- and low-numerical-aperture objectives, which limits the modality of WSI. To overcome this limitation, we previously developed a darkfield internal reflection illumination (DIRI) microscope using white light-emitting diodes (LEDs). Although the developed DIRI is useful for biological applications, substantial problems remain to be resolved. In this study, we propose a novel illumination technique called color DIRI. The use of three-color LEDs dramatically improves the capability of the system, such that color DIRI (1) enables optimization of the illumination color; (2) can be combined with an oil objective lens; (3) can produce fluorescence excitation illumination; (4) can adjust the wavelength of light to avoid cell damage or reactions; and (5) can be used as a photostimulator. These results clearly illustrate that the proposed color DIRI can significantly extend WSI modalities for biological applications. PMID:28085892

Enhancing resource coordination for multi-modal evacuation planning.

DOT National Transportation Integrated Search

2013-01-01

This research project seeks to increase knowledge about coordinating effective multi-modal evacuation for disasters. It does so by identifying, evaluating, and assessing : current transportation management approaches for multi-modal evacuation planni...

A portable microscopy system for fluorescence, polarized, and brightfield imaging

NASA Astrophysics Data System (ADS)

Gordon, Paul; Wattinger, Rolla; Lewis, Cody; Venancio, Vinicius Paula; Mertens-Talcott, Susanne U.; Coté, Gerard

2018-02-01

The use of mobile phones to conduct diagnostic microscopy at the point-of-care presents intriguing possibilities for the advancement of high-quality medical care in remote settings. However, it is challenging to create a single device that can adapt to the ever-varying camera technologies in phones or that can image with the customization that multiple modalities require for applications such as malaria diagnosis. A portable multi-modal microscope system is presented that utilizes a Raspberry Pi to collect and transmit data wirelessly to a myriad of electronic devices for image analysis. The microscopy system is capable of providing to the user correlated brightfield, polarized, and fluorescent images of samples fixed on traditional microscopy slides. The multimodal diagnostic capabilities of the microscope were assessed by measuring parasitemia of Plasmodium falciparum-infected thin blood smears. The device is capable of detecting fluorescently-labeled DNA using FITC excitation (490 nm) and emission (525 nm), the birefringent P. falciparum byproduct hemozoin, and detecting brightfield absorption with a resolution of 0.78 micrometers (element 9-3 of a 1951 Air Force Target). This microscopy system is a novel portable imaging tool that may be a viable candidate for field implementation if challenges of system durability, cost considerations, and full automation can be overcome.

Integrative Data Analysis of Multi-Platform Cancer Data with a Multimodal Deep Learning Approach.

PubMed

Liang, Muxuan; Li, Zhizhong; Chen, Ting; Zeng, Jianyang

2015-01-01

Identification of cancer subtypes plays an important role in revealing useful insights into disease pathogenesis and advancing personalized therapy. The recent development of high-throughput sequencing technologies has enabled the rapid collection of multi-platform genomic data (e.g., gene expression, miRNA expression, and DNA methylation) for the same set of tumor samples. Although numerous integrative clustering approaches have been developed to analyze cancer data, few of them are particularly designed to exploit both deep intrinsic statistical properties of each input modality and complex cross-modality correlations among multi-platform input data. In this paper, we propose a new machine learning model, called multimodal deep belief network (DBN), to cluster cancer patients from multi-platform observation data. In our integrative clustering framework, relationships among inherent features of each single modality are first encoded into multiple layers of hidden variables, and then a joint latent model is employed to fuse common features derived from multiple input modalities. A practical learning algorithm, called contrastive divergence (CD), is applied to infer the parameters of our multimodal DBN model in an unsupervised manner. Tests on two available cancer datasets show that our integrative data analysis approach can effectively extract a unified representation of latent features to capture both intra- and cross-modality correlations, and identify meaningful disease subtypes from multi-platform cancer data. In addition, our approach can identify key genes and miRNAs that may play distinct roles in the pathogenesis of different cancer subtypes. Among those key miRNAs, we found that the expression level of miR-29a is highly correlated with survival time in ovarian cancer patients. These results indicate that our multimodal DBN based data analysis approach may have practical applications in cancer pathogenesis studies and provide useful guidelines for personalized cancer therapy.

Magnetoacoustic microscopic imaging of conductive objects and nanoparticles distribution

NASA Astrophysics Data System (ADS)

Liu, Siyu; Zhang, Ruochong; Luo, Yunqi; Zheng, Yuanjin

2017-09-01

Magnetoacoustic tomography has been demonstrated as a powerful and low-cost multi-wave imaging modality. However, due to limited spatial resolution and detection efficiency of magnetoacoustic signal, full potential of the magnetoacoustic imaging remains to be tapped. Here we report a high-resolution magnetoacoustic microscopy method, where magnetic stimulation is provided by a compact solenoid resonance coil connected with a matching network, and acoustic reception is realized by using a high-frequency focused ultrasound transducer. Scanning the magnetoacoustic microscopy system perpendicularly to the acoustic axis of the focused transducer would generate a two-dimensional microscopic image with acoustically determined lateral resolution. It is analyzed theoretically and demonstrated experimentally that magnetoacoustic generation in this microscopic system depends on the conductivity profile of conductive objects and localized distribution of superparamagnetic iron magnetic nanoparticles, based on two different but related implementations. The lateral resolution is characterized. Directional nature of magnetoacoustic vibration and imaging sensitivity for mapping magnetic nanoparticles are also discussed. The proposed microscopy system offers a high-resolution method that could potentially map intrinsic conductivity distribution in biological tissue and extraneous magnetic nanoparticles.

Measurement of specimen-induced aberrations of biological samples using phase stepping interferometry.

PubMed

Schwertner, M; Booth, M J; Neil, M A A; Wilson, T

2004-01-01

Confocal or multiphoton microscopes, which deliver optical sections and three-dimensional (3D) images of thick specimens, are widely used in biology. These techniques, however, are sensitive to aberrations that may originate from the refractive index structure of the specimen itself. The aberrations cause reduced signal intensity and the 3D resolution of the instrument is compromised. It has been suggested to correct for aberrations in confocal microscopes using adaptive optics. In order to define the design specifications for such adaptive optics systems, one has to know the amount of aberrations present for typical applications such as with biological samples. We have built a phase stepping interferometer microscope that directly measures the aberration of the wavefront. The modal content of the wavefront is extracted by employing Zernike mode decomposition. Results for typical biological specimens are presented. It was found for all samples investigated that higher order Zernike modes give only a small contribution to the overall aberration. Therefore, these higher order modes can be neglected in future adaptive optics sensing and correction schemes implemented into confocal or multiphoton microscopes, leading to more efficient designs.

Multidirectional Image Sensing for Microscopy Based on a Rotatable Robot.

PubMed

Shen, Yajing; Wan, Wenfeng; Zhang, Lijun; Yong, Li; Lu, Haojian; Ding, Weili

2015-12-15

Image sensing at a small scale is essentially important in many fields, including microsample observation, defect inspection, material characterization and so on. However, nowadays, multi-directional micro object imaging is still very challenging due to the limited field of view (FOV) of microscopes. This paper reports a novel approach for multi-directional image sensing in microscopes by developing a rotatable robot. First, a robot with endless rotation ability is designed and integrated with the microscope. Then, the micro object is aligned to the rotation axis of the robot automatically based on the proposed forward-backward alignment strategy. After that, multi-directional images of the sample can be obtained by rotating the robot within one revolution under the microscope. To demonstrate the versatility of this approach, we view various types of micro samples from multiple directions in both optical microscopy and scanning electron microscopy, and panoramic images of the samples are processed as well. The proposed method paves a new way for the microscopy image sensing, and we believe it could have significant impact in many fields, especially for sample detection, manipulation and characterization at a small scale.

Compact multi-band fluorescent microscope with an electrically tunable lens for autofocusing

PubMed Central

Wang, Zhaojun; Lei, Ming; Yao, Baoli; Cai, Yanan; Liang, Yansheng; Yang, Yanlong; Yang, Xibin; Li, Hui; Xiong, Daxi

2015-01-01

Autofocusing is a routine technique in redressing focus drift that occurs in time-lapse microscopic image acquisition. To date, most automatic microscopes are designed on the distance detection scheme to fulfill the autofocusing operation, which may suffer from the low contrast of the reflected signal due to the refractive index mismatch at the water/glass interface. To achieve high autofocusing speed with minimal motion artifacts, we developed a compact multi-band fluorescent microscope with an electrically tunable lens (ETL) device for autofocusing. A modified searching algorithm based on equidistant scanning and curve fitting is proposed, which no longer requires a single-peak focus curve and then efficiently restrains the impact of external disturbance. This technique enables us to achieve an autofocusing time of down to 170 ms and the reproductivity of over 97%. The imaging head of the microscope has dimensions of 12 cm × 12 cm × 6 cm. This portable instrument can easily fit inside standard incubators for real-time imaging of living specimens. PMID:26601001

Large Margin Multi-Modal Multi-Task Feature Extraction for Image Classification.

PubMed

Yong Luo; Yonggang Wen; Dacheng Tao; Jie Gui; Chao Xu

2016-01-01

The features used in many image analysis-based applications are frequently of very high dimension. Feature extraction offers several advantages in high-dimensional cases, and many recent studies have used multi-task feature extraction approaches, which often outperform single-task feature extraction approaches. However, most of these methods are limited in that they only consider data represented by a single type of feature, even though features usually represent images from multiple modalities. We, therefore, propose a novel large margin multi-modal multi-task feature extraction (LM3FE) framework for handling multi-modal features for image classification. In particular, LM3FE simultaneously learns the feature extraction matrix for each modality and the modality combination coefficients. In this way, LM3FE not only handles correlated and noisy features, but also utilizes the complementarity of different modalities to further help reduce feature redundancy in each modality. The large margin principle employed also helps to extract strongly predictive features, so that they are more suitable for prediction (e.g., classification). An alternating algorithm is developed for problem optimization, and each subproblem can be efficiently solved. Experiments on two challenging real-world image data sets demonstrate the effectiveness and superiority of the proposed method.

Multi-Modal Curriculum Learning for Semi-Supervised Image Classification.

PubMed

Gong, Chen; Tao, Dacheng; Maybank, Stephen J; Liu, Wei; Kang, Guoliang; Yang, Jie

2016-07-01

Semi-supervised image classification aims to classify a large quantity of unlabeled images by typically harnessing scarce labeled images. Existing semi-supervised methods often suffer from inadequate classification accuracy when encountering difficult yet critical images, such as outliers, because they treat all unlabeled images equally and conduct classifications in an imperfectly ordered sequence. In this paper, we employ the curriculum learning methodology by investigating the difficulty of classifying every unlabeled image. The reliability and the discriminability of these unlabeled images are particularly investigated for evaluating their difficulty. As a result, an optimized image sequence is generated during the iterative propagations, and the unlabeled images are logically classified from simple to difficult. Furthermore, since images are usually characterized by multiple visual feature descriptors, we associate each kind of features with a teacher, and design a multi-modal curriculum learning (MMCL) strategy to integrate the information from different feature modalities. In each propagation, each teacher analyzes the difficulties of the currently unlabeled images from its own modality viewpoint. A consensus is subsequently reached among all the teachers, determining the currently simplest images (i.e., a curriculum), which are to be reliably classified by the multi-modal learner. This well-organized propagation process leveraging multiple teachers and one learner enables our MMCL to outperform five state-of-the-art methods on eight popular image data sets.

vECTlab—A fully integrated multi-modality Monte Carlo simulation framework for the radiological imaging sciences

NASA Astrophysics Data System (ADS)

Peter, Jörg; Semmler, Wolfhard

2007-10-01

Alongside and in part motivated by recent advances in molecular diagnostics, the development of dual-modality instruments for patient and dedicated small animal imaging has gained attention by diverse research groups. The desire for such systems is high not only to link molecular or functional information with the anatomical structures, but also for detecting multiple molecular events simultaneously at shorter total acquisition times. While PET and SPECT have been integrated successfully with X-ray CT, the advance of optical imaging approaches (OT) and the integration thereof into existing modalities carry a high application potential, particularly for imaging small animals. A multi-modality Monte Carlo (MC) simulation approach at present has been developed that is able to trace high-energy (keV) as well as optical (eV) photons concurrently within identical phantom representation models. We show that the involved two approaches for ray-tracing keV and eV photons can be integrated into a unique simulation framework which enables both photon classes to be propagated through various geometry models representing both phantoms and scanners. The main advantage of such integrated framework for our specific application is the investigation of novel tomographic multi-modality instrumentation intended for in vivo small animal imaging through time-resolved MC simulation upon identical phantom geometries. Design examples are provided for recently proposed SPECT-OT and PET-OT imaging systems.

Note: Tandem Kirkpatrick-Baez microscope with sixteen channels for high-resolution laser-plasma diagnostics

NASA Astrophysics Data System (ADS)

Yi, Shengzhen; Zhang, Zhe; Huang, Qiushi; Zhang, Zhong; Wang, Zhanshan; Wei, Lai; Liu, Dongxiao; Cao, Leifeng; Gu, Yuqiu

2018-03-01

Multi-channel Kirkpatrick-Baez (KB) microscopes, which have better resolution and collection efficiency than pinhole cameras, have been widely used in laser inertial confinement fusion to diagnose time evolution of the target implosion. In this study, a tandem multi-channel KB microscope was developed to have sixteen imaging channels with the precise control of spatial resolution and image intervals. This precise control was created using a coarse assembly of mirror pairs with high-accuracy optical prisms, followed by precise adjustment in real-time x-ray imaging experiments. The multilayers coated on the KB mirrors were designed to have substantially the same reflectivity to obtain a uniform brightness of different images for laser-plasma temperature analysis. The study provides a practicable method to achieve the optimum performance of the microscope for future high-resolution applications in inertial confinement fusion experiments.

Multi-modality molecular imaging: pre-clinical laboratory configuration

NASA Astrophysics Data System (ADS)

Wu, Yanjun; Wellen, Jeremy W.; Sarkar, Susanta K.

2006-02-01

In recent years, the prevalence of in vivo molecular imaging applications has rapidly increased. Here we report on the construction of a multi-modality imaging facility in a pharmaceutical setting that is expected to further advance existing capabilities for in vivo imaging of drug distribution and the interaction with their target. The imaging instrumentation in our facility includes a microPET scanner, a four wavelength time-domain optical imaging scanner, a 9.4T/30cm MRI scanner and a SPECT/X-ray CT scanner. An electronics shop and a computer room dedicated to image analysis are additional features of the facility. The layout of the facility was designed with a central animal preparation room surrounded by separate laboratory rooms for each of the major imaging modalities to accommodate the work-flow of simultaneous in vivo imaging experiments. This report will focus on the design of and anticipated applications for our microPET and optical imaging laboratory spaces. Additionally, we will discuss efforts to maximize the daily throughput of animal scans through development of efficient experimental work-flows and the use of multiple animals in a single scanning session.

Multi-Modality Phantom Development

DOE Office of Scientific and Technical Information (OSTI.GOV)

Huber, Jennifer S.; Peng, Qiyu; Moses, William W.

2009-03-20

Multi-modality imaging has an increasing role in the diagnosis and treatment of a large number of diseases, particularly if both functional and anatomical information are acquired and accurately co-registered. Hence, there is a resulting need for multi modality phantoms in order to validate image co-registration and calibrate the imaging systems. We present our PET-ultrasound phantom development, including PET and ultrasound images of a simple prostate phantom. We use agar and gelatin mixed with a radioactive solution. We also present our development of custom multi-modality phantoms that are compatible with PET, transrectal ultrasound (TRUS), MRI and CT imaging. We describe bothmore » our selection of tissue mimicking materials and phantom construction procedures. These custom PET-TRUS-CT-MRI prostate phantoms use agargelatin radioactive mixtures with additional contrast agents and preservatives. We show multi-modality images of these custom prostate phantoms, as well as discuss phantom construction alternatives. Although we are currently focused on prostate imaging, this phantom development is applicable to many multi-modality imaging applications.« less

Multi-modal vehicle display design and analysis

DOT National Transportation Integrated Search

2004-10-01

It is now evident from anecdotal evidence and preliminary research that distractions can : hinder the task of operating a vehicle, and consequently reduce driver safety. However with : increasing wireless connectivity and the mobility of office devic...

A Multi-Modal Digital Game-Based Learning Environment for Hospitalized Children with Chronic Illnesses.

ERIC Educational Resources Information Center

Chin, Jui-Chih; Tsuei, Mengping

2014-01-01

The aim of this study was to explore the digital game-based learning for children with chronic illnesses in the hospital settings. The design-based research and qualitative methods were applied. Three eight-year-old children with leukemia participated in this study. In the first phase, the multi-user game-based learning system was developed and…

Dynamic Gesture Recognition with a Terahertz Radar Based on Range Profile Sequences and Doppler Signatures

PubMed Central

Pi, Yiming

2017-01-01

The frequency of terahertz radar ranges from 0.1 THz to 10 THz, which is higher than that of microwaves. Multi-modal signals, including high-resolution range profile (HRRP) and Doppler signatures, can be acquired by the terahertz radar system. These two kinds of information are commonly used in automatic target recognition; however, dynamic gesture recognition is rarely discussed in the terahertz regime. In this paper, a dynamic gesture recognition system using a terahertz radar is proposed, based on multi-modal signals. The HRRP sequences and Doppler signatures were first achieved from the radar echoes. Considering the electromagnetic scattering characteristics, a feature extraction model is designed using location parameter estimation of scattering centers. Dynamic Time Warping (DTW) extended to multi-modal signals is used to accomplish the classifications. Ten types of gesture signals, collected from a terahertz radar, are applied to validate the analysis and the recognition system. The results of the experiment indicate that the recognition rate reaches more than 91%. This research verifies the potential applications of dynamic gesture recognition using a terahertz radar. PMID:29267249

Iconic Gestures for Robot Avatars, Recognition and Integration with Speech.

PubMed

Bremner, Paul; Leonards, Ute

2016-01-01

Co-verbal gestures are an important part of human communication, improving its efficiency and efficacy for information conveyance. One possible means by which such multi-modal communication might be realized remotely is through the use of a tele-operated humanoid robot avatar. Such avatars have been previously shown to enhance social presence and operator salience. We present a motion tracking based tele-operation system for the NAO robot platform that allows direct transmission of speech and gestures produced by the operator. To assess the capabilities of this system for transmitting multi-modal communication, we have conducted a user study that investigated if robot-produced iconic gestures are comprehensible, and are integrated with speech. Robot performed gesture outcomes were compared directly to those for gestures produced by a human actor, using a within participant experimental design. We show that iconic gestures produced by a tele-operated robot are understood by participants when presented alone, almost as well as when produced by a human. More importantly, we show that gestures are integrated with speech when presented as part of a multi-modal communication equally well for human and robot performances.

Dynamic Gesture Recognition with a Terahertz Radar Based on Range Profile Sequences and Doppler Signatures.

PubMed

Zhou, Zhi; Cao, Zongjie; Pi, Yiming

2017-12-21

The frequency of terahertz radar ranges from 0.1 THz to 10 THz, which is higher than that of microwaves. Multi-modal signals, including high-resolution range profile (HRRP) and Doppler signatures, can be acquired by the terahertz radar system. These two kinds of information are commonly used in automatic target recognition; however, dynamic gesture recognition is rarely discussed in the terahertz regime. In this paper, a dynamic gesture recognition system using a terahertz radar is proposed, based on multi-modal signals. The HRRP sequences and Doppler signatures were first achieved from the radar echoes. Considering the electromagnetic scattering characteristics, a feature extraction model is designed using location parameter estimation of scattering centers. Dynamic Time Warping (DTW) extended to multi-modal signals is used to accomplish the classifications. Ten types of gesture signals, collected from a terahertz radar, are applied to validate the analysis and the recognition system. The results of the experiment indicate that the recognition rate reaches more than 91%. This research verifies the potential applications of dynamic gesture recognition using a terahertz radar.

Enabling Low-Power, Multi-Modal Neural Interfaces Through a Common, Low-Bandwidth Feature Space.

PubMed

Irwin, Zachary T; Thompson, David E; Schroeder, Karen E; Tat, Derek M; Hassani, Ali; Bullard, Autumn J; Woo, Shoshana L; Urbanchek, Melanie G; Sachs, Adam J; Cederna, Paul S; Stacey, William C; Patil, Parag G; Chestek, Cynthia A

2016-05-01

Brain-Machine Interfaces (BMIs) have shown great potential for generating prosthetic control signals. Translating BMIs into the clinic requires fully implantable, wireless systems; however, current solutions have high power requirements which limit their usability. Lowering this power consumption typically limits the system to a single neural modality, or signal type, and thus to a relatively small clinical market. Here, we address both of these issues by investigating the use of signal power in a single narrow frequency band as a decoding feature for extracting information from electrocorticographic (ECoG), electromyographic (EMG), and intracortical neural data. We have designed and tested the Multi-modal Implantable Neural Interface (MINI), a wireless recording system which extracts and transmits signal power in a single, configurable frequency band. In prerecorded datasets, we used the MINI to explore low frequency signal features and any resulting tradeoff between power savings and decoding performance losses. When processing intracortical data, the MINI achieved a power consumption 89.7% less than a more typical system designed to extract action potential waveforms. When processing ECoG and EMG data, the MINI achieved similar power reductions of 62.7% and 78.8%. At the same time, using the single signal feature extracted by the MINI, we were able to decode all three modalities with less than a 9% drop in accuracy relative to using high-bandwidth, modality-specific signal features. We believe this system architecture can be used to produce a viable, cost-effective, clinical BMI.

A Multi-Modality CMOS Sensor Array for Cell-Based Assay and Drug Screening.

PubMed

Chi, Taiyun; Park, Jong Seok; Butts, Jessica C; Hookway, Tracy A; Su, Amy; Zhu, Chengjie; Styczynski, Mark P; McDevitt, Todd C; Wang, Hua

2015-12-01

In this paper, we present a fully integrated multi-modality CMOS cellular sensor array with four sensing modalities to characterize different cell physiological responses, including extracellular voltage recording, cellular impedance mapping, optical detection with shadow imaging and bioluminescence sensing, and thermal monitoring. The sensor array consists of nine parallel pixel groups and nine corresponding signal conditioning blocks. Each pixel group comprises one temperature sensor and 16 tri-modality sensor pixels, while each tri-modality sensor pixel can be independently configured for extracellular voltage recording, cellular impedance measurement (voltage excitation/current sensing), and optical detection. This sensor array supports multi-modality cellular sensing at the pixel level, which enables holistic cell characterization and joint-modality physiological monitoring on the same cellular sample with a pixel resolution of 80 μm × 100 μm. Comprehensive biological experiments with different living cell samples demonstrate the functionality and benefit of the proposed multi-modality sensing in cell-based assay and drug screening.

Privacy Preserving Facial and Fingerprint Multi-biometric Authentication

NASA Astrophysics Data System (ADS)

Anzaku, Esla Timothy; Sohn, Hosik; Ro, Yong Man

The cases of identity theft can be mitigated by the adoption of secure authentication methods. Biohashing and its variants, which utilizes secret keys and biometrics, are promising methods for secure authentication; however, their shortcoming is the degraded performance under the assumption that secret keys are compromised. In this paper, we extend the concept of Biohashing to multi-biometrics - facial and fingerprint traits. We chose these traits because they are widely used, howbeit, little research attention has been given to designing privacy preserving multi-biometric systems using them. Instead of just using a single modality (facial or fingerprint), we presented a framework for using both modalities. The improved performance of the proposed method, using face and fingerprint, as against either facial or fingerprint trait used in isolation is evaluated using two chimerical bimodal databases formed from publicly available facial and fingerprint databases.

Medical information, communication, and archiving system (MICAS): Phase II integration and acceptance testing

NASA Astrophysics Data System (ADS)

Smith, Edward M.; Wandtke, John; Robinson, Arvin E.

1999-07-01

The Medical Information, Communication and Archive System (MICAS) is a multi-modality integrated image management system that is seamlessly integrated with the Radiology Information System (RIS). This project was initiated in the summer of 1995 with the first phase being installed during the first half of 1997 and the second phase installed during the summer of 1998. Phase II enhancements include a permanent archive, automated workflow including modality worklist, study caches, NT diagnostic workstations with all components adhering to Digital Imaging and Communications in Medicine (DICOM) standards. This multi-vendor phased approach to PACS implementation is designed as an enterprise-wide PACS to provide images and reports throughout our healthcare network. MICAS demonstrates that aa multi-vendor open system phased approach to PACS is feasible, cost-effective, and has significant advantages over a single vendor implementation.

An evaluation of the effectiveness of a multi-modal intervention in frail and pre-frail older people with type 2 diabetes - the MID-Frail study: study protocol for a randomised controlled trial

PubMed Central

2014-01-01

Background Diabetes, a highly prevalent, chronic disease, is associated with increasing frailty and functional decline in older people, with concomitant personal, social, and public health implications. We describe the rationale and methods of the multi-modal intervention in diabetes in frailty (MID-Frail) study. Methods/Design The MID-Frail study is an open, randomised, multicentre study, with random allocation by clusters (each trial site) to a usual care group or an intervention group. A total of 1,718 subjects will be randomised with each site enrolling on average 14 or 15 subjects. The primary objective of the study is to evaluate, in comparison with usual clinical practice, the effectiveness of a multi-modal intervention (specific clinical targets, education, diet, and resistance training exercise) in frail and pre-frail subjects aged ≥70 years with type 2 diabetes in terms of the difference in function 2 years post-randomisation. Difference in function will be measured by changes in a summary ordinal score on the short physical performance battery (SPPB) of at least one point. Secondary outcomes include daily activities, economic evaluation, and quality of life. Discussion The MID-Frail study will provide evidence on the clinical, functional, social, and economic impact of a multi-modal approach in frail and pre-frail older people with type 2 diabetes. Trial registration ClinicalTrials.gov: NCT01654341. PMID:24456998

Contemporary Multi-Modal Historical Representations and the Teaching of Disciplinary Understandings in History

ERIC Educational Resources Information Center

Donnelly, Debra J.

2018-01-01

Traditional privileging of the printed text has been considerably eroded by rapid technological advancement and in Australia, as elsewhere, many History teaching programs feature an array of multi-modal historical representations. Research suggests that engagement with the visual and multi-modal constructs has the potential to enrich the pedagogy…

Isometric multimodal photoacoustic microscopy based on optically transparent micro-ring ultrasonic detection.

PubMed

Dong, Biqin; Li, Hao; Zhang, Zhen; Zhang, Kevin; Chen, Siyu; Sun, Cheng; Zhang, Hao F

2015-01-01

Photoacoustic microscopy (PAM) is an attractive imaging tool complementary to established optical microscopic modalities by providing additional molecular specificities through imaging optical absorption contrast. While the development of optical resolution photoacoustic microscopy (ORPAM) offers high lateral resolution, the acoustically-determined axial resolution is limited due to the constraint in ultrasonic detection bandwidth. ORPAM with isometric spatial resolution along both axial and lateral direction is yet to be developed. Although recently developed sophisticated optical illumination and reconstruction methods offer improved axial resolution in ORPAM, the image acquisition procedures are rather complicated, limiting their capabilities for high-speed imaging and being easily integrated with established optical microscopic modalities. Here we report an isometric ORPAM based on an optically transparent micro-ring resonator ultrasonic detector and a commercial inverted microscope platform. Owing to the superior spatial resolution and the ease of integrating our ORPAM with established microscopic modalities, single cell imaging with extrinsic fluorescence staining, intrinsic autofluorescence, and optical absorption can be achieved simultaneously. This technique holds promise to greatly improve the accessibility of PAM to the broader biomedical researchers.

Neural network for intelligent query of an FBI forensic database

NASA Astrophysics Data System (ADS)

Uvanni, Lee A.; Rainey, Timothy G.; Balasubramanian, Uma; Brettle, Dean W.; Weingard, Fred; Sibert, Robert W.; Birnbaum, Eric

1997-02-01

Examiner is an automated fired cartridge case identification system utilizing a dual-use neural network pattern recognition technology, called the statistical-multiple object detection and location system (S-MODALS) developed by Booz(DOT)Allen & Hamilton, Inc. in conjunction with Rome Laboratory. S-MODALS was originally designed for automatic target recognition (ATR) of tactical and strategic military targets using multisensor fusion [electro-optical (EO), infrared (IR), and synthetic aperture radar (SAR)] sensors. Since S-MODALS is a learning system readily adaptable to problem domains other than automatic target recognition, the pattern matching problem of microscopic marks for firearms evidence was analyzed using S-MODALS. The physics; phenomenology; discrimination and search strategies; robustness requirements; error level and confidence level propagation that apply to the pattern matching problem of military targets were found to be applicable to the ballistic domain as well. The Examiner system uses S-MODALS to rank a set of queried cartridge case images from the most similar to the least similar image in reference to an investigative fired cartridge case image. The paper presents three independent tests and evaluation studies of the Examiner system utilizing the S-MODALS technology for the Federal Bureau of Investigation.

Design and implementation of a novel modal space active force control concept for spatial multi-DOF parallel robotic manipulators actuated by electrical actuators.

PubMed

Yang, Chifu; Zhao, Jinsong; Li, Liyi; Agrawal, Sunil K

2018-01-01

Robotic spine brace based on parallel-actuated robotic system is a new device for treatment and sensing of scoliosis, however, the strong dynamic coupling and anisotropy problem of parallel manipulators result in accuracy loss of rehabilitation force control, including big error in direction and value of force. A novel active force control strategy named modal space force control is proposed to solve these problems. Considering the electrical driven system and contact environment, the mathematical model of spatial parallel manipulator is built. The strong dynamic coupling problem in force field is described via experiments as well as the anisotropy problem of work space of parallel manipulators. The effects of dynamic coupling on control design and performances are discussed, and the influences of anisotropy on accuracy are also addressed. With mass/inertia matrix and stiffness matrix of parallel manipulators, a modal matrix can be calculated by using eigenvalue decomposition. Making use of the orthogonality of modal matrix with mass matrix of parallel manipulators, the strong coupled dynamic equations expressed in work space or joint space of parallel manipulator may be transformed into decoupled equations formulated in modal space. According to this property, each force control channel is independent of others in the modal space, thus we proposed modal space force control concept which means the force controller is designed in modal space. A modal space active force control is designed and implemented with only a simple PID controller employed as exampled control method to show the differences, uniqueness, and benefits of modal space force control. Simulation and experimental results show that the proposed modal space force control concept can effectively overcome the effects of the strong dynamic coupling and anisotropy problem in the physical space, and modal space force control is thus a very useful control framework, which is better than the current joint space control and work space control. Copyright © 2017 ISA. Published by Elsevier Ltd. All rights reserved.

Access-enabling architectures : new hybrid multi-modal spatial prototypes towards resource and social sustainability : USDOT Region V Regional University Transportation Center final report.

DOT National Transportation Integrated Search

2016-12-19

The efforts of this project aim to capture and engage these potentials through a design-research method that incorporates a top down, data-driven approach with bottom-up stakeholder perspectives to develop prototypical scenario-based design solutions...

XML-based scripting of multimodality image presentations in multidisciplinary clinical conferences

NASA Astrophysics Data System (ADS)

Ratib, Osman M.; Allada, Vivekanand; Dahlbom, Magdalena; Marcus, Phillip; Fine, Ian; Lapstra, Lorelle

2002-05-01

We developed a multi-modality image presentation software for display and analysis of images and related data from different imaging modalities. The software is part of a cardiac image review and presentation platform that supports integration of digital images and data from digital and analog media such as videotapes, analog x-ray films and 35 mm cine films. The software supports standard DICOM image files as well as AVI and PDF data formats. The system is integrated in a digital conferencing room that includes projections of digital and analog sources, remote videoconferencing capabilities, and an electronic whiteboard. The goal of this pilot project is to: 1) develop a new paradigm for image and data management for presentation in a clinically meaningful sequence adapted to case-specific scenarios, 2) design and implement a multi-modality review and conferencing workstation using component technology and customizable 'plug-in' architecture to support complex review and diagnostic tasks applicable to all cardiac imaging modalities and 3) develop an XML-based scripting model of image and data presentation for clinical review and decision making during routine clinical tasks and multidisciplinary clinical conferences.

Multi-Modal Hallucinations and Cognitive Function in Parkinson's Disease

PubMed Central

Katzen, Heather; Myerson, Connie; Papapetropoulos, Spiridon; Nahab, Fatta; Gallo, Bruno; Levin, Bonnie

2010-01-01

Background/Aims Hallucinations have been linked to a constellation of cognitive deficits in Parkinson's disease (PD), but it is not known whether multi-modal hallucinations are associated with greater neuropsychological dysfunction. Methods 152 idiopathic PD patients were categorized based on the presence or absence of hallucinations and then were further subdivided into visual-only (VHonly; n = 35) or multi-modal (VHplus; n = 12) hallucination groups. All participants underwent detailed neuropsychological assessment. Results Participants with hallucinations performed more poorly on select neuropsychological measures and exhibited more mood symptoms. There were no differences between VHonly and VHplus groups. Conclusions PD patients with multi-modal hallucinations are not at greater risk for neuropsychological impairment than those with single-modal hallucinations. PMID:20689283

Field-Portable Pixel Super-Resolution Colour Microscope

PubMed Central

Greenbaum, Alon; Akbari, Najva; Feizi, Alborz; Luo, Wei; Ozcan, Aydogan

2013-01-01

Based on partially-coherent digital in-line holography, we report a field-portable microscope that can render lensfree colour images over a wide field-of-view of e.g., >20 mm2. This computational holographic microscope weighs less than 145 grams with dimensions smaller than 17×6×5 cm, making it especially suitable for field settings and point-of-care use. In this lensfree imaging design, we merged a colorization algorithm with a source shifting based multi-height pixel super-resolution technique to mitigate ‘rainbow’ like colour artefacts that are typical in holographic imaging. This image processing scheme is based on transforming the colour components of an RGB image into YUV colour space, which separates colour information from brightness component of an image. The resolution of our super-resolution colour microscope was characterized using a USAF test chart to confirm sub-micron spatial resolution, even for reconstructions that employ multi-height phase recovery to handle dense and connected objects. To further demonstrate the performance of this colour microscope Papanicolaou (Pap) smears were also successfully imaged. This field-portable and wide-field computational colour microscope could be useful for tele-medicine applications in resource poor settings. PMID:24086742

Field-portable pixel super-resolution colour microscope.

PubMed

Greenbaum, Alon; Akbari, Najva; Feizi, Alborz; Luo, Wei; Ozcan, Aydogan

2013-01-01

Based on partially-coherent digital in-line holography, we report a field-portable microscope that can render lensfree colour images over a wide field-of-view of e.g., >20 mm(2). This computational holographic microscope weighs less than 145 grams with dimensions smaller than 17×6×5 cm, making it especially suitable for field settings and point-of-care use. In this lensfree imaging design, we merged a colorization algorithm with a source shifting based multi-height pixel super-resolution technique to mitigate 'rainbow' like colour artefacts that are typical in holographic imaging. This image processing scheme is based on transforming the colour components of an RGB image into YUV colour space, which separates colour information from brightness component of an image. The resolution of our super-resolution colour microscope was characterized using a USAF test chart to confirm sub-micron spatial resolution, even for reconstructions that employ multi-height phase recovery to handle dense and connected objects. To further demonstrate the performance of this colour microscope Papanicolaou (Pap) smears were also successfully imaged. This field-portable and wide-field computational colour microscope could be useful for tele-medicine applications in resource poor settings.

Fluorescence Live Cell Imaging

PubMed Central

Ettinger, Andreas

2014-01-01

Fluorescence microscopy of live cells has become an integral part of modern cell biology. Fluorescent protein tags, live cell dyes, and other methods to fluorescently label proteins of interest provide a range of tools to investigate virtually any cellular process under the microscope. The two main experimental challenges in collecting meaningful live cell microscopy data are to minimize photodamage while retaining a useful signal-to-noise ratio, and to provide a suitable environment for cells or tissues to replicate physiological cell dynamics. This chapter aims to give a general overview on microscope design choices critical for fluorescence live cell imaging that apply to most fluorescence microscopy modalities, and on environmental control with a focus on mammalian tissue culture cells. In addition, we provide guidance on how to design and evaluate fluorescent protein constructs by spinning disk confocal microscopy. PMID:24974023

Use of Multi-Modal Media and Tools in an Online Information Literacy Course: College Students' Attitudes and Perceptions

ERIC Educational Resources Information Center

Chen, Hsin-Liang; Williams, James Patrick

2009-01-01

This project studies the use of multi-modal media objects in an online information literacy class. One hundred sixty-two undergraduate students answered seven surveys. Significant relationships are found among computer skills, teaching materials, communication tools and learning experience. Multi-modal media objects and communication tools are…

Crack Identification in CFRP Laminated Beams Using Multi-Resolution Modal Teager–Kaiser Energy under Noisy Environments

PubMed Central

Xu, Wei; Cao, Maosen; Ding, Keqin; Radzieński, Maciej; Ostachowicz, Wiesław

2017-01-01

Carbon fiber reinforced polymer laminates are increasingly used in the aerospace and civil engineering fields. Identifying cracks in carbon fiber reinforced polymer laminated beam components is of considerable significance for ensuring the integrity and safety of the whole structures. With the development of high-resolution measurement technologies, mode-shape-based crack identification in such laminated beam components has become an active research focus. Despite its sensitivity to cracks, however, this method is susceptible to noise. To address this deficiency, this study proposes a new concept of multi-resolution modal Teager–Kaiser energy, which is the Teager–Kaiser energy of a mode shape represented in multi-resolution, for identifying cracks in carbon fiber reinforced polymer laminated beams. The efficacy of this concept is analytically demonstrated by identifying cracks in Timoshenko beams with general boundary conditions; and its applicability is validated by diagnosing cracks in a carbon fiber reinforced polymer laminated beam, whose mode shapes are precisely acquired via non-contact measurement using a scanning laser vibrometer. The analytical and experimental results show that multi-resolution modal Teager–Kaiser energy is capable of designating the presence and location of cracks in these beams under noisy environments. This proposed method holds promise for developing crack identification systems for carbon fiber reinforced polymer laminates. PMID:28773016

Design and prototyping of a chip-based multi-micro-organoid culture system for substance testing, predictive to human (substance) exposure.

PubMed

Sonntag, Frank; Schilling, Niels; Mader, Katja; Gruchow, Mathias; Klotzbach, Udo; Lindner, Gerd; Horland, Reyk; Wagner, Ilka; Lauster, Roland; Howitz, Steffen; Hoffmann, Silke; Marx, Uwe

2010-07-01

Dynamic miniaturized human multi-micro-organ bioreactor systems are envisaged as a possible solution for the embarrassing gap of predictive substance testing prior to human exposure. A rational approach was applied to simulate and design dynamic long-term cultures of the smallest possible functional human organ units, human "micro-organoids", on a chip the shape of a microscope slide. Each chip contains six identical dynamic micro-bioreactors with three different micro-organoid culture segments each, a feed supply and waste reservoirs. A liver, a brain cortex and a bone marrow micro-organoid segment were designed into each bioreactor. This design was translated into a multi-layer chip prototype and a routine manufacturing procedure was established. The first series of microscopable, chemically resistant and sterilizable chip prototypes was tested for matrix compatibility and primary cell culture suitability. Sterility and long-term human cell survival could be shown. Optimizing the applied design approach and prototyping tools resulted in a time period of only 3 months for a single design and prototyping cycle. This rapid prototyping scheme now allows for fast adjustment or redesign of inaccurate architectures. The designed chip platform is thus ready to be evaluated for the establishment and maintenance of the human liver, brain cortex and bone marrow micro-organoids in a systemic microenvironment. Copyright (c) 2010 Elsevier B.V. All rights reserved.

Multi-Modal Traveler Information System - Lessons Learned

DOT National Transportation Integrated Search

1997-05-19

The purpose of this working paper is to provide an information base of lessons learned from activities similar to the design of the Gary Chicago Milwaukee (GCM) Corridor Architecture and the Gateway Traveler Information System (TIS). Many similar act...

Multi-modal vehicle display design and analysis

DOT National Transportation Integrated Search

2004-10-01

There is increasing interest in systematically studying the risks encountered while driving. In some cases, the : focus is on potential risks such as those associated with the use of in-car devices (e.g., mobile phones, radio, navigational : displays...

Pre-Motor Response Time Benefits in Multi-Modal Displays

DTIC Science & Technology

2013-11-12

when animals are presented with stimuli from two sensory modalities as compared with stimulation from only one modality. The combinations of two...modality attention and orientation behaviors (see also Wallace, Meredith, & Stein, 609 !998). Multi-modal stimulation in the world is not always...perceptually when the stimuli are congruent. In another study, Craig (2006) had participants judge the direction of apparent motion by stimulating

COMPACT NON-CONTACT TOTAL EMISSION DETECTION FOR IN-VIVO MULTI-PHOTON EXCITATION MICROSCOPY

PubMed Central

Glancy, Brian; Karamzadeh, Nader S.; Gandjbakhche, Amir H.; Redford, Glen; Kilborn, Karl; Knutson, Jay R.; Balaban, Robert S.

2014-01-01

Summary We describe a compact, non-contact design for a Total Emission Detection (c-TED) system for intra-vital multi-photon imaging. To conform to a standard upright two-photon microscope design, this system uses a parabolic mirror surrounding a standard microscope objective in concert with an optical path that does not interfere with normal microscope operation. The non-contact design of this device allows for maximal light collection without disrupting the physiology of the specimen being examined. Tests were conducted on exposed tissues in live animals to examine the emission collection enhancement of the c-TED device compared to heavily optimized objective-based emission collection. The best light collection enhancement was seen from murine fat (5×-2× gains as a function of depth), while murine skeletal muscle and rat kidney showed gains of over two and just under two-fold near the surface, respectively. Gains decreased with imaging depth (particularly in the kidney). Zebrafish imaging on a reflective substrate showed close to a two-fold gain throughout the entire volume of an intact embryo (approximately 150 μm deep). Direct measurement of bleaching rates confirmed that the lower laser powers (enabled by greater light collection efficiency) yielded reduced photobleaching in vivo. The potential benefits of increased light collection in terms of speed of imaging and reduced photo-damage, as well as the applicability of this device to other multi-photon imaging methods is discussed. PMID:24251437

Multi-Modal Intersections: Resolving Conflicts between Trains, Motor Vehicles, Bicyclists and Pedestrians

DOT National Transportation Integrated Search

2017-09-01

This research report investigates the relationship between pedestrians and bicyclists on paths parallel to railroad tracks and with a road perpendicular to the path. The possible conflicts at intersections within these design parameters are of concer...

Grid-Enabled Quantitative Analysis of Breast Cancer

DTIC Science & Technology

2010-10-01

large-scale, multi-modality computerized image analysis . The central hypothesis of this research is that large-scale image analysis for breast cancer...research, we designed a pilot study utilizing large scale parallel Grid computing harnessing nationwide infrastructure for medical image analysis . Also

Design and Construction of a Multi-wavelength, Micromirror Total Internal Reflectance Fluorescence Microscope

PubMed Central

Larson, Joshua; Kirk, Matt; Drier, Eric A.; O’Brien, William; MacKay, James F.; Friedman, Larry; Hoskins, Aaron

2015-01-01

Colocalization Single Molecule Spectroscopy (CoSMoS) has proven to be a useful method for studying the composition, kinetics, and mechanisms of complex cellular machines. Key to the technique is the ability to simultaneously monitor multiple proteins and/or nucleic acids as they interact with one another. Here we describe a protocol for constructing a CoSMoS micromirror Total Internal Reflection Fluorescence Microscope (mmTIRFM). Design and construction of a scientific microscope often requires a number of custom components and a significant time commitment. In our protocol, we have streamlined this process by implementation of a commercially available microscopy platform designed to accommodate the optical components necessary for a mmTIRFM. The mmTIRF system eliminates the need for machining custom parts by the end-user and facilitates optical alignment. Depending on the experience-level of the microscope builder, these time-savings and the following protocol can enable mmTIRF construction to be completed within two months. PMID:25188633

The connectome viewer toolkit: an open source framework to manage, analyze, and visualize connectomes.

PubMed

Gerhard, Stephan; Daducci, Alessandro; Lemkaddem, Alia; Meuli, Reto; Thiran, Jean-Philippe; Hagmann, Patric

2011-01-01

Advanced neuroinformatics tools are required for methods of connectome mapping, analysis, and visualization. The inherent multi-modality of connectome datasets poses new challenges for data organization, integration, and sharing. We have designed and implemented the Connectome Viewer Toolkit - a set of free and extensible open source neuroimaging tools written in Python. The key components of the toolkit are as follows: (1) The Connectome File Format is an XML-based container format to standardize multi-modal data integration and structured metadata annotation. (2) The Connectome File Format Library enables management and sharing of connectome files. (3) The Connectome Viewer is an integrated research and development environment for visualization and analysis of multi-modal connectome data. The Connectome Viewer's plugin architecture supports extensions with network analysis packages and an interactive scripting shell, to enable easy development and community contributions. Integration with tools from the scientific Python community allows the leveraging of numerous existing libraries for powerful connectome data mining, exploration, and comparison. We demonstrate the applicability of the Connectome Viewer Toolkit using Diffusion MRI datasets processed by the Connectome Mapper. The Connectome Viewer Toolkit is available from http://www.cmtk.org/

Iconic Gestures for Robot Avatars, Recognition and Integration with Speech

PubMed Central

Bremner, Paul; Leonards, Ute

2016-01-01

Co-verbal gestures are an important part of human communication, improving its efficiency and efficacy for information conveyance. One possible means by which such multi-modal communication might be realized remotely is through the use of a tele-operated humanoid robot avatar. Such avatars have been previously shown to enhance social presence and operator salience. We present a motion tracking based tele-operation system for the NAO robot platform that allows direct transmission of speech and gestures produced by the operator. To assess the capabilities of this system for transmitting multi-modal communication, we have conducted a user study that investigated if robot-produced iconic gestures are comprehensible, and are integrated with speech. Robot performed gesture outcomes were compared directly to those for gestures produced by a human actor, using a within participant experimental design. We show that iconic gestures produced by a tele-operated robot are understood by participants when presented alone, almost as well as when produced by a human. More importantly, we show that gestures are integrated with speech when presented as part of a multi-modal communication equally well for human and robot performances. PMID:26925010

The Connectome Viewer Toolkit: An Open Source Framework to Manage, Analyze, and Visualize Connectomes

PubMed Central

Gerhard, Stephan; Daducci, Alessandro; Lemkaddem, Alia; Meuli, Reto; Thiran, Jean-Philippe; Hagmann, Patric

2011-01-01

Advanced neuroinformatics tools are required for methods of connectome mapping, analysis, and visualization. The inherent multi-modality of connectome datasets poses new challenges for data organization, integration, and sharing. We have designed and implemented the Connectome Viewer Toolkit – a set of free and extensible open source neuroimaging tools written in Python. The key components of the toolkit are as follows: (1) The Connectome File Format is an XML-based container format to standardize multi-modal data integration and structured metadata annotation. (2) The Connectome File Format Library enables management and sharing of connectome files. (3) The Connectome Viewer is an integrated research and development environment for visualization and analysis of multi-modal connectome data. The Connectome Viewer's plugin architecture supports extensions with network analysis packages and an interactive scripting shell, to enable easy development and community contributions. Integration with tools from the scientific Python community allows the leveraging of numerous existing libraries for powerful connectome data mining, exploration, and comparison. We demonstrate the applicability of the Connectome Viewer Toolkit using Diffusion MRI datasets processed by the Connectome Mapper. The Connectome Viewer Toolkit is available from http://www.cmtk.org/ PMID:21713110

A multi-modal training programme to improve physical activity, physical fitness and perceived physical ability in obese children.

PubMed

Morano, Milena; Colella, Dario; Rutigliano, Irene; Fiore, Pietro; Pettoello-Mantovani, Massimo; Campanozzi, Angelo

2014-01-01

Actual and perceived physical abilities are important correlates of physical activity (PA) and fitness, but little research has explored these relationships over time in obese children. This study was designed: (a) to assess the feasibility of a multi-modal training programme promoting changes in PA, fundamental motor skills and real and perceived physical abilities of obese children; and (b) to explore cross-sectional and longitudinal relationships between real and perceived physical competence in boys and girls. Forty-one participants (9.2 ± 1.2 years) were assessed before and after an 8-month intervention with respect to body composition, physical fitness, self-reported PA and perceived physical ability. After treatment, obese children reported improvements in the body mass index, PA levels, gross motor performance and actual and perceived physical abilities. Real and perceived physical competence was correlated in boys, but not in girls. Results indicate that a multi-modal programme focused on actual and perceived physical competence as associated with the gradual increase in the volume of activity might be an effective strategy to improve adherence of the participants and to increase the lifelong exercise skills of obese children.

Enhancing image classification models with multi-modal biomarkers

NASA Astrophysics Data System (ADS)

Caban, Jesus J.; Liao, David; Yao, Jianhua; Mollura, Daniel J.; Gochuico, Bernadette; Yoo, Terry

2011-03-01

Currently, most computer-aided diagnosis (CAD) systems rely on image analysis and statistical models to diagnose, quantify, and monitor the progression of a particular disease. In general, CAD systems have proven to be effective at providing quantitative measurements and assisting physicians during the decision-making process. As the need for more flexible and effective CADs continues to grow, questions about how to enhance their accuracy have surged. In this paper, we show how statistical image models can be augmented with multi-modal physiological values to create more robust, stable, and accurate CAD systems. In particular, this paper demonstrates how highly correlated blood and EKG features can be treated as biomarkers and used to enhance image classification models designed to automatically score subjects with pulmonary fibrosis. In our results, a 3-5% improvement was observed when comparing the accuracy of CADs that use multi-modal biomarkers with those that only used image features. Our results show that lab values such as Erythrocyte Sedimentation Rate and Fibrinogen, as well as EKG measurements such as QRS and I:40, are statistically significant and can provide valuable insights about the severity of the pulmonary fibrosis disease.

Integration of Multi-Modal Biomedical Data to Predict Cancer Grade and Patient Survival.

PubMed

Phan, John H; Hoffman, Ryan; Kothari, Sonal; Wu, Po-Yen; Wang, May D

2016-02-01

The Big Data era in Biomedical research has resulted in large-cohort data repositories such as The Cancer Genome Atlas (TCGA). These repositories routinely contain hundreds of matched patient samples for genomic, proteomic, imaging, and clinical data modalities, enabling holistic and multi-modal integrative analysis of human disease. Using TCGA renal and ovarian cancer data, we conducted a novel investigation of multi-modal data integration by combining histopathological image and RNA-seq data. We compared the performances of two integrative prediction methods: majority vote and stacked generalization. Results indicate that integration of multiple data modalities improves prediction of cancer grade and outcome. Specifically, stacked generalization, a method that integrates multiple data modalities to produce a single prediction result, outperforms both single-data-modality prediction and majority vote. Moreover, stacked generalization reveals the contribution of each data modality (and specific features within each data modality) to the final prediction result and may provide biological insights to explain prediction performance.

MINC 2.0: A Flexible Format for Multi-Modal Images.

PubMed

Vincent, Robert D; Neelin, Peter; Khalili-Mahani, Najmeh; Janke, Andrew L; Fonov, Vladimir S; Robbins, Steven M; Baghdadi, Leila; Lerch, Jason; Sled, John G; Adalat, Reza; MacDonald, David; Zijdenbos, Alex P; Collins, D Louis; Evans, Alan C

2016-01-01

It is often useful that an imaging data format can afford rich metadata, be flexible, scale to very large file sizes, support multi-modal data, and have strong inbuilt mechanisms for data provenance. Beginning in 1992, MINC was developed as a system for flexible, self-documenting representation of neuroscientific imaging data with arbitrary orientation and dimensionality. The MINC system incorporates three broad components: a file format specification, a programming library, and a growing set of tools. In the early 2000's the MINC developers created MINC 2.0, which added support for 64-bit file sizes, internal compression, and a number of other modern features. Because of its extensible design, it has been easy to incorporate details of provenance in the header metadata, including an explicit processing history, unique identifiers, and vendor-specific scanner settings. This makes MINC ideal for use in large scale imaging studies and databases. It also makes it easy to adapt to new scanning sequences and modalities.

Final report : model deployment of a regional, multi-modal 511 traveler information system

DOT National Transportation Integrated Search

1999-02-01

A survey was designed and conducted, to extend prior work discussed in the Driver Fatigue and Alertness Study literature review, by collecting additional data about commercial motor vehicle (CMV) drivers and their job characteristics. It also sought ...

A non-invasive blood glucose meter design using multi-type sensors

NASA Astrophysics Data System (ADS)

Nguyen, D.; Nguyen, Hienvu; Roveda, Janet

2012-10-01

In this paper, we present a design of a multi optical modalities blood glucose monitor. The Monte Carlo tissues optics simulation with typical human skin model suggests the SNR ratio for a detector sensor is 104 with high sensitivity that can detect low blood sugar limit at 1 mMole/dL ( <20 mg/dL). A Bayesian filtering algorithm is proposed for multisensor fusion to identify whether e user has the danger of having diabetes. The new design has real time response (on the average of 2 minutes) and provides great potential to perform real time monitoring for blood glucose.

Multi-Modal Nano-Probes for Radionuclide and 5-color Near Infrared Optical Lymphatic Imaging

PubMed Central

Kobayashi, Hisataka; Koyama, Yoshinori; Barrett, Tristan; Hama, Yukihiro; Regino, Celeste A. S.; Shin, In Soo; Jang, Beom-Su; Le, Nhat; Paik, Chang H.; Choyke, Peter L.; Urano, Yasuteru

2008-01-01

Current contrast agents generally have one function and can only be imaged in monochrome, therefore, the majority of imaging methods can only impart uniparametric information. A single nano-particle has the potential to be loaded with multiple payloads. Such multi-modality probes have the ability to be imaged by more than one imaging technique, which could compensate for the weakness or even combine the advantages of each individual modality. Furthermore, optical imaging using different optical probes enables us to achieve multi-color in vivo imaging, wherein multiple parameters can be read from a single image. To allow differentiation of multiple optical signals in vivo, each probe should have a close but different near infrared emission. To this end, we synthesized nano-probes with multi-modal and multi-color potential, which employed a polyamidoamine dendrimer platform linked to both radionuclides and optical probes, permitting dual-modality scintigraphic and 5-color near infrared optical lymphatic imaging using a multiple excitation spectrally-resolved fluorescence imaging technique. PMID:19079788

Open-source do-it-yourself multi-color fluorescence smartphone microscopy

PubMed Central

Sung, Yulung; Campa, Fernando; Shih, Wei-Chuan

2017-01-01

Fluorescence microscopy is an important technique for cellular and microbiological investigations. Translating this technique onto a smartphone can enable particularly powerful applications such as on-site analysis, on-demand monitoring, and point-of-care diagnostics. Current fluorescence smartphone microscope setups require precise illumination and imaging alignment which altogether limit its broad adoption. We report a multi-color fluorescence smartphone microscope with a single contact lens-like add-on lens and slide-launched total-internal-reflection guided illumination for three common tasks in investigative fluorescence microscopy: autofluorescence, fluorescent stains, and immunofluorescence. The open-source, simple and cost-effective design has the potential for do-it-yourself fluorescence smartphone microscopy. PMID:29188104

The design of a microscopic system for typical fluorescent in-situ hybridization applications

NASA Astrophysics Data System (ADS)

Yi, Dingrong; Xie, Shaochuan

2013-12-01

Fluorescence in situ hybridization (FISH) is a modern molecular biology technique used for the detection of genetic abnormalities in terms of the number and structure of chromosomes and genes. The FISH technique is typically employed for prenatal diagnosis of congenital dementia in the Obstetrics and Genecology department. It is also routinely used to pick up qualifying breast cancer patients that are known to be highly curable by the prescription of Her2 targeted therapy. During the microscopic observation phase, the technician needs to count typically green probe dots and red probe dots contained in a single nucleus and calculate their ratio. This procedure need to be done to over hundreds of nuclei. Successful implementation of FISH tests critically depends on a suitable fluorescent microscope which is primarily imported from overseas due to the complexity of such a system beyond the maturity of the domestic optoelectrical industry. In this paper, the typical requirements of a fluorescent microscope that is suitable for FISH applications are first reviewed. The focus of this paper is on the system design and computational methods of an automatic florescent microscopy with high magnification APO objectives, a fast spinning automatic filter wheel, an automatic shutter, a cooled CCD camera used as a photo-detector, and a software platform for image acquisition, registration, pseudo-color generation, multi-channel fusing and multi-focus fusion. Preliminary results from FISH experiments indicate that this system satisfies routine FISH microscopic observation tasks.

Sensei: A Multi-Modal Framework for Assessing Stress Resiliency

DTIC Science & Technology

2013-04-30

DATE MAY2013 2. REPORT TYPE 4. TITLE AND SUBTITLE Sensei: A Multi-Modal Framework for Assessing Stress Resiliency 6. AUTHOR(S) 7. PERFORMING...Report: Distribution A Page 1 of 3 SRI International (Sarnoff) Document Sensei: A Multi-Modal Framework for Assessing Stress Resiliency (April... Stress Markers in Real-Time in Lab Environment with graded exposure to ICT’s scenarios MAC 1-6 During this reporting period, we established

Portable and cost-effective pixel super-resolution on-chip microscope for telemedicine applications.

PubMed

Bishara, Waheb; Sikora, Uzair; Mudanyali, Onur; Su, Ting-Wei; Yaglidere, Oguzhan; Luckhart, Shirley; Ozcan, Aydogan

2011-01-01

We report a field-portable lensless on-chip microscope with a lateral resolution of <1 μm and a large field-of-view of ~24 mm(2). This microscope is based on digital in-line holography and a pixel super-resolution algorithm to process multiple lensfree holograms and obtain a single high-resolution hologram. In its compact and cost-effective design, we utilize 23 light emitting diodes butt-coupled to 23 multi-mode optical fibers, and a simple optical filter, with no moving parts. Weighing only ~95 grams, we demonstrate the performance of this field-portable microscope by imaging various objects including human malaria parasites in thin blood smears.

Interactive Volume Exploration of Petascale Microscopy Data Streams Using a Visualization-Driven Virtual Memory Approach.

PubMed

Hadwiger, M; Beyer, J; Jeong, Won-Ki; Pfister, H

2012-12-01

This paper presents the first volume visualization system that scales to petascale volumes imaged as a continuous stream of high-resolution electron microscopy images. Our architecture scales to dense, anisotropic petascale volumes because it: (1) decouples construction of the 3D multi-resolution representation required for visualization from data acquisition, and (2) decouples sample access time during ray-casting from the size of the multi-resolution hierarchy. Our system is designed around a scalable multi-resolution virtual memory architecture that handles missing data naturally, does not pre-compute any 3D multi-resolution representation such as an octree, and can accept a constant stream of 2D image tiles from the microscopes. A novelty of our system design is that it is visualization-driven: we restrict most computations to the visible volume data. Leveraging the virtual memory architecture, missing data are detected during volume ray-casting as cache misses, which are propagated backwards for on-demand out-of-core processing. 3D blocks of volume data are only constructed from 2D microscope image tiles when they have actually been accessed during ray-casting. We extensively evaluate our system design choices with respect to scalability and performance, compare to previous best-of-breed systems, and illustrate the effectiveness of our system for real microscopy data from neuroscience.

Cross contrast multi-channel image registration using image synthesis for MR brain images.

PubMed

Chen, Min; Carass, Aaron; Jog, Amod; Lee, Junghoon; Roy, Snehashis; Prince, Jerry L

2017-02-01

Multi-modal deformable registration is important for many medical image analysis tasks such as atlas alignment, image fusion, and distortion correction. Whereas a conventional method would register images with different modalities using modality independent features or information theoretic metrics such as mutual information, this paper presents a new framework that addresses the problem using a two-channel registration algorithm capable of using mono-modal similarity measures such as sum of squared differences or cross-correlation. To make it possible to use these same-modality measures, image synthesis is used to create proxy images for the opposite modality as well as intensity-normalized images from each of the two available images. The new deformable registration framework was evaluated by performing intra-subject deformation recovery, intra-subject boundary alignment, and inter-subject label transfer experiments using multi-contrast magnetic resonance brain imaging data. Three different multi-channel registration algorithms were evaluated, revealing that the framework is robust to the multi-channel deformable registration algorithm that is used. With a single exception, all results demonstrated improvements when compared against single channel registrations using the same algorithm with mutual information. Copyright © 2016 Elsevier B.V. All rights reserved.

Multimodal Imaging of Human Brain Activity: Rational, Biophysical Aspects and Modes of Integration

PubMed Central

Blinowska, Katarzyna; Müller-Putz, Gernot; Kaiser, Vera; Astolfi, Laura; Vanderperren, Katrien; Van Huffel, Sabine; Lemieux, Louis

2009-01-01

Until relatively recently the vast majority of imaging and electrophysiological studies of human brain activity have relied on single-modality measurements usually correlated with readily observable or experimentally modified behavioural or brain state patterns. Multi-modal imaging is the concept of bringing together observations or measurements from different instruments. We discuss the aims of multi-modal imaging and the ways in which it can be accomplished using representative applications. Given the importance of haemodynamic and electrophysiological signals in current multi-modal imaging applications, we also review some of the basic physiology relevant to understanding their relationship. PMID:19547657

Multiscale Imaging of the Mouse Cortex Using Two-Photon Microscopy and Wide-Field Illumination

NASA Astrophysics Data System (ADS)

Bumstead, Jonathan R.

The mouse brain can be studied over vast spatial scales ranging from microscopic imaging of single neurons to macroscopic measurements of hemodynamics acquired over the majority of the mouse cortex. However, most neuroimaging modalities are limited by a fundamental trade-off between the spatial resolution and the field-of-view (FOV) over which the brain can be imaged, making it difficult to fully understand the functional and structural architecture of the healthy mouse brain and its disruption in disease. My dissertation has focused on developing multiscale optical systems capable of imaging the mouse brain at both microscopic and mesoscopic spatial scales, specifically addressing the difference in spatial scales imaged with two-photon microscopy (TPM) and optical intrinsic signal imaging (OISI). Central to this work has been the formulation of a principled design strategy for extending the FOV of the two-photon microscope. Using this design approach, we constructed a TPM system with subcellular resolution and a FOV area 100 times greater than a conventional two-photon microscope. To image the ellipsoidal shape of the mouse cortex, we also developed the microscope to image arbitrary surfaces within a single frame using an electrically tunable lens. Finally, to address the speed limitations of the TPM systems developed during my dissertation, I also conducted research in large-scale neural phenomena occurring in the mouse brain imaged with high-speed OISI. The work conducted during my dissertation addresses some of the fundamental principles in designing and applying optical systems for multiscale imaging of the mouse brain.

A method for automatic grain segmentation of multi-angle cross-polarized microscopic images of sandstone

NASA Astrophysics Data System (ADS)

Jiang, Feng; Gu, Qing; Hao, Huizhen; Li, Na; Wang, Bingqian; Hu, Xiumian

2018-06-01

Automatic grain segmentation of sandstone is to partition mineral grains into separate regions in the thin section, which is the first step for computer aided mineral identification and sandstone classification. The sandstone microscopic images contain a large number of mixed mineral grains where differences among adjacent grains, i.e., quartz, feldspar and lithic grains, are usually ambiguous, which make grain segmentation difficult. In this paper, we take advantage of multi-angle cross-polarized microscopic images and propose a method for grain segmentation with high accuracy. The method consists of two stages, in the first stage, we enhance the SLIC (Simple Linear Iterative Clustering) algorithm, named MSLIC, to make use of multi-angle images and segment the images as boundary adherent superpixels. In the second stage, we propose the region merging technique which combines the coarse merging and fine merging algorithms. The coarse merging merges the adjacent superpixels with less evident boundaries, and the fine merging merges the ambiguous superpixels using the spatial enhanced fuzzy clustering. Experiments are designed on 9 sets of multi-angle cross-polarized images taken from the three major types of sandstones. The results demonstrate both the effectiveness and potential of the proposed method, comparing to the available segmentation methods.

Using queuing models to aid design and guide research effort for multimodality buried target detection systems

NASA Astrophysics Data System (ADS)

Malof, Jordan M.; Collins, Leslie M.

2016-05-01

Many remote sensing modalities have been developed for buried target detection (BTD), each one offering relative advantages over the others. There has been interest in combining several modalities into a single BTD system that benefits from the advantages of each constituent sensor. Recently an approach was developed, called multi-state management (MSM), that aims to achieve this goal by separating BTD system operation into discrete states, each with different sensor activity and system velocity. Additionally, a modeling approach, called Q-MSM, was developed to quickly analyze multi-modality BTD systems operating with MSM. This work extends previous work by demonstrating how Q-MSM modeling can be used to design BTD systems operating with MSM, and to guide research to yield the most performance benefits. In this work an MSM system is considered that combines a forward-looking infrared (FLIR) camera and a ground penetrating radar (GPR). Experiments are conducted using a dataset of real, field-collected, data which demonstrates how the Q-MSM model can be used to evaluate performance benefits of altering, or improving via research investment, various characteristics of the GPR and FLIR systems. Q-MSM permits fast analysis that can determine where system improvements will have the greatest impact, and can therefore help guide BTD research.

Cross-Modality Image Synthesis via Weakly Coupled and Geometry Co-Regularized Joint Dictionary Learning.

PubMed

Huang, Yawen; Shao, Ling; Frangi, Alejandro F

2018-03-01

Multi-modality medical imaging is increasingly used for comprehensive assessment of complex diseases in either diagnostic examinations or as part of medical research trials. Different imaging modalities provide complementary information about living tissues. However, multi-modal examinations are not always possible due to adversary factors, such as patient discomfort, increased cost, prolonged scanning time, and scanner unavailability. In additionally, in large imaging studies, incomplete records are not uncommon owing to image artifacts, data corruption or data loss, which compromise the potential of multi-modal acquisitions. In this paper, we propose a weakly coupled and geometry co-regularized joint dictionary learning method to address the problem of cross-modality synthesis while considering the fact that collecting the large amounts of training data is often impractical. Our learning stage requires only a few registered multi-modality image pairs as training data. To employ both paired images and a large set of unpaired data, a cross-modality image matching criterion is proposed. Then, we propose a unified model by integrating such a criterion into the joint dictionary learning and the observed common feature space for associating cross-modality data for the purpose of synthesis. Furthermore, two regularization terms are added to construct robust sparse representations. Our experimental results demonstrate superior performance of the proposed model over state-of-the-art methods.

Strategies for Multi-Modal Analysis

NASA Astrophysics Data System (ADS)

Hexemer, Alexander; Wang, Cheng; Pandolfi, Ronald; Kumar, Dinesh; Venkatakrishnan, Singanallur; Sethian, James; Camera Team

This section on soft materials will be dedicated to discuss the extraction of the chemical distribution and spatial arrangement of constituent elements and functional groups at multiple length scales and, thus, the examination of collective dynamics, transport, and electronic ordering phenomena. Traditional measures of structure in soft materials have relied heavily on scattering and imaging based techniques due to their capacity to measure nanoscale dimensions and their capacity to monitor structure under conditions of dynamic stress loading. Special attentions are planned to focus on the application of resonant x-ray scattering, contrast-varied neutron scattering, analytical transmission electron microscopy, and their combinations. This session aims to bring experts in both scattering and electron microscope fields to discuss recent advances in selectively characterizing structural architectures of complex soft materials, which have often multi-components with a wide range of length scales and multiple functionalities, and thus hopes to foster novel ideas to decipher a higher level of structural complexity in soft materials in future. CAMERA, Early Career Award.

Chronic monitoring of cortical hemodynamics in behaving, freely-moving rats using a miniaturized head-mounted optical microscope

NASA Astrophysics Data System (ADS)

Sigal, Iliya; Gad, Raanan; Koletar, Margaret; Ringuette, Dene; Stefanovic, Bojana; Levi, Ofer

2016-03-01

Growing interest within the neurophysiology community in assessing healthy and pathological brain activity in animals that are awake and freely-behaving has triggered the need for optical systems that are suitable for such longitudinal studies. In this work we report label-free multi-modal imaging of cortical hemodynamics in the somatosensory cortex of awake, freely-behaving rats, using a novel head-mounted miniature optical microscope. The microscope employs vertical cavity surface emitting lasers (VCSELs) at three distinct wavelengths (680 nm, 795 nm, and 850 nm) to provide measurements of four hemodynamic markers: blood flow speeds, HbO, HbR, and total Hb concentration, across a > 2 mm field of view. Blood flow speeds are extracted using Laser Speckle Contrast Imaging (LSCI), while oxygenation measurements are performed using Intrinsic Optical Signal Imaging (IOSI). Longitudinal measurements on the same animal are made possible over the course of > 6 weeks using a chronic window that is surgically implanted into the skull. We use the device to examine changes in blood flow and blood oxygenation in superficial cortical blood vessels and tissue in response to drug-induced absence-like seizures, correlating motor behavior with changes in blood flow and blood oxygenation in the brain.

Distributed microscopic actuation analysis of deformable plate membrane mirrors

NASA Astrophysics Data System (ADS)

Lu, Yifan; Yue, Honghao; Deng, Zongquan; Tzou, Hornsen

2018-02-01

To further reduce the areal density of optical mirrors used in space telescopes and other space-borne optical structures, the concept of flexible membrane deformable mirror has been proposed. Because of their high flexibility, poor stiffness and low damping properties, environmental excitations such as orbital maneuver, path changing, and non-uniform heating may induce unexpected vibrations and thus reduce working performance. Therefore, active vibration control is essential for these membrane mirrors. In this paper, two different mirror models, i.e., the plate membrane model and pure membrane model, are studied respectively. In order to investigate the modal vibration characteristics of the mirror, a piezoelectric layer is fully laminated on its non-reflective side to serve as actuators. Dynamic equations of the mirror laminated with piezoelectric actuators are presented first. Then, the actuator induced modal control force is defined. When the actuator area shrinks to infinitesimal, the expressions of microscopic local modal control force and its two components are obtained to predict the spatial microscopic actuation behavior of the mirror. Different membrane pretension forces are also applied to reveal the tension effects on the actuation of the mirror. Analyses indicate that the spatial distribution of modal micro-control forces is exactly the same with the sensing signals distribution of the mirror, which provides crucial guidelines for optimal actuator placement of membrane deformable mirrors.

Rhesus macaques recognize unique multi-modal face-voice relations of familiar individuals and not of unfamiliar ones

PubMed Central

Habbershon, Holly M.; Ahmed, Sarah Z.; Cohen, Yale E.

2013-01-01

Communication signals in non-human primates are inherently multi-modal. However, for laboratory-housed monkeys, there is relatively little evidence in support of the use of multi-modal communication signals in individual recognition. Here, we used a preferential-looking paradigm to test whether laboratory-housed rhesus could “spontaneously” (i.e., in the absence of operant training) use multi-modal communication stimuli to discriminate between known conspecifics. The multi-modal stimulus was a silent movie of two monkeys vocalizing and an audio file of the vocalization from one of the monkeys in the movie. We found that the gaze patterns of those monkeys that knew the individuals in the movie were reliably biased toward the individual that did not produce the vocalization. In contrast, there was not a systematic gaze pattern for those monkeys that did not know the individuals in the movie. These data are consistent with the hypothesis that laboratory-housed rhesus can recognize and distinguish between conspecifics based on auditory and visual communication signals. PMID:23774779

Distributed microscopic actuation analysis of paraboloidal membrane shells of different geometric parameters

NASA Astrophysics Data System (ADS)

Yue, Honghao; Lu, Yifan; Deng, Zongquan; Tzou, Hornsen

2018-03-01

Paraboloidal membrane shells of revolution are commonly used as key components for advanced aerospace structures and aviation mechanical systems. Due to their high flexibility and low damping property, active vibration control is of significant importance for these in-orbit membrane structures. To explore the dynamic control behavior of space flexible paraboloidal membrane shells, precision distributed actuation and control effectiveness of free-floating paraboloidal membrane shells with piezoelectric actuators are investigated. Governing equations of the shell structronic system are presented first. Then, distributed control forces and control actions are formulated. A transverse mode shape function of the paraboloidal shell based on the membrane approximation theory and specified boundary condition is assumed in the modal control force analysis. The actuator induced modal control forces on the paraboloidal shell are derived. The expressions of microscopic local modal control forces are obtained by shrinking the actuator area into infinitesimal and the four control components are investigated respectively to predict the spatial microscopic actuation behavior. Geometric parameter (height-radius ratio and shell thickness) effects on the modal actuation behavior are explored when evaluating the micro-control efficiency. Four different cases are discussed and the results reveal the fact that shallow (e.g., antennas/reflectors) and deep (e.g., rocket/missile fairing) paraboloidal shells exhibit totally different modal actuation behaviors due to their curvature differences. Analytical results in this paper can serve as guidelines for optimal actuator placement for vibration control of different paraboloidal structures.

Thermal-to-visible face recognition using partial least squares.

PubMed

Hu, Shuowen; Choi, Jonghyun; Chan, Alex L; Schwartz, William Robson

2015-03-01

Although visible face recognition has been an active area of research for several decades, cross-modal face recognition has only been explored by the biometrics community relatively recently. Thermal-to-visible face recognition is one of the most difficult cross-modal face recognition challenges, because of the difference in phenomenology between the thermal and visible imaging modalities. We address the cross-modal recognition problem using a partial least squares (PLS) regression-based approach consisting of preprocessing, feature extraction, and PLS model building. The preprocessing and feature extraction stages are designed to reduce the modality gap between the thermal and visible facial signatures, and facilitate the subsequent one-vs-all PLS-based model building. We incorporate multi-modal information into the PLS model building stage to enhance cross-modal recognition. The performance of the proposed recognition algorithm is evaluated on three challenging datasets containing visible and thermal imagery acquired under different experimental scenarios: time-lapse, physical tasks, mental tasks, and subject-to-camera range. These scenarios represent difficult challenges relevant to real-world applications. We demonstrate that the proposed method performs robustly for the examined scenarios.

Quality models for audiovisual streaming

NASA Astrophysics Data System (ADS)

Thang, Truong Cong; Kim, Young Suk; Kim, Cheon Seog; Ro, Yong Man

2006-01-01

Quality is an essential factor in multimedia communication, especially in compression and adaptation. Quality metrics can be divided into three categories: within-modality quality, cross-modality quality, and multi-modality quality. Most research has so far focused on within-modality quality. Moreover, quality is normally just considered from the perceptual perspective. In practice, content may be drastically adapted, even converted to another modality. In this case, we should consider the quality from semantic perspective as well. In this work, we investigate the multi-modality quality from the semantic perspective. To model the semantic quality, we apply the concept of "conceptual graph", which consists of semantic nodes and relations between the nodes. As an typical of multi-modality example, we focus on audiovisual streaming service. Specifically, we evaluate the amount of information conveyed by a audiovisual content where both video and audio channels may be strongly degraded, even audio are converted to text. In the experiments, we also consider the perceptual quality model of audiovisual content, so as to see the difference with semantic quality model.

ADMultiImg: a novel missing modality transfer learning based CAD system for diagnosis of MCI due to AD using incomplete multi-modality imaging data

NASA Astrophysics Data System (ADS)

Liu, Xiaonan; Chen, Kewei; Wu, Teresa; Weidman, David; Lure, Fleming; Li, Jing

2018-02-01

Alzheimer's Disease (AD) is the most common cause of dementia and currently has no cure. Treatments targeting early stages of AD such as Mild Cognitive Impairment (MCI) may be most effective to deaccelerate AD, thus attracting increasing attention. However, MCI has substantial heterogeneity in that it can be caused by various underlying conditions, not only AD. To detect MCI due to AD, NIA-AA published updated consensus criteria in 2011, in which the use of multi-modality images was highlighted as one of the most promising methods. It is of great interest to develop a CAD system based on automatic, quantitative analysis of multi-modality images and machine learning algorithms to help physicians more adequately diagnose MCI due to AD. The challenge, however, is that multi-modality images are not universally available for many patients due to cost, access, safety, and lack of consent. We developed a novel Missing Modality Transfer Learning (MMTL) algorithm capable of utilizing whatever imaging modalities are available for an MCI patient to diagnose the patient's likelihood of MCI due to AD. Furthermore, we integrated MMTL with radiomics steps including image processing, feature extraction, and feature screening, and a post-processing for uncertainty quantification (UQ), and developed a CAD system called "ADMultiImg" to assist clinical diagnosis of MCI due to AD using multi-modality images together with patient demographic and genetic information. Tested on ADNI date, our system can generate a diagnosis with high accuracy even for patients with only partially available image modalities (AUC=0.94), and therefore may have broad clinical utility.

Multimodal Nonlinear Optical Microscopy

PubMed Central

Yue, Shuhua; Slipchenko, Mikhail N.; Cheng, Ji-Xin

2013-01-01

Because each nonlinear optical (NLO) imaging modality is sensitive to specific molecules or structures, multimodal NLO imaging capitalizes the potential of NLO microscopy for studies of complex biological tissues. The coupling of multiphoton fluorescence, second harmonic generation, and coherent anti-Stokes Raman scattering (CARS) has allowed investigation of a broad range of biological questions concerning lipid metabolism, cancer development, cardiovascular disease, and skin biology. Moreover, recent research shows the great potential of using CARS microscope as a platform to develop more advanced NLO modalities such as electronic-resonance-enhanced four-wave mixing, stimulated Raman scattering, and pump-probe microscopy. This article reviews the various approaches developed for realization of multimodal NLO imaging as well as developments of new NLO modalities on a CARS microscope. Applications to various aspects of biological and biomedical research are discussed. PMID:24353747

77 FR 15037 - Agency Information Collection Activities: Proposed Collection; Comment Request-Special Nutrition...

Federal Register 2010, 2011, 2012, 2013, 2014

2012-03-14

... assistance and training. Specifically, this study will help FNS obtain: [ssquf] General descriptive data on... programs in schools; [ssquf] Data related to program administration for designing and revising program... this notice include: [ssquf] Conducting a multi-modal (e.g. paper, Web, and telephone) survey of...

A Study in Instructional Design: A Multi-Modal Approach to Business Logistics.

ERIC Educational Resources Information Center

Griffin, Robert E.; And Others

Pennsylvania State University provided financial grants and support services to faculty members for improvement of instruction. Funds were provided for released time for faculty, audiovisual production materials, and research and evaluation. An extension course in business logistics was developed using these funds. Lecture presentations were…

Multi-Sensory, Multi-Modal Concepts for Information Understanding

DTIC Science & Technology

2004-04-01

September 20022-2 Outline • The modern dilemma of knowledge acquisition • A vision for information access and understanding • Emerging concepts for...Multi-Sensory, Multi-Modal Concepts for Information Understanding David L. Hall, Ph.D. School of Information Sciences and Technology The... understanding . INTRODUCTION Historically, information displays for display and understanding of data fusion products have focused on the use of vision

Waveguide analysis of heat-drawn and chemically etched probe tips for scanning near-field optical microscopy.

PubMed

Moar, Peter N; Love, John D; Ladouceur, François; Cahill, Laurence W

2006-09-01

We analyze two basic aspects of a scanning near-field optical microscope (SNOM) probe's operation: (i) spot-size evolution of the electric field along the probe with and without a metal layer, and (ii) a modal analysis of the SNOM probe, particularly in close proximity to the aperture. A slab waveguide model is utilized to minimize the analytical complexity, yet provides useful quantitative results--including losses associated with the metal coating--which can then be used as design rules.

Pulse-Shaping-Based Nonlinear Microscopy: Development and Applications

NASA Astrophysics Data System (ADS)

Flynn, Daniel Christopher

The combination of optical microscopy and ultrafast spectroscopy make the spatial characterization of chemical kinetics on the femtosecond time scale possible. Commercially available octave-spanning Ti:Sapphire oscillators with sub-8 fs pulse durations can drive a multitude of nonlinear transitions across a significant portion of the visible spectrum with minimal average power. Unfortunately, dispersion from microscope objectives broadens pulse durations, decreases temporal resolution and lowers the peak intensities required for driving nonlinear transitions. In this dissertation, pulse shaping is used to compress laser pulses after the microscope objective. By using a binary genetic algorithm, pulse-shapes are designed to enable selective two-photon excitation. The pulse-shapes are demonstrated in two-photon fluorescence of live COS-7 cells expressing GFP-variants mAmetrine and tdTomato. The pulse-shaping approach is applied to a new multiphoton fluorescence resonance energy transfer (FRET) stoichiometry method that quantifies donor and acceptor molecules in complex, as well as the ratio of total donor to acceptor molecules. Compared to conventional multi-photon imaging techniques that require laser tuning or multiple laser systems to selectively excite individual fluorophores, the pulse-shaping approach offers rapid selective multifluorphore imaging at biologically relevant time scales. By splitting the laser beam into two beams and building a second pulse shaper, a pulse-shaping-based pump-probe microscope is developed. The technique offers multiple imaging modalities, such as excited state absorption (ESA), ground state bleach (GSB), and stimulated emission (SE), enhancing contrast of structures via their unique quantum pathways without the addition of contrast agents. Pulse-shaping based pump-probe microscopy is demonstrated for endogenous chemical-contrast imaging of red blood cells. In the second section of this dissertation, ultrafast spectroscopic techniques are used to characterize structure-function relationships of two-photon absorbing GFP-type probes and optical limiting materials. Fluorescence lifetimes of GFP-type probes are shown to depend on functional group substitution position, therefore, enabling the synthesis of designer probes for the possible study of conformation changes and aggregation in biological systems. Similarly, it is determined that small differences in the structure and dimensionality of organometallic macrocycles result in a diverse set of optical properties, which serves as a basis for the molecular level design of nonlinear optical materials.

Retrospective Analysis of Communication Events - Understanding the Dynamics of Collaborative Multi-Party Discourse

DOE Office of Scientific and Technical Information (OSTI.GOV)

Cowell, Andrew J.; Haack, Jereme N.; McColgin, Dave W.

2006-06-08

This research is aimed at understanding the dynamics of collaborative multi-party discourse across multiple communication modalities. Before we can truly make sig-nificant strides in devising collaborative communication systems, there is a need to understand how typical users utilize com-putationally supported communications mechanisms such as email, instant mes-saging, video conferencing, chat rooms, etc., both singularly and in conjunction with traditional means of communication such as face-to-face meetings, telephone calls and postal mail. Attempting to un-derstand an individual’s communications profile with access to only a single modal-ity is challenging at best and often futile. Here, we discuss the development of RACE –more » Retrospective Analysis of Com-munications Events – a test-bed prototype to investigate issues relating to multi-modal multi-party discourse.« less

A simple tool for stereological assessment of digital images: the STEPanizer.

PubMed

Tschanz, S A; Burri, P H; Weibel, E R

2011-07-01

STEPanizer is an easy-to-use computer-based software tool for the stereological assessment of digitally captured images from all kinds of microscopical (LM, TEM, LSM) and macroscopical (radiology, tomography) imaging modalities. The program design focuses on providing the user a defined workflow adapted to most basic stereological tasks. The software is compact, that is user friendly without being bulky. STEPanizer comprises the creation of test systems, the appropriate display of digital images with superimposed test systems, a scaling facility, a counting module and an export function for the transfer of results to spreadsheet programs. Here we describe the major workflow of the tool illustrating the application on two examples from transmission electron microscopy and light microscopy, respectively. © 2011 The Authors Journal of Microscopy © 2011 Royal Microscopical Society.

Near-common-path interferometer for imaging Fourier-transform spectroscopy in wide-field microscopy

PubMed Central

Wadduwage, Dushan N.; Singh, Vijay Raj; Choi, Heejin; Yaqoob, Zahid; Heemskerk, Hans; Matsudaira, Paul; So, Peter T. C.

2017-01-01

Imaging Fourier-transform spectroscopy (IFTS) is a powerful method for biological hyperspectral analysis based on various imaging modalities, such as fluorescence or Raman. Since the measurements are taken in the Fourier space of the spectrum, it can also take advantage of compressed sensing strategies. IFTS has been readily implemented in high-throughput, high-content microscope systems based on wide-field imaging modalities. However, there are limitations in existing wide-field IFTS designs. Non-common-path approaches are less phase-stable. Alternatively, designs based on the common-path Sagnac interferometer are stable, but incompatible with high-throughput imaging. They require exhaustive sequential scanning over large interferometric path delays, making compressive strategic data acquisition impossible. In this paper, we present a novel phase-stable, near-common-path interferometer enabling high-throughput hyperspectral imaging based on strategic data acquisition. Our results suggest that this approach can improve throughput over those of many other wide-field spectral techniques by more than an order of magnitude without compromising phase stability. PMID:29392168

Imaging multi-scale dynamics in vivo with spiral volumetric optoacoustic tomography

NASA Astrophysics Data System (ADS)

Deán-Ben, X. Luís.; Fehm, Thomas F.; Ford, Steven J.; Gottschalk, Sven; Razansky, Daniel

2017-03-01

Imaging dynamics in living organisms is essential for the understanding of biological complexity. While multiple imaging modalities are often required to cover both microscopic and macroscopic spatial scales, dynamic phenomena may also extend over different temporal scales, necessitating the use of different imaging technologies based on the trade-off between temporal resolution and effective field of view. Optoacoustic (photoacoustic) imaging has been shown to offer the exclusive capability to link multiple spatial scales ranging from organelles to entire organs of small animals. Yet, efficient visualization of multi-scale dynamics remained difficult with state-of-the-art systems due to inefficient trade-offs between image acquisition and effective field of view. Herein, we introduce a spiral volumetric optoacoustic tomography (SVOT) technique that provides spectrally-enriched high-resolution optical absorption contrast across multiple spatio-temporal scales. We demonstrate that SVOT can be used to monitor various in vivo dynamics, from video-rate volumetric visualization of cardiac-associated motion in whole organs to high-resolution imaging of pharmacokinetics in larger regions. The multi-scale dynamic imaging capability thus emerges as a powerful and unique feature of the optoacoustic technology that adds to the multiple advantages of this technology for structural, functional and molecular imaging.

Label-aligned Multi-task Feature Learning for Multimodal Classification of Alzheimer’s Disease and Mild Cognitive Impairment

PubMed Central

Zu, Chen; Jie, Biao; Liu, Mingxia; Chen, Songcan

2015-01-01

Multimodal classification methods using different modalities of imaging and non-imaging data have recently shown great advantages over traditional single-modality-based ones for diagnosis and prognosis of Alzheimer’s disease (AD), as well as its prodromal stage, i.e., mild cognitive impairment (MCI). However, to the best of our knowledge, most existing methods focus on mining the relationship across multiple modalities of the same subjects, while ignoring the potentially useful relationship across different subjects. Accordingly, in this paper, we propose a novel learning method for multimodal classification of AD/MCI, by fully exploring the relationships across both modalities and subjects. Specifically, our proposed method includes two subsequent components, i.e., label-aligned multi-task feature selection and multimodal classification. In the first step, the feature selection learning from multiple modalities are treated as different learning tasks and a group sparsity regularizer is imposed to jointly select a subset of relevant features. Furthermore, to utilize the discriminative information among labeled subjects, a new label-aligned regularization term is added into the objective function of standard multi-task feature selection, where label-alignment means that all multi-modality subjects with the same class labels should be closer in the new feature-reduced space. In the second step, a multi-kernel support vector machine (SVM) is adopted to fuse the selected features from multi-modality data for final classification. To validate our method, we perform experiments on the Alzheimer’s Disease Neuroimaging Initiative (ADNI) database using baseline MRI and FDG-PET imaging data. The experimental results demonstrate that our proposed method achieves better classification performance compared with several state-of-the-art methods for multimodal classification of AD/MCI. PMID:26572145

Spatial accessibility to healthcare services in Shenzhen, China: improving the multi-modal two-step floating catchment area method by estimating travel time via online map APIs.

PubMed

Tao, Zhuolin; Yao, Zaoxing; Kong, Hui; Duan, Fei; Li, Guicai

2018-05-09

Shenzhen has rapidly grown into a megacity in the recent decades. It is a challenging task for the Shenzhen government to provide sufficient healthcare services. The spatial configuration of healthcare services can influence the convenience for the consumers to obtain healthcare services. Spatial accessibility has been widely adopted as a scientific measurement for evaluating the rationality of the spatial configuration of healthcare services. The multi-modal two-step floating catchment area (2SFCA) method is an important advance in the field of healthcare accessibility modelling, which enables the simultaneous assessment of spatial accessibility via multiple transport modes. This study further develops the multi-modal 2SFCA method by introducing online map APIs to improve the estimation of travel time by public transit or by car respectively. As the results show, the distribution of healthcare accessibility by multi-modal 2SFCA shows significant spatial disparity. Moreover, by dividing the multi-modal accessibility into car-mode and transit-mode accessibility, this study discovers that the transit-mode subgroup is disadvantaged in the competition for healthcare services with the car-mode subgroup. The disparity in transit-mode accessibility is the main reason of the uneven pattern of healthcare accessibility in Shenzhen. The findings suggest improving the public transit conditions for accessing healthcare services to reduce the disparity of healthcare accessibility. More healthcare services should be allocated in the eastern and western Shenzhen, especially sub-districts in Dapeng District and western Bao'an District. As these findings cannot be drawn by the traditional single-modal 2SFCA method, the advantage of the multi-modal 2SFCA method is significant to both healthcare studies and healthcare system planning.

Drug-related webpages classification based on multi-modal local decision fusion

NASA Astrophysics Data System (ADS)

Hu, Ruiguang; Su, Xiaojing; Liu, Yanxin

2018-03-01

In this paper, multi-modal local decision fusion is used for drug-related webpages classification. First, meaningful text are extracted through HTML parsing, and effective images are chosen by the FOCARSS algorithm. Second, six SVM classifiers are trained for six kinds of drug-taking instruments, which are represented by PHOG. One SVM classifier is trained for the cannabis, which is represented by the mid-feature of BOW model. For each instance in a webpage, seven SVMs give seven labels for its image, and other seven labels are given by searching the names of drug-taking instruments and cannabis in its related text. Concatenating seven labels of image and seven labels of text, the representation of those instances in webpages are generated. Last, Multi-Instance Learning is used to classify those drugrelated webpages. Experimental results demonstrate that the classification accuracy of multi-instance learning with multi-modal local decision fusion is much higher than those of single-modal classification.

Multi-modal trip planning system : Northeastern Illinois Regional Transportation Authority.

DOT National Transportation Integrated Search

2013-01-01

This report evaluates the Multi-Modal Trip Planner System (MMTPS) implemented by the Northeastern Illinois Regional Transportation Authority (RTA) against the specific functional objectives enumerated by the Federal Transit Administration (FTA) in it...

Adding Pluggable and Personalized Natural Control Capabilities to Existing Applications

PubMed Central

Lamberti, Fabrizio; Sanna, Andrea; Carlevaris, Gilles; Demartini, Claudio

2015-01-01

Advancements in input device and sensor technologies led to the evolution of the traditional human-machine interaction paradigm based on the mouse and keyboard. Touch-, gesture- and voice-based interfaces are integrated today in a variety of applications running on consumer devices (e.g., gaming consoles and smartphones). However, to allow existing applications running on desktop computers to utilize natural interaction, significant re-design and re-coding efforts may be required. In this paper, a framework designed to transparently add multi-modal interaction capabilities to applications to which users are accustomed is presented. Experimental observations confirmed the effectiveness of the proposed framework and led to a classification of those applications that could benefit more from the availability of natural interaction modalities. PMID:25635410

Adding pluggable and personalized natural control capabilities to existing applications.

PubMed

Lamberti, Fabrizio; Sanna, Andrea; Carlevaris, Gilles; Demartini, Claudio

2015-01-28

Advancements in input device and sensor technologies led to the evolution of the traditional human-machine interaction paradigm based on the mouse and keyboard. Touch-, gesture- and voice-based interfaces are integrated today in a variety of applications running on consumer devices (e.g., gaming consoles and smartphones). However, to allow existing applications running on desktop computers to utilize natural interaction, significant re-design and re-coding efforts may be required. In this paper, a framework designed to transparently add multi-modal interaction capabilities to applications to which users are accustomed is presented. Experimental observations confirmed the effectiveness of the proposed framework and led to a classification of those applications that could benefit more from the availability of natural interaction modalities.

Magnetic Nanoparticles for Multi-Imaging and Drug Delivery

PubMed Central

Lee, Jae-Hyun; Kim, Ji-wook; Cheon, Jinwoo

2013-01-01

Various bio-medical applications of magnetic nanoparticles have been explored during the past few decades. As tools that hold great potential for advancing biological sciences, magnetic nanoparticles have been used as platform materials for enhanced magnetic resonance imaging (MRI) agents, biological separation and magnetic drug delivery systems, and magnetic hyperthermia treatment. Furthermore, approaches that integrate various imaging and bioactive moieties have been used in the design of multi-modality systems, which possess synergistically enhanced properties such as better imaging resolution and sensitivity, molecular recognition capabilities, stimulus responsive drug delivery with on-demand control, and spatio-temporally controlled cell signal activation. Below, recent studies that focus on the design and synthesis of multi-mode magnetic nanoparticles will be briefly reviewed and their potential applications in the imaging and therapy areas will be also discussed. PMID:23579479

Direct visualization of gastrointestinal tract with lanthanide-doped BaYbF5 upconversion nanoprobes.

PubMed

Liu, Zhen; Ju, Enguo; Liu, Jianhua; Du, Yingda; Li, Zhengqiang; Yuan, Qinghai; Ren, Jinsong; Qu, Xiaogang

2013-10-01

Nanoparticulate contrast agents have attracted a great deal of attention along with the rapid development of modern medicine. Here, a binary contrast agent based on PAA modified BaYbF5:Tm nanoparticles for direct visualization of gastrointestinal (GI) tract has been designed and developed via a one-pot solvothermal route. By taking advantages of excellent colloidal stability, low cytotoxicity, and neglectable hemolysis of these well-designed nanoparticles, their feasibility as a multi-modal contrast agent for GI tract was intensively investigated. Significant enhancement of contrast efficacy relative to clinical barium meal and iodine-based contrast agent was evaluated via X-ray imaging and CT imaging in vivo. By doping Tm(3+) ions into these nanoprobes, in vivo NIR-NIR imaging was then demonstrated. Unlike some invasive imaging modalities, non-invasive imaging strategy including X-ray imaging, CT imaging, and UCL imaging for GI tract could extremely reduce the painlessness to patients, effectively facilitate imaging procedure, as well as rationality economize diagnostic time. Critical to clinical applications, long-term toxicity of our contrast agent was additionally investigated in detail, indicating their overall safety. Based on our results, PAA-BaYbF5:Tm nanoparticles were the excellent multi-modal contrast agent to integrate X-ray imaging, CT imaging, and UCL imaging for direct visualization of GI tract with low systemic toxicity. Copyright © 2013 Elsevier Ltd. All rights reserved.

Multi-Contrast Imaging and Digital Refocusing on a Mobile Microscope with a Domed LED Array.

PubMed

Phillips, Zachary F; D'Ambrosio, Michael V; Tian, Lei; Rulison, Jared J; Patel, Hurshal S; Sadras, Nitin; Gande, Aditya V; Switz, Neil A; Fletcher, Daniel A; Waller, Laura

2015-01-01

We demonstrate the design and application of an add-on device for improving the diagnostic and research capabilities of CellScope--a low-cost, smartphone-based point-of-care microscope. We replace the single LED illumination of the original CellScope with a programmable domed LED array. By leveraging recent advances in computational illumination, this new device enables simultaneous multi-contrast imaging with brightfield, darkfield, and phase imaging modes. Further, we scan through illumination angles to capture lightfield datasets, which can be used to recover 3D intensity and phase images without any hardware changes. This digital refocusing procedure can be used for either 3D imaging or software-only focus correction, reducing the need for precise mechanical focusing during field experiments. All acquisition and processing is performed on the mobile phone and controlled through a smartphone application, making the computational microscope compact and portable. Using multiple samples and different objective magnifications, we demonstrate that the performance of our device is comparable to that of a commercial microscope. This unique device platform extends the field imaging capabilities of CellScope, opening up new clinical and research possibilities.

Multi-Contrast Imaging and Digital Refocusing on a Mobile Microscope with a Domed LED Array

PubMed Central

Phillips, Zachary F.; D'Ambrosio, Michael V.; Tian, Lei; Rulison, Jared J.; Patel, Hurshal S.; Sadras, Nitin; Gande, Aditya V.; Switz, Neil A.; Fletcher, Daniel A.; Waller, Laura

2015-01-01

We demonstrate the design and application of an add-on device for improving the diagnostic and research capabilities of CellScope—a low-cost, smartphone-based point-of-care microscope. We replace the single LED illumination of the original CellScope with a programmable domed LED array. By leveraging recent advances in computational illumination, this new device enables simultaneous multi-contrast imaging with brightfield, darkfield, and phase imaging modes. Further, we scan through illumination angles to capture lightfield datasets, which can be used to recover 3D intensity and phase images without any hardware changes. This digital refocusing procedure can be used for either 3D imaging or software-only focus correction, reducing the need for precise mechanical focusing during field experiments. All acquisition and processing is performed on the mobile phone and controlled through a smartphone application, making the computational microscope compact and portable. Using multiple samples and different objective magnifications, we demonstrate that the performance of our device is comparable to that of a commercial microscope. This unique device platform extends the field imaging capabilities of CellScope, opening up new clinical and research possibilities. PMID:25969980

Multi-Modal Traveler Information System - Gateway Functional Requirements

DOT National Transportation Integrated Search

1997-11-17

The Multi-Modal Traveler Information System (MMTIS) project involves a large number of Intelligent Transportation System (ITS) related tasks. It involves research of all ITS initiatives in the Gary-Chicago-Milwaukee (GCM) Corridor which are currently...

Multi-Modal Traveler Information System - Gateway Interface Control Requirements

DOT National Transportation Integrated Search

1997-10-30

The Multi-Modal Traveler Information System (MMTIS) project involves a large number of Intelligent Transportation System (ITS) related tasks. It involves research of all ITS initiatives in the Gary-Chicago-Milwaukee (GCM) Corridor which are currently...

Designing a Website to Support Students' Academic Writing Process

ERIC Educational Resources Information Center

Åberg, Eva Svärdemo; Ståhle, Ylva; Engdahl, Ingrid; Knutes-Nyqvist, Helen

2016-01-01

Academic writing skills are crucial when students, e.g., in teacher education programs, write their undergraduate theses. A multi-modal web-based and self-regulated learning resource on academic writing was developed, using texts, hypertext, moving images, podcasts and templates. A study, using surveys and a focus group, showed that students used…

75 FR 68316 - Agency Information Collection Activities: Proposed Collection; Comment Request-Special Nutrition...

Federal Register 2010, 2011, 2012, 2013, 2014

2010-11-05

...: General descriptive data on the Child Nutrition (CN) program characteristics to help FNS respond to questions about the nutrition programs in schools; Data related to program administration for designing and... subject to this notice include: Conducting a multi-modal (e.g. paper, Web, and telephone) survey of...

Label-Free, High Resolution, Multi-Modal Light Microscopy for Discrimination of Live Stem Cell Differentiation Status.

PubMed

Zhang, Jing; Moradi, Emilia; Somekh, Michael G; Mather, Melissa L

2018-01-15

A label-free microscopy method for assessing the differentiation status of stem cells is presented with potential application for characterization of therapeutic stem cell populations. The microscopy system is capable of characterizing live cells based on the use of evanescent wave microscopy and quantitative phase contrast (QPC) microscopy. The capability of the microscopy system is demonstrated by studying the differentiation of live immortalised neonatal mouse neural stem cells over a 15 day time course. Metrics extracted from microscope images are assessed and images compared with results from endpoint immuno-staining studies to illustrate the system's performance. Results demonstrate the potential of the microscopy system as a valuable tool for cell biologists to readily identify the differentiation status of unlabelled live cells.

Hybrid-modality high-resolution imaging: for diagnostic biomedical imaging and sensing for disease diagnosis

NASA Astrophysics Data System (ADS)

Murukeshan, Vadakke M.; Hoong Ta, Lim

2014-11-01

Medical diagnostics in the recent past has seen the challenging trend to come up with dual and multi-modality imaging for implementing better diagnostic procedures. The changes in tissues in the early disease stages are often subtle and can occur beneath the tissue surface. In most of these cases, conventional types of medical imaging using optics may not be able to detect these changes easily due to its penetration depth of the orders of 1 mm. Each imaging modality has its own advantages and limitations, and the use of a single modality is not suitable for every diagnostic applications. Therefore the need for multi or hybrid-modality imaging arises. Combining more than one imaging modalities overcomes the limitation of individual imaging method and integrates the respective advantages into a single setting. In this context, this paper will be focusing on the research and development of two multi-modality imaging platforms. The first platform combines ultrasound and photoacoustic imaging for diagnostic applications in the eye. The second platform consists of optical hyperspectral and photoacoustic imaging for diagnostic applications in the colon. Photoacoustic imaging is used as one of the modalities in both platforms as it can offer deeper penetration depth compared to optical imaging. The optical engineering and research challenges in developing the dual/multi-modality platforms will be discussed, followed by initial results validating the proposed scheme. The proposed schemes offer high spatial and spectral resolution imaging and sensing, and is expected to offer potential biomedical imaging solutions in the near future.

X ray imaging microscope for cancer research

NASA Technical Reports Server (NTRS)

Hoover, Richard B.; Shealy, David L.; Brinkley, B. R.; Baker, Phillip C.; Barbee, Troy W., Jr.; Walker, Arthur B. C., Jr.

1991-01-01

The NASA technology employed during the Stanford MSFC LLNL Rocket X Ray Spectroheliograph flight established that doubly reflecting, normal incidence multilayer optics can be designed, fabricated, and used for high resolution x ray imaging of the Sun. Technology developed as part of the MSFC X Ray Microscope program, showed that high quality, high resolution multilayer x ray imaging microscopes are feasible. Using technology developed at Stanford University and at the DOE Lawrence Livermore National Laboratory (LLNL), Troy W. Barbee, Jr. has fabricated multilayer coatings with near theoretical reflectivities and perfect bandpass matching for a new rocket borne solar observatory, the Multi-Spectral Solar Telescope Array (MSSTA). Advanced Flow Polishing has provided multilayer mirror substrates with sub-angstrom (rms) smoothnesss for the astronomical x ray telescopes and x ray microscopes. The combination of these important technological advancements has paved the way for the development of a Water Window Imaging X Ray Microscope for cancer research.

Investigation of multimodal forward scatter phenotyping from bacterial colonies

NASA Astrophysics Data System (ADS)

Kim, Huisung

A rapid, label-free, and elastic light scattering (ELS) based bacterial colony phenotyping technology, bacterial rapid detection using optical scattering technology (BARDOT) provides a successful classification of several bacterial genus and species. For a thorough understanding of the phenomena and overcoming the limitations of the previous design, five additional modalities from a bacterial colony: 3D morphology, spatial optical density (OD) distribution, spectral forward scattering pattern, spectral OD, and surface backward reflection pattern are proposed to enhance the classification/identification ratio, and the feasibilities of each modality are verified. For the verification, three different instruments: integrated colony morphology analyzer (ICMA), multi-spectral BARDOT (MS-BARDOT) , and multi-modal BARDOT (MM-BARDOT) are proposed and developed. The ICMA can measure 3D morphology and spatial OD distribution of the colony simultaneously. A commercialized confocal displacement meter is used to measure the profiles of the bacterial colonies, together with a custom built optical density measurement unit to interrogate the biophysics behind the collective behavior of a bacterial colony. The system delivers essential information related to the quantitative growth dynamics (height, diameter, aspect ratio, optical density) of the bacterial colony, as well as, a relationship in between the morphological characteristics of the bacterial colony and its forward scattering pattern. Two different genera: Escherichia coli O157:H7 EDL933, and Staphylococcus aureus ATCC 25923 are selected for the analysis of the spatially resolved growth dynamics, while, Bacillus spp. such as B. subtilis ATCC 6633, B. cereus ATCC 14579, B. thuringiensis DUP6044, B. polymyxa B719W, and B. megaterium DSP 81319, are interrogated since some of the Bacillus spp. provides strikingly different characteristics of ELS patterns, and the origin of the speckle patterns are successfully correlated with the 2-D spatial density map from the ICMA. The MS-BARDOT can measure multispectral elastic-light-scatter patterns of the bacterial colony and its spectral OD to overcome the inherent limits of the single-wavelength BARDOT. A theoretical model for spectral forward scatter patterns from a bacterial colony based on elastic light scatter is presented. The spectral forward scatter patterns are computed by scalar diffraction theory, and compared with experimental results of three discrete wavelengths (405 nm, 635 nm, and 904 nm). Both model and experiment results show an excellent agreement; a longer wavelength induces a wider ring width, a wider ring gap, a smaller pattern size, and smaller numbers of rings. Further analysis using spatial fast Fourier transform (SFFT) shows a good agreement; the spatial frequencies are increasing towards the inward direction, and the slope is inversely proportional to the incoming wavelength. Four major pathogenic bacterial genera (Escherichia coli O157:H7 EDL933, Listeria monocytogenes F4244, Salmonella enterica serovar Enteritidis PT21, and Staphylococcus aureus ATCC 25923) and the seven major Escherichia coli serovar (O26, O45, O103, O111, O121, O145, and O157) with 3-4 strains each are measured and analyzed with the proposed instrument and algorithm. The MM-BARDOT can measure six different modalities: 1) light microscopy, 2) 3D morphology map from confocal microscopy, 3) 3D optical density map, 4) spectral forward scattering pattern, 5) spectral OD, 6) surface backward reflection pattern, and 7) fluorescence of a bacterial colony without moving the specimen. A custom-built confocal microscope with a controller which can be easily attached to an infinity-corrected commercial microscope is designed and built. Since the current BARDOT needs additional information from a bacterial colony to enhance the identification/classification ratio for a lower hierarchy of bacterial taxonomy such as serovar or strain level, the approach can offer a series of coordinates matched and correlated bio-optical characteristics of a colony and enhance the classification accuracy of the previously introduced BARDOT system. Four major pathogenic bacterial genera: Escherichia coli O157:H7 EDL933, Listeria monocytogenes F4244, Salmonella enterica serovar Enteritidis PT21, and Staphylococcus aureus ATCC 25923 are measured and analyzed with the proposed instrument and algorithm. Also, a feasibility test for a smaller colony (up to 500 mum) classification utilizing a surface backward reflection pattern from the measurement is done, and shows a potential as an additional modality for the bacterial phenotyping.

A novel automated method for doing registration and 3D reconstruction from multi-modal RGB/IR image sequences

NASA Astrophysics Data System (ADS)

Kirby, Richard; Whitaker, Ross

2016-09-01

In recent years, the use of multi-modal camera rigs consisting of an RGB sensor and an infrared (IR) sensor have become increasingly popular for use in surveillance and robotics applications. The advantages of using multi-modal camera rigs include improved foreground/background segmentation, wider range of lighting conditions under which the system works, and richer information (e.g. visible light and heat signature) for target identification. However, the traditional computer vision method of mapping pairs of images using pixel intensities or image features is often not possible with an RGB/IR image pair. We introduce a novel method to overcome the lack of common features in RGB/IR image pairs by using a variational methods optimization algorithm to map the optical flow fields computed from different wavelength images. This results in the alignment of the flow fields, which in turn produce correspondences similar to those found in a stereo RGB/RGB camera rig using pixel intensities or image features. In addition to aligning the different wavelength images, these correspondences are used to generate dense disparity and depth maps. We obtain accuracies similar to other multi-modal image alignment methodologies as long as the scene contains sufficient depth variations, although a direct comparison is not possible because of the lack of standard image sets from moving multi-modal camera rigs. We test our method on synthetic optical flow fields and on real image sequences that we created with a multi-modal binocular stereo RGB/IR camera rig. We determine our method's accuracy by comparing against a ground truth.

A gantry-based tri-modality system for bioluminescence tomography

PubMed Central

Yan, Han; Lin, Yuting; Barber, William C.; Unlu, Mehmet Burcin; Gulsen, Gultekin

2012-01-01

A gantry-based tri-modality system that combines bioluminescence (BLT), diffuse optical (DOT), and x-ray computed tomography (XCT) into the same setting is presented here. The purpose of this system is to perform bioluminescence tomography using a multi-modality imaging approach. As parts of this hybrid system, XCT and DOT provide anatomical information and background optical property maps. This structural and functional a priori information is used to guide and restrain bioluminescence reconstruction algorithm and ultimately improve the BLT results. The performance of the combined system is evaluated using multi-modality phantoms. In particular, a cylindrical heterogeneous multi-modality phantom that contains regions with higher optical absorption and x-ray attenuation is constructed. We showed that a 1.5 mm diameter bioluminescence inclusion can be localized accurately with the functional a priori information while its source strength can be recovered more accurately using both structural and the functional a priori information. PMID:22559540

Towards Omni-Tomography—Grand Fusion of Multiple Modalities for Simultaneous Interior Tomography

PubMed Central

Wang, Ge; Zhang, Jie; Gao, Hao; Weir, Victor; Yu, Hengyong; Cong, Wenxiang; Xu, Xiaochen; Shen, Haiou; Bennett, James; Furth, Mark; Wang, Yue; Vannier, Michael

2012-01-01

We recently elevated interior tomography from its origin in computed tomography (CT) to a general tomographic principle, and proved its validity for other tomographic modalities including SPECT, MRI, and others. Here we propose “omni-tomography”, a novel concept for the grand fusion of multiple tomographic modalities for simultaneous data acquisition in a region of interest (ROI). Omni-tomography can be instrumental when physiological processes under investigation are multi-dimensional, multi-scale, multi-temporal and multi-parametric. Both preclinical and clinical studies now depend on in vivo tomography, often requiring separate evaluations by different imaging modalities. Over the past decade, two approaches have been used for multimodality fusion: Software based image registration and hybrid scanners such as PET-CT, PET-MRI, and SPECT-CT among others. While there are intrinsic limitations with both approaches, the main obstacle to the seamless fusion of multiple imaging modalities has been the bulkiness of each individual imager and the conflict of their physical (especially spatial) requirements. To address this challenge, omni-tomography is now unveiled as an emerging direction for biomedical imaging and systems biomedicine. PMID:22768108

Prospectus on Multi-Modal Aspects of Human Factors in Transportation

DOT National Transportation Integrated Search

1991-02-01

This prospectus identifies and discusses a series of human factors : issues which are critical to transportation safety and productivity, and : examines the potential benefits that can accrue from taking a multi-modal : approach to human factors rese...

Multi-Modal Traveler Information System - GCM Corridor Architecture Interface Control Requirements

DOT National Transportation Integrated Search

1997-10-31

The Multi-Modal Traveler Information System (MMTIS) project involves a large number of Intelligent Transportation System (ITS) related tasks. It involves research of all ITS initiatives in the Gary-Chicago-Milwaukee (GCM) Corridor which are currently...

Multi-Modal Traveler Information System - GCM Corridor Architecture Functional Requirements

DOT National Transportation Integrated Search

1997-11-17

The Multi-Modal Traveler Information System (MMTIS) project involves a large number of Intelligent Transportation System (ITS) related tasks. It involves research of all ITS initiatives in the Gary-Chicago-Milwaukee (GCM) Corridor which are currently...

Multi-Modal Intelligent Traffic Signal Systems (MMITSS) impacts assessment.

DOT National Transportation Integrated Search

2015-08-01

The study evaluates the potential network-wide impacts of the Multi-Modal Intelligent Transportation Signal System (MMITSS) based on a field data analysis utilizing data collected from a MMITSS prototype and a simulation analysis. The Intelligent Tra...

Individual and group sensitivity to remedial reading program design: Examining reading gains across three middle school reading projects

PubMed Central

Calhoon, Mary Beth; Petscher, Yaacov

2015-01-01

The purpose of this project was to examine group- and individual-level responses by struggling adolescents readers (6th – 8th grades; N = 155) to three different modalities of the same reading program, Reading Achievement Multi-Component Program (RAMP-UP). The three modalities differ in the combination of reading components (phonological decoding, spelling, fluency, comprehension) that are taught and their organization. Latent change scores were used to examine changes in phonological decoding, fluency, and comprehension for each modality at the group level. In addition, individual students were classified as gainers versus non-gainers (a reading level increase of a year or more vs. less than one year) so that characteristics of gainers and differential sensitivity to instructional modality could be investigated. Findings from both group and individual analyses indicated that reading outcomes were related to modalities of reading instruction. Furthermore, differences in reading gains were seen between students who began treatment with higher reading scores than those with lower reading scores; dependent on modality of treatment. Results, examining group and individual analyses similarities and differences, and the effect the different modalities have on reading outcomes for older struggling readers will be discussed. PMID:25657503

Antibody Drug Conjugates: Application of Quantitative Pharmacology in Modality Design and Target Selection.

PubMed

Sadekar, S; Figueroa, I; Tabrizi, M

2015-07-01

Antibody drug conjugates (ADCs) are a multi-component modality comprising of an antibody targeting a cell-specific antigen, a potent drug/payload, and a linker that can be processed within cellular compartments to release payload upon internalization. Numerous ADCs are being evaluated in both research and clinical settings within the academic and pharmaceutical industry due to their ability to selectively deliver potent payloads. Hence, there is a clear need to incorporate quantitative approaches during early stages of drug development for effective modality design and target selection. In this review, we describe a quantitative approach and framework for evaluation of the interplay between drug- and systems-dependent properties (i.e., target expression, density, localization, turnover, and affinity) in order to deliver a sufficient amount of a potent payload into the relevant target cells. As discussed, theoretical approaches with particular considerations given to various key properties for the target and modality suggest that delivery of the payload into particular effect cells to be more sensitive to antigen concentrations for targets with slow turnover rates as compared to those with faster internalization rates. Further assessments also suggest that increasing doses beyond the threshold of the target capacity (a function of target internalization and expression) may not impact the maximum amount of payload delivered to the intended effect cells. This article will explore the important application of quantitative sciences in selection of the target and design of ADC modalities.

Multi-modality endoscopic imaging for the detection of colorectal cancer

NASA Astrophysics Data System (ADS)

Wall, Richard Andrew

Optical coherence tomography (OCT) is an imaging method that is considered the optical analog to ultrasound, using the technique of optical interferometry to construct two-dimensional depth-resolved images of tissue microstructure. With a resolution on the order of 10 um and a penetration depth of 1-2 mm in highly scattering tissue, fiber optics-coupled OCT is an ideal modality for the inspection of the mouse colon with its miniaturization capabilities. In the present study, the complementary modalities laser-induced fluorescence (LIF), which offers information on the biochemical makeup of the tissue, and surface magnifying chromoendoscopy, which offers high contrast surface visualization, are combined with OCT in endoscopic imaging systems for the greater specificity and sensitivity in the differentiation between normal and neoplastic tissue, and for the visualization of biomarkers which are indicative of early events in colorectal carcinogenesis. Oblique incidence reflectometry (OIR) also offers advantages, allowing the calculation of bulk tissue optical properties for use as a diagnostic tool. The study was broken up into three specific sections. First, a dual-modality OCTLIF imaging system was designed, capable of focusing light over 325-1300 nm using a reflective distal optics design. A dual-modality fluorescence-based SMC-OCT system was then designed and constructed, capable of resolving the stained mucosal crypt structure of the in vivo mouse colon. The SMC-OCT instrument's OIR capabilities were then modeled, as a modified version of the probe was used measure tissue scattering and absorption coefficients.

Outcome of transarterial chemoembolization-based multi-modal treatment in patients with unresectable hepatocellular carcinoma.

PubMed

Song, Do Seon; Nam, Soon Woo; Bae, Si Hyun; Kim, Jin Dong; Jang, Jeong Won; Song, Myeong Jun; Lee, Sung Won; Kim, Hee Yeon; Lee, Young Joon; Chun, Ho Jong; You, Young Kyoung; Choi, Jong Young; Yoon, Seung Kew

2015-02-28

To investigate the efficacy and safety of transarterial chemoembolization (TACE)-based multimodal treatment in patients with large hepatocellular carcinoma (HCC). A total of 146 consecutive patients were included in the analysis, and their medical records and radiological data were reviewed retrospectively. In total, 119 patients received TACE-based multi-modal treatments, and the remaining 27 received conservative management. Overall survival (P<0.001) and objective tumor response (P=0.003) were significantly better in the treatment group than in the conservative group. After subgroup analysis, survival benefits were observed not only in the multi-modal treatment group compared with the TACE-only group (P=0.002) but also in the surgical treatment group compared with the loco-regional treatment-only group (P<0.001). Multivariate analysis identified tumor stage (P<0.001) and tumor type (P=0.009) as two independent pre-treatment factors for survival. After adjusting for significant pre-treatment prognostic factors, objective response (P<0.001), surgical treatment (P=0.009), and multi-modal treatment (P=0.002) were identified as independent post-treatment prognostic factors. TACE-based multi-modal treatments were safe and more beneficial than conservative management. Salvage surgery after successful downstaging resulted in long-term survival in patients with large, unresectable HCC.

Outcome of transarterial chemoembolization-based multi-modal treatment in patients with unresectable hepatocellular carcinoma

PubMed Central

Song, Do Seon; Nam, Soon Woo; Bae, Si Hyun; Kim, Jin Dong; Jang, Jeong Won; Song, Myeong Jun; Lee, Sung Won; Kim, Hee Yeon; Lee, Young Joon; Chun, Ho Jong; You, Young Kyoung; Choi, Jong Young; Yoon, Seung Kew

2015-01-01

AIM: To investigate the efficacy and safety of transarterial chemoembolization (TACE)-based multimodal treatment in patients with large hepatocellular carcinoma (HCC). METHODS: A total of 146 consecutive patients were included in the analysis, and their medical records and radiological data were reviewed retrospectively. RESULTS: In total, 119 patients received TACE-based multi-modal treatments, and the remaining 27 received conservative management. Overall survival (P < 0.001) and objective tumor response (P = 0.003) were significantly better in the treatment group than in the conservative group. After subgroup analysis, survival benefits were observed not only in the multi-modal treatment group compared with the TACE-only group (P = 0.002) but also in the surgical treatment group compared with the loco-regional treatment-only group (P < 0.001). Multivariate analysis identified tumor stage (P < 0.001) and tumor type (P = 0.009) as two independent pre-treatment factors for survival. After adjusting for significant pre-treatment prognostic factors, objective response (P < 0.001), surgical treatment (P = 0.009), and multi-modal treatment (P = 0.002) were identified as independent post-treatment prognostic factors. CONCLUSION: TACE-based multi-modal treatments were safe and more beneficial than conservative management. Salvage surgery after successful downstaging resulted in long-term survival in patients with large, unresectable HCC. PMID:25741147

Adaptive optics plug-and-play setup for high-resolution microscopes with multi-actuator adaptive lens

NASA Astrophysics Data System (ADS)

Quintavalla, M.; Pozzi, P.; Verhaegen, Michelle; Bijlsma, Hielke; Verstraete, Hans; Bonora, S.

2018-02-01

Adaptive Optics (AO) has revealed as a very promising technique for high-resolution microscopy, where the presence of optical aberrations can easily compromise the image quality. Typical AO systems however, are almost impossible to implement on commercial microscopes. We propose a simple approach by using a Multi-actuator Adaptive Lens (MAL) that can be inserted right after the objective and works in conjunction with an image optimization software allowing for a wavefront sensorless correction. We presented the results obtained on several commercial microscopes among which a confocal microscope, a fluorescence microscope, a light sheet microscope and a multiphoton microscope.

Simultaneous photoacoustic and optically mediated ultrasound microscopy: an in vivo study

PubMed Central

Orlova, Anna; Shirmanova, Marina; Postnikova, Anna; Turchin, Ilya

2015-01-01

We propose the use of thermoelastic (TE) excitation of an ultrasonic (US) detector by backscattered laser radiation as a means of upgrading a single-modality photoacoustic (PA) microscope to dual-modality PA/US imaging at minimal cost. The upgraded scanning head of our dual-modality microscope consists of a fiber bundle with 14 output arms and a 32MHz polyvinylidene difluoride (PVDF) detector with a 34 MHz bandwidth (−6 dB level), 12.7 mm focal length, and a 0.25 numerical aperture. A single optical pulse delivered through the fiber bundle to the biotissue being investigated, in combination with a metalized surface on the PVDF detector allows us to obtain both PA and US A-scans. To demonstrate the in vivo capabilities of the proposed method we present the results of bimodal imaging of the brain of a newborn rat, a mouse tail and a mouse tumor. PMID:25780752

Robust multi-site MR data processing: iterative optimization of bias correction, tissue classification, and registration.

PubMed

Young Kim, Eun; Johnson, Hans J

2013-01-01

A robust multi-modal tool, for automated registration, bias correction, and tissue classification, has been implemented for large-scale heterogeneous multi-site longitudinal MR data analysis. This work focused on improving the an iterative optimization framework between bias-correction, registration, and tissue classification inspired from previous work. The primary contributions are robustness improvements from incorporation of following four elements: (1) utilize multi-modal and repeated scans, (2) incorporate high-deformable registration, (3) use extended set of tissue definitions, and (4) use of multi-modal aware intensity-context priors. The benefits of these enhancements were investigated by a series of experiments with both simulated brain data set (BrainWeb) and by applying to highly-heterogeneous data from a 32 site imaging study with quality assessments through the expert visual inspection. The implementation of this tool is tailored for, but not limited to, large-scale data processing with great data variation with a flexible interface. In this paper, we describe enhancements to a joint registration, bias correction, and the tissue classification, that improve the generalizability and robustness for processing multi-modal longitudinal MR scans collected at multi-sites. The tool was evaluated by using both simulated and simulated and human subject MRI images. With these enhancements, the results showed improved robustness for large-scale heterogeneous MRI processing.

Multi-wavelength lenses for terahertz surface wave.

PubMed

Wei, Minggui; Yang, Quanlong; Xu, Quan; Zhang, Xueqian; Li, Yanfeng; Gu, Jianqiang; Han, Jiaguang; Zhang, Weili

2017-10-16

Metasurface-based surface wave (SW) devices working at multi-wavelength has been continuously arousing enormous curiosity recently, especially in the terahertz community. In this work, we propose a multi-layer metasurface structure composed of metallic slit pairs to build terahertz SW devices. The slit pair has a narrow bandwidth and its response frequency can be altered by its geometric parameter, thereby suppressing the frequency crosstalk and reducing the difficulty of design. By elaborately tailoring the distribution of the slit pairs, a series of achromatic SW lenses (SWLs) working at 0.6, 0.75 and 1 THz are experimentally demonstrated by the near field scanning terahertz microscope (NSTM) system. In addition, a wavelength-division-multiplexer (WDM) is further designed and implemented, which is promising in building multiplexed devices for plasmonic circuits. The structure proposed here cannot only couple the terahertz wave from free space to SWs, but also control its propagation. Moreover, our findings demonstrate the great potential to design multi-wavelength plasmonic metasurface devices, which can be extended to microwave and visible frequencies as well.

[Research on non-rigid registration of multi-modal medical image based on Demons algorithm].

PubMed

Hao, Peibo; Chen, Zhen; Jiang, Shaofeng; Wang, Yang

2014-02-01

Non-rigid medical image registration is a popular subject in the research areas of the medical image and has an important clinical value. In this paper we put forward an improved algorithm of Demons, together with the conservation of gray model and local structure tensor conservation model, to construct a new energy function processing multi-modal registration problem. We then applied the L-BFGS algorithm to optimize the energy function and solve complex three-dimensional data optimization problem. And finally we used the multi-scale hierarchical refinement ideas to solve large deformation registration. The experimental results showed that the proposed algorithm for large de formation and multi-modal three-dimensional medical image registration had good effects.

Multi-Modal Traveler Information System - Performance Criteria for Evaluating GCM Corridor Strategies & Technologies

DOT National Transportation Integrated Search

1997-07-16

The Gary-Chicago-Milwaukee (GCM) Multi-Modal Traveler Information System (MMTIS) is a complex project involving a wide spectrum of participants. In order to facilitate its implementation it is important to understand the direction of the MMTIS. This ...

Dynamic mobility applications policy analysis : policy and institutional issues for multi-modal intelligent traffic signal system (MMITSS).

DOT National Transportation Integrated Search

2015-03-01

The Connected Vehicle Mobility Policy team (herein, policy team) developed this report to document policy considerations for the Multi-Modal Intelligent Traffic Signal System, or MMITSS. MMITSS comprises a bundle of dynamic mobility application...

Development and Application of a Multi-Modal Task Analysis to Support Intelligent Tutoring of Complex Skills

ERIC Educational Resources Information Center

Skinner, Anna; Diller, David; Kumar, Rohit; Cannon-Bowers, Jan; Smith, Roger; Tanaka, Alyssa; Julian, Danielle; Perez, Ray

2018-01-01

Background: Contemporary work in the design and development of intelligent training systems employs task analysis (TA) methods for gathering knowledge that is subsequently encoded into task models. These task models form the basis of intelligent interpretation of student performance within education and training systems. Also referred to as expert…

Missing Modality Transfer Learning via Latent Low-Rank Constraint.

PubMed

Ding, Zhengming; Shao, Ming; Fu, Yun

2015-11-01

Transfer learning is usually exploited to leverage previously well-learned source domain for evaluating the unknown target domain; however, it may fail if no target data are available in the training stage. This problem arises when the data are multi-modal. For example, the target domain is in one modality, while the source domain is in another. To overcome this, we first borrow an auxiliary database with complete modalities, then consider knowledge transfer across databases and across modalities within databases simultaneously in a unified framework. The contributions are threefold: 1) a latent factor is introduced to uncover the underlying structure of the missing modality from the known data; 2) transfer learning in two directions allows the data alignment between both modalities and databases, giving rise to a very promising recovery; and 3) an efficient solution with theoretical guarantees to the proposed latent low-rank transfer learning algorithm. Comprehensive experiments on multi-modal knowledge transfer with missing target modality verify that our method can successfully inherit knowledge from both auxiliary database and source modality, and therefore significantly improve the recognition performance even when test modality is inaccessible in the training stage.

The use of multi representative learning materials: definitive, macroscopic, microscopic, symbolic, and practice in analyzing students’ concept understanding

NASA Astrophysics Data System (ADS)

Susilaningsih, E.; Wulandari, C.; Supartono; Kasmui; Alighiri, D.

2018-03-01

This research aims to compose learning material which contains definitive macroscopic, microscopic and symbolic to analyze students’ conceptual understanding in acid-base learning materials. This research was conducted in eleven grade, natural science class, senior high school 1 (SMAN 1) Karangtengah, Demak province, Indonesia as the low level of students’ conceptual understanding and the high level of students’ misconception. The data collecting technique is by test to assess the cognitive aspect, questionnaire to assess students’ responses to multi representative learning materials (definitive, macroscopic, microscopic, symbolic), and observation to assess students’ macroscopic aspects. Three validators validate the multi-representative learning materials (definitive, macroscopic, microscopic, symbolic). The results of the research show that the multi-representative learning materials (definitive, macroscopic, microscopes, symbolic) being used is valid in the average score 62 of 75. The data is analyzed using the descriptive qualitative method. The results of the research show that 72.934 % students understand, 7.977 % less understand, 8.831 % do not understand, and 10.256 % misconception. In comparison, the second experiment class shows 54.970 % students understand, 5.263% less understand, 11.988 % do not understand, 27.777 % misconception. In conclusion, the application of multi representative learning materials (definitive, macroscopic, microscopic, symbolic) can be used to analyze the students’ understanding of acid-base materials.

Neurocognitive insights on conceptual knowledge and its breakdown

PubMed Central

Lambon Ralph, Matthew A.

2014-01-01

Conceptual knowledge reflects our multi-modal ‘semantic database’. As such, it brings meaning to all verbal and non-verbal stimuli, is the foundation for verbal and non-verbal expression and provides the basis for computing appropriate semantic generalizations. Multiple disciplines (e.g. philosophy, cognitive science, cognitive neuroscience and behavioural neurology) have striven to answer the questions of how concepts are formed, how they are represented in the brain and how they break down differentially in various neurological patient groups. A long-standing and prominent hypothesis is that concepts are distilled from our multi-modal verbal and non-verbal experience such that sensation in one modality (e.g. the smell of an apple) not only activates the intramodality long-term knowledge, but also reactivates the relevant intermodality information about that item (i.e. all the things you know about and can do with an apple). This multi-modal view of conceptualization fits with contemporary functional neuroimaging studies that observe systematic variation of activation across different modality-specific association regions dependent on the conceptual category or type of information. A second vein of interdisciplinary work argues, however, that even a smorgasbord of multi-modal features is insufficient to build coherent, generalizable concepts. Instead, an additional process or intermediate representation is required. Recent multidisciplinary work, which combines neuropsychology, neuroscience and computational models, offers evidence that conceptualization follows from a combination of modality-specific sources of information plus a transmodal ‘hub’ representational system that is supported primarily by regions within the anterior temporal lobe, bilaterally. PMID:24324236

A feasibility study of evaluating transportation security systems and associated multi-modal efficiency impacts

DOT National Transportation Integrated Search

2006-08-01

The overall purpose of this research project is to conduct a feasibility study and development of a general methodology to determine the impacts on multi-modal and system efficiency of alternative freight security measures. The methodology to be exam...

The sweet spot: FDG and other 2-carbon glucose analogs for multi-modal metabolic imaging of tumor metabolism

PubMed Central

Cox, Benjamin L; Mackie, Thomas R; Eliceiri, Kevin W

2015-01-01

Multi-modal imaging approaches of tumor metabolism that provide improved specificity, physiological relevance and spatial resolution would improve diagnosing of tumors and evaluation of tumor progression. Currently, the molecular probe FDG, glucose fluorinated with 18F at the 2-carbon, is the primary metabolic approach for clinical diagnostics with PET imaging. However, PET lacks the resolution necessary to yield intratumoral distributions of deoxyglucose, on the cellular level. Multi-modal imaging could elucidate this problem, but requires the development of new glucose analogs that are better suited for other imaging modalities. Several such analogs have been created and are reviewed here. Also reviewed are several multi-modal imaging studies that have been performed that attempt to shed light on the cellular distribution of glucose analogs within tumors. Some of these studies are performed in vitro, while others are performed in vivo, in an animal model. The results from these studies introduce a visualization gap between the in vitro and in vivo studies that, if solved, could enable the early detection of tumors, the high resolution monitoring of tumors during treatment, and the greater accuracy in assessment of different imaging agents. PMID:25625022

3D widefield light microscope image reconstruction without dyes

NASA Astrophysics Data System (ADS)

Larkin, S.; Larson, J.; Holmes, C.; Vaicik, M.; Turturro, M.; Jurkevich, A.; Sinha, S.; Ezashi, T.; Papavasiliou, G.; Brey, E.; Holmes, T.

2015-03-01

3D image reconstruction using light microscope modalities without exogenous contrast agents is proposed and investigated as an approach to produce 3D images of biological samples for live imaging applications. Multimodality and multispectral imaging, used in concert with this 3D optical sectioning approach is also proposed as a way to further produce contrast that could be specific to components in the sample. The methods avoid usage of contrast agents. Contrast agents, such as fluorescent or absorbing dyes, can be toxic to cells or alter cell behavior. Current modes of producing 3D image sets from a light microscope, such as 3D deconvolution algorithms and confocal microscopy generally require contrast agents. Zernike phase contrast (ZPC), transmitted light brightfield (TLB), darkfield microscopy and others can produce contrast without dyes. Some of these modalities have not previously benefitted from 3D image reconstruction algorithms, however. The 3D image reconstruction algorithm is based on an underlying physical model of scattering potential, expressed as the sample's 3D absorption and phase quantities. The algorithm is based upon optimizing an objective function - the I-divergence - while solving for the 3D absorption and phase quantities. Unlike typical deconvolution algorithms, each microscope modality, such as ZPC or TLB, produces two output image sets instead of one. Contrast in the displayed image and 3D renderings is further enabled by treating the multispectral/multimodal data as a feature set in a mathematical formulation that uses the principal component method of statistics.

DOE Office of Scientific and Technical Information (OSTI.GOV)

Barstow, Del R; Patlolla, Dilip Reddy; Mann, Christopher J

Abstract The data captured by existing standoff biometric systems typically has lower biometric recognition performance than their close range counterparts due to imaging challenges, pose challenges, and other factors. To assist in overcoming these limitations systems typically perform in a multi-modal capacity such as Honeywell s Combined Face and Iris (CFAIRS) [21] system. While this improves the systems performance, standoff systems have yet to be proven as accurate as their close range equivalents. We will present a standoff system capable of operating up to 7 meters in range. Unlike many systems such as the CFAIRS our system captures high qualitymore » 12 MP video allowing for a multi-sample as well as multi-modal comparison. We found that for standoff systems multi-sample improved performance more than multi-modal. For a small test group of 50 subjects we were able to achieve 100% rank one recognition performance with our system.« less

Measurements and simulations of the optical gain and anti-reflection coating modal reflectivity in quantum cascade lasers with multiple active region stacks

DOE Office of Scientific and Technical Information (OSTI.GOV)

Bidaux, Y., E-mail: yves.bidaux@alpeslasers.ch; Alpes Lasers SA, 1-3 Maximilien-de-Meuron, CH-2000 Neuchatel; Terazzi, R.

2015-09-07

We report spectrally resolved gain measurements and simulations for quantum cascade lasers (QCLs) composed of multiple heterogeneous stacks designed for broadband emission in the mid-infrared. The measurement method is first demonstrated on a reference single active region QCL based on a double-phonon resonance design emitting at 7.8 μm. It is then extended to a three-stack active region based on bound-to-continuum designs with a broadband emission range from 7.5 to 10.5 μm. A tight agreement is found with simulations based on a density matrix model. The latter implements exhaustive microscopic scattering and dephasing sources with virtually no fitting parameters. The quantitative agreement ismore » furthermore assessed by measuring gain coefficients obtained by studying the threshold current dependence with the cavity length. These results are particularly relevant to understand fundamental gain mechanisms in complex semiconductor heterostructure QCLs and to move towards efficient gain engineering. Finally, the method is extended to the measurement of the modal reflectivity of an anti-reflection coating deposited on the front facet of the broadband QCL.« less

Key informant interviews test plan : model deployment of a regional, multi-modal 511 traveler information system

DOT National Transportation Integrated Search

2004-01-28

This document presents the detailed plan to conduct the Key Informants Interviews Test, one of several test activities to be conducted as part of the national evaluation of the regional, multi-modal 511 Traveler Information System Model Deployment. T...

Scientific and industrial challenges of developing nanoparticle-based theranostics and multiple-modality contrast agents for clinical application

NASA Astrophysics Data System (ADS)

Wáng, Yì Xiáng J.; Idée, Jean-Marc; Corot, Claire

2015-10-01

Designing of theranostics and dual or multi-modality contrast agents are currently two of the hottest topics in biotechnology and biomaterials science. However, for single entity theranostics, a right ratio of their diagnostic component and their therapeutic component may not always be realized in a composite suitable for clinical application. For dual/multiple modality molecular imaging agents, after in vivo administration, there is an optimal time window for imaging, when an agent is imaged by one modality, the pharmacokinetics of this agent may not allow imaging by another modality. Due to reticuloendothelial system clearance, efficient in vivo delivery of nanoparticles to the lesion site is sometimes difficult. The toxicity of these entities also remains poorly understood. While the medical need of theranostics is admitted, the business model remains to be established. There is an urgent need for a global and internationally harmonized re-evaluation of the approval and marketing processes of theranostics. However, a reasonable expectation exists that, in the near future, the current obstacles will be removed, thus allowing the wide use of these very promising agents.

Bioengineering/Biophysicist Post-doctoral Fellow | Center for Cancer Research

Cancer.gov

A post-doctoral fellow position is available in the Tissue Morphodynamics Unit headed by Dr. Kandice Tanner at the National Cancer Institute. The Tanner lab combines biophysical and cell biological approaches to understand the interplay between tissue architecture and metastasis. We use a combination of imaging modalities, cell biology and animal models. It is expected that as a member of this lab, one will have an opportunity to be exposed to all these areas. We value a vibrant and collaborative environment where lab members share ideas, reagents and expertise and want to work on fundamental problems in the establishment of metastatic lesions. Our lab is located in the NIH main campus in Bethesda. The research facilities at NIH are outstanding and the lab has state-of-the-art equipment such as multi-photon and confocal microscopes, FACS facilities and animal vivarium.

DOE Office of Scientific and Technical Information (OSTI.GOV)

Michael, Stephan; Chow, Weng; Schneider, Hans

In the framework of a microscopic model for intersubband gain from electrically pumped quantum-dot structures we investigate electrically pumped quantum-dots as active material for a mid-infrared quantum cascade laser. Our previous calculations have indicated that these structures could operate with reduced threshold current densities while also achieving a modal gain comparable to that of quantum well active materials. We study the influence of two important quantum-dot material parameters, here, namely inhomogeneous broadening and quantum-dot sheet density, on the performance of a proposed quantum cascade laser design. In terms of achieving a positive modal net gain, a high quantum-dot density canmore » compensate for moderately high inhomogeneous broadening, but at a cost of increased threshold current density. By minimizing quantum-dot density with presently achievable inhomogeneous broadening and total losses, significantly lower threshold densities than those reported in quantum-well quantum-cascade lasers are predicted by our theory.« less

Multi-Modal Performance Measures in Oregon: Developing a Transportation Cost Index Based Upon Multi-Modal Network and Land Use Information

DOT National Transportation Integrated Search

2016-02-01

Transportation Cost Index is a performance measure for transportation and land use systems originally proposed and piloted by Reiff and Gregor (2005). It fills important niches of existing similar measures in term of policy areas covered and type of ...

(In)Flexibility of Constituency in Japanese in Multi-Modal Categorial Grammar with Structured Phonology

ERIC Educational Resources Information Center

Kubota, Yusuke

2010-01-01

This dissertation proposes a theory of categorial grammar called Multi-Modal Categorial Grammar with Structured Phonology. The central feature that distinguishes this theory from the majority of contemporary syntactic theories is that it decouples (without completely segregating) two aspects of syntax--hierarchical organization (reflecting…

Alternative Fuels Data Center: Multi-Modal Transportation

Science.gov Websites

examples of resources to help travelers use multi-modal transportation. OpenTripPlanner Map - an online transportation modes including transit (bus or train), walking, and bicycling 511 - a one-stop source from the of alternative transportation modes. A 2010 evaluation by the Oregon Transportation Research and

Utilizing Multi-Modal Literacies in Middle Grades Science

ERIC Educational Resources Information Center

Saurino, Dan; Ogletree, Tamra; Saurino, Penelope

2010-01-01

The nature of literacy is changing. Increased student use of computer-mediated, digital, and visual communication spans our understanding of adolescent multi-modal capabilities that reach beyond the traditional conventions of linear speech and written text in the science curriculum. Advancing technology opens doors to learning that involve…

Evaluation of Title I Program, Community School Distrlct 31, New York City. 1978-79 School Year. Final Report, E.D.L. Reading Lab.

ERIC Educational Resources Information Center

Knight, Michael E.

This program was designed to improve reading skills and to provide intensive remediation for students in grades six through nine. Specialized materials and equipment were provided by Educational Development Laboratories (EDL). The EDL Reading Laboratory utilized the Learning 100 program, a multi-modality developmental and remedial program. Small…

Design of Open Content Social Learning That Increases Learning Efficiency and Engagement Based on Open Pedagogy

ERIC Educational Resources Information Center

John, Benneaser; Thavavel, V.; Jayaraj, Jayakumar; Muthukumar, A.; Jeevanandam, Poornaselvan Kittu

2016-01-01

Academic writing skills are crucial when students, e.g., in teacher education programs, write their undergraduate theses. A multi-modal web-based and self-regulated learning resource on academic writing was developed, using texts, hypertext, moving images, podcasts and templates. A study, using surveys and a focus group, showed that students used…

Effect of perceptual load on semantic access by speech in children

PubMed Central

Jerger, Susan; Damian, Markus F.; Mills, Candice; Bartlett, James; Tye-Murray, Nancy; Abdi, Hervè

2013-01-01

Purpose To examine whether semantic access by speech requires attention in children. Method Children (N=200) named pictures and ignored distractors on a cross-modal (distractors: auditory-no face) or multi-modal (distractors: auditory-static face and audiovisual-dynamic face) picture word task. The cross-modal had a low load, and the multi-modal had a high load [i.e., respectively naming pictures displayed 1) on a blank screen vs 2) below the talker’s face on his T-shirt]. Semantic content of distractors was manipulated to be related vs unrelated to picture (e.g., picture dog with distractors bear vs cheese). Lavie's (2005) perceptual load model proposes that semantic access is independent of capacity limited attentional resources if irrelevant semantic-content manipulation influences naming times on both tasks despite variations in loads but dependent on attentional resources exhausted by higher load task if irrelevant content influences naming only on cross-modal (low load). Results Irrelevant semantic content affected performance for both tasks in 6- to 9-year-olds, but only on cross-modal in 4–5-year-olds. The addition of visual speech did not influence results on the multi-modal task. Conclusion Younger and older children differ in dependence on attentional resources for semantic access by speech. PMID:22896045

A software framework for real-time multi-modal detection of microsleeps.

PubMed

Knopp, Simon J; Bones, Philip J; Weddell, Stephen J; Jones, Richard D

2017-09-01

A software framework is described which was designed to process EEG, video of one eye, and head movement in real time, towards achieving early detection of microsleeps for prevention of fatal accidents, particularly in transport sectors. The framework is based around a pipeline structure with user-replaceable signal processing modules. This structure can encapsulate a wide variety of feature extraction and classification techniques and can be applied to detecting a variety of aspects of cognitive state. Users of the framework can implement signal processing plugins in C++ or Python. The framework also provides a graphical user interface and the ability to save and load data to and from arbitrary file formats. Two small studies are reported which demonstrate the capabilities of the framework in typical applications: monitoring eye closure and detecting simulated microsleeps. While specifically designed for microsleep detection/prediction, the software framework can be just as appropriately applied to (i) other measures of cognitive state and (ii) development of biomedical instruments for multi-modal real-time physiological monitoring and event detection in intensive care, anaesthesiology, cardiology, neurosurgery, etc. The software framework has been made freely available for researchers to use and modify under an open source licence.

Experimental modal substructuring to couple and uncouple substructures with flexible fixtures and multi-point connections

NASA Astrophysics Data System (ADS)

Allen, Matthew S.; Mayes, Randall L.; Bergman, Elizabeth J.

2010-11-01

Modal substructuring or component mode synthesis (CMS) has been standard practice for many decades in the analytical realm, yet a number of significant difficulties have been encountered when attempting to combine experimentally derived modal models with analytical ones or when predicting the effect of structural modifications using experimental measurements. This work presents a new method that removes the effects of a flexible fixture from an experimentally obtained modal model. It can be viewed as an extension to the approach where rigid masses are removed from a structure. The approach presented here improves the modal basis of the substructure, so that it can be used to more accurately estimate the modal parameters of the built-up system. New types of constraints are also presented, which constrain the modal degrees of freedom of the substructures, avoiding the need to estimate the connection point displacements and rotations. These constraints together with the use of a flexible fixture enable a new approach for joining structures, especially those with statically indeterminate multi-point connections, such as two circular flanges that are joined by many more bolts than required to enforce compatibility if the substructures were rigid. Fixture design is discussed, one objective of which is to achieve a mass-loaded boundary condition that exercises the substructure at the connection point as it is in the built up system. The proposed approach is demonstrated with two examples using experimental measurements from laboratory systems. The first is a simple problem of joining two beams of differing lengths, while the second consists of a three-dimensional structure comprising a circular plate that is bolted at eight locations to a flange on a cylindrical structure. In both cases frequency response functions predicted by the substructuring methods agree well with those of the actual coupled structures over a significant range of frequencies.

Stability, structure and scale: improvements in multi-modal vessel extraction for SEEG trajectory planning.

PubMed

Zuluaga, Maria A; Rodionov, Roman; Nowell, Mark; Achhala, Sufyan; Zombori, Gergely; Mendelson, Alex F; Cardoso, M Jorge; Miserocchi, Anna; McEvoy, Andrew W; Duncan, John S; Ourselin, Sébastien

2015-08-01

Brain vessels are among the most critical landmarks that need to be assessed for mitigating surgical risks in stereo-electroencephalography (SEEG) implantation. Intracranial haemorrhage is the most common complication associated with implantation, carrying significantly associated morbidity. SEEG planning is done pre-operatively to identify avascular trajectories for the electrodes. In current practice, neurosurgeons have no assistance in the planning of electrode trajectories. There is great interest in developing computer-assisted planning systems that can optimise the safety profile of electrode trajectories, maximising the distance to critical structures. This paper presents a method that integrates the concepts of scale, neighbourhood structure and feature stability with the aim of improving robustness and accuracy of vessel extraction within a SEEG planning system. The developed method accounts for scale and vicinity of a voxel by formulating the problem within a multi-scale tensor voting framework. Feature stability is achieved through a similarity measure that evaluates the multi-modal consistency in vesselness responses. The proposed measurement allows the combination of multiple images modalities into a single image that is used within the planning system to visualise critical vessels. Twelve paired data sets from two image modalities available within the planning system were used for evaluation. The mean Dice similarity coefficient was 0.89 ± 0.04, representing a statistically significantly improvement when compared to a semi-automated single human rater, single-modality segmentation protocol used in clinical practice (0.80 ± 0.03). Multi-modal vessel extraction is superior to semi-automated single-modality segmentation, indicating the possibility of safer SEEG planning, with reduced patient morbidity.

Dynamic Load on Continuous Multi-Lane Bridge Deck from Moving Vehicles

NASA Astrophysics Data System (ADS)

ZHU, X. Q.; LAW, S. S.

2002-04-01

The dynamic loading on a multi-lane continuous bridge deck due to vehicles moving on top at a constant velocity is investigated. The bridge is modelled as a multi-span continuous orthotropic rectangular plate with line rigid intermediate supports. The vehicle is simulated as a two-axle three-dimensional vehicle model with seven degrees of freedom according to the H20-44 vehicle design loading (AASHTO LRFD Bridge Design Specifications 1998 American Association of State Highway and Transportation Officials [1]). The dynamic behavior of the bridge deck under single and several vehicles moving in different lanes is analyzed using the orthotropic plate theory and modal superposition technique. The dynamic loading is studied in terms of the dynamic impact factor of the bridge deck. The impact factor is found varying in an opposite trend as the dynamic responses for the different loading cases under study.

Molecular Imaging of Apoptosis: From Micro to Macro

PubMed Central

Zeng, Wenbin; Wang, Xiaobo; Xu, Pengfei; Liu, Gang; Eden, Henry S.; Chen, Xiaoyuan

2015-01-01

Apoptosis, or programmed cell death, is involved in numerous human conditions including neurodegenerative diseases, ischemic damage, autoimmune disorders and many types of cancer, and is often confused with other types of cell death. Therefore strategies that enable visualized detection of apoptosis would be of enormous benefit in the clinic for diagnosis, patient management, and development of new therapies. In recent years, improved understanding of the apoptotic machinery and progress in imaging modalities have provided opportunities for researchers to formulate microscopic and macroscopic imaging strategies based on well-defined molecular markers and/or physiological features. Correspondingly, a large collection of apoptosis imaging probes and approaches have been documented in preclinical and clinical studies. In this review, we mainly discuss microscopic imaging assays and macroscopic imaging probes, ranging in complexity from simple attachments of reporter moieties to proteins that interact with apoptotic biomarkers, to rationally designed probes that target biochemical changes. Their clinical translation will also be our focus. PMID:25825597

Integration of Fiber-Optic Sensor Arrays into a Multi-Modal Tactile Sensor Processing System for Robotic End-Effectors

PubMed Central

Kampmann, Peter; Kirchner, Frank

2014-01-01

With the increasing complexity of robotic missions and the development towards long-term autonomous systems, the need for multi-modal sensing of the environment increases. Until now, the use of tactile sensor systems has been mostly based on sensing one modality of forces in the robotic end-effector. The use of a multi-modal tactile sensory system is motivated, which combines static and dynamic force sensor arrays together with an absolute force measurement system. This publication is focused on the development of a compact sensor interface for a fiber-optic sensor array, as optic measurement principles tend to have a bulky interface. Mechanical, electrical and software approaches are combined to realize an integrated structure that provides decentralized data pre-processing of the tactile measurements. Local behaviors are implemented using this setup to show the effectiveness of this approach. PMID:24743158

Unified treatment of microscopic boundary conditions and efficient algorithms for estimating tangent operators of the homogenized behavior in the computational homogenization method

NASA Astrophysics Data System (ADS)

Nguyen, Van-Dung; Wu, Ling; Noels, Ludovic

2017-03-01

This work provides a unified treatment of arbitrary kinds of microscopic boundary conditions usually considered in the multi-scale computational homogenization method for nonlinear multi-physics problems. An efficient procedure is developed to enforce the multi-point linear constraints arising from the microscopic boundary condition either by the direct constraint elimination or by the Lagrange multiplier elimination methods. The macroscopic tangent operators are computed in an efficient way from a multiple right hand sides linear system whose left hand side matrix is the stiffness matrix of the microscopic linearized system at the converged solution. The number of vectors at the right hand side is equal to the number of the macroscopic kinematic variables used to formulate the microscopic boundary condition. As the resolution of the microscopic linearized system often follows a direct factorization procedure, the computation of the macroscopic tangent operators is then performed using this factorized matrix at a reduced computational time.

LudusScope: Accessible Interactive Smartphone Microscopy for Life-Science Education.

PubMed

Kim, Honesty; Gerber, Lukas Cyrill; Chiu, Daniel; Lee, Seung Ah; Cira, Nate J; Xia, Sherwin Yuyang; Riedel-Kruse, Ingmar H

2016-01-01

For centuries, observational microscopy has greatly facilitated biology education, but we still cannot easily and playfully interact with the microscopic world we see. We therefore developed the LudusScope, an accessible, interactive do-it-yourself smartphone microscopy platform that promotes exploratory stimulation and observation of microscopic organisms, in a design that combines the educational modalities of build, play, and inquire. The LudusScope's touchscreen and joystick allow the selection and stimulation of phototactic microorganisms such as Euglena gracilis with light. Organismal behavior is tracked and displayed in real time, enabling open and structured game play as well as scientific inquiry via quantitative experimentation. Furthermore, we used the Scratch programming language to incorporate biophysical modeling. This platform is designed as an accessible, low-cost educational kit for easy construction and expansion. User testing with both teachers and students demonstrates the educational potential of the LudusScope, and we anticipate additional synergy with the maker movement. Transforming observational microscopy into an interactive experience will make microbiology more tangible to society, and effectively support the interdisciplinary learning required by the Next Generation Science Standards.

LudusScope: Accessible Interactive Smartphone Microscopy for Life-Science Education

PubMed Central

Kim, Honesty; Gerber, Lukas Cyrill; Chiu, Daniel; Lee, Seung Ah; Cira, Nate J.; Xia, Sherwin Yuyang; Riedel-Kruse, Ingmar H.

2016-01-01

For centuries, observational microscopy has greatly facilitated biology education, but we still cannot easily and playfully interact with the microscopic world we see. We therefore developed the LudusScope, an accessible, interactive do-it-yourself smartphone microscopy platform that promotes exploratory stimulation and observation of microscopic organisms, in a design that combines the educational modalities of build, play, and inquire. The LudusScope’s touchscreen and joystick allow the selection and stimulation of phototactic microorganisms such as Euglena gracilis with light. Organismal behavior is tracked and displayed in real time, enabling open and structured game play as well as scientific inquiry via quantitative experimentation. Furthermore, we used the Scratch programming language to incorporate biophysical modeling. This platform is designed as an accessible, low-cost educational kit for easy construction and expansion. User testing with both teachers and students demonstrates the educational potential of the LudusScope, and we anticipate additional synergy with the maker movement. Transforming observational microscopy into an interactive experience will make microbiology more tangible to society, and effectively support the interdisciplinary learning required by the Next Generation Science Standards. PMID:27706189

Dual-modality single particle orientation and rotational tracking of intracellular transport of nanocargos.

PubMed

Sun, Wei; Gu, Yan; Wang, Gufeng; Fang, Ning

2012-01-17

The single particle orientation and rotational tracking (SPORT) technique was introduced recently to follow the rotational motion of plasmonic gold nanorod under a differential interference contrast (DIC) microscope. In biological studies, however, cellular activities usually involve a multiplicity of molecules; thus, tracking the motion of a single molecule/object is insufficient. Fluorescence-based techniques have long been used to follow the spatial and temporal distributions of biomolecules of interest thanks to the availability of multiplexing fluorescent probes. To know the type and number of molecules and the timing of their involvement in a biological process under investigation by SPORT, we constructed a dual-modality DIC/fluorescence microscope to simultaneously image fluorescently tagged biomolecules and plasmonic nanoprobes in living cells. With the dual-modality SPORT technique, the microtubule-based intracellular transport can be unambiguously identified while the dynamic orientation of nanometer-sized cargos can be monitored at video rate. Furthermore, the active transport on the microtubule can be easily separated from the diffusion before the nanocargo docks on the microtubule or after it undocks from the microtubule. The potential of dual-modality SPORT is demonstrated for shedding new light on unresolved questions in intracellular transport.

A setup for combined multiphoton laser scanning microscopic and multi-electrode patch clamp experiments on brain slices

NASA Astrophysics Data System (ADS)

Helm, P. Johannes; Reppen, Trond; Heggelund, Paul

2009-02-01

Multi Photon Laser Scanning Microscopy (MPLSM) appears today as one of the most powerful experimental tools in cellular neurophysiology, notably in studies of the functional dynamics of signal processing in single neurons. Simultaneous recording of fluorescence signals at high spatial and temporal resolution and electric signals by means of multi electrode patch clamp techniques have provided new paths for the systematic investigation of neuronal mechanisms. In particular, this approach has opened for direct studies of dendritic signal processing in neurons. We report about a setup optimized for simultaneous electrophysiological multi electrode patch clamp and multi photon laser scanning fluorescence microscopic experiments on brain slices. The microscopic system is based on a modified commercially available confocal scanning laser microscope (CLSM). From a technical and operational point of view, two developments are important: Firstly, in order to reduce the workload for the experimentalist, who in general is forced to concentrate on controlling the electrophysiological parameters during the recordings, a system of shutters has been installed together with dedicated electronic modules protecting the photo detectors against destructive light levels caused by erroneous opening or closing of microscopic light paths by the experimentalist. Secondly, the standard detection unit has been improved by installing the photomultiplier tubes (PMT) in a Peltier cooled thermal box shielding the detector from both room temperature and distortions caused by external electromagnetic fields. The electrophysiological system is based on an industrial standard multi patch clamp unit ergonomically arranged around the microscope stage. The electrophysiological and scanning processes can be time coordinated by standard trigger electronics.

Collaboration Modality, Cognitive Load, and Science Inquiry Learning in Virtual Inquiry Environments

ERIC Educational Resources Information Center

Erlandson, Benjamin E.; Nelson, Brian C.; Savenye, Wilhelmina C.

2010-01-01

Educational multi-user virtual environments (MUVEs) have been shown to be effective platforms for situated science inquiry curricula. While researchers find MUVEs to be supportive of collaborative scientific inquiry processes, the complex mix of multi-modal messages present in MUVEs can lead to cognitive overload, with learners unable to…

Students' Multi-Modal Re-Presentations of Scientific Knowledge and Creativity

ERIC Educational Resources Information Center

Koren, Yitzhak; Klavir, Rama; Gorodetsky, Malka

2005-01-01

The paper brings the results of a project that passed on to students the opportunity for re-presenting their acquired knowledge via the construction of multi-modal "learning resources". These "learning resources" substituted for lectures and books and became the official learning sources in the classroom. The rational for the…

A Multi-Modal Active Learning Experience for Teaching Social Categorization

ERIC Educational Resources Information Center

Schwarzmueller, April

2011-01-01

This article details a multi-modal active learning experience to help students understand elements of social categorization. Each student in a group dynamics course observed two groups in conflict and identified examples of in-group bias, double-standard thinking, out-group homogeneity bias, law of small numbers, group attribution error, ultimate…

Importance of multi-modal approaches to effectively identify cataract cases from electronic health records.

PubMed

Peissig, Peggy L; Rasmussen, Luke V; Berg, Richard L; Linneman, James G; McCarty, Catherine A; Waudby, Carol; Chen, Lin; Denny, Joshua C; Wilke, Russell A; Pathak, Jyotishman; Carrell, David; Kho, Abel N; Starren, Justin B

2012-01-01

There is increasing interest in using electronic health records (EHRs) to identify subjects for genomic association studies, due in part to the availability of large amounts of clinical data and the expected cost efficiencies of subject identification. We describe the construction and validation of an EHR-based algorithm to identify subjects with age-related cataracts. We used a multi-modal strategy consisting of structured database querying, natural language processing on free-text documents, and optical character recognition on scanned clinical images to identify cataract subjects and related cataract attributes. Extensive validation on 3657 subjects compared the multi-modal results to manual chart review. The algorithm was also implemented at participating electronic MEdical Records and GEnomics (eMERGE) institutions. An EHR-based cataract phenotyping algorithm was successfully developed and validated, resulting in positive predictive values (PPVs) >95%. The multi-modal approach increased the identification of cataract subject attributes by a factor of three compared to single-mode approaches while maintaining high PPV. Components of the cataract algorithm were successfully deployed at three other institutions with similar accuracy. A multi-modal strategy incorporating optical character recognition and natural language processing may increase the number of cases identified while maintaining similar PPVs. Such algorithms, however, require that the needed information be embedded within clinical documents. We have demonstrated that algorithms to identify and characterize cataracts can be developed utilizing data collected via the EHR. These algorithms provide a high level of accuracy even when implemented across multiple EHRs and institutional boundaries.

Multisensory Integration Strategy for Modality-Specific Loss of Inhibition Control in Older Adults.

PubMed

Lee, Ahreum; Ryu, Hokyoung; Kim, Jae-Kwan; Jeong, Eunju

2018-04-11

Older adults are known to have lesser cognitive control capability and greater susceptibility to distraction than young adults. Previous studies have reported age-related problems in selective attention and inhibitory control, yielding mixed results depending on modality and context in which stimuli and tasks were presented. The purpose of the study was to empirically demonstrate a modality-specific loss of inhibitory control in processing audio-visual information with ageing. A group of 30 young adults (mean age = 25.23, Standar Desviation (SD) = 1.86) and 22 older adults (mean age = 55.91, SD = 4.92) performed the audio-visual contour identification task (AV-CIT). We compared performance of visual/auditory identification (Uni-V, Uni-A) with that of visual/auditory identification in the presence of distraction in counterpart modality (Multi-V, Multi-A). The findings showed a modality-specific effect on inhibitory control. Uni-V performance was significantly better than Multi-V, indicating that auditory distraction significantly hampered visual target identification. However, Multi-A performance was significantly enhanced compared to Uni-A, indicating that auditory target performance was significantly enhanced by visual distraction. Additional analysis showed an age-specific effect on enhancement between Uni-A and Multi-A depending on the level of visual inhibition. Together, our findings indicated that the loss of visual inhibitory control was beneficial for the auditory target identification presented in a multimodal context in older adults. A likely multisensory information processing strategy in the older adults was further discussed in relation to aged cognition.

Endoscopic endonasal trans-sphenoid surgery of pituitary adenoma

PubMed Central

Yadav, YR; Sachdev, S; Parihar, V; Namdev, H; Bhatele, PR

2012-01-01

Endoscopic endonasal trans-sphenoid surgery (EETS) is increasingly used for pituitary lesions. Pre-operative CT and MRI scans and peroperative endoscopic visualization can provide useful anatomical information. EETS is indicated in sellar, suprasellar, intraventricular, retro-infundibular, and invasive tumors. Recurrent and residual lesions, pituitary apoplexy and empty sella syndrome can be managed by EETS. Modern neuronavigation techniques, ultrasonic aspirators, ultrasonic bone curette can add to the safety. The binostril approach provides a wider working area. High definition camera is much superior to three-chip camera. Most of the recent reports favor EETS in terms of safety, quality of life and tumor resection, hospital stay, better endocrinological, and visual outcome as compared to the microscopic technique. Nasal symptoms, blood loss, operating time are less in EETS. Various naso-septal flaps and other techniques of CSF leak repair could help reduce complications. Complications can be further reduced after achieving the learning curve, good understanding of limitations with proper patient selection. Use of neuronavigation, proper post-operative care of endocrine function, establishing pituitary center of excellence and more focused residency and endoscopic fellowship training could improve results. The faster and safe transition from microscopic to EETS can be done by the team concept of neurosurgeon/otolaryngologist, attending hands on cadaveric dissection, practice on models, and observation of live surgeries. Conversion to a microscopic or endoscopic-assisted approach may be required in selected patients. Multi-modality treatment could be required in giant and invasive tumors. EETS appears to be a better surgical option in most pituitary adenoma. PMID:23188987

Band-edge engineering for controlled multi-modal nanolasing in plasmonic superlattices

DOE PAGES

Wang, Danqing; Yang, Ankun; Wang, Weijia; ...

2017-07-10

Single band-edge states can trap light and function as high-quality optical feedback for microscale lasers and nanolasers. However, access to more than a single band-edge mode for nanolasing has not been possible because of limited cavity designs. Here, we describe how plasmonic superlattices-finite-arrays of nanoparticles (patches) grouped into microscale arrays-can support multiple band-edge modes capable of multi-modal nanolasing at programmed emission wavelengths and with large mode spacings. Different lasing modes show distinct input-output light behaviour and decay dynamics that can be tailored by nanoparticle size. By modelling the superlattice nanolasers with a four-level gain system and a time-domain approach, wemore » reveal that the accumulation of population inversion at plasmonic hot spots can be spatially modulated by the diffractive coupling order of the patches. Furthermore, we show that symmetry-broken superlattices can sustain switchable nanolasing between a single mode and multiple modes.« less

Feature-based Alignment of Volumetric Multi-modal Images

PubMed Central

Toews, Matthew; Zöllei, Lilla; Wells, William M.

2014-01-01

This paper proposes a method for aligning image volumes acquired from different imaging modalities (e.g. MR, CT) based on 3D scale-invariant image features. A novel method for encoding invariant feature geometry and appearance is developed, based on the assumption of locally linear intensity relationships, providing a solution to poor repeatability of feature detection in different image modalities. The encoding method is incorporated into a probabilistic feature-based model for multi-modal image alignment. The model parameters are estimated via a group-wise alignment algorithm, that iteratively alternates between estimating a feature-based model from feature data, then realigning feature data to the model, converging to a stable alignment solution with few pre-processing or pre-alignment requirements. The resulting model can be used to align multi-modal image data with the benefits of invariant feature correspondence: globally optimal solutions, high efficiency and low memory usage. The method is tested on the difficult RIRE data set of CT, T1, T2, PD and MP-RAGE brain images of subjects exhibiting significant inter-subject variability due to pathology. PMID:24683955

Dual-modal three-dimensional imaging of single cells with isometric high resolution using an optical projection tomography microscope

NASA Astrophysics Data System (ADS)

Miao, Qin; Rahn, J. Richard; Tourovskaia, Anna; Meyer, Michael G.; Neumann, Thomas; Nelson, Alan C.; Seibel, Eric J.

2009-11-01

The practice of clinical cytology relies on bright-field microscopy using absorption dyes like hematoxylin and eosin in the transmission mode, while the practice of research microscopy relies on fluorescence microscopy in the epi-illumination mode. The optical projection tomography microscope is an optical microscope that can generate 3-D images of single cells with isometric high resolution both in absorption and fluorescence mode. Although the depth of field of the microscope objective is in the submicron range, it can be extended by scanning the objective's focal plane. The extended depth of field image is similar to a projection in a conventional x-ray computed tomography. Cells suspended in optical gel flow through a custom-designed microcapillary. Multiple pseudoprojection images are taken by rotating the microcapillary. After these pseudoprojection images are further aligned, computed tomography methods are applied to create 3-D reconstruction. 3-D reconstructed images of single cells are shown in both absorption and fluorescence mode. Fluorescence spatial resolution is measured at 0.35 μm in both axial and lateral dimensions. Since fluorescence and absorption images are taken in two different rotations, mechanical error may cause misalignment of 3-D images. This mechanical error is estimated to be within the resolution of the system.

A versatile optical microscope for time-dependent single-molecule and single-particle spectroscopy

NASA Astrophysics Data System (ADS)

Li, Hao; Yang, Haw

2018-03-01

This work reports the design and implementation of a multi-function optical microscope for time-dependent spectroscopy on single molecules and single nanoparticles. It integrates the now-routine single-object measurements into one standalone platform so that no reconfiguration is needed when switching between different types of sample or spectroscopy modes. The illumination modes include evanescent field through total internal reflection, dark-field illumination, and epi-excitation onto a diffraction-limited spot suitable for confocal detection. The detection modes include spectrally resolved line imaging, wide-field imaging with dual-color capability, and two-color single-element photon-counting detection. The switch between different spectroscopy and data acquisition modes is fully automated and executed through computer programming. The capability of this microscope is demonstrated through selected proof-of-principle experiments.

A versatile optical microscope for time-dependent single-molecule and single-particle spectroscopy.

PubMed

Li, Hao; Yang, Haw

2018-03-28

This work reports the design and implementation of a multi-function optical microscope for time-dependent spectroscopy on single molecules and single nanoparticles. It integrates the now-routine single-object measurements into one standalone platform so that no reconfiguration is needed when switching between different types of sample or spectroscopy modes. The illumination modes include evanescent field through total internal reflection, dark-field illumination, and epi-excitation onto a diffraction-limited spot suitable for confocal detection. The detection modes include spectrally resolved line imaging, wide-field imaging with dual-color capability, and two-color single-element photon-counting detection. The switch between different spectroscopy and data acquisition modes is fully automated and executed through computer programming. The capability of this microscope is demonstrated through selected proof-of-principle experiments.

Single-channel stereoscopic ophthalmology microscope based on TRD

NASA Astrophysics Data System (ADS)

Radfar, Edalat; Park, Jihoon; Lee, Sangyeob; Ha, Myungjin; Yu, Sungkon; Jang, Seulki; Jung, Byungjo

2016-03-01

A stereoscopic imaging modality was developed for the application of ophthalmology surgical microscopes. A previous study has already introduced a single-channel stereoscopic video imaging modality based on a transparent rotating deflector (SSVIM-TRD), in which two different view angles, image disparity, are generated by imaging through a transparent rotating deflector (TRD) mounted on a stepping motor and is placed in a lens system. In this case, the image disparity is a function of the refractive index and the rotation angle of TRD. Real-time single-channel stereoscopic ophthalmology microscope (SSOM) based on the TRD is improved by real-time controlling and programming, imaging speed, and illumination method. Image quality assessments were performed to investigate images quality and stability during the TRD operation. Results presented little significant difference in image quality in terms of stability of structural similarity (SSIM). A subjective analysis was performed with 15 blinded observers to evaluate the depth perception improvement and presented significant improvement in the depth perception capability. Along with all evaluation results, preliminary results of rabbit eye imaging presented that the SSOM could be utilized as an ophthalmic operating microscopes to overcome some of the limitations of conventional ones.

Electrophysiology Tool Construction

PubMed Central

Ide, David

2016-01-01

This protocol documents the construction of a custom microscope stage system currently in widespread use by a wide variety of investigators. The current design and construction of this stage is the result of multiple iterations, integrating input from a number of electrophysiologists working with a variety of preparations. Thus, this tool is a generally applicable solution, suitable for a wide array of end-user requirements; its flexible design facilitates rapid and easy configuration, making it useful for multi-user microscopes, as individual researchers can reconfigure the stage system or have their own readily replaceable stage plates. Furthermore, the stage can be manufactured using equipment typically found in small research machine shops, and by keeping the various parts on hand, machinists can quickly satisfy new requests and/or modifications for a wide variety of applications. PMID:23315946

A Module-Based Approach to Foster and Document the Intercultural Process before and during the Residence Abroad

ERIC Educational Resources Information Center

Penman, C.; Ratz, S.

2015-01-01

This article contributes to the debate on what form of preparation and support can enhance the intercultural student experience during a Year Abroad. It presents a credit-bearing and multi-modal module at a UK university designed to both prepare students prior to departure through a series of workshops and activities on an e-portfolio and help…

Operational modal analysis of a high-rise multi-function building with dampers by a Bayesian approach

NASA Astrophysics Data System (ADS)

Ni, Yanchun; Lu, Xilin; Lu, Wensheng

2017-03-01

The field non-destructive vibration test plays an important role in the area of structural health monitoring. It assists in monitoring the health status and reducing the risk caused by the poor performance of structures. As the most economic field test among the various vibration tests, the ambient vibration test is the most popular and is widely used to assess the physical condition of a structure under operational service. Based on the ambient vibration data, modal identification can help provide significant previous study for model updating and damage detection during the service life of a structure. It has been proved that modal identification works well in the investigation of the dynamic performance of different kinds of structures. In this paper, the objective structure is a high-rise multi-function office building. The whole building is composed of seven three-story structural units. Each unit comprises one complete floor and two L shaped floors to form large spaces along the vertical direction. There are 56 viscous dampers installed in the building to improve the energy dissipation capacity. Due to the special feature of the structure, field vibration tests and further modal identification were performed to investigate its dynamic performance. Twenty-nine setups were designed to cover all the degrees of freedom of interest. About two years later, another field test was carried out to measure the building for 48 h to investigate the performance variance and the distribution of the modal parameters. A Fast Bayesian FFT method was employed to perform the modal identification. This Bayesian method not only provides the most probable values of the modal parameters but also assesses the associated posterior uncertainty analytically, which is especially relevant in field vibration tests arising due to measurement noise, sensor alignment error, modelling error, etc. A shaking table test was also implemented including cases with and without dampers, which assists in investigating the effect of dampers. The modal parameters obtained from different tests were investigated separately and then compared with each other.

Endoscopic optical coherence tomography: technologies and clinical applications [Invited

PubMed Central

Gora, Michalina J.; Suter, Melissa J.; Tearney, Guillermo J.; Li, Xingde

2017-01-01

In this paper, we review the current state of technology development and clinical applications of endoscopic optical coherence tomography (OCT). Key design and engineering considerations are discussed for most OCT endoscopes, including side-viewing and forward-viewing probes, along with different scanning mechanisms (proximal-scanning versus distal-scanning). Multi-modal endoscopes that integrate OCT with other imaging modalities are also discussed. The review of clinical applications of endoscopic OCT focuses heavily on diagnosis of diseases and guidance of interventions. Representative applications in several organ systems are presented, such as in the cardiovascular, digestive, respiratory, and reproductive systems. A brief outlook of the field of endoscopic OCT is also discussed. PMID:28663882

Evidence-based development and first usability testing of a social serious game based multi-modal system for early screening for atypical socio-cognitive development.

PubMed

Gyori, Miklos; Borsos, Zsófia; Stefanik, Krisztina

2015-01-01

At current, screening for, and diagnosis of, autism spectrum disorders (ASD) are based on purely behavioral data; established screening tools rely on human observation and ratings of relevant behaviors. The research and development project in the focus of this paper is aimed at designing, creating and evaluating a social serious game based multi-modal, interactive software system for screening for high functioning cases of ASD at kindergarten age. The aims of this paper are (1) to summarize the evidence-based design process and (2) to present results from the first usability test of the system. Game topic, candidate responses, and candidate game contents were identified via an iterative literature review. On this basis, the 1^st partial prototype of the fully playable game has been created, with complete data recording functionality but without the decision making component. A first usability test was carried out on this prototype (n=13). Overall results were unambiguously promising. Although sporadic difficulties in, and slightly negative attitudes towards, using the game occasionally arose, these were confined to non-target-group children only. The next steps of development include (1) completing the game design; (2) carrying out first large-n field test; (3) creating the first prototype of the decision making component.

Graduate Student Perceptions of Multi-Modal Tablet Use in Academic Environments

ERIC Educational Resources Information Center

Bryant, Ezzard C., Jr.

2016-01-01

The purpose of this study was to explore graduate student perceptions of use and the ease of use of multi-modal tablets to access electronic course materials, and the perceived differences based on students' gender, age, college of enrollment, and previous experience. This study used the Unified Theory of Acceptance and Use of Technology to…

A big-data model for multi-modal public transportation with application to macroscopic control and optimisation

NASA Astrophysics Data System (ADS)

Faizrahnemoon, Mahsa; Schlote, Arieh; Maggi, Lorenzo; Crisostomi, Emanuele; Shorten, Robert

2015-11-01

This paper describes a Markov-chain-based approach to modelling multi-modal transportation networks. An advantage of the model is the ability to accommodate complex dynamics and handle huge amounts of data. The transition matrix of the Markov chain is built and the model is validated using the data extracted from a traffic simulator. A realistic test-case using multi-modal data from the city of London is given to further support the ability of the proposed methodology to handle big quantities of data. Then, we use the Markov chain as a control tool to improve the overall efficiency of a transportation network, and some practical examples are described to illustrate the potentials of the approach.

Multi-modal measurement of the myelin-to-axon diameter g-ratio in preterm-born neonates and adult controls.

PubMed

Melbourne, Andrew; Eaton-Rosen, Zach; De Vita, Enrico; Bainbridge, Alan; Cardoso, Manuel Jorge; Price, David; Cady, Ernest; Kendall, Giles S; Robertson, Nicola J; Marlow, Neil; Ourselin, Sébastien

2014-01-01

Infants born prematurely are at increased risk of adverse functional outcome. The measurement of white matter tissue composition and structure can help predict functional performance and this motivates the search for new multi-modal imaging biomarkers. In this work we develop a novel combined biomarker from diffusion MRI and multi-component T2 relaxation measurements in a group of infants born very preterm and scanned between 30 and 40 weeks equivalent gestational age. We also investigate this biomarker on a group of seven adult controls, using a multi-modal joint model-fitting strategy. The proposed emergent biomarker is tentatively related to axonal energetic efficiency (in terms of axonal membrane charge storage) and conduction velocity and is thus linked to the tissue electrical properties, giving it a good theoretical justification as a predictive measurement of functional outcome.

Implementation of PSF engineering in high-resolution 3D microscopy imaging with a LCoS (reflective) SLM

NASA Astrophysics Data System (ADS)

King, Sharon V.; Doblas, Ana; Patwary, Nurmohammed; Saavedra, Genaro; Martínez-Corral, Manuel; Preza, Chrysanthe

2014-03-01

Wavefront coding techniques are currently used to engineer unique point spread functions (PSFs) that enhance existing microscope modalities or create new ones. Previous work in this field demonstrated that simulated intensity PSFs encoded with a generalized cubic phase mask (GCPM) are invariant to spherical aberration or misfocus; dependent on parameter selection. Additional work demonstrated that simulated PSFs encoded with a squared cubic phase mask (SQUBIC) produce a depth invariant focal spot for application in confocal scanning microscopy. Implementation of PSF engineering theory with a liquid crystal on silicon (LCoS) spatial light modulator (SLM) enables validation of WFC phase mask designs and parameters by manipulating optical wavefront properties with a programmable diffractive element. To validate and investigate parameters of the GCPM and SQUBIC WFC masks, we implemented PSF engineering in an upright microscope modified with a dual camera port and a LCoS SLM. We present measured WFC PSFs and compare them to simulated PSFs through analysis of their effect on the microscope imaging system properties. Experimentally acquired PSFs show the same intensity distribution as simulation for the GCPM phase mask, the SQUBIC-mask and the well-known and characterized cubic-phase mask (CPM), first applied to high NA microscopy by Arnison et al.10, for extending depth of field. These measurements provide experimental validation of new WFC masks and demonstrate the use of the LCoS SLM as a WFC design tool. Although efficiency improvements are needed, this application of LCoS technology renders the microscope capable of switching among multiple WFC modes.

Multi-modality optical imaging of ovarian cancer in a post-menopausal mouse model

NASA Astrophysics Data System (ADS)

Watson, Jennifer M.; Rice, Photini Faith; Marion, Samuel L.; Bentley, David L.; Brewer, Molly A.; Utzinger, Urs; Hoyer, Patricia B.; Barton, Jennifer K.

2011-03-01

Our goal is to use optical imaging to detect cancer development on the sub cellular scale. By determining the microscopic changes that precede ovarian cancer we hope to develop a minimally invasive screening test for high risk patients. A mouse ovarian cancer model has been developed by treating mice with 4-Vinylcyclohexene Diepoxide to induce ovarian failure and 7, 12-Dimethylbenz[a]anthracene (DMBA) to induce ovarian cancer. Using optical coherence tomography (OCT) and multiphoton microscopy (MPM) we have obtained co-registered en face images of sixty-seven mouse ovaries ex vivo and forty-two ovaries in vivo. Preliminary analysis indicates that OCT and MPM can visualize ovarian microstructure. During the next year we will be completing a long term survival study using post-menopausal mice that have been treated with DMBA to induce cancer and imaged in vivo at time points before and after treatment.

Multi Modality Brain Mapping System (MBMS) Using Artificial Intelligence and Pattern Recognition

NASA Technical Reports Server (NTRS)

Nikzad, Shouleh (Inventor); Kateb, Babak (Inventor)

2017-01-01

A Multimodality Brain Mapping System (MBMS), comprising one or more scopes (e.g., microscopes or endoscopes) coupled to one or more processors, wherein the one or more processors obtain training data from one or more first images and/or first data, wherein one or more abnormal regions and one or more normal regions are identified; receive a second image captured by one or more of the scopes at a later time than the one or more first images and/or first data and/or captured using a different imaging technique; and generate, using machine learning trained using the training data, one or more viewable indicators identifying one or abnormalities in the second image, wherein the one or more viewable indicators are generated in real time as the second image is formed. One or more of the scopes display the one or more viewable indicators on the second image.

Cortical reorganization in postlingually deaf cochlear implant users: Intra-modal and cross-modal considerations.

PubMed

Stropahl, Maren; Chen, Ling-Chia; Debener, Stefan

2017-01-01

With the advances of cochlear implant (CI) technology, many deaf individuals can partially regain their hearing ability. However, there is a large variation in the level of recovery. Cortical changes induced by hearing deprivation and restoration with CIs have been thought to contribute to this variation. The current review aims to identify these cortical changes in postlingually deaf CI users and discusses their maladaptive or adaptive relationship to the CI outcome. Overall, intra-modal and cross-modal reorganization patterns have been identified in postlingually deaf CI users in visual and in auditory cortex. Even though cross-modal activation in auditory cortex is considered as maladaptive for speech recovery in CI users, a similar activation relates positively to lip reading skills. Furthermore, cross-modal activation of the visual cortex seems to be adaptive for speech recognition. Currently available evidence points to an involvement of further brain areas and suggests that a focus on the reversal of visual take-over of the auditory cortex may be too limited. Future investigations should consider expanded cortical as well as multi-sensory processing and capture different hierarchical processing steps. Furthermore, prospective longitudinal designs are needed to track the dynamics of cortical plasticity that takes place before and after implantation. Copyright © 2016 The Authors. Published by Elsevier B.V. All rights reserved.

Online Multi-Modal Robust Non-Negative Dictionary Learning for Visual Tracking

PubMed Central

Zhang, Xiang; Guan, Naiyang; Tao, Dacheng; Qiu, Xiaogang; Luo, Zhigang

2015-01-01

Dictionary learning is a method of acquiring a collection of atoms for subsequent signal representation. Due to its excellent representation ability, dictionary learning has been widely applied in multimedia and computer vision. However, conventional dictionary learning algorithms fail to deal with multi-modal datasets. In this paper, we propose an online multi-modal robust non-negative dictionary learning (OMRNDL) algorithm to overcome this deficiency. Notably, OMRNDL casts visual tracking as a dictionary learning problem under the particle filter framework and captures the intrinsic knowledge about the target from multiple visual modalities, e.g., pixel intensity and texture information. To this end, OMRNDL adaptively learns an individual dictionary, i.e., template, for each modality from available frames, and then represents new particles over all the learned dictionaries by minimizing the fitting loss of data based on M-estimation. The resultant representation coefficient can be viewed as the common semantic representation of particles across multiple modalities, and can be utilized to track the target. OMRNDL incrementally learns the dictionary and the coefficient of each particle by using multiplicative update rules to respectively guarantee their non-negativity constraints. Experimental results on a popular challenging video benchmark validate the effectiveness of OMRNDL for visual tracking in both quantity and quality. PMID:25961715

Online multi-modal robust non-negative dictionary learning for visual tracking.

PubMed

Zhang, Xiang; Guan, Naiyang; Tao, Dacheng; Qiu, Xiaogang; Luo, Zhigang

2015-01-01

Dictionary learning is a method of acquiring a collection of atoms for subsequent signal representation. Due to its excellent representation ability, dictionary learning has been widely applied in multimedia and computer vision. However, conventional dictionary learning algorithms fail to deal with multi-modal datasets. In this paper, we propose an online multi-modal robust non-negative dictionary learning (OMRNDL) algorithm to overcome this deficiency. Notably, OMRNDL casts visual tracking as a dictionary learning problem under the particle filter framework and captures the intrinsic knowledge about the target from multiple visual modalities, e.g., pixel intensity and texture information. To this end, OMRNDL adaptively learns an individual dictionary, i.e., template, for each modality from available frames, and then represents new particles over all the learned dictionaries by minimizing the fitting loss of data based on M-estimation. The resultant representation coefficient can be viewed as the common semantic representation of particles across multiple modalities, and can be utilized to track the target. OMRNDL incrementally learns the dictionary and the coefficient of each particle by using multiplicative update rules to respectively guarantee their non-negativity constraints. Experimental results on a popular challenging video benchmark validate the effectiveness of OMRNDL for visual tracking in both quantity and quality.

Implications of differences of echoic and iconic memory for the design of multimodal displays

NASA Astrophysics Data System (ADS)

Glaser, Daniel Shields

It has been well documented that dual-task performance is more accurate when each task is based on a different sensory modality. It is also well documented that the memory for each sense has unequal durations, particularly visual (iconic) and auditory (echoic) sensory memory. In this dissertation I address whether differences in sensory memory (e.g. iconic vs. echoic) duration have implications for the design of a multimodal display. Since echoic memory persists for seconds in contrast to iconic memory which persists only for milliseconds, one of my hypotheses was that in a visual-auditory dual task condition, performance will be better if the visual task is completed before the auditory task than vice versa. In Experiment 1 I investigated whether the ability to recall multi-modal stimuli is affected by recall order, with each mode being responded to separately. In Experiment 2, I investigated the effects of stimulus order and recall order on the ability to recall information from a multi-modal presentation. In Experiment 3 I investigated the effect of presentation order using a more realistic task. In Experiment 4 I investigated whether manipulating the presentation order of stimuli of different modalities improves humans' ability to combine the information from the two modalities in order to make decision based on pre-learned rules. As hypothesized, accuracy was greater when visual stimuli were responded to first and auditory stimuli second. Also as hypothesized, performance was improved by not presenting both sequences at the same time, limiting the perceptual load. Contrary to my expectations, overall performance was better when a visual sequence was presented before the audio sequence. Though presenting a visual sequence prior to an auditory sequence lengthens the visual retention interval, it also provides time for visual information to be recoded to a more robust form without disruption. Experiment 4 demonstrated that decision making requiring the integration of visual and auditory information is enhanced by reducing workload and promoting a strategic use of echoic memory. A framework for predicting Experiment 1-4 results is proposed and evaluated.

Vital-dye enhanced fluorescence imaging of gastrointestinal mucosa: metaplasia, neoplasia, inflammation

PubMed Central

Muldoon, Timothy J; Polydorides, Alexandros D; Maru, Dipen M; Harpaz, Noam; Harris, Michael T; Hofstettor, Wayne; Hiotis, Spiros P; Kim, Sanghyun A; Ky, Alex J; Anandasabapathy, Sharmila; Richards-Kortum, Rebecca

2012-01-01

Background Confocal endomicroscopy has revolutionized endoscopy by offering sub-cellular images of gastrointestinal epithelium; however, field-of-view is limited. There is a need for multi-scale endoscopy platforms that use widefield imaging to better direct placement of high-resolution probes. Design Feasibility Study Objective This study evaluates the feasibility of a single agent, proflavine hemisulfate, as a contrast medium during both widefield and high resolution imaging to characterize morphologic changes associated with a variety of gastrointestinal conditions. Setting U.T. M.D. Anderson Cancer Center (Houston, TX) and Mount Sinai Medical Center (New York, NY) Patients, Interventions, and Main Outcome Measurements Surgical specimens were obtained from 15 patients undergoing esophagectomy/colectomy. Proflavine, a vital fluorescent dye, was applied topically. Specimens were imaged with a widefield multispectral microscope and a high-resolution microendoscope. Images were compared to histopathology. Results Widefield-fluorescence imaging enhanced visualization of morphology, including the presence and spatial distribution of glands, glandular distortion, atrophy and crowding. High-resolution imaging of widefield-abnormal areas revealed that neoplastic progression corresponded to glandular heterogeneity and nuclear crowding in dysplasia, with glandular effacement in carcinoma. These widefield and high-resolution image features correlated well with histopathology. Limitations This imaging approach must be validated in vivo with a larger sample size. Conclusions Multi-scale proflavine-enhanced fluorescence imaging can delineate epithelial changes in a variety of gastrointestinal conditions. Distorted glandular features seen with widefield imaging could serve as a critical ‘bridge’ to high-resolution probe placement. An endoscopic platform combining the two modalities with a single vital-dye may facilitate point-of-care decision-making by providing real-time, in vivo diagnoses. PMID:22301343

Magnetic Polarization Measurements of the Multi-modal Plasma Response to 3D fields in the EAST Tokamak

DOE PAGES

Logan, Nikolas; Cui, L.; Wang, Hui -Hui; ...

2018-04-30

A multi-modal plasma response to applied non-axisymmetric fields has been found in EAST tokamak plasmas. Here, multi-modal means the radial and poloidal structure of an individually driven toroidal harmonic is not fixed. The signature of such a multi-modal response is the magnetic polarization (ratio of radial and poloidal components) of the plasma response field measured on the low field side device mid-plane. A difference in the 3D coil phasing (the relative phase of two coil arrays) dependencies between the two responses is observed in response to n=2 fields in the same plasma for which the n=1 responses are well synchronized.more » Neither the maximum radial nor the maximum poloidal field response to n=2 fields agrees with the best applied phasing for mitigating edge localized modes, suggesting that the edge plasma response is not a dominant component of either polarization. GPEC modeling reproduces the discrepant phasing dependences of the experimental measurements, and confirms the edge resonances are maximized by the coil phasing that mitigates ELMs in the experiments. The model confirms the measured plasma response is not dominated by resonant current drive from the external field. Instead, non-resonant contributions play a large role in the diagnostic signal for both toroidal harmonics n=1 and n=2. The analysis in this paper demonstrates the ability of 3D modeling to connect external magnetic sensor measurements to the internal plasma physics and accurately predict optimal applied 3D field configurations in multi-modal plasmas.« less

Importance of multi-modal approaches to effectively identify cataract cases from electronic health records

PubMed Central

Rasmussen, Luke V; Berg, Richard L; Linneman, James G; McCarty, Catherine A; Waudby, Carol; Chen, Lin; Denny, Joshua C; Wilke, Russell A; Pathak, Jyotishman; Carrell, David; Kho, Abel N; Starren, Justin B

2012-01-01

Objective There is increasing interest in using electronic health records (EHRs) to identify subjects for genomic association studies, due in part to the availability of large amounts of clinical data and the expected cost efficiencies of subject identification. We describe the construction and validation of an EHR-based algorithm to identify subjects with age-related cataracts. Materials and methods We used a multi-modal strategy consisting of structured database querying, natural language processing on free-text documents, and optical character recognition on scanned clinical images to identify cataract subjects and related cataract attributes. Extensive validation on 3657 subjects compared the multi-modal results to manual chart review. The algorithm was also implemented at participating electronic MEdical Records and GEnomics (eMERGE) institutions. Results An EHR-based cataract phenotyping algorithm was successfully developed and validated, resulting in positive predictive values (PPVs) >95%. The multi-modal approach increased the identification of cataract subject attributes by a factor of three compared to single-mode approaches while maintaining high PPV. Components of the cataract algorithm were successfully deployed at three other institutions with similar accuracy. Discussion A multi-modal strategy incorporating optical character recognition and natural language processing may increase the number of cases identified while maintaining similar PPVs. Such algorithms, however, require that the needed information be embedded within clinical documents. Conclusion We have demonstrated that algorithms to identify and characterize cataracts can be developed utilizing data collected via the EHR. These algorithms provide a high level of accuracy even when implemented across multiple EHRs and institutional boundaries. PMID:22319176

Magnetic Polarization Measurements of the Multi-modal Plasma Response to 3D fields in the EAST Tokamak

DOE Office of Scientific and Technical Information (OSTI.GOV)

Logan, Nikolas; Cui, L.; Wang, Hui -Hui

A multi-modal plasma response to applied non-axisymmetric fields has been found in EAST tokamak plasmas. Here, multi-modal means the radial and poloidal structure of an individually driven toroidal harmonic is not fixed. The signature of such a multi-modal response is the magnetic polarization (ratio of radial and poloidal components) of the plasma response field measured on the low field side device mid-plane. A difference in the 3D coil phasing (the relative phase of two coil arrays) dependencies between the two responses is observed in response to n=2 fields in the same plasma for which the n=1 responses are well synchronized.more » Neither the maximum radial nor the maximum poloidal field response to n=2 fields agrees with the best applied phasing for mitigating edge localized modes, suggesting that the edge plasma response is not a dominant component of either polarization. GPEC modeling reproduces the discrepant phasing dependences of the experimental measurements, and confirms the edge resonances are maximized by the coil phasing that mitigates ELMs in the experiments. The model confirms the measured plasma response is not dominated by resonant current drive from the external field. Instead, non-resonant contributions play a large role in the diagnostic signal for both toroidal harmonics n=1 and n=2. The analysis in this paper demonstrates the ability of 3D modeling to connect external magnetic sensor measurements to the internal plasma physics and accurately predict optimal applied 3D field configurations in multi-modal plasmas.« less

Multisensory Integration Strategy for Modality-Specific Loss of Inhibition Control in Older Adults

PubMed Central

Ryu, Hokyoung; Kim, Jae-Kwan; Jeong, Eunju

2018-01-01

Older adults are known to have lesser cognitive control capability and greater susceptibility to distraction than young adults. Previous studies have reported age-related problems in selective attention and inhibitory control, yielding mixed results depending on modality and context in which stimuli and tasks were presented. The purpose of the study was to empirically demonstrate a modality-specific loss of inhibitory control in processing audio-visual information with ageing. A group of 30 young adults (mean age = 25.23, Standard Deviation (SD) = 1.86) and 22 older adults (mean age = 55.91, SD = 4.92) performed the audio-visual contour identification task (AV-CIT). We compared performance of visual/auditory identification (Uni-V, Uni-A) with that of visual/auditory identification in the presence of distraction in counterpart modality (Multi-V, Multi-A). The findings showed a modality-specific effect on inhibitory control. Uni-V performance was significantly better than Multi-V, indicating that auditory distraction significantly hampered visual target identification. However, Multi-A performance was significantly enhanced compared to Uni-A, indicating that auditory target performance was significantly enhanced by visual distraction. Additional analysis showed an age-specific effect on enhancement between Uni-A and Multi-A depending on the level of visual inhibition. Together, our findings indicated that the loss of visual inhibitory control was beneficial for the auditory target identification presented in a multimodal context in older adults. A likely multisensory information processing strategy in the older adults was further discussed in relation to aged cognition. PMID:29641462

A Single Session of rTMS Enhances Small-Worldness in Writer's Cramp: Evidence from Simultaneous EEG-fMRI Multi-Modal Brain Graph.

PubMed

Bharath, Rose D; Panda, Rajanikant; Reddam, Venkateswara Reddy; Bhaskar, M V; Gohel, Suril; Bhardwaj, Sujas; Prajapati, Arvind; Pal, Pramod Kumar

2017-01-01

Background and Purpose : Repetitive transcranial magnetic stimulation (rTMS) induces widespread changes in brain connectivity. As the network topology differences induced by a single session of rTMS are less known we undertook this study to ascertain whether the network alterations had a small-world morphology using multi-modal graph theory analysis of simultaneous EEG-fMRI. Method : Simultaneous EEG-fMRI was acquired in duplicate before (R1) and after (R2) a single session of rTMS in 14 patients with Writer's Cramp (WC). Whole brain neuronal and hemodynamic network connectivity were explored using the graph theory measures and clustering coefficient, path length and small-world index were calculated for EEG and resting state fMRI (rsfMRI). Multi-modal graph theory analysis was used to evaluate the correlation of EEG and fMRI clustering coefficients. Result : A single session of rTMS was found to increase the clustering coefficient and small-worldness significantly in both EEG and fMRI ( p < 0.05). Multi-modal graph theory analysis revealed significant modulations in the fronto-parietal regions immediately after rTMS. The rsfMRI revealed additional modulations in several deep brain regions including cerebellum, insula and medial frontal lobe. Conclusion : Multi-modal graph theory analysis of simultaneous EEG-fMRI can supplement motor physiology methods in understanding the neurobiology of rTMS in vivo . Coinciding evidence from EEG and rsfMRI reports small-world morphology for the acute phase network hyper-connectivity indicating changes ensuing low-frequency rTMS is probably not "noise".

Multi-modal gesture recognition using integrated model of motion, audio and video

NASA Astrophysics Data System (ADS)

Goutsu, Yusuke; Kobayashi, Takaki; Obara, Junya; Kusajima, Ikuo; Takeichi, Kazunari; Takano, Wataru; Nakamura, Yoshihiko

2015-07-01

Gesture recognition is used in many practical applications such as human-robot interaction, medical rehabilitation and sign language. With increasing motion sensor development, multiple data sources have become available, which leads to the rise of multi-modal gesture recognition. Since our previous approach to gesture recognition depends on a unimodal system, it is difficult to classify similar motion patterns. In order to solve this problem, a novel approach which integrates motion, audio and video models is proposed by using dataset captured by Kinect. The proposed system can recognize observed gestures by using three models. Recognition results of three models are integrated by using the proposed framework and the output becomes the final result. The motion and audio models are learned by using Hidden Markov Model. Random Forest which is the video classifier is used to learn the video model. In the experiments to test the performances of the proposed system, the motion and audio models most suitable for gesture recognition are chosen by varying feature vectors and learning methods. Additionally, the unimodal and multi-modal models are compared with respect to recognition accuracy. All the experiments are conducted on dataset provided by the competition organizer of MMGRC, which is a workshop for Multi-Modal Gesture Recognition Challenge. The comparison results show that the multi-modal model composed of three models scores the highest recognition rate. This improvement of recognition accuracy means that the complementary relationship among three models improves the accuracy of gesture recognition. The proposed system provides the application technology to understand human actions of daily life more precisely.

Increasing knowledge of best practices for occupational therapists treating post-stroke unilateral spatial neglect: results of a knowledge-translation intervention study.

PubMed

Petzold, Anita; Korner-Bitensky, Nicol; Salbach, Nancy M; Ahmed, Sara; Menon, Anita; Ogourtsova, Tatiana

2012-02-01

The aim of this study was to investigate: (i) the feasibility of delivering a multi-modal knowledge translation intervention specific to the management of acute post-stroke unilateral spatial neglect; and (ii) the impact of the knowledge translation intervention on occupational therapists' knowledge of evidence-based unilateral spatial neglect problem identification, assessment and treatment, and self-efficacy related to evidence-based practice implementation. A 3-period (pre-post) repeated measures design. Acute care occupational therapists treating patients with post-stroke unilateral spatial neglect were recruited from two major Canadian cities. Participants completed two pre-intervention assessments, took part in a day-long interactive multi-modal knowledge translation intervention and a subsequent 8-week follow-up, and completed a post-intervention assessment. Knowledge of evidence-based problem identification, assessment and treatment of unilateral spatial neglect, and self-efficacy to perform evidence-based practice activities were measured using standard scales. The intervention was tested on 20 occupational therapists. Results indicate a significant improvement in knowledge of best practice unilateral spatial neglect management (p < 0.000) and evidence-based practice self-efficacy in carrying out evidence-based practice activities (p < 0.045) post-intervention. Use of a multi-modal knowledge translation intervention is feasible and can significantly improve occupational therapists' knowledge of unilateral spatial neglect best practices and self-efficacy. The findings should help advance best practices specific to the management of post-stroke unilateral spatial neglect as well as informing knowledge translation studies in other areas of practice.

Deep Convolutional Neural Networks for Multi-Modality Isointense Infant Brain Image Segmentation

PubMed Central

Zhang, Wenlu; Li, Rongjian; Deng, Houtao; Wang, Li; Lin, Weili; Ji, Shuiwang; Shen, Dinggang

2015-01-01

The segmentation of infant brain tissue images into white matter (WM), gray matter (GM), and cerebrospinal fluid (CSF) plays an important role in studying early brain development in health and disease. In the isointense stage (approximately 6–8 months of age), WM and GM exhibit similar levels of intensity in both T1 and T2 MR images, making the tissue segmentation very challenging. Only a small number of existing methods have been designed for tissue segmentation in this isointense stage; however, they only used a single T1 or T2 images, or the combination of T1 and T2 images. In this paper, we propose to use deep convolutional neural networks (CNNs) for segmenting isointense stage brain tissues using multi-modality MR images. CNNs are a type of deep models in which trainable filters and local neighborhood pooling operations are applied alternatingly on the raw input images, resulting in a hierarchy of increasingly complex features. Specifically, we used multimodality information from T1, T2, and fractional anisotropy (FA) images as inputs and then generated the segmentation maps as outputs. The multiple intermediate layers applied convolution, pooling, normalization, and other operations to capture the highly nonlinear mappings between inputs and outputs. We compared the performance of our approach with that of the commonly used segmentation methods on a set of manually segmented isointense stage brain images. Results showed that our proposed model significantly outperformed prior methods on infant brain tissue segmentation. In addition, our results indicated that integration of multi-modality images led to significant performance improvement. PMID:25562829

Multishaker modal testing

NASA Technical Reports Server (NTRS)

Craig, Roy R., Jr.

1987-01-01

The major accomplishments of this research are: (1) the refinement and documentation of a multi-input, multi-output modal parameter estimation algorithm which is applicable to general linear, time-invariant dynamic systems; (2) the development and testing of an unsymmetric block-Lanzcos algorithm for reduced-order modeling of linear systems with arbitrary damping; and (3) the development of a control-structure-interaction (CSI) test facility.

Final Technical Report

DOE Office of Scientific and Technical Information (OSTI.GOV)

Rasure, John, et. al.

Through past DOE funding, the MIND Research network has funded a national consortium effort that used multi-modal neuroimaging, genetics, and clinical assessment of subjects to study schizophrenia in both first episode and persistently ill patients. Although active recruitment of research participants is complete, this consortium remains active and productive in terms of analysis of this unique multi-modal data collected on over 320 subjects.

Multi-Modal Interaction for Robotic Mules

DTIC Science & Technology

2014-02-26

Multi-Modal Interaction for Robotic Mules Glenn Taylor, Mike Quist, Matt Lanting, Cory Dunham , Patrick Theisen, Paul Muench Abstract...Taylor, Mike Quist, Matt Lanting, Cory Dunham , and Patrick Theisen are with Soar Technology, Inc. (corresponding author: 734-887- 7620; email: glenn...soartech.com; quist@soartech.com; matt.lanting@soartech.com; dunham @soartech.com; patrick.theisen@soartech.com Paul Muench is with US Army TARDEC

Ships/Trains/Planes/Automobiles: A Renaissance of their Interface

NASA Technical Reports Server (NTRS)

Allan, Stanley N.

1974-01-01

This paper highlights some of the major multi-modal interface problems created by technological advances, socio-political individualism and the flexibility of choices we expect from our transportation modes. The emphasis is on the need for a comprehensive national network of multi-modal priorities to enhance the movement of people and goods within the changing physical shape of our cities.

Effect of Multi Modal Representations on the Critical Thinking Skills of the Fifth Grade Students

ERIC Educational Resources Information Center

Öz, Muhittin; Memis, Esra Kabatas

2018-01-01

The purpose of this study was to explore the effects of multi modal representations within writing to learn activities on students' critical thinking. Mixed method was used. The participants included 32 students 5th grade from elementary school. The groups were randomly selected as a control group and the other class was selected as the…

A Multi-Modal Face Recognition Method Using Complete Local Derivative Patterns and Depth Maps

PubMed Central

Yin, Shouyi; Dai, Xu; Ouyang, Peng; Liu, Leibo; Wei, Shaojun

2014-01-01

In this paper, we propose a multi-modal 2D + 3D face recognition method for a smart city application based on a Wireless Sensor Network (WSN) and various kinds of sensors. Depth maps are exploited for the 3D face representation. As for feature extraction, we propose a new feature called Complete Local Derivative Pattern (CLDP). It adopts the idea of layering and has four layers. In the whole system, we apply CLDP separately on Gabor features extracted from a 2D image and depth map. Then, we obtain two features: CLDP-Gabor and CLDP-Depth. The two features weighted by the corresponding coefficients are combined together in the decision level to compute the total classification distance. At last, the probe face is assigned the identity with the smallest classification distance. Extensive experiments are conducted on three different databases. The results demonstrate the robustness and superiority of the new approach. The experimental results also prove that the proposed multi-modal 2D + 3D method is superior to other multi-modal ones and CLDP performs better than other Local Binary Pattern (LBP) based features. PMID:25333290

Quantitative multi-modal NDT data analysis

DOE Office of Scientific and Technical Information (OSTI.GOV)

Heideklang, René; Shokouhi, Parisa

2014-02-18

A single NDT technique is often not adequate to provide assessments about the integrity of test objects with the required coverage or accuracy. In such situations, it is often resorted to multi-modal testing, where complementary and overlapping information from different NDT techniques are combined for a more comprehensive evaluation. Multi-modal material and defect characterization is an interesting task which involves several diverse fields of research, including signal and image processing, statistics and data mining. The fusion of different modalities may improve quantitative nondestructive evaluation by effectively exploiting the augmented set of multi-sensor information about the material. It is the redundantmore » information in particular, whose quantification is expected to lead to increased reliability and robustness of the inspection results. There are different systematic approaches to data fusion, each with its specific advantages and drawbacks. In our contribution, these will be discussed in the context of nondestructive materials testing. A practical study adopting a high-level scheme for the fusion of Eddy Current, GMR and Thermography measurements on a reference metallic specimen with built-in grooves will be presented. Results show that fusion is able to outperform the best single sensor regarding detection specificity, while retaining the same level of sensitivity.« less

Comparison study of five different display modalities for whole slide images in surgical pathology and cytopathology in Europe

NASA Astrophysics Data System (ADS)

D'Haene, Nicky; Maris, Calliope; Rorive, Sandrine; Moles Lopez, Xavier; Rostang, Johan; Marchessoux, Cédric; Pantanowitz, Liron; Parwani, Anil V.; Salmon, Isabelle

2013-03-01

User experience with viewing images in pathology is crucial for accurate interpretation and diagnosis. With digital pathology, images are being read on a display system, and this poses new types of questions: such as what is the difference in terms of pixelation, refresh lag or obscured features compared to an optical microscope. Is there a resultant change in user performance in terms of speed of slide review, perception of adequacy and quality or in diagnostic confidence? A prior psychophysical study was carried out comparing various display modalities on whole slide imaging (WSI) in pathology at the University of Pittsburgh Medical Center (UPMC) in the USA. This prior study compared professional and non-professional grade display modalities and highlighted the importance of using a medical grade display to view pathological digital images. This study was duplicated in Europe at the Department of Pathology in Erasme Hospital (Université Libre de Bruxelles (ULB)) in an attempt to corroborate these findings. Digital WSI with corresponding glass slides of 58 cases including surgical pathology and cytopathology slides of varying difficulty were employed. Similar non-professional and professional grade display modalities were compared to an optical microscope (Olympus BX51). Displays ranged from a laptop (DELL Latitude D620), to a consumer grade display (DELL E248WFPb), to two professional grade monitors (Eizo CG245W and Barco MDCC-6130). Three pathologists were selected from the Department of Pathology in Erasme Hospital (ULB) in Belgium to view and interpret the pathological images on these different displays. The results show that non-professional grade displays (laptop and consumer) have inferior user experience compared to professional grade monitors and the optical microscope.

MIND: modality independent neighbourhood descriptor for multi-modal deformable registration.

PubMed

Heinrich, Mattias P; Jenkinson, Mark; Bhushan, Manav; Matin, Tahreema; Gleeson, Fergus V; Brady, Sir Michael; Schnabel, Julia A

2012-10-01

Deformable registration of images obtained from different modalities remains a challenging task in medical image analysis. This paper addresses this important problem and proposes a modality independent neighbourhood descriptor (MIND) for both linear and deformable multi-modal registration. Based on the similarity of small image patches within one image, it aims to extract the distinctive structure in a local neighbourhood, which is preserved across modalities. The descriptor is based on the concept of image self-similarity, which has been introduced for non-local means filtering for image denoising. It is able to distinguish between different types of features such as corners, edges and homogeneously textured regions. MIND is robust to the most considerable differences between modalities: non-functional intensity relations, image noise and non-uniform bias fields. The multi-dimensional descriptor can be efficiently computed in a dense fashion across the whole image and provides point-wise local similarity across modalities based on the absolute or squared difference between descriptors, making it applicable for a wide range of transformation models and optimisation algorithms. We use the sum of squared differences of the MIND representations of the images as a similarity metric within a symmetric non-parametric Gauss-Newton registration framework. In principle, MIND would be applicable to the registration of arbitrary modalities. In this work, we apply and validate it for the registration of clinical 3D thoracic CT scans between inhale and exhale as well as the alignment of 3D CT and MRI scans. Experimental results show the advantages of MIND over state-of-the-art techniques such as conditional mutual information and entropy images, with respect to clinically annotated landmark locations. Copyright © 2012 Elsevier B.V. All rights reserved.

The evolution of gadolinium based contrast agents: from single-modality to multi-modality

NASA Astrophysics Data System (ADS)

Zhang, Li; Liu, Ruiqing; Peng, Hui; Li, Penghui; Xu, Zushun; Whittaker, Andrew K.

2016-05-01

Gadolinium-based contrast agents are extensively used as magnetic resonance imaging (MRI) contrast agents due to their outstanding signal enhancement and ease of chemical modification. However, it is increasingly recognized that information obtained from single modal molecular imaging cannot satisfy the higher requirements on the efficiency and accuracy for clinical diagnosis and medical research, due to its limitation and default rooted in single molecular imaging technique itself. To compensate for the deficiencies of single function magnetic resonance imaging contrast agents, the combination of multi-modality imaging has turned to be the research hotpot in recent years. This review presents an overview on the recent developments of the functionalization of gadolinium-based contrast agents, and their application in biomedicine applications.

Combined multi-modal photoacoustic tomography, optical coherence tomography (OCT) and OCT angiography system with an articulated probe for in vivo human skin structure and vasculature imaging

PubMed Central

Liu, Mengyang; Chen, Zhe; Zabihian, Behrooz; Sinz, Christoph; Zhang, Edward; Beard, Paul C.; Ginner, Laurin; Hoover, Erich; Minneman, Micheal P.; Leitgeb, Rainer A.; Kittler, Harald; Drexler, Wolfgang

2016-01-01

Cutaneous blood flow accounts for approximately 5% of cardiac output in human and plays a key role in a number of a physiological and pathological processes. We show for the first time a multi-modal photoacoustic tomography (PAT), optical coherence tomography (OCT) and OCT angiography system with an articulated probe to extract human cutaneous vasculature in vivo in various skin regions. OCT angiography supplements the microvasculature which PAT alone is unable to provide. Co-registered volumes for vessel network is further embedded in the morphologic image provided by OCT. This multi-modal system is therefore demonstrated as a valuable tool for comprehensive non-invasive human skin vasculature and morphology imaging in vivo. PMID:27699106

Advances in Induced Pluripotent Stem Cells, Genomics, Biomarkers, and Antiplatelet Therapy

PubMed Central

Barbato, Emanuele; Lara-Pezzi, Enrique; Stolen, Craig; Taylor, Angela; Barton, Paul J.; Bartunek, Jozef; Iaizzo, Paul; Judge, Daniel P.; Kirshenbaum, Lorrie; Blaxall, Burns C.; Terzic, Andre; Hall, Jennifer L.

2014-01-01

The Journal provides the clinician and scientist with the latest advances in discovery research, emerging technologies, pre-clinical research design and testing, and clinical trials. We highlight advances in areas of induced pluripotent stem cells, genomics, biomarkers, multi-modality imaging and antiplatelet biology and therapy. The top publications are critically discussed and presented along with anatomical reviews and FDA insight to provide context. PMID:24659088

Design of graded refractive index profile for silica multimode optical fibers with improved effective modal bandwidth for short-distance laser-based multi-Gigabit data transmission over "O"-band

NASA Astrophysics Data System (ADS)

Bourdine, Anton V.; Zhukov, Alexander E.

2017-04-01

High bit rate laser-based data transmission over silica optical fibers with enlarged core diameter in comparison with standard singlemode fibers is found variety infocommunication applications. Since IEEE 802.3z standard was ratified on 1998 this technique started to be widely used for short-range in-premises distributed multi-Gigabit networks based on new generation laser optimized multimode fibers 50/125 of Cat. OM2…OM4. Nowadays it becomes to be in demand for on-board cable systems and industrial network applications requiring 1Gps and more bit rates over fibers with extremely enlarged core diameter up to 100 μm. This work presents an alternative method for design the special refractive index profiles of silica few-mode fibers with extremely enlarged core diameter, that provides modal bandwidth enhancing under a few-mode regime of laser-based data optical transmission. Here some results are presented concerning with refractive index profile synthesis for few-mode fibers with reduced differential mode delay for "O"-band central region, as well as computed differential mode delay spectral curves corresponding to profiles for fibers 50/125 and 100/125 for in-premises and on-board/industrial cable systems.

Noncontact Sleep Study by Multi-Modal Sensor Fusion.

PubMed

Chung, Ku-Young; Song, Kwangsub; Shin, Kangsoo; Sohn, Jinho; Cho, Seok Hyun; Chang, Joon-Hyuk

2017-07-21

Polysomnography (PSG) is considered as the gold standard for determining sleep stages, but due to the obtrusiveness of its sensor attachments, sleep stage classification algorithms using noninvasive sensors have been developed throughout the years. However, the previous studies have not yet been proven reliable. In addition, most of the products are designed for healthy customers rather than for patients with sleep disorder. We present a novel approach to classify sleep stages via low cost and noncontact multi-modal sensor fusion, which extracts sleep-related vital signals from radar signals and a sound-based context-awareness technique. This work is uniquely designed based on the PSG data of sleep disorder patients, which were received and certified by professionals at Hanyang University Hospital. The proposed algorithm further incorporates medical/statistical knowledge to determine personal-adjusted thresholds and devise post-processing. The efficiency of the proposed algorithm is highlighted by contrasting sleep stage classification performance between single sensor and sensor-fusion algorithms. To validate the possibility of commercializing this work, the classification results of this algorithm were compared with the commercialized sleep monitoring device, ResMed S+. The proposed algorithm was investigated with random patients following PSG examination, and results show a promising novel approach for determining sleep stages in a low cost and unobtrusive manner.

Noncontact Sleep Study by Multi-Modal Sensor Fusion

PubMed Central

Chung, Ku-young; Song, Kwangsub; Shin, Kangsoo; Sohn, Jinho; Cho, Seok Hyun; Chang, Joon-Hyuk

2017-01-01

Polysomnography (PSG) is considered as the gold standard for determining sleep stages, but due to the obtrusiveness of its sensor attachments, sleep stage classification algorithms using noninvasive sensors have been developed throughout the years. However, the previous studies have not yet been proven reliable. In addition, most of the products are designed for healthy customers rather than for patients with sleep disorder. We present a novel approach to classify sleep stages via low cost and noncontact multi-modal sensor fusion, which extracts sleep-related vital signals from radar signals and a sound-based context-awareness technique. This work is uniquely designed based on the PSG data of sleep disorder patients, which were received and certified by professionals at Hanyang University Hospital. The proposed algorithm further incorporates medical/statistical knowledge to determine personal-adjusted thresholds and devise post-processing. The efficiency of the proposed algorithm is highlighted by contrasting sleep stage classification performance between single sensor and sensor-fusion algorithms. To validate the possibility of commercializing this work, the classification results of this algorithm were compared with the commercialized sleep monitoring device, ResMed S+. The proposed algorithm was investigated with random patients following PSG examination, and results show a promising novel approach for determining sleep stages in a low cost and unobtrusive manner. PMID:28753994

Modal Identification in an Automotive Multi-Component System Using HS 3D-DIC

PubMed Central

López-Alba, Elías; Felipe-Sesé, Luis; Díaz, Francisco A.

2018-01-01

The modal characterization of automotive lighting systems becomes difficult using sensors due to the light weight of the elements which compose the component as well as the intricate access to allocate them. In experimental modal analysis, high speed 3D digital image correlation (HS 3D-DIC) is attracting the attention since it provides full-field contactless measurements of 3D displacements as main advantage over other techniques. Different methodologies have been published that perform modal identification, i.e., natural frequencies, damping ratios, and mode shapes using the full-field information. In this work, experimental modal analysis has been performed in a multi-component automotive lighting system using HS 3D-DIC. Base motion excitation was applied to simulate operating conditions. A recently validated methodology has been employed for modal identification using transmissibility functions, i.e., the transfer functions from base motion tests. Results make it possible to identify local and global behavior of the different elements of injected polymeric and metallic materials. PMID:29401725

Quantitative optical imaging and sensing by joint design of point spread functions and estimation algorithms

NASA Astrophysics Data System (ADS)

Quirin, Sean Albert

The joint application of tailored optical Point Spread Functions (PSF) and estimation methods is an important tool for designing quantitative imaging and sensing solutions. By enhancing the information transfer encoded by the optical waves into an image, matched post-processing algorithms are able to complete tasks with improved performance relative to conventional designs. In this thesis, new engineered PSF solutions with image processing algorithms are introduced and demonstrated for quantitative imaging using information-efficient signal processing tools and/or optical-efficient experimental implementations. The use of a 3D engineered PSF, the Double-Helix (DH-PSF), is applied as one solution for three-dimensional, super-resolution fluorescence microscopy. The DH-PSF is a tailored PSF which was engineered to have enhanced information transfer for the task of localizing point sources in three dimensions. Both an information- and optical-efficient implementation of the DH-PSF microscope are demonstrated here for the first time. This microscope is applied to image single-molecules and micro-tubules located within a biological sample. A joint imaging/axial-ranging modality is demonstrated for application to quantifying sources of extended transverse and axial extent. The proposed implementation has improved optical-efficiency relative to prior designs due to the use of serialized cycling through select engineered PSFs. This system is demonstrated for passive-ranging, extended Depth-of-Field imaging and digital refocusing of random objects under broadband illumination. Although the serialized engineered PSF solution is an improvement over prior designs for the joint imaging/passive-ranging modality, it requires the use of multiple PSFs---a potentially significant constraint. Therefore an alternative design is proposed, the Single-Helix PSF, where only one engineered PSF is necessary and the chromatic behavior of objects under broadband illumination provides the necessary information transfer. The matched estimation algorithms are introduced along with an optically-efficient experimental system to image and passively estimate the distance to a test object. An engineered PSF solution is proposed for improving the sensitivity of optical wave-front sensing using a Shack-Hartmann Wave-front Sensor (SHWFS). The performance limits of the classical SHWFS design are evaluated and the engineered PSF system design is demonstrated to enhance performance. This system is fabricated and the mechanism for additional information transfer is identified.

Automated SEM Modal Analysis Applied to the Diogenites

NASA Technical Reports Server (NTRS)

Bowman, L. E.; Spilde, M. N.; Papike, James J.

1996-01-01

Analysis of volume proportions of minerals, or modal analysis, is routinely accomplished by point counting on an optical microscope, but the process, particularly on brecciated samples such as the diogenite meteorites, is tedious and prone to error by misidentification of very small fragments, which may make up a significant volume of the sample. Precise volume percentage data can be gathered on a scanning electron microscope (SEM) utilizing digital imaging and an energy dispersive spectrometer (EDS). This form of automated phase analysis reduces error, and at the same time provides more information than could be gathered using simple point counting alone, such as particle morphology statistics and chemical analyses. We have previously studied major, minor, and trace-element chemistry of orthopyroxene from a suite of diogenites. This abstract describes the method applied to determine the modes on this same suite of meteorites and the results of that research. The modal abundances thus determined add additional information on the petrogenesis of the diogenites. In addition, low-abundance phases such as spinels were located for further analysis by this method.

Epi-detected quadruple-modal nonlinear optical microscopy for label-free imaging of the tooth

DOE Office of Scientific and Technical Information (OSTI.GOV)

Wang, Zi; Zheng, Wei; Huang, Zhiwei, E-mail: biehzw@nus.edu.sg

2015-01-19

We present an epi-detected quadruple-modal nonlinear optical microscopic imaging technique (i.e., coherent anti-Stokes Raman scattering (CARS), second-harmonic generation (SHG), third-harmonic generation (THG), and two-photon excited fluorescence (TPEF)) based on a picosecond (ps) laser-pumped optical parametric oscillator system for label-free imaging of the tooth. We demonstrate that high contrast ps-CARS images covering both the fingerprint (500–1800 cm{sup −1}) and high-wavenumber (2500–3800 cm{sup −1}) regions can be acquired to uncover the distributions of mineral and organic biomaterials in the tooth, while high quality TPEF, SHG, and THG images of the tooth can also be acquired under ps laser excitation without damaging the samples. Themore » quadruple-modal nonlinear microscopic images (CARS/SHG/THG/TPEF) acquired provide better understanding of morphological structures and biochemical/biomolecular distributions in the dentin, enamel, and the dentin-enamel junction of the tooth without labeling, facilitating optical diagnosis and characterization of the tooth in dentistry.« less

Data Processing And Machine Learning Methods For Multi-Modal Operator State Classification Systems

NASA Technical Reports Server (NTRS)

Hearn, Tristan A.

2015-01-01

This document is intended as an introduction to a set of common signal processing learning methods that may be used in the software portion of a functional crew state monitoring system. This includes overviews of both the theory of the methods involved, as well as examples of implementation. Practical considerations are discussed for implementing modular, flexible, and scalable processing and classification software for a multi-modal, multi-channel monitoring system. Example source code is also given for all of the discussed processing and classification methods.

Effective Beginning Handwriting Instruction: Multi-Modal, Consistent Format for 2 Years, and Linked to Spelling and Composing

ERIC Educational Resources Information Center

Wolf, Beverly; Abbott, Robert D.; Berninger, Virginia W.

2017-01-01

In Study 1, the treatment group (N = 33 first graders, M = 6 years 10 months, 16 girls) received Slingerland multi-modal (auditory, visual, tactile, motor through hand, and motor through mouth) manuscript (unjoined) handwriting instruction embedded in systematic spelling, reading, and composing lessons; and the control group (N = 16 first graders,…

Providing University Education in Physical Geography across the South Pacific Islands: Multi-Modal Course Delivery and Student Grade Performance

ERIC Educational Resources Information Center

Terry, James P.; Poole, Brian

2012-01-01

Enormous distances across the vast South Pacific hinder student access to the main Fiji campus of the regional tertiary education provider, the University of the South Pacific (USP). Fortunately, USP has been a pioneer in distance education (DE) and promotes multi-modal delivery of programmes. Geography has embraced DE, but doubts remain about…

Mid-Infrared Quantum-Dot Quantum Cascade Laser: A Theoretical Feasibility Study

DOE PAGES

Michael, Stephan; Chow, Weng; Schneider, Hans

2016-05-01

In the framework of a microscopic model for intersubband gain from electrically pumped quantum-dot structures we investigate electrically pumped quantum-dots as active material for a mid-infrared quantum cascade laser. Our previous calculations have indicated that these structures could operate with reduced threshold current densities while also achieving a modal gain comparable to that of quantum well active materials. We study the influence of two important quantum-dot material parameters, here, namely inhomogeneous broadening and quantum-dot sheet density, on the performance of a proposed quantum cascade laser design. In terms of achieving a positive modal net gain, a high quantum-dot density canmore » compensate for moderately high inhomogeneous broadening, but at a cost of increased threshold current density. By minimizing quantum-dot density with presently achievable inhomogeneous broadening and total losses, significantly lower threshold densities than those reported in quantum-well quantum-cascade lasers are predicted by our theory.« less

Fiber-optic fluorescence imaging

PubMed Central

Flusberg, Benjamin A; Cocker, Eric D; Piyawattanametha, Wibool; Jung, Juergen C; Cheung, Eunice L M; Schnitzer, Mark J

2010-01-01

Optical fibers guide light between separate locations and enable new types of fluorescence imaging. Fiber-optic fluorescence imaging systems include portable handheld microscopes, flexible endoscopes well suited for imaging within hollow tissue cavities and microendoscopes that allow minimally invasive high-resolution imaging deep within tissue. A challenge in the creation of such devices is the design and integration of miniaturized optical and mechanical components. Until recently, fiber-based fluorescence imaging was mainly limited to epifluorescence and scanning confocal modalities. Two new classes of photonic crystal fiber facilitate ultrashort pulse delivery for fiber-optic two-photon fluorescence imaging. An upcoming generation of fluorescence imaging devices will be based on microfabricated device components. PMID:16299479

Three dimensional profile measurement using multi-channel detector MVM-SEM

NASA Astrophysics Data System (ADS)

Yoshikawa, Makoto; Harada, Sumito; Ito, Keisuke; Murakawa, Tsutomu; Shida, Soichi; Matsumoto, Jun; Nakamura, Takayuki

2014-07-01

In next generation lithography (NGL) for the 1x nm node and beyond, the three dimensional (3D) shape measurements such as side wall angle (SWA) and height of feature on photomask become more critical for the process control. Until today, AFM (Atomic Force Microscope), X-SEM (cross-section Scanning Electron Microscope) and TEM (Transmission Electron Microscope) tools are normally used for 3D measurements, however, these techniques require time-consuming preparation and observation. And both X-SEM and TEM are destructive measurement techniques. This paper presents a technology for quick and non-destructive 3D shape analysis using multi-channel detector MVM-SEM (Multi Vision Metrology SEM), and also reports its accuracy and precision.

Magnetic polarization measurements of the multi-modal plasma response to 3D fields in the EAST tokamak

NASA Astrophysics Data System (ADS)

Logan, N. C.; Cui, L.; Wang, H.; Sun, Y.; Gu, S.; Li, G.; Nazikian, R.; Paz-Soldan, C.

2018-07-01

A multi-modal plasma response to applied non-axisymmetric fields has been found in EAST tokamak plasmas. Here, multi-modal means the radial and poloidal structure of an individually driven toroidal harmonic is not fixed. The signature of such a multi-modal response is the magnetic polarization (ratio of radial and poloidal components) of the plasma response field measured on the low field side device mid-plane. A difference in the 3D coil phasing (the relative phase of two coil arrays) dependencies between the two responses is observed in response to n  =  2 fields in the same plasma for which the n  =  1 responses are well synchronized. Neither the maximum radial nor the maximum poloidal field response to n  =  2 fields agrees with the best applied phasing for mitigating edge localized modes, suggesting that the edge plasma response is not a dominant component of either polarization. GPEC modeling reproduces the discrepant phasing dependences of the experimental measurements, and confirms the edge resonances are maximized by the coil phasing that mitigates ELMs in the experiments. The model confirms the measured plasma response is not dominated by resonant current drive from the external field. Instead, non-resonant contributions play a large role in the diagnostic signal for both toroidal harmonics n  =  1 and n  =  2. The analysis in this paper demonstrates the ability of 3D modeling to connect external magnetic sensor measurements to the internal plasma physics and accurately predict optimal applied 3D field configurations in multi-modal plasmas.

Primary prevention of cannabis use: a systematic review of randomized controlled trials.

PubMed

Norberg, Melissa M; Kezelman, Sarah; Lim-Howe, Nicholas

2013-01-01

A systematic review of primary prevention was conducted for cannabis use outcomes in youth and young adults. The aim of the review was to develop a comprehensive understanding of prevention programming by assessing universal, targeted, uni-modal, and multi-modal approaches as well as individual program characteristics. Twenty-eight articles, representing 25 unique studies, identified from eight electronic databases (EMBASE, MEDLINE, CINAHL, ERIC, PsycINFO, DRUG, EBM Reviews, and Project CORK), were eligible for inclusion. Results indicated that primary prevention programs can be effective in reducing cannabis use in youth populations, with statistically significant effect sizes ranging from trivial (0.07) to extremely large (5.26), with the majority of significant effect sizes being trivial to small. Given that the preponderance of significant effect sizes were trivial to small and that percentages of statistically significant and non-statistically significant findings were often equivalent across program type and individual components, the effectiveness of primary prevention for cannabis use should be interpreted with caution. Universal multi-modal programs appeared to outperform other program types (i.e, universal uni-modal, targeted multi-modal, targeted unimodal). Specifically, universal multi-modal programs that targeted early adolescents (10-13 year olds), utilised non-teacher or multiple facilitators, were short in duration (10 sessions or less), and implemented boosters sessions were associated with large median effect sizes. While there were studies in these areas that contradicted these results, the results highlight the importance of assessing the interdependent relationship of program components and program types. Finally, results indicated that the overall quality of included studies was poor, with an average quality rating of 4.64 out of 9. Thus, further quality research and reporting and the development of new innovative programs are required.

Primary Prevention of Cannabis Use: A Systematic Review of Randomized Controlled Trials

PubMed Central

Norberg, Melissa M.; Kezelman, Sarah; Lim-Howe, Nicholas

2013-01-01

A systematic review of primary prevention was conducted for cannabis use outcomes in youth and young adults. The aim of the review was to develop a comprehensive understanding of prevention programming by assessing universal, targeted, uni-modal, and multi-modal approaches as well as individual program characteristics. Twenty-eight articles, representing 25 unique studies, identified from eight electronic databases (EMBASE, MEDLINE, CINAHL, ERIC, PsycINFO, DRUG, EBM Reviews, and Project CORK), were eligible for inclusion. Results indicated that primary prevention programs can be effective in reducing cannabis use in youth populations, with statistically significant effect sizes ranging from trivial (0.07) to extremely large (5.26), with the majority of significant effect sizes being trivial to small. Given that the preponderance of significant effect sizes were trivial to small and that percentages of statistically significant and non-statistically significant findings were often equivalent across program type and individual components, the effectiveness of primary prevention for cannabis use should be interpreted with caution. Universal multi-modal programs appeared to outperform other program types (i.e, universal uni-modal, targeted multi-modal, targeted unimodal). Specifically, universal multi-modal programs that targeted early adolescents (10–13 year olds), utilised non-teacher or multiple facilitators, were short in duration (10 sessions or less), and implemented boosters sessions were associated with large median effect sizes. While there were studies in these areas that contradicted these results, the results highlight the importance of assessing the interdependent relationship of program components and program types. Finally, results indicated that the overall quality of included studies was poor, with an average quality rating of 4.64 out of 9. Thus, further quality research and reporting and the development of new innovative programs are required. PMID:23326396

Multishaker modal testing

NASA Technical Reports Server (NTRS)

Craig, R. R., Jr.

1983-01-01

Procedures for improving the modal modeling of structures using test data and to determine appropriate analytical models based on substructure experimental data were explored. Two related research topics were considered in modal modeling: using several independently acquired columns of frequency response data, and modal modeling using simultaneous multi-point excitation. In component mode synthesis modeling, the emphasis is on determining the best way to employ complex modes and residuals.

Acta Aeronautica et Astronautica Sinica,

DTIC Science & Technology

1983-07-28

substructural analysis in modal synthesis - two improved substructural assembling techniques 49 9-node quadrilateral isoparametric element 64 Application of laser...Time from Service Data, J. Aircraft, Vol. 15, No. 11, 1978. 48 MULTI-LEVEL SUBSTRUCTURAL ANALYSIS IN MODAL SYNTHESIS -- TWO IMPROVED SUBSTRUCTURAL...34 Modal Synthesis in Structural Dynamic Analysis ," Naching Institute of Aeronautics and Astronautics, 1979. 62a 8. Chang Te-wen, "Free-Interface Modal

Hybrid optical acoustic seafloor mapping

NASA Astrophysics Data System (ADS)

Inglis, Gabrielle

The oceanographic research and industrial communities have a persistent demand for detailed three dimensional sea floor maps which convey both shape and texture. Such data products are used for archeology, geology, ship inspection, biology, and habitat classification. There are a variety of sensing modalities and processing techniques available to produce these maps and each have their own potential benefits and related challenges. Multibeam sonar and stereo vision are such two sensors with complementary strengths making them ideally suited for data fusion. Data fusion approaches however, have seen only limited application to underwater mapping and there are no established methods for creating hybrid, 3D reconstructions from two underwater sensing modalities. This thesis develops a processing pipeline to synthesize hybrid maps from multi-modal survey data. It is helpful to think of this processing pipeline as having two distinct phases: Navigation Refinement and Map Construction. This thesis extends existing work in underwater navigation refinement by incorporating methods which increase measurement consistency between both multibeam and camera. The result is a self consistent 3D point cloud comprised of camera and multibeam measurements. In map construction phase, a subset of the multi-modal point cloud retaining the best characteristics of each sensor is selected to be part of the final map. To quantify the desired traits of a map several characteristics of a useful map are distilled into specific criteria. The different ways that hybrid maps can address these criteria provides justification for producing them as an alternative to current methodologies. The processing pipeline implements multi-modal data fusion and outlier rejection with emphasis on different aspects of map fidelity. The resulting point cloud is evaluated in terms of how well it addresses the map criteria. The final hybrid maps retain the strengths of both sensors and show significant improvement over the single modality maps and naively assembled multi-modal maps.

Statistical modeling of SRAM yield performance and circuit variability

NASA Astrophysics Data System (ADS)

Cheng, Qi; Chen, Yijian

2015-03-01

In this paper, we develop statistical models to investigate SRAM yield performance and circuit variability in the presence of self-aligned multiple patterning (SAMP) process. It is assumed that SRAM fins are fabricated by a positivetone (spacer is line) self-aligned sextuple patterning (SASP) process which accommodates two types of spacers, while gates are fabricated by a more pitch-relaxed self-aligned quadruple patterning (SAQP) process which only allows one type of spacer. A number of possible inverter and SRAM structures are identified and the related circuit multi-modality is studied using the developed failure-probability and yield models. It is shown that SRAM circuit yield is significantly impacted by the multi-modality of fins' spatial variations in a SRAM cell. The sensitivity of 6-transistor SRAM read/write failure probability to SASP process variations is calculated and the specific circuit type with the highest probability to fail in the reading/writing operation is identified. Our study suggests that the 6-transistor SRAM configuration may not be scalable to 7-nm half pitch and more robust SRAM circuit design needs to be researched.

Improved estimation of random vibration loads in launch vehicles

NASA Technical Reports Server (NTRS)

Mehta, R.; Erwin, E.; Suryanarayan, S.; Krishna, Murali M. R.

1993-01-01

Random vibration induced load is an important component of the total design load environment for payload and launch vehicle components and their support structures. The current approach to random vibration load estimation is based, particularly at the preliminary design stage, on the use of Miles' equation which assumes a single degree-of-freedom (DOF) system and white noise excitation. This paper examines the implications of the use of multi-DOF system models and response calculation based on numerical integration using the actual excitation spectra for random vibration load estimation. The analytical study presented considers a two-DOF system and brings out the effects of modal mass, damping and frequency ratios on the random vibration load factor. The results indicate that load estimates based on the Miles' equation can be significantly different from the more accurate estimates based on multi-DOF models.

Development of a Hybrid Optical Biopsy Probe to Improve Prostate Cancer Diagnosis

DTIC Science & Technology

2012-06-01

can be developed for guiding needle biopsy for prostate cancer diagnosis. Multi-modal optical measurements to be utilized for the study are (1) light...which collect light scattering and auto-fluorescence from the prostate tissue, into a transrectal- ultrasound , needle - biopsy probe. In the...probe can be developed for guiding needle biopsy for prostate cancer diagnosis. Multi-modal optical measurements to be utilized for the study were

Development of a Hybrid Optical Biopsy Probe to Improve Prostate Cancer Diagnosis

DTIC Science & Technology

2011-06-01

integrated needle probe can be developed for guiding needle biopsy for prostate cancer diagnosis. Multi-modal optical measurements to be utilized for... needle probe can be developed for guiding needle biopsy for prostate cancer diagnosis. Multi-modal optical measurements to be utilized for the study...tissue, into a transrectal- ultrasound , needle - biopsy probe. In the development phase, documentation to obtain IRB approval for ex vivo human prostate

Identification of multi-modal plasma responses to applied magnetic perturbations using the plasma reluctance

DOE PAGES

Logan, Nikolas C.; Paz-Soldan, Carlos; Park, Jong-Kyu; ...

2016-05-03

Using the plasma reluctance, the Ideal Perturbed Equilibrium Code is able to efficiently identify the structure of multi-modal magnetic plasma response measurements and the corresponding impact on plasma performance in the DIII-D tokamak. Recent experiments demonstrated that multiple kink modes of comparable amplitudes can be driven by applied nonaxisymmetric fields with toroidal mode number n = 2. This multi-modal response is in good agreement with ideal magnetohydrodynamic models, but detailed decompositions presented here show that the mode structures are not fully described by either the least stable modes or the resonant plasma response. This paper identifies the measured response fieldsmore » as the first eigenmodes of the plasma reluctance, enabling clear diagnosis of the plasma modes and their impact on performance from external sensors. The reluctance shows, for example, how very stable modes compose a significant portion of the multi-modal plasma response field and that these stable modes drive significant resonant current. Finally, this work is an overview of the first experimental applications using the reluctance to interpret the measured response and relate it to multifaceted physics, aimed towards providing the foundation of understanding needed to optimize nonaxisymmetric fields for independent control of stability and transport.« less

Flexible Skins Containing Integrated Sensors and Circuitry

NASA Technical Reports Server (NTRS)

Liu, Chang

2007-01-01

Artificial sensor skins modeled partly in imitation of biological sensor skins are undergoing development. These sensor skins comprise flexible polymer substrates that contain and/or support dense one- and two-dimensional arrays of microscopic sensors and associated microelectronic circuits. They afford multiple tactile sensing modalities for measuring physical phenomena that can include contact forces; hardnesses, temperatures, and thermal conductivities of objects with which they are in contact; and pressures, shear stresses, and flow velocities in fluids. The sensor skins are mechanically robust, and, because of their flexibility, they can be readily attached to curved and possibly moving and flexing surfaces of robots, wind-tunnel models, and other objects that one might seek to equip for tactile sensing. Because of the diversity of actual and potential sensor-skin design criteria and designs and the complexity of the fabrication processes needed to realize the designs, it is not possible to describe the sensor-skin concept in detail within this article.

Computational method for multi-modal microscopy based on transport of intensity equation

NASA Astrophysics Data System (ADS)

Li, Jiaji; Chen, Qian; Sun, Jiasong; Zhang, Jialin; Zuo, Chao

2017-02-01

In this paper, we develop the requisite theory to describe a hybrid virtual-physical multi-modal imaging system which yields quantitative phase, Zernike phase contrast, differential interference contrast (DIC), and light field moment imaging simultaneously based on transport of intensity equation(TIE). We then give the experimental demonstration of these ideas by time-lapse imaging of live HeLa cell mitosis. Experimental results verify that a tunable lens based TIE system, combined with the appropriate post-processing algorithm, can achieve a variety of promising imaging modalities in parallel with the quantitative phase images for the dynamic study of cellular processes.

Wide field-of-view, multi-region two-photon imaging of neuronal activity in the mammalian brain

PubMed Central

Stirman, Jeffrey N.; Smith, Ikuko T.; Kudenov, Michael W.; Smith, Spencer L.

2016-01-01

Two-photon calcium imaging provides an optical readout of neuronal activity in populations of neurons with subcellular resolution. However, conventional two-photon imaging systems are limited in their field of view to ~1 mm2, precluding the visualization of multiple cortical areas simultaneously. Here, we demonstrate a two-photon microscope with an expanded field of view (>9.5 mm2) for rapidly reconfigurable simultaneous scanning of widely separated populations of neurons. We custom designed and assembled an optimized scan engine, objective, and two independently positionable, temporally multiplexed excitation pathways. We used this new microscope to measure activity correlations between two cortical visual areas in mice during visual processing. PMID:27347754

Imaging Modalities Relevant to Intracranial Pressure Assessment in Astronauts: A Case-Based Discussion

NASA Technical Reports Server (NTRS)

Sargsyan, Ashot E.; Kramer, Larry A.; Hamilton, Douglas R.; Hamilton, Douglas R.; Fogarty, Jennifer; Polk, J. D.

2010-01-01

Introduction: Intracranial pressure (ICP) elevation has been inferred or documented in a number of space crewmembers. Recent advances in noninvasive imaging technology offer new possibilities for ICP assessment. Most International Space Station (ISS) partner agencies have adopted a battery of occupational health monitoring tests including magnetic resonance imaging (MRI) pre- and postflight, and high-resolution sonography of the orbital structures in all mission phases including during flight. We hypothesize that joint consideration of data from the two techniques has the potential to improve quality and continuity of crewmember monitoring and care. Methods: Specially designed MRI and sonographic protocols were used to image eyes and optic nerves (ON) including the meningeal sheaths. Specific crewmembers multi-modality imaging data were analyzed to identify points of mutual validation as well as unique features of complementary nature. Results and Conclusion: Magnetic resonance imaging (MRI) and high-resolution sonography are both tomographic methods, however images obtained by the two modalities are based on different physical phenomena and use different acquisition principles. Consideration of the images acquired by these two modalities allows cross-validating findings related to the volume and fluid content of the ON subarachnoid space, shape of the globe, and other anatomical features of the orbit. Each of the imaging modalities also has unique advantages, making them complementary techniques.

Simultaneous dual-color fluorescence microscope: a characterization study.

PubMed

Li, Zheng; Chen, Xiaodong; Ren, Liqiang; Song, Jie; Li, Yuhua; Zheng, Bin; Liu, Hong

2013-01-01

High spatial resolution and geometric accuracy is crucial for chromosomal analysis of clinical cytogenetic applications. High resolution and rapid simultaneous acquisition of multiple fluorescent wavelengths can be achieved by utilizing concurrent imaging with multiple detectors. However, such class of microscopic systems functions differently from traditional fluorescence microscopes. To develop a practical characterization framework to assess and optimize the performance of a high resolution and dual-color fluorescence microscope designed for clinical chromosomal analysis. A dual-band microscopic imaging system utilizes a dichroic mirror, two sets of specially selected optical filters, and two detectors to simultaneously acquire two fluorescent wavelengths. The system's geometric distortion, linearity, the modulation transfer function, and the dual detectors' alignment were characterized. Experiment results show that the geometric distortion at lens periphery is less than 1%. Both fluorescent channels show linear signal responses, but there exists discrepancy between the two due to the detectors' non-uniform response ratio to different wavelengths. In terms of the spatial resolution, the two contrast transfer function curves trend agreeably with the spatial frequency. The alignment measurement allows quantitatively assessing the cameras' alignment. A result image of adjusted alignment is demonstrated to show the reduced discrepancy by using the alignment measurement method. In this paper, we present a system characterization study and its methods for a specially designed imaging system for clinical cytogenetic applications. The presented characterization methods are not only unique to this dual-color imaging system but also applicable to evaluation and optimization of other similar multi-color microscopic image systems for improving their clinical utilities for future cytogenetic applications.

In Situ Microstructural Control and Mechanical Testing Inside the Transmission Electron Microscope at Elevated Temperatures

NASA Astrophysics Data System (ADS)

Wang, Baoming; Haque, M. A.

2015-08-01

With atomic-scale imaging and analytical capabilities such as electron diffraction and energy-loss spectroscopy, the transmission electron microscope has allowed access to the internal microstructure of materials like no other microscopy. It has been mostly a passive or post-mortem analysis tool, but that trend is changing with in situ straining, heating and electrical biasing. In this study, we design and demonstrate a multi-functional microchip that integrates actuators, sensors, heaters and electrodes with freestanding electron transparent specimens. In addition to mechanical testing at elevated temperatures, the chip can actively control microstructures (grain growth and phase change) of the specimen material. Using nano-crystalline aluminum, nickel and zirconium as specimen materials, we demonstrate these novel capabilities inside the microscope. Our approach of active microstructural control and quantitative testing with real-time visualization can influence mechanistic modeling by providing direct and accurate evidence of the fundamental mechanisms behind materials behavior.

Development and reliability of a multi-modality scoring system for evaluation of disease progression in pre-clinical models of osteoarthritis: celecoxib may possess disease-modifying properties.

PubMed

Panahifar, A; Jaremko, J L; Tessier, A G; Lambert, R G; Maksymowych, W P; Fallone, B G; Doschak, M R

2014-10-01

We sought to develop a comprehensive scoring system for evaluation of pre-clinical models of osteoarthritis (OA) progression, and use this to evaluate two different classes of drugs for management of OA. Post-traumatic OA (PTOA) was surgically induced in skeletally mature rats. Rats were randomly divided in three groups receiving either glucosamine (high dose of 192 mg/kg) or celecoxib (clinical dose) or no treatment. Disease progression was monitored utilizing micro-magnetic resonance imaging (MRI), micro-computed tomography (CT) and histology. Pertinent features such as osteophytes, subchondral sclerosis, joint effusion, bone marrow lesion (BML), cysts, loose bodies and cartilage abnormalities were included in designing a sensitive multi-modality based scoring system, termed the rat arthritis knee scoring system (RAKSS). Overall, an inter-observer correlation coefficient (ICC) of greater than 0.750 was achieved for each scored feature. None of the treatments prevented cartilage loss, synovitis, joint effusion, or sclerosis. However, celecoxib significantly reduced osteophyte development compared to placebo. Although signs of inflammation such as synovitis and joint effusion were readily identified at 4 weeks post-operation, we did not detect any BML. We report the development of a sensitive and reliable multi-modality scoring system, the RAKSS, for evaluation of OA severity in pre-clinical animal models. Using this scoring system, we found that celecoxib prevented enlargement of osteophytes in this animal model of PTOA, and thus it may be useful in preventing OA progression. However, it did not show any chondroprotective effect using the recommended dose. In contrast, high dose glucosamine had no measurable effects. Copyright © 2014 Osteoarthritis Research Society International. Published by Elsevier Ltd. All rights reserved.

A Modal Approach to Compact MIMO Antenna Design

NASA Astrophysics Data System (ADS)

Yang, Binbin

MIMO (Multiple-Input Multiple-Output) technology offers new possibilities for wireless communication through transmission over multiple spatial channels, and enables linear increases in spectral efficiency as the number of the transmitting and receiving antennas increases. However, the physical implementation of such systems in compact devices encounters many physical constraints mainly from the design of multi-antennas. First, an antenna's bandwidth decreases dramatically as its electrical size reduces, a fact known as antenna Q limit; secondly, multiple antennas closely spaced tend to couple with each other, undermining MIMO performance. Though different MIMO antenna designs have been proposed in the literature, there is still a lack of a systematic design methodology and knowledge of performance limits. In this dissertation, we employ characteristic mode theory (CMT) as a powerful tool for MIMO antenna analysis and design. CMT allows us to examine each physical mode of the antenna aperture, and to access its many physical parameters without even exciting the antenna. For the first time, we propose efficient circuit models for MIMO antennas of arbitrary geometry using this modal decomposition technique. Those circuit models demonstrate the powerful physical insight of CMT for MIMO antenna modeling, and simplify MIMO antenna design problem to just the design of specific antenna structural modes and a modal feed network, making possible the separate design of antenna aperture and feeds. We therefore develop a feed-independent shape synthesis technique for optimization of broadband multi-mode apertures. Combining the shape synthesis and circuit modeling techniques for MIMO antennas, we propose a shape-first feed-next design methodology for MIMO antennas, and designed and fabricated two planar MIMO antennas, each occupying an aperture much smaller than the regular size of lambda/2 x lambda/2. Facilitated by the newly developed source formulation for antenna stored energy and recently reported work on antenna Q factor minimization, we extend the minimum Q limit to antennas of arbitrary geometry, and show that given an antenna aperture, any antenna design based on its substructure will result into minimum Q factors larger than or equal to that of the complete structure. This limit is much tighter than Chu's limit based on spherical modes, and applies to antennas of arbitrary geometry. Finally, considering the almost inevitable presence of mutual coupling effects within compact multiport antennas, we develop new decoupling networks (DN) and decoupling network synthesis techniques. An information-theoretic metric, information mismatch loss (Gammainfo), is defined for DN characterization. Based on this metric, the optimization of decoupling networks for broadband system performance is conducted, which demonstrates the limitation of the single-frequency decoupling techniques and room for improvement.

Computer Based Behavioral Biometric Authentication via Multi-Modal Fusion

DTIC Science & Technology

2013-03-01

the decisions made by each individual modality. Fusion of features is the simple concatenation of feature vectors from multiple modalities to be...of Features BayesNet MDL 330 LibSVM PCA 80 J48 Wrapper Evaluator 11 3.5.3 Ensemble Based Decision Level Fusion. In ensemble learning multiple ...The high fusion percentages validate our hypothesis that by combining features from multiple modalities, classification accuracy can be improved. As

Nonlinear dynamics of magnetically coupled beams for multi-modal vibration energy harvesting

NASA Astrophysics Data System (ADS)

Abed, I.; Kacem, N.; Bouhaddi, N.; Bouazizi, M. L.

2016-04-01

We investigate the nonlinear dynamics of magnetically coupled beams for multi-modal vibration energy harvesting. A multi-physics model for the proposed device is developed taking into account geometric and magnetic nonlinearities. The coupled nonlinear equations of motion are solved using the Galerkin discretization coupled with the harmonic balance method and the asymptotic numerical method. Several numerical simulations have been performed showing that the expected performances of the proposed vibration energy harvester are significantly promising with up to 130 % in term of bandwidth and up to 60 μWcm-3g-2 in term of normalized harvested power.

Energy Logic (EL): a novel fusion engine of multi-modality multi-agent data/information fusion for intelligent surveillance systems

NASA Astrophysics Data System (ADS)

Rababaah, Haroun; Shirkhodaie, Amir

2009-04-01

The rapidly advancing hardware technology, smart sensors and sensor networks are advancing environment sensing. One major potential of this technology is Large-Scale Surveillance Systems (LS3) especially for, homeland security, battlefield intelligence, facility guarding and other civilian applications. The efficient and effective deployment of LS3 requires addressing number of aspects impacting the scalability of such systems. The scalability factors are related to: computation and memory utilization efficiency, communication bandwidth utilization, network topology (e.g., centralized, ad-hoc, hierarchical or hybrid), network communication protocol and data routing schemes; and local and global data/information fusion scheme for situational awareness. Although, many models have been proposed to address one aspect or another of these issues but, few have addressed the need for a multi-modality multi-agent data/information fusion that has characteristics satisfying the requirements of current and future intelligent sensors and sensor networks. In this paper, we have presented a novel scalable fusion engine for multi-modality multi-agent information fusion for LS3. The new fusion engine is based on a concept we call: Energy Logic. Experimental results of this work as compared to a Fuzzy logic model strongly supported the validity of the new model and inspired future directions for different levels of fusion and different applications.

On using the Hilbert transform for blind identification of complex modes: A practical approach

NASA Astrophysics Data System (ADS)

Antunes, Jose; Debut, Vincent; Piteau, Pilippe; Delaune, Xavier; Borsoi, Laurent

2018-01-01

The modal identification of dynamical systems under operational conditions, when subjected to wide-band unmeasured excitations, is today a viable alternative to more traditional modal identification approaches based on processing sets of measured FRFs or impulse responses. Among current techniques for performing operational modal identification, the so-called blind identification methods are the subject of considerable investigation. In particular, the SOBI (Second-Order Blind Identification) method was found to be quite efficient. SOBI was originally developed for systems with normal modes. To address systems with complex modes, various extension approaches have been proposed, in particular: (a) Using a first-order state-space formulation for the system dynamics; (b) Building complex analytic signals from the measured responses using the Hilbert transform. In this paper we further explore the latter option, which is conceptually interesting while preserving the model order and size. Focus is on applicability of the SOBI technique for extracting the modal responses from analytic signals built from a set of vibratory responses. The novelty of this work is to propose a straightforward computational procedure for obtaining the complex cross-correlation response matrix to be used for the modal identification procedure. After clarifying subtle aspects of the general theoretical framework, we demonstrate that the correlation matrix of the analytic responses can be computed through a Hilbert transform of the real correlation matrix, so that the actual time-domain responses are no longer required for modal identification purposes. The numerical validation of the proposed technique is presented based on time-domain simulations of a conceptual physical multi-modal system, designed to display modes ranging from normal to highly complex, while keeping modal damping low and nearly independent of the modal complexity, and which can prove very interesting in test bench applications. Numerical results for complex modal identifications are presented, and the quality of the identified modal matrix and modal responses, extracted using the complex SOBI technique and implementing the proposed formulation, is assessed.

Volatile-bearing phases in carbonaceous chondrites: Compositions, modal abundance, and reaction kinetics

NASA Technical Reports Server (NTRS)

Ganguly, Jibamitra

1990-01-01

The spectral and density characteristics of Phobos and Deimos (the two small natural satellites of Mars) strongly suggest that a significant fraction of the near-earth asteroids are made of carbonaceous chondrites, which are rich in volatile components and, thus, could serve as potential resources for propellants and life supporting systems in future planetary missions. However, in order to develop energy efficient engineering designs for the extraction of volatiles, knowledge of the nature and modal abundance of the minerals in which the volatiles are structurally bound and appropriate kinetic data on the rates of the devolatilization reactions is required. Theoretical calculations to predict the modal abundances and compositions of the major volatile-bearing and other mineral phases that could develop in the bulk compositions of C1 and C2 classes (the most volatile rich classes among the carbonaceous chondrites) were performed as functions of pressure and temperature. The rates of dehydration of talc at 585, 600, 637, and 670 C at P(total) = 1 bar were determine for the reaction: Talc = 3 enstatite + quartz + water. A scanning electron microscopic study was conducted to see if the relative abundance of phases can be determined on the basis of the spectral identification and x ray mapping. The results of this study and the other studies within the project are discussed.

Mobile, Multi-modal, Label-Free Imaging Probe Analysis of Choroidal Oximetry and Retinal Hypoxia

DTIC Science & Technology

2015-10-01

eyes and image choroidal vessels/capillaries using CARS intravital microscopy Subtask 3: Measure oxy-hemoglobin levels in PBI test and control eyes...AWARD NUMBER: W81XWH-14-1-0537 TITLE: Mobile, Multi-modal, Label-Free Imaging Probe Analysis of Choroidal Oximetry and Retinal Hypoxia...4. TITLE AND SUBTITLE Mobile, Multimodal, Label-Free Imaging Probe Analysis of Choroidal Oximetry and Retinal Hypoxia 5a. CONTRACT NUMBER W81XWH

Development of a new multi-modal Monte-Carlo radiotherapy planning system.

PubMed

Kumada, H; Nakamura, T; Komeda, M; Matsumura, A

2009-07-01

A new multi-modal Monte-Carlo radiotherapy planning system (developing code: JCDS-FX) is under development at Japan Atomic Energy Agency. This system builds on fundamental technologies of JCDS applied to actual boron neutron capture therapy (BNCT) trials in JRR-4. One of features of the JCDS-FX is that PHITS has been applied to particle transport calculation. PHITS is a multi-purpose particle Monte-Carlo transport code. Hence application of PHITS enables to evaluate total doses given to a patient by a combined modality therapy. Moreover, JCDS-FX with PHITS can be used for the study of accelerator based BNCT. To verify calculation accuracy of the JCDS-FX, dose evaluations for neutron irradiation of a cylindrical water phantom and for an actual clinical trial were performed, then the results were compared with calculations by JCDS with MCNP. The verification results demonstrated that JCDS-FX is applicable to BNCT treatment planning in practical use.

A collaborative interaction and visualization multi-modal environment for surgical planning.

PubMed

Foo, Jung Leng; Martinez-Escobar, Marisol; Peloquin, Catherine; Lobe, Thom; Winer, Eliot

2009-01-01

The proliferation of virtual reality visualization and interaction technologies has changed the way medical image data is analyzed and processed. This paper presents a multi-modal environment that combines a virtual reality application with a desktop application for collaborative surgical planning. Both visualization applications can function independently but can also be synced over a network connection for collaborative work. Any changes to either application is immediately synced and updated to the other. This is an efficient collaboration tool that allows multiple teams of doctors with only an internet connection to visualize and interact with the same patient data simultaneously. With this multi-modal environment framework, one team working in the VR environment and another team from a remote location working on a desktop machine can both collaborate in the examination and discussion for procedures such as diagnosis, surgical planning, teaching and tele-mentoring.

Health Care Robotics: A Progress Report

NASA Technical Reports Server (NTRS)

Fiorini, Paolo; Ali, Khaled; Seraji, Homayoun

1997-01-01

This paper describes the approach followed in the design of a service robot for health care applications. Under the auspices of the NASA Technology Transfer program, a partnership was established between JPL and RWI, a manufacturer of mobile robots, to design and evaluate a mobile robot for health care assistance to the elderly and the handicapped. The main emphasis of the first phase of the project is on the development on a multi-modal operator interface and its evaluation by health care professionals and users. This paper describes the architecture of the system, the evaluation method used, and some preliminary results of the user evaluation.

Control and acquisition systems for new scanning transmission x-ray microscopes at Advanced Light Source (abstract)

NASA Astrophysics Data System (ADS)

Tyliszczak, T.; Hitchcock, P.; Kilcoyne, A. L. D.; Ade, H.; Hitchcock, A. P.; Fakra, S.; Steele, W. F.; Warwick, T.

2002-03-01

Two new scanning x-ray transmission microscopes are being built at beamline 5.3.2 and beamline 7.0 of the Advanced Light Source that have novel aspects in their control and acquisition systems. Both microscopes use multiaxis laser interferometry to improve the precision of pixel location during imaging and energy scans as well as to remove image distortions. Beam line 5.3.2 is a new beam line where the new microscope will be dedicated to studies of polymers in the 250-600 eV energy range. Since this is a bending magnet beam line with lower x-ray brightness than undulator beam lines, special attention is given to the design not only to minimize distortions and vibrations but also to optimize the controls and acquisition to improve data collection efficiency. 5.3.2 microscope control and acquisition is based on a PC computer running WINDOWS 2000. All mechanical stages are moved by stepper motors with rack mounted controllers. A dedicated counter board is used for counting and timing and a multi-input/output board is used for analog acquisition and control of the focusing mirror. A three axis differential laser interferometer is being used to improve stability and precision by careful tracking of the relative positions of the sample and zone plate. Each axis measures the relative distance between a mirror placed on the sample stage and a mirror attached to the zone plate holder. Agilent Technologies HP 10889A servo-axis interferometer boards are used. While they were designed to control servo motors, our tests show that they can be used to directly control the piezo stage. The use of the interferometer servo-axis boards provides excellent point stability for spectral measurements. The interferometric feedback also provides active vibration isolation which reduces deleterious impact of mechanical vibrations up to 20-30 Hz. It also can improve the speed and precision of image scans. Custom C++ software has been written to provide user friendly control of the microscope and integration with visual light microscopy indexing of the samples. The beam line 7.0 microscope upgrade is a new design which will replace the existing microscope. The design is similar to that of beam line 5.3.2, including interferometric position encoding. However the acquisition and control is based on VXI systems, a Sun computer, and LABVIEW™ software. The main objective of the BL 7.0 microscope upgrade is to achieve precise image scans at very high speed (pixel dwells as short as 10 μs) to take full advantage of the high brightness of the 7.0 undulator beamline. Results of tests and a discussion of the benefits of our scanning microscope designs will be presented.

Fundamental-mode MMF transmission enabled by mode conversion

NASA Astrophysics Data System (ADS)

Wu, Zhongying; Li, Juhao; Tian, Yu; Ge, Dawei; Zhu, Jinglong; Ren, Fang; Mo, Qi; Yu, Jinyi; Li, Zhengbin; Chen, Zhangyuan; He, Yongqi

2018-03-01

Modal dispersion in conventional multi-mode fiber (MMF) will cause serious signal degradation and an effective solution is to restrict the signal transmission in the fundamental mode of MMF. In this paper, unlike previous methods by filtering out higher-order modes, we propose to adopt low-modal-crosstalk mode converters to realize fundamental-mode MMF transmission. We design and fabricate all-fiber mode-selective couplers (MSC), which perform mode conversion between the fundamental mode in single-mode fiber (SMF) and fundamental mode in MMF. The proposed scheme is experimentally compared with center launching method under different MMF links and then its wavelength division multiplexing (WDM) transmission performance is investigated. Experimental results indicate that the proposed mode conversion scheme could achieve better transmission performance and works well for the whole C-band.

A System Approach to Adaptive Multi-Modal Sensor Designs

DTIC Science & Technology

2010-02-01

afosr.af.mil> Prepared for Air Force Office of Scientific Research under Award FA9550-08-1-0199 February 2010 The City College of New York...York, NY 10031 9. SPONSORING / MONITORING AGENCY NAME(S) AND ADDRESS(ES) 10. SPONSOR/MONITOR’S ACRONYM(S) Dr. Douglas Cochran AFOSR Air ...RIT. We would also like to thank Dr. Erik Blasch at the Air Force Research Laboratory (AFRL/RYAA) for his collaboration when our PhD student Mr

LapTrain: multi-modality training curriculum for laparoscopic cholecystectomy-results of a randomized controlled trial.

PubMed

Kowalewski, K F; Garrow, C R; Proctor, T; Preukschas, A A; Friedrich, M; Müller, P C; Kenngott, H G; Fischer, L; Müller-Stich, B P; Nickel, F

2018-02-12

Multiple training modalities for laparoscopy have different advantages, but little research has been conducted on the benefit of a training program that includes multiple different training methods compared to one method only. This study aimed to evaluate benefits of a combined multi-modality training program for surgical residents. Laparoscopic cholecystectomy (LC) was performed on a porcine liver as the pre-test. Randomization was stratified for experience to the multi-modality Training group (12 h of training on Virtual Reality (VR) and box trainer) or Control group (no training). The post-test consisted of a VR LC and porcine LC. Performance was rated with the Global Operative Assessment of Laparoscopic Skills (GOALS) score by blinded experts. Training (n = 33) and Control (n = 31) were similar in the pre-test (GOALS: 13.7 ± 3.4 vs. 14.7 ± 2.6; p = 0.198; operation time 57.0 ± 18.1 vs. 63.4 ± 17.5 min; p = 0.191). In the post-test porcine LC, Training had improved GOALS scores (+ 2.84 ± 2.85 points, p < 0.001), while Control did not (+ 0.55 ± 2.34 points, p = 0.154). Operation time in the post-test was shorter for Training vs. Control (40.0 ± 17.0 vs. 55.0 ± 22.2 min; p = 0.012). Junior residents improved GOALS scores to the level of senior residents (pre-test: 13.7 ± 2.7 vs. 18.3 ± 2.9; p = 0.010; post-test: 15.5 ± 3.4 vs. 18.8 ± 3.8; p = 0.120) but senior residents remained faster (50.1 ± 20.6 vs. 25.0 ± 1.9 min; p < 0.001). No differences were found between groups on the post-test VR trainer. Structured multi-modality training is beneficial for novices to improve basics and overcome the initial learning curve in laparoscopy as well as to decrease operation time for LCs in different stages of experience. Future studies should evaluate multi-modality training in comparison with single modalities. German Clinical Trials Register DRKS00011040.

A Dual-Modality System for Both Multi-Color Ultrasound-Switchable Fluorescence and Ultrasound Imaging

PubMed Central

Kandukuri, Jayanth; Yu, Shuai; Cheng, Bingbing; Bandi, Venugopal; D’Souza, Francis; Nguyen, Kytai T.; Hong, Yi; Yuan, Baohong

2017-01-01

Simultaneous imaging of multiple targets (SIMT) in opaque biological tissues is an important goal for molecular imaging in the future. Multi-color fluorescence imaging in deep tissues is a promising technology to reach this goal. In this work, we developed a dual-modality imaging system by combining our recently developed ultrasound-switchable fluorescence (USF) imaging technology with the conventional ultrasound (US) B-mode imaging. This dual-modality system can simultaneously image tissue acoustic structure information and multi-color fluorophores in centimeter-deep tissue with comparable spatial resolutions. To conduct USF imaging on the same plane (i.e., x-z plane) as US imaging, we adopted two 90°-crossed ultrasound transducers with an overlapped focal region, while the US transducer (the third one) was positioned at the center of these two USF transducers. Thus, the axial resolution of USF is close to the lateral resolution, which allows a point-by-point USF scanning on the same plane as the US imaging. Both multi-color USF and ultrasound imaging of a tissue phantom were demonstrated. PMID:28165390

Three-way parallel independent component analysis for imaging genetics using multi-objective optimization.

PubMed

Ulloa, Alvaro; Jingyu Liu; Vergara, Victor; Jiayu Chen; Calhoun, Vince; Pattichis, Marios

2014-01-01

In the biomedical field, current technology allows for the collection of multiple data modalities from the same subject. In consequence, there is an increasing interest for methods to analyze multi-modal data sets. Methods based on independent component analysis have proven to be effective in jointly analyzing multiple modalities, including brain imaging and genetic data. This paper describes a new algorithm, three-way parallel independent component analysis (3pICA), for jointly identifying genomic loci associated with brain function and structure. The proposed algorithm relies on the use of multi-objective optimization methods to identify correlations among the modalities and maximally independent sources within modality. We test the robustness of the proposed approach by varying the effect size, cross-modality correlation, noise level, and dimensionality of the data. Simulation results suggest that 3p-ICA is robust to data with SNR levels from 0 to 10 dB and effect-sizes from 0 to 3, while presenting its best performance with high cross-modality correlations, and more than one subject per 1,000 variables. In an experimental study with 112 human subjects, the method identified links between a genetic component (pointing to brain function and mental disorder associated genes, including PPP3CC, KCNQ5, and CYP7B1), a functional component related to signal decreases in the default mode network during the task, and a brain structure component indicating increases of gray matter in brain regions of the default mode region. Although such findings need further replication, the simulation and in-vivo results validate the three-way parallel ICA algorithm presented here as a useful tool in biomedical data decomposition applications.

The benefits of adaptive parametrization in multi-objective Tabu Search optimization

NASA Astrophysics Data System (ADS)

Ghisu, Tiziano; Parks, Geoffrey T.; Jaeggi, Daniel M.; Jarrett, Jerome P.; Clarkson, P. John

2010-10-01

In real-world optimization problems, large design spaces and conflicting objectives are often combined with a large number of constraints, resulting in a highly multi-modal, challenging, fragmented landscape. The local search at the heart of Tabu Search, while being one of its strengths in highly constrained optimization problems, requires a large number of evaluations per optimization step. In this work, a modification of the pattern search algorithm is proposed: this modification, based on a Principal Components' Analysis of the approximation set, allows both a re-alignment of the search directions, thereby creating a more effective parametrization, and also an informed reduction of the size of the design space itself. These changes make the optimization process more computationally efficient and more effective - higher quality solutions are identified in fewer iterations. These advantages are demonstrated on a number of standard analytical test functions (from the ZDT and DTLZ families) and on a real-world problem (the optimization of an axial compressor preliminary design).

Energy-weighted dynamical scattering simulations of electron diffraction modalities in the scanning electron microscope.

PubMed

Pascal, Elena; Singh, Saransh; Callahan, Patrick G; Hourahine, Ben; Trager-Cowan, Carol; Graef, Marc De

2018-04-01

Transmission Kikuchi diffraction (TKD) has been gaining momentum as a high resolution alternative to electron back-scattered diffraction (EBSD), adding to the existing electron diffraction modalities in the scanning electron microscope (SEM). The image simulation of any of these measurement techniques requires an energy dependent diffraction model for which, in turn, knowledge of electron energies and diffraction distances distributions is required. We identify the sample-detector geometry and the effect of inelastic events on the diffracting electron beam as the important factors to be considered when predicting these distributions. However, tractable models taking into account inelastic scattering explicitly are lacking. In this study, we expand the Monte Carlo (MC) energy-weighting dynamical simulations models used for EBSD [1] and ECP [2] to the TKD case. We show that the foil thickness in TKD can be used as a means of energy filtering and compare band sharpness in the different modalities. The current model is shown to correctly predict TKD patterns and, through the dictionary indexing approach, to produce higher quality indexed TKD maps than conventional Hough transform approach, especially close to grain boundaries. Copyright © 2018 The Authors. Published by Elsevier B.V. All rights reserved.

Obstacle traversal and self-righting of bio-inspired robots reveal the physics of multi-modal locomotion

NASA Astrophysics Data System (ADS)

Li, Chen; Fearing, Ronald; Full, Robert

Most animals move in nature in a variety of locomotor modes. For example, to traverse obstacles like dense vegetation, cockroaches can climb over, push across, reorient their bodies to maneuver through slits, or even transition among these modes forming diverse locomotor pathways; if flipped over, they can also self-right using wings or legs to generate body pitch or roll. By contrast, most locomotion studies have focused on a single mode such as running, walking, or jumping, and robots are still far from capable of life-like, robust, multi-modal locomotion in the real world. Here, we present two recent studies using bio-inspired robots, together with new locomotion energy landscapes derived from locomotor-environment interaction physics, to begin to understand the physics of multi-modal locomotion. (1) Our experiment of a cockroach-inspired legged robot traversing grass-like beam obstacles reveals that, with a terradynamically ``streamlined'' rounded body like that of the insect, robot traversal becomes more probable by accessing locomotor pathways that overcome lower potential energy barriers. (2) Our experiment of a cockroach-inspired self-righting robot further suggests that body vibrations are crucial for exploring locomotion energy landscapes and reaching lower barrier pathways. Finally, we posit that our new framework of locomotion energy landscapes holds promise to better understand and predict multi-modal biological and robotic movement.

Light-sheet microscopy for everyone? Experience of building an OpenSPIM to study flatworm development.

PubMed

Girstmair, Johannes; Zakrzewski, Anne; Lapraz, François; Handberg-Thorsager, Mette; Tomancak, Pavel; Pitrone, Peter Gabriel; Simpson, Fraser; Telford, Maximilian J

2016-06-30

Selective plane illumination microscopy (SPIM a type of light-sheet microscopy) involves focusing a thin sheet of laser light through a specimen at right angles to the objective lens. As only the thin section of the specimen at the focal plane of the lens is illuminated, out of focus light is naturally absent and toxicity due to light (phototoxicity) is greatly reduced enabling longer term live imaging. OpenSPIM is an open access platform (Pitrone et al. 2013 and OpenSPIM.org) created to give new users step-by-step instructions on building a basic configuration of a SPIM microscope, which can in principle be adapted and upgraded to each laboratory's own requirements and budget. Here we describe our own experience with the process of designing, building, configuring and using an OpenSPIM for our research into the early development of the polyclad flatworm Maritigrella crozieri - a non-model animal. Our OpenSPIM builds on the standard design with the addition of two colour laser illumination for simultaneous detection of two probes/molecules and dual sided illumination, which provides more even signal intensity across a specimen. Our OpenSPIM provides high resolution 3d images and time lapse recordings, and we demonstrate the use of two colour lasers and the benefits of two color dual-sided imaging. We used our microscope to study the development of the embryo of the polyclad flatworm M. crozieri. The capabilities of our microscope are demonstrated by our ability to record the stereotypical spiral cleavage pattern of M. crozieri with high-speed multi-view time lapse imaging. 3D and 4D (3D + time) reconstruction of early development from these data is possible using image registration and deconvolution tools provided as part of the open source Fiji platform. We discuss our findings on the pros and cons of a self built microscope. We conclude that home-built microscopes, such as an OpenSPIM, together with the available open source software, such as MicroManager and Fiji, make SPIM accessible to anyone interested in having continuous access to their own light-sheet microscope. However, building an OpenSPIM is not without challenges and an open access microscope is a worthwhile, if significant, investment of time and money. Multi-view 4D microscopy is more challenging than we had expected. We hope that our experience gained during this project will help future OpenSPIM users with similar ambitions.

Design and modeling of a prototype fiber scanning CARS endoscope

NASA Astrophysics Data System (ADS)

Veilleux, Isra"l.; Doucet, Michel; Coté, Patrice; Verreault, Sonia; Fortin, Michel; Paradis, Patrick; Leclair, Sébastien; Da Costa, Ralph S.; Wilson, Brian C.; Seibel, Eric; Mermut, Ozzy; Cormier, Jean-François

2010-02-01

An endoscope capable of Coherent Anti-Stokes Raman scattering (CARS) imaging would be of significant clinical value for improving early detection of endoluminal cancers. However, developing this technology is challenging for many reasons. First, nonlinear imaging techniques such as CARS are single point measurements thus requiring fast scanning in a small footprint if video rate is to be achieved. Moreover, the intrinsic nonlinearity of this modality imposes several technical constraints and limitations, mainly related to pulse and beam distortions that occur within the optical fiber and the focusing objective. Here, we describe the design and report modeling results of a new CARS endoscope. The miniature microscope objective design and its anticipated performance are presented, along with its compatibility with a new spiral scanningfiber imaging technology developed at the University of Washington. This technology has ideal attributes for clinical use, with its small footprint, adjustable field-of-view and high spatial-resolution. This compact hybrid fiber-based endoscopic CARS imaging design is anticipated to have a wide clinical applicability.

Advanced Methods in Fluorescence Microscopy

PubMed Central

Fritzky, Luke; Lagunoff, David

2013-01-01

It requires a good deal of will power to resist hyperbole in considering the advances that have been achieved in fluorescence microscopy in the last 25 years. Our effort has been to survey the modalities of microscopic fluorescence imaging available to cell biologists and perhaps useful for diagnostic pathologists. The gamut extends from established confocal laser scanning through multiphoton and TIRF to the emerging technologies of super-resolution microscopy that breech the Abbé limit of resolution. Also considered are the recent innovations in structured and light sheet illumination, the use of FRET and molecular beacons that exploit specific characteristics of designer fluorescent proteins, fluorescence speckles, and second harmonic generation for native anisometric structures like collagen, microtubules and sarcomeres. PMID:23271142

Advanced methods in fluorescence microscopy.

PubMed

Fritzky, Luke; Lagunoff, David

2013-01-01

It requires a good deal of will power to resist hyperbole in considering the advances that have been achieved in fluorescence microscopy in the last 25 years. Our effort has been to survey the modalities of microscopic fluorescence imaging available to cell biologists and perhaps useful for diagnostic pathologists. The gamut extends from established confocal laser scanning through multiphoton and TIRF to the emerging technologies of super-resolution microscopy that breech the Abbe limit of resolution. Also considered are the recent innovations in structured and light sheet illumination, the use of FRET and molecular beacons that exploit specific characteristics of designer fluorescent proteins, fluorescence speckles, and second harmonic generation for native anisometric structures like collagen, microtubules and sarcomeres.

Advanced methods in fluorescence microscopy.

PubMed

Fritzky, Luke; Lagunoff, David

2013-01-01

It requires a good deal of will power to resist hyperbole in considering the advances that have been achieved in fluorescence microscopy in the last 25 years. Our effort has been to survey the modalities of microscopic fluorescence imaging available to cell biologists and perhaps useful for diagnostic pathologists. The gamut extends from established confocal laser scanning through multiphoton and TIRF to the emerging technologies of super-resolution microscopy that breech the Abbé limit of resolution. Also considered are the recent innovations in structured and light sheet illumination, the use of FRET and molecular beacons that exploit specific characteristics of designer fluorescent proteins, fluorescence speckles, and second harmonic generation for native anisometric structures like collagen, microtubules and sarcomeres.

Context-Aware Fusion of RGB and Thermal Imagery for Traffic Monitoring

PubMed Central

Alldieck, Thiemo; Bahnsen, Chris H.; Moeslund, Thomas B.

2016-01-01

In order to enable a robust 24-h monitoring of traffic under changing environmental conditions, it is beneficial to observe the traffic scene using several sensors, preferably from different modalities. To fully benefit from multi-modal sensor output, however, one must fuse the data. This paper introduces a new approach for fusing color RGB and thermal video streams by using not only the information from the videos themselves, but also the available contextual information of a scene. The contextual information is used to judge the quality of a particular modality and guides the fusion of two parallel segmentation pipelines of the RGB and thermal video streams. The potential of the proposed context-aware fusion is demonstrated by extensive tests of quantitative and qualitative characteristics on existing and novel video datasets and benchmarked against competing approaches to multi-modal fusion. PMID:27869730

Joint MR-PET reconstruction using a multi-channel image regularizer

PubMed Central

Koesters, Thomas; Otazo, Ricardo; Bredies, Kristian; Sodickson, Daniel K

2016-01-01

While current state of the art MR-PET scanners enable simultaneous MR and PET measurements, the acquired data sets are still usually reconstructed separately. We propose a new multi-modality reconstruction framework using second order Total Generalized Variation (TGV) as a dedicated multi-channel regularization functional that jointly reconstructs images from both modalities. In this way, information about the underlying anatomy is shared during the image reconstruction process while unique differences are preserved. Results from numerical simulations and in-vivo experiments using a range of accelerated MR acquisitions and different MR image contrasts demonstrate improved PET image quality, resolution, and quantitative accuracy. PMID:28055827

In vivo two-photon imaging of macrophage activities in skeletal muscle regeneration

NASA Astrophysics Data System (ADS)

Qin, Zhongya; Long, Yanyang; Sun, Qiqi; He, Sicong; Li, Xuesong; Chen, Congping; Wu, Zhenguo; Qu, Jianan Y.

2018-02-01

Macrophages are essential for the regeneration of skeletal muscle after injury. It has been demonstrated that depletion of macrophages results in delay of necrotic fiber phagocytosis and decreased size of regenerated myofibers. In this work, we developed a multi-modal two-photon microscope system for in vivo study of macrophage activities in the regenerative and fibrotic healing process of injured skeletal muscles. The system is capable to image the muscles based on the second harmonic generation (SHG) and two-photon excited fluorescence (TPEF) signals simultaneously. The dynamic activities of macrophages and muscle satellite cells are recorded in different time windows post the muscle injury. Moreover, we found that infiltrating macrophages emitted strong autofluorescence in the injured skeletal muscle of mouse model, which has not been reported previously. The macrophage autofluorescence was characterized in both spectral and temporal domains. The information extracted from the autofluorescence signals may facilitate the understanding on the formation mechanisms and possible applications in biological research related to skeletal muscle regeneration.

DMD-based LED-illumination super-resolution and optical sectioning microscopy.

PubMed

Dan, Dan; Lei, Ming; Yao, Baoli; Wang, Wen; Winterhalder, Martin; Zumbusch, Andreas; Qi, Yujiao; Xia, Liang; Yan, Shaohui; Yang, Yanlong; Gao, Peng; Ye, Tong; Zhao, Wei

2013-01-01

Super-resolution three-dimensional (3D) optical microscopy has incomparable advantages over other high-resolution microscopic technologies, such as electron microscopy and atomic force microscopy, in the study of biological molecules, pathways and events in live cells and tissues. We present a novel approach of structured illumination microscopy (SIM) by using a digital micromirror device (DMD) for fringe projection and a low-coherence LED light for illumination. The lateral resolution of 90 nm and the optical sectioning depth of 120 μm were achieved. The maximum acquisition speed for 3D imaging in the optical sectioning mode was 1.6×10(7) pixels/second, which was mainly limited by the sensitivity and speed of the CCD camera. In contrast to other SIM techniques, the DMD-based LED-illumination SIM is cost-effective, ease of multi-wavelength switchable and speckle-noise-free. The 2D super-resolution and 3D optical sectioning modalities can be easily switched and applied to either fluorescent or non-fluorescent specimens.

DMD-based LED-illumination Super-resolution and optical sectioning microscopy

PubMed Central

Dan, Dan; Lei, Ming; Yao, Baoli; Wang, Wen; Winterhalder, Martin; Zumbusch, Andreas; Qi, Yujiao; Xia, Liang; Yan, Shaohui; Yang, Yanlong; Gao, Peng; Ye, Tong; Zhao, Wei

2013-01-01

Super-resolution three-dimensional (3D) optical microscopy has incomparable advantages over other high-resolution microscopic technologies, such as electron microscopy and atomic force microscopy, in the study of biological molecules, pathways and events in live cells and tissues. We present a novel approach of structured illumination microscopy (SIM) by using a digital micromirror device (DMD) for fringe projection and a low-coherence LED light for illumination. The lateral resolution of 90 nm and the optical sectioning depth of 120 μm were achieved. The maximum acquisition speed for 3D imaging in the optical sectioning mode was 1.6×107 pixels/second, which was mainly limited by the sensitivity and speed of the CCD camera. In contrast to other SIM techniques, the DMD-based LED-illumination SIM is cost-effective, ease of multi-wavelength switchable and speckle-noise-free. The 2D super-resolution and 3D optical sectioning modalities can be easily switched and applied to either fluorescent or non-fluorescent specimens. PMID:23346373

Fully Convolutional Neural Networks Improve Abdominal Organ Segmentation.

PubMed

Bobo, Meg F; Bao, Shunxing; Huo, Yuankai; Yao, Yuang; Virostko, Jack; Plassard, Andrew J; Lyu, Ilwoo; Assad, Albert; Abramson, Richard G; Hilmes, Melissa A; Landman, Bennett A

2018-03-01

Abdominal image segmentation is a challenging, yet important clinical problem. Variations in body size, position, and relative organ positions greatly complicate the segmentation process. Historically, multi-atlas methods have achieved leading results across imaging modalities and anatomical targets. However, deep learning is rapidly overtaking classical approaches for image segmentation. Recently, Zhou et al. showed that fully convolutional networks produce excellent results in abdominal organ segmentation of computed tomography (CT) scans. Yet, deep learning approaches have not been applied to whole abdomen magnetic resonance imaging (MRI) segmentation. Herein, we evaluate the applicability of an existing fully convolutional neural network (FCNN) designed for CT imaging to segment abdominal organs on T2 weighted (T2w) MRI's with two examples. In the primary example, we compare a classical multi-atlas approach with FCNN on forty-five T2w MRI's acquired from splenomegaly patients with five organs labeled (liver, spleen, left kidney, right kidney, and stomach). Thirty-six images were used for training while nine were used for testing. The FCNN resulted in a Dice similarity coefficient (DSC) of 0.930 in spleens, 0.730 in left kidneys, 0.780 in right kidneys, 0.913 in livers, and 0.556 in stomachs. The performance measures for livers, spleens, right kidneys, and stomachs were significantly better than multi-atlas (p < 0.05, Wilcoxon rank-sum test). In a secondary example, we compare the multi-atlas approach with FCNN on 138 distinct T2w MRI's with manually labeled pancreases (one label). On the pancreas dataset, the FCNN resulted in a median DSC of 0.691 in pancreases versus 0.287 for multi-atlas. The results are highly promising given relatively limited training data and without specific training of the FCNN model and illustrate the potential of deep learning approaches to transcend imaging modalities.

Fully convolutional neural networks improve abdominal organ segmentation

NASA Astrophysics Data System (ADS)

Bobo, Meg F.; Bao, Shunxing; Huo, Yuankai; Yao, Yuang; Virostko, Jack; Plassard, Andrew J.; Lyu, Ilwoo; Assad, Albert; Abramson, Richard G.; Hilmes, Melissa A.; Landman, Bennett A.

2018-03-01

Abdominal image segmentation is a challenging, yet important clinical problem. Variations in body size, position, and relative organ positions greatly complicate the segmentation process. Historically, multi-atlas methods have achieved leading results across imaging modalities and anatomical targets. However, deep learning is rapidly overtaking classical approaches for image segmentation. Recently, Zhou et al. showed that fully convolutional networks produce excellent results in abdominal organ segmentation of computed tomography (CT) scans. Yet, deep learning approaches have not been applied to whole abdomen magnetic resonance imaging (MRI) segmentation. Herein, we evaluate the applicability of an existing fully convolutional neural network (FCNN) designed for CT imaging to segment abdominal organs on T2 weighted (T2w) MRI's with two examples. In the primary example, we compare a classical multi-atlas approach with FCNN on forty-five T2w MRI's acquired from splenomegaly patients with five organs labeled (liver, spleen, left kidney, right kidney, and stomach). Thirty-six images were used for training while nine were used for testing. The FCNN resulted in a Dice similarity coefficient (DSC) of 0.930 in spleens, 0.730 in left kidneys, 0.780 in right kidneys, 0.913 in livers, and 0.556 in stomachs. The performance measures for livers, spleens, right kidneys, and stomachs were significantly better than multi-atlas (p < 0.05, Wilcoxon rank-sum test). In a secondary example, we compare the multi-atlas approach with FCNN on 138 distinct T2w MRI's with manually labeled pancreases (one label). On the pancreas dataset, the FCNN resulted in a median DSC of 0.691 in pancreases versus 0.287 for multi-atlas. The results are highly promising given relatively limited training data and without specific training of the FCNN model and illustrate the potential of deep learning approaches to transcend imaging modalities. 1

Residual Shuffling Convolutional Neural Networks for Deep Semantic Image Segmentation Using Multi-Modal Data

NASA Astrophysics Data System (ADS)

Chen, K.; Weinmann, M.; Gao, X.; Yan, M.; Hinz, S.; Jutzi, B.; Weinmann, M.

2018-05-01

In this paper, we address the deep semantic segmentation of aerial imagery based on multi-modal data. Given multi-modal data composed of true orthophotos and the corresponding Digital Surface Models (DSMs), we extract a variety of hand-crafted radiometric and geometric features which are provided separately and in different combinations as input to a modern deep learning framework. The latter is represented by a Residual Shuffling Convolutional Neural Network (RSCNN) combining the characteristics of a Residual Network with the advantages of atrous convolution and a shuffling operator to achieve a dense semantic labeling. Via performance evaluation on a benchmark dataset, we analyze the value of different feature sets for the semantic segmentation task. The derived results reveal that the use of radiometric features yields better classification results than the use of geometric features for the considered dataset. Furthermore, the consideration of data on both modalities leads to an improvement of the classification results. However, the derived results also indicate that the use of all defined features is less favorable than the use of selected features. Consequently, data representations derived via feature extraction and feature selection techniques still provide a gain if used as the basis for deep semantic segmentation.

Exogenous Molecular Probes for Targeted Imaging in Cancer: Focus on Multi-modal Imaging

PubMed Central

Joshi, Bishnu P.; Wang, Thomas D.

2010-01-01

Cancer is one of the major causes of mortality and morbidity in our healthcare system. Molecular imaging is an emerging methodology for the early detection of cancer, guidance of therapy, and monitoring of response. The development of new instruments and exogenous molecular probes that can be labeled for multi-modality imaging is critical to this process. Today, molecular imaging is at a crossroad, and new targeted imaging agents are expected to broadly expand our ability to detect and manage cancer. This integrated imaging strategy will permit clinicians to not only localize lesions within the body but also to manage their therapy by visualizing the expression and activity of specific molecules. This information is expected to have a major impact on drug development and understanding of basic cancer biology. At this time, a number of molecular probes have been developed by conjugating various labels to affinity ligands for targeting in different imaging modalities. This review will describe the current status of exogenous molecular probes for optical, scintigraphic, MRI and ultrasound imaging platforms. Furthermore, we will also shed light on how these techniques can be used synergistically in multi-modal platforms and how these techniques are being employed in current research. PMID:22180839

Differences in Multi-Modal Ultrasound Imaging between Triple Negative and Non-Triple Negative Breast Cancer.

PubMed

Li, Ziyao; Tian, Jiawei; Wang, Xiaowei; Wang, Ying; Wang, Zhenzhen; Zhang, Lei; Jing, Hui; Wu, Tong

2016-04-01

The objective of this study was to identify multi-modal ultrasound imaging parameters that could potentially help to differentiate between triple negative breast cancer (TNBC) and non-TNBC. Conventional ultrasonography, ultrasound strain elastography and 3-D ultrasound (3-D-US) findings from 50 TNBC and 179 non-TNBC patients were retrospectively reviewed. Immunohistochemical examination was used as the reference gold standard for cancer subtyping. Different ultrasound modalities were initially analyzed to define TNBC-related features. Subsequently, logistic regression analysis was applied to TNBC-related features to establish models for predicting TNBC. TNBCs often presented as micro-lobulated, markedly hypo-echoic masses with an abrupt interface (p = 0.015, 0.0015 and 0.004, compared with non-TNBCs, respectively) on conventional ultrasound, and showed a diminished retraction pattern phenomenon in the coronal plane (p = 0.035) on 3-D-US. Our findings suggest that B-mode ultrasound and 3-D-US in multi-modality ultrasonography could be a useful non-invasive technique for differentiating TNBCs from non-TNBCs. Copyright © 2016 World Federation for Ultrasound in Medicine & Biology. Published by Elsevier Inc. All rights reserved.

Design and performance of an ultra-high vacuum spin-polarized scanning tunneling microscope operating at 30 mK and in a vector magnetic field

NASA Astrophysics Data System (ADS)

von Allwörden, Henning; Eich, Andreas; Knol, Elze J.; Hermenau, Jan; Sonntag, Andreas; Gerritsen, Jan W.; Wegner, Daniel; Khajetoorians, Alexander A.

2018-03-01

We describe the design and performance of a scanning tunneling microscope (STM) that operates at a base temperature of 30 mK in a vector magnetic field. The cryogenics is based on an ultra-high vacuum (UHV) top-loading wet dilution refrigerator that contains a vector magnet allowing for fields up to 9 T perpendicular and 4 T parallel to the sample. The STM is placed in a multi-chamber UHV system, which allows in situ preparation and exchange of samples and tips. The entire system rests on a 150-ton concrete block suspended by pneumatic isolators, which is housed in an acoustically isolated and electromagnetically shielded laboratory optimized for extremely low noise scanning probe measurements. We demonstrate the overall performance by illustrating atomic resolution and quasiparticle interference imaging and detail the vibrational noise of both the laboratory and microscope. We also determine the electron temperature via measurement of the superconducting gap of Re(0001) and illustrate magnetic field-dependent measurements of the spin excitations of individual Fe atoms on Pt(111). Finally, we demonstrate spin resolution by imaging the magnetic structure of the Fe double layer on W(110).

Design and performance of an ultra-high vacuum spin-polarized scanning tunneling microscope operating at 30 mK and in a vector magnetic field.

PubMed

von Allwörden, Henning; Eich, Andreas; Knol, Elze J; Hermenau, Jan; Sonntag, Andreas; Gerritsen, Jan W; Wegner, Daniel; Khajetoorians, Alexander A

2018-03-01

We describe the design and performance of a scanning tunneling microscope (STM) that operates at a base temperature of 30 mK in a vector magnetic field. The cryogenics is based on an ultra-high vacuum (UHV) top-loading wet dilution refrigerator that contains a vector magnet allowing for fields up to 9 T perpendicular and 4 T parallel to the sample. The STM is placed in a multi-chamber UHV system, which allows in situ preparation and exchange of samples and tips. The entire system rests on a 150-ton concrete block suspended by pneumatic isolators, which is housed in an acoustically isolated and electromagnetically shielded laboratory optimized for extremely low noise scanning probe measurements. We demonstrate the overall performance by illustrating atomic resolution and quasiparticle interference imaging and detail the vibrational noise of both the laboratory and microscope. We also determine the electron temperature via measurement of the superconducting gap of Re(0001) and illustrate magnetic field-dependent measurements of the spin excitations of individual Fe atoms on Pt(111). Finally, we demonstrate spin resolution by imaging the magnetic structure of the Fe double layer on W(110).

A scanning tunneling microscope with a scanning range from hundreds of micrometers down to nanometer resolution.

PubMed

Kalkan, Fatih; Zaum, Christopher; Morgenstern, Karina

2012-10-01

A beetle type stage and a flexure scanning stage are combined to form a two stages scanning tunneling microscope (STM). It operates at room temperature in ultrahigh vacuum and is capable of scanning areas up to 300 μm × 450 μm down to resolution on the nanometer scale. This multi-scale STM has been designed and constructed in order to investigate prestructured metallic or semiconducting micro- and nano-structures in real space from atomic-sized structures up to the large-scale environment. The principle of the instrument is demonstrated on two different systems. Gallium nitride based micropillars demonstrate scan areas up to hundreds of micrometers; a Au(111) surface demonstrates nanometer resolution.

A graph-based approach for the retrieval of multi-modality medical images.

PubMed

Kumar, Ashnil; Kim, Jinman; Wen, Lingfeng; Fulham, Michael; Feng, Dagan

2014-02-01

In this paper, we address the retrieval of multi-modality medical volumes, which consist of two different imaging modalities, acquired sequentially, from the same scanner. One such example, positron emission tomography and computed tomography (PET-CT), provides physicians with complementary functional and anatomical features as well as spatial relationships and has led to improved cancer diagnosis, localisation, and staging. The challenge of multi-modality volume retrieval for cancer patients lies in representing the complementary geometric and topologic attributes between tumours and organs. These attributes and relationships, which are used for tumour staging and classification, can be formulated as a graph. It has been demonstrated that graph-based methods have high accuracy for retrieval by spatial similarity. However, naïvely representing all relationships on a complete graph obscures the structure of the tumour-anatomy relationships. We propose a new graph structure derived from complete graphs that structurally constrains the edges connected to tumour vertices based upon the spatial proximity of tumours and organs. This enables retrieval on the basis of tumour localisation. We also present a similarity matching algorithm that accounts for different feature sets for graph elements from different imaging modalities. Our method emphasises the relationships between a tumour and related organs, while still modelling patient-specific anatomical variations. Constraining tumours to related anatomical structures improves the discrimination potential of graphs, making it easier to retrieve similar images based on tumour location. We evaluated our retrieval methodology on a dataset of clinical PET-CT volumes. Our results showed that our method enabled the retrieval of multi-modality images using spatial features. Our graph-based retrieval algorithm achieved a higher precision than several other retrieval techniques: gray-level histograms as well as state-of-the-art methods such as visual words using the scale- invariant feature transform (SIFT) and relational matrices representing the spatial arrangements of objects. Copyright © 2013 Elsevier B.V. All rights reserved.

Single-photon counting multicolor multiphoton fluorescence microscope.

PubMed

Buehler, Christof; Kim, Ki H; Greuter, Urs; Schlumpf, Nick; So, Peter T C

2005-01-01

We present a multicolor multiphoton fluorescence microscope with single-photon counting sensitivity. The system integrates a standard multiphoton fluorescence microscope, an optical grating spectrograph operating in the UV-Vis wavelength region, and a 16-anode photomultiplier tube (PMT). The major technical innovation is in the development of a multichannel photon counting card (mC-PhCC) for direct signal collection from multi-anode PMTs. The electronic design of the mC-PhCC employs a high-throughput, fully-parallel, single-photon counting scheme along with a high-speed electrical or fiber-optical link interface to the data acquisition computer. There is no electronic crosstalk among the detection channels of the mC-PhCC. The collected signal remains linear up to an incident photon rate of 10(8) counts per second. The high-speed data interface offers ample bandwidth for real-time readout: 2 MByte lambda-stacks composed of 16 spectral channels, 256 x 256 pixel image with 12-bit dynamic range can be transferred at 30 frames per second. The modular design of the mC-PhCC can be readily extended to accommodate PMTs of more anodes. Data acquisition from a 64-anode PMT has been verified. As a demonstration of system performance, spectrally resolved images of fluorescent latex spheres and ex-vivo human skin are reported. The multicolor multiphoton microscope is suitable for highly sensitive, real-time, spectrally-resolved three-dimensional imaging in biomedical applications.

A DICOM-based 2nd generation Molecular Imaging Data Grid implementing the IHE XDS-i integration profile.

PubMed

Lee, Jasper; Zhang, Jianguo; Park, Ryan; Dagliyan, Grant; Liu, Brent; Huang, H K

2012-07-01

A Molecular Imaging Data Grid (MIDG) was developed to address current informatics challenges in archival, sharing, search, and distribution of preclinical imaging studies between animal imaging facilities and investigator sites. This manuscript presents a 2nd generation MIDG replacing the Globus Toolkit with a new system architecture that implements the IHE XDS-i integration profile. Implementation and evaluation were conducted using a 3-site interdisciplinary test-bed at the University of Southern California. The 2nd generation MIDG design architecture replaces the initial design's Globus Toolkit with dedicated web services and XML-based messaging for dedicated management and delivery of multi-modality DICOM imaging datasets. The Cross-enterprise Document Sharing for Imaging (XDS-i) integration profile from the field of enterprise radiology informatics was adopted into the MIDG design because streamlined image registration, management, and distribution dataflow are likewise needed in preclinical imaging informatics systems as in enterprise PACS application. Implementation of the MIDG is demonstrated at the University of Southern California Molecular Imaging Center (MIC) and two other sites with specified hardware, software, and network bandwidth. Evaluation of the MIDG involves data upload, download, and fault-tolerance testing scenarios using multi-modality animal imaging datasets collected at the USC Molecular Imaging Center. The upload, download, and fault-tolerance tests of the MIDG were performed multiple times using 12 collected animal study datasets. Upload and download times demonstrated reproducibility and improved real-world performance. Fault-tolerance tests showed that automated failover between Grid Node Servers has minimal impact on normal download times. Building upon the 1st generation concepts and experiences, the 2nd generation MIDG system improves accessibility of disparate animal-model molecular imaging datasets to users outside a molecular imaging facility's LAN using a new architecture, dataflow, and dedicated DICOM-based management web services. Productivity and efficiency of preclinical research for translational sciences investigators has been further streamlined for multi-center study data registration, management, and distribution.

Shapes, scents and sounds: quantifying the full multi-sensory basis of conceptual knowledge.

PubMed

Hoffman, Paul; Lambon Ralph, Matthew A

2013-01-01

Contemporary neuroscience theories assume that concepts are formed through experience in multiple sensory-motor modalities. Quantifying the contribution of each modality to different object categories is critical to understanding the structure of the conceptual system and to explaining category-specific knowledge deficits. Verbal feature listing is typically used to elicit this information but has a number of drawbacks: sensory knowledge often cannot easily be translated into verbal features and many features are experienced in multiple modalities. Here, we employed a more direct approach in which subjects rated their knowledge of objects in each sensory-motor modality separately. Compared with these ratings, feature listing over-estimated the importance of visual form and functional knowledge and under-estimated the contributions of other sensory channels. An item's sensory rating proved to be a better predictor of lexical-semantic processing speed than the number of features it possessed, suggesting that ratings better capture the overall quantity of sensory information associated with a concept. Finally, the richer, multi-modal rating data not only replicated the sensory-functional distinction between animals and non-living things but also revealed novel distinctions between different types of artefact. Hierarchical cluster analyses indicated that mechanical devices (e.g., vehicles) were distinct from other non-living objects because they had strong sound and motion characteristics, making them more similar to animals in this respect. Taken together, the ratings align with neuroscience evidence in suggesting that a number of distinct sensory processing channels make important contributions to object knowledge. Multi-modal ratings for 160 objects are provided as supplementary materials. Copyright © 2012 Elsevier Ltd. All rights reserved.

Distributed flow estimation and closed-loop control of an underwater vehicle with a multi-modal artificial lateral line.

PubMed

DeVries, Levi; Lagor, Francis D; Lei, Hong; Tan, Xiaobo; Paley, Derek A

2015-03-25

Bio-inspired sensing modalities enhance the ability of autonomous vehicles to characterize and respond to their environment. This paper concerns the lateral line of cartilaginous and bony fish, which is sensitive to fluid motion and allows fish to sense oncoming flow and the presence of walls or obstacles. The lateral line consists of two types of sensing modalities: canal neuromasts measure approximate pressure gradients, whereas superficial neuromasts measure local flow velocities. By employing an artificial lateral line, the performance of underwater sensing and navigation strategies is improved in dark, cluttered, or murky environments where traditional sensing modalities may be hindered. This paper presents estimation and control strategies enabling an airfoil-shaped unmanned underwater vehicle to assimilate measurements from a bio-inspired, multi-modal artificial lateral line and estimate flow properties for feedback control. We utilize potential flow theory to model the fluid flow past a foil in a uniform flow and in the presence of an upstream obstacle. We derive theoretically justified nonlinear estimation strategies to estimate the free stream flowspeed, angle of attack, and the relative position of an upstream obstacle. The feedback control strategy uses the estimated flow properties to execute bio-inspired behaviors including rheotaxis (the tendency of fish to orient upstream) and station-holding (the tendency of fish to position behind an upstream obstacle). A robotic prototype outfitted with a multi-modal artificial lateral line composed of ionic polymer metal composite and embedded pressure sensors experimentally demonstrates the distributed flow sensing and closed-loop control strategies.

Development of a Multi-modal Tissue Diagnostic System Combining High Frequency Ultrasound and Photoacoustic Imaging with Lifetime Fluorescence Spectroscopy

PubMed Central

Sun, Yang; Stephens, Douglas N.; Park, Jesung; Sun, Yinghua; Marcu, Laura; Cannata, Jonathan M.; Shung, K. Kirk

2010-01-01

We report the development and validate a multi-modal tissue diagnostic technology, which combines three complementary techniques into one system including ultrasound backscatter microscopy (UBM), photoacoustic imaging (PAI), and time-resolved laser-induced fluorescence spectroscopy (TR-LIFS). UBM enables the reconstruction of the tissue microanatomy. PAI maps the optical absorption heterogeneity of the tissue associated with structure information and has the potential to provide functional imaging of the tissue. Examination of the UBM and PAI images allows for localization of regions of interest for TR-LIFS evaluation of the tissue composition. The hybrid probe consists of a single element ring transducer with concentric fiber optics for multi-modal data acquisition. Validation and characterization of the multi-modal system and ultrasonic, photoacoustic, and spectroscopic data coregistration were conducted in a physical phantom with properties of ultrasound scattering, optical absorption, and fluorescence. The UBM system with the 41 MHz ring transducer can reach the axial and lateral resolution of 30 and 65 μm, respectively. The PAI system with 532 nm excitation light from a Nd:YAG laser shows great contrast for the distribution of optical absorbers. The TR-LIFS system records the fluorescence decay with the time resolution of ~300 ps and a high sensitivity of nM concentration range. Biological phantom constructed with different types of tissues (tendon and fat) was used to demonstrate the complementary information provided by the three modalities. Fluorescence spectra and lifetimes were compared to differentiate chemical composition of tissues at the regions of interest determined by the coregistered high resolution UBM and PAI image. Current results demonstrate that the fusion of these techniques enables sequentially detection of functional, morphological, and compositional features of biological tissue, suggesting potential applications in diagnosis of tumors and atherosclerotic plaques. PMID:21894259

Development of a Multi-modal Tissue Diagnostic System Combining High Frequency Ultrasound and Photoacoustic Imaging with Lifetime Fluorescence Spectroscopy.

PubMed

Sun, Yang; Stephens, Douglas N; Park, Jesung; Sun, Yinghua; Marcu, Laura; Cannata, Jonathan M; Shung, K Kirk

2008-01-01

We report the development and validate a multi-modal tissue diagnostic technology, which combines three complementary techniques into one system including ultrasound backscatter microscopy (UBM), photoacoustic imaging (PAI), and time-resolved laser-induced fluorescence spectroscopy (TR-LIFS). UBM enables the reconstruction of the tissue microanatomy. PAI maps the optical absorption heterogeneity of the tissue associated with structure information and has the potential to provide functional imaging of the tissue. Examination of the UBM and PAI images allows for localization of regions of interest for TR-LIFS evaluation of the tissue composition. The hybrid probe consists of a single element ring transducer with concentric fiber optics for multi-modal data acquisition. Validation and characterization of the multi-modal system and ultrasonic, photoacoustic, and spectroscopic data coregistration were conducted in a physical phantom with properties of ultrasound scattering, optical absorption, and fluorescence. The UBM system with the 41 MHz ring transducer can reach the axial and lateral resolution of 30 and 65 μm, respectively. The PAI system with 532 nm excitation light from a Nd:YAG laser shows great contrast for the distribution of optical absorbers. The TR-LIFS system records the fluorescence decay with the time resolution of ~300 ps and a high sensitivity of nM concentration range. Biological phantom constructed with different types of tissues (tendon and fat) was used to demonstrate the complementary information provided by the three modalities. Fluorescence spectra and lifetimes were compared to differentiate chemical composition of tissues at the regions of interest determined by the coregistered high resolution UBM and PAI image. Current results demonstrate that the fusion of these techniques enables sequentially detection of functional, morphological, and compositional features of biological tissue, suggesting potential applications in diagnosis of tumors and atherosclerotic plaques.

A novel tracing method for the segmentation of cell wall networks.

PubMed

De Vylder, Jonas; Rooms, Filip; Dhondt, Stijn; Inze, Dirk; Philips, Wilfried

2013-01-01

Cell wall networks are a common subject of research in biology, which are important for plant growth analysis, organ studies, etc. In order to automate the detection of individual cells in such cell wall networks, we propose a new segmentation algorithm. The proposed method is a network tracing algorithm, exploiting the prior knowledge of the network structure. The method is applicable on multiple microscopy modalities such as fluorescence, but also for images captured using non invasive microscopes such as differential interference contrast (DIC) microscopes.

Percolated microstructures for multi-modal transport enhancement in porous active materials

DOEpatents

McKay, Ian Salmon; Yang, Sungwoo; Wang, Evelyn N.; Kim, Hyunho

2018-03-13

A method of forming a composite material for use in multi-modal transport includes providing three-dimensional graphene having hollow channels, enabling a polymer to wick into the hollow channels of the three-dimensional graphene, curing the polymer to form a cured three-dimensional graphene, adding an active material to the cured three-dimensional graphene to form a composite material, and removing the polymer from within the hollow channels. A composite material formed according to the method is also provided.

A deep learning approach for pose estimation from volumetric OCT data.

PubMed

Gessert, Nils; Schlüter, Matthias; Schlaefer, Alexander

2018-05-01

Tracking the pose of instruments is a central problem in image-guided surgery. For microscopic scenarios, optical coherence tomography (OCT) is increasingly used as an imaging modality. OCT is suitable for accurate pose estimation due to its micrometer range resolution and volumetric field of view. However, OCT image processing is challenging due to speckle noise and reflection artifacts in addition to the images' 3D nature. We address pose estimation from OCT volume data with a new deep learning-based tracking framework. For this purpose, we design a new 3D convolutional neural network (CNN) architecture to directly predict the 6D pose of a small marker geometry from OCT volumes. We use a hexapod robot to automatically acquire labeled data points which we use to train 3D CNN architectures for multi-output regression. We use this setup to provide an in-depth analysis on deep learning-based pose estimation from volumes. Specifically, we demonstrate that exploiting volume information for pose estimation yields higher accuracy than relying on 2D representations with depth information. Supporting this observation, we provide quantitative and qualitative results that 3D CNNs effectively exploit the depth structure of marker objects. Regarding the deep learning aspect, we present efficient design principles for 3D CNNs, making use of insights from the 2D deep learning community. In particular, we present Inception3D as a new architecture which performs best for our application. We show that our deep learning approach reaches errors at our ground-truth label's resolution. We achieve a mean average error of 14.89 ± 9.3 µm and 0.096 ± 0.072° for position and orientation learning, respectively. Copyright © 2018 Elsevier B.V. All rights reserved.

Design and installation of a multimode microscopy system

NASA Astrophysics Data System (ADS)

Helm, Johannes P.; Haug, Finn-Mogens S.; Storm, Johan F.; Ottersen, Ole-Petter

2001-04-01

We describe design and installation of a multi-mode microscopy core facility in an environment of varied research activity in life-sciences. The experimentators can select any combination of a) microscopes (upright, upright fixed-stage, inverted), b) microscopy modes (widefield, DIC, IRDIC, widefield epifluorescence, transmission LSM, reflection and fluorescence CLSM, MPLSM), c) imaging techniques (direct observation, video observation, photography, quantitative camera-recording, flying spot scanning), d) auxiliary systems (equipment for live specimen imaging, electrophysiology, time-coordinated laser-scanning and electrophysiology, patch-clamp). The equipment is installed on one large vibration-isolating optical table (3m X 1.5m X 0.3m). Electronics, auxiliary equipment, and a fiber-coupled, remotely controlled Ar+-Kr+ laser are mounted in a rack system fixed to the ceiling. The design of the shelves allows the head of the CSLM to be moved to any of the microscopes without increasing critical cable lengths. At the same time easy access to all the units is preserved. The beam of a Titanium-Sapphire laser, controlled by means of an EOM and a prism GVD, is coupled directly to the microscopes. Three mirrors mounted on a single precision translation table are integrated into the beam steering system so that the beam can easily be redirected to any of the microscopes. All the available instruments can be operated by the educated and trained user. The system is popular among researchers in neuroanatomy, embryology, cell biology, molecular biology - including the study of protein interactions, e.g. by means of FRET, and electrophysiology. Its colocalization with an EM facility promises to provide considerable synergy effects.

Introduction to clinical and laboratory (small-animal) image registration and fusion.

PubMed

Zanzonico, Pat B; Nehmeh, Sadek A

2006-01-01

Imaging has long been a vital component of clinical medicine and, increasingly, of biomedical research in small-animals. Clinical and laboratory imaging modalities can be divided into two general categories, structural (or anatomical) and functional (or physiological). The latter, in particular, has spawned what has come to be known as "molecular imaging". Image registration and fusion have rapidly emerged as invaluable components of both clinical and small-animal imaging and has lead to the development and marketing of a variety of multi-modality, e.g. PET-CT, devices which provide registered and fused three-dimensional image sets. This paper briefly reviews the basics of image registration and fusion and available clinical and small-animal multi-modality instrumentation.

Using online modules is a multi-modality teaching system: a high-touch high-tech approach to geriatric education.

PubMed

Gainor, Sara Jane; Goins, R Turner; Miller, Lee Ann

2004-01-01

Making geriatric education available to rural faculty/preceptors, students, and practitioners presents many challenges. Often the only options considered for educating those in the health professions about geriatrics are either traditional face-to-face courses or distance education programs. The purpose of this paper was to examine the use of Web-based modules or courses and other distance learning technology in concert with traditional learning modalities. The Mountain State Geriatric Education Center explored the use of a multi-modal approach within a high-touch, high-tech framework. Our findings indicate the following: it is important to start where participants are ready to begin; flexibility and variety are needed; soliciting evaluative feedback from participants is valuable; there is a need to integrate distance learning with more traditional modalities; and a high-tech, high-touch approach provides a format which participants find acceptable, accessible, and attractive. This assertion does not rule out the use of technology for distance education but rather encourages educators to take advantage of a wide range of modalities, traditional and technological, to reach rural practitioners, faculty, and students.

The Cambridge Centre for Ageing and Neuroscience (Cam-CAN) data repository: Structural and functional MRI, MEG, and cognitive data from a cross-sectional adult lifespan sample.

PubMed

Taylor, Jason R; Williams, Nitin; Cusack, Rhodri; Auer, Tibor; Shafto, Meredith A; Dixon, Marie; Tyler, Lorraine K; Cam-Can; Henson, Richard N

2017-01-01

This paper describes the data repository for the Cambridge Centre for Ageing and Neuroscience (Cam-CAN) initial study cohort. The Cam-CAN Stage 2 repository contains multi-modal (MRI, MEG, and cognitive-behavioural) data from a large (approximately N=700), cross-sectional adult lifespan (18-87years old) population-based sample. The study is designed to characterise age-related changes in cognition and brain structure and function, and to uncover the neurocognitive mechanisms that support healthy cognitive ageing. The database contains raw and preprocessed structural MRI, functional MRI (active tasks and resting state), and MEG data (active tasks and resting state), as well as derived scores from cognitive behavioural experiments spanning five broad domains (attention, emotion, action, language, and memory), and demographic and neuropsychological data. The dataset thus provides a depth of neurocognitive phenotyping that is currently unparalleled, enabling integrative analyses of age-related changes in brain structure, brain function, and cognition, and providing a testbed for novel analyses of multi-modal neuroimaging data. Copyright © 2015 The Authors. Published by Elsevier Inc. All rights reserved.

DOE Office of Scientific and Technical Information (OSTI.GOV)

Larner, J.

In this interactive session, lung SBRT patient cases will be presented to highlight real-world considerations for ensuring safe and accurate treatment delivery. An expert panel of speakers will discuss challenges specific to lung SBRT including patient selection, patient immobilization techniques, 4D CT simulation and respiratory motion management, target delineation for treatment planning, online treatment alignment, and established prescription regimens and OAR dose limits. Practical examples of cases, including the patient flow thought the clinical process are presented and audience participation will be encouraged. This panel session is designed to provide case demonstration and review for lung SBRT in terms ofmore » (1) clinical appropriateness in patient selection, (2) strategies for simulation, including 4D and respiratory motion management, and (3) applying multi imaging modality (4D CT imaging, MRI, PET) for tumor volume delineation and motion extent, and (4) image guidance in treatment delivery. Learning Objectives: Understand the established requirements for patient selection in lung SBRT Become familiar with the various immobilization strategies for lung SBRT, including technology for respiratory motion management Understand the benefits and pitfalls of applying multi imaging modality (4D CT imaging, MRI, PET) for tumor volume delineation and motion extent determination for lung SBRT Understand established prescription regimes and OAR dose limits.« less

A View on the Importance of "Multi-Attribute Method" for Measuring Purity of Biopharmaceuticals and Improving Overall Control Strategy.

PubMed

Rogers, Richard S; Abernathy, Michael; Richardson, Douglas D; Rouse, Jason C; Sperry, Justin B; Swann, Patrick; Wypych, Jette; Yu, Christopher; Zang, Li; Deshpande, Rohini

2017-11-30

Today, we are experiencing unprecedented growth and innovation within the pharmaceutical industry. Established protein therapeutic modalities, such as recombinant human proteins, monoclonal antibodies (mAbs), and fusion proteins, are being used to treat previously unmet medical needs. Novel therapies such as bispecific T cell engagers (BiTEs), chimeric antigen T cell receptors (CARTs), siRNA, and gene therapies are paving the path towards increasingly personalized medicine. This advancement of new indications and therapeutic modalities is paralleled by development of new analytical technologies and methods that provide enhanced information content in a more efficient manner. Recently, a liquid chromatography-mass spectrometry (LC-MS) multi-attribute method (MAM) has been developed and designed for improved simultaneous detection, identification, quantitation, and quality control (monitoring) of molecular attributes (Rogers et al. MAbs 7(5):881-90, 2015). Based on peptide mapping principles, this powerful tool represents a true advancement in testing methodology that can be utilized not only during product characterization, formulation development, stability testing, and development of the manufacturing process, but also as a platform quality control method in dispositioning clinical materials for both innovative biotherapeutics and biosimilars.

Working Memory and Speech Recognition in Noise Under Ecologically Relevant Listening Conditions: Effects of Visual Cues and Noise Type Among Adults With Hearing Loss.

PubMed

Miller, Christi W; Stewart, Erin K; Wu, Yu-Hsiang; Bishop, Christopher; Bentler, Ruth A; Tremblay, Kelly

2017-08-16

This study evaluated the relationship between working memory (WM) and speech recognition in noise with different noise types as well as in the presence of visual cues. Seventy-six adults with bilateral, mild to moderately severe sensorineural hearing loss (mean age: 69 years) participated. Using a cross-sectional design, 2 measures of WM were taken: a reading span measure, and Word Auditory Recognition and Recall Measure (Smith, Pichora-Fuller, & Alexander, 2016). Speech recognition was measured with the Multi-Modal Lexical Sentence Test for Adults (Kirk et al., 2012) in steady-state noise and 4-talker babble, with and without visual cues. Testing was under unaided conditions. A linear mixed model revealed visual cues and pure-tone average as the only significant predictors of Multi-Modal Lexical Sentence Test outcomes. Neither WM measure nor noise type showed a significant effect. The contribution of WM in explaining unaided speech recognition in noise was negligible and not influenced by noise type or visual cues. We anticipate that with audibility partially restored by hearing aids, the effects of WM will increase. For clinical practice to be affected, more significant effect sizes are needed.

[3D-TV health assessment system by the multi-modal physiological signals].

PubMed

Li, Zhongqiang; Xing, Lidong; Qian, Zhiyu; Wang, Xiao; Yu, Defei; Liu, Baoyu; Jin, Shuai

2014-03-01

In order to meet the requirements of the multi-physiological signal measurement of the 3D-TV health assessment, try to find the suitable biological acquisition chips and design the hardware system which can detect different physiological signals in real time. The systems mainly uses ARM11/S3C6410 microcontroller to control the EEG/EOG acquisition chip RHA2116 and the ECG acquisition chip ADS1298, and then the microcontroller transfer the data collected by the chips to the PC software by the USB port which can display and save the experimental data in real time, then use the Matlab software for further processing of the data, finally make a final health assessment. In the meantime, for the different varieties in the different brain regions of watching 3D-TV, developed the special brain electrode placement and the experimental data processing methods, then effectively disposed the multi-signal data in the multilevel.

Partnering for transportation safety : human-centered systems : operator fatigue management conference

DOT National Transportation Integrated Search

2000-01-01

This Conference was intended to enlist support for, and participation in, a new multi-modal DOT safety initiative. This initiative builds on the modal agency programs within DOT to develop techniques that transportation operating companies can employ...

Multi-Modal Traveler Information System - VMS/HAR State-of-the-Practice

DOT National Transportation Integrated Search

1997-05-30

The Gary-Chicago-Milwaukee (GCM) Corridor is one of the four "Priority Corridors" established by the United States Congress in the Inter-Modal Surface Transportation Efficiency Act (ISTEA). These corridors have been selected for special federal trans...

Failure Analysis of a Complex Learning Framework Incorporating Multi-Modal and Semi-Supervised Learning

DOE Office of Scientific and Technical Information (OSTI.GOV)

Pullum, Laura L; Symons, Christopher T

2011-01-01

Machine learning is used in many applications, from machine vision to speech recognition to decision support systems, and is used to test applications. However, though much has been done to evaluate the performance of machine learning algorithms, little has been done to verify the algorithms or examine their failure modes. Moreover, complex learning frameworks often require stepping beyond black box evaluation to distinguish between errors based on natural limits on learning and errors that arise from mistakes in implementation. We present a conceptual architecture, failure model and taxonomy, and failure modes and effects analysis (FMEA) of a semi-supervised, multi-modal learningmore » system, and provide specific examples from its use in a radiological analysis assistant system. The goal of the research described in this paper is to provide a foundation from which dependability analysis of systems using semi-supervised, multi-modal learning can be conducted. The methods presented provide a first step towards that overall goal.« less

Research on electromechanical resonance of two-axis tracking system

NASA Astrophysics Data System (ADS)

Zhao, Zhi-ming; Xue, Ying-jie; Zeng, Shu-qin; Li, Zhi-guo

2017-02-01

The multi-axes synchronous system about the spatial two-axis turntable is the key equipment for semi-physical simulation and test in aerospace. In this paper, the whole structure design of the turntable is created by using Solidworks, then putting the three-dimensional solid model into ANSYS to build the finite element model. The software ANSYS is used to do the simulation about the static and dynamic analysis of two-axis turntable. Based on the modal analysis, we can forecast the inherent frequencies and the mode of vibration during the launch conditions which is very important to the design and safety of the structure.

Endoscopy in neuro-otologic surgery.

PubMed

Wackym, Phillip A; King, Wesley A; Meyer, Glenn A; Poe, Dennis S

2002-04-01

Endoscopy offers several distinct advantages over the operating microscope during neuro-otologic surgery that make it an excellent adjunctive tool to the microscope or independent modality during cranial base surgery. The high magnification gives excellent definition of perforating blood vessels, cranial nerves, and neural structures, which in many cases is superior to that achieved with the microscope. Furthermore, the use of angled or flexible endoscopes allows one to look around corners and behind anatomic structures blocking the view seen via a 0 degree microscope. Endoscopy also has the theoretical advantage that a less invasive operative procedure is required, which should reduce the operative morbidity. Several notable disadvantages of endoscopy include the problems associated with blood soiling the endoscope, making visualization difficult or impossible, the lack of readily available instrumentation designed specifically for endoscopic neuro-otology, and the poor overview of the operative field. This last point is an important one because the endoscope is placed adjacent to the lesion and does not allow one to look backward to prevent [figure: see text] injury to structures next to the shaft of the telescope. Furthermore, the surgeon must be cognizant of potential thermal injury to structures caused by the heat generated by the light source. The present endoscopic technology limits the image that the surgeon sees to two dimensions, which results in certain unique problems when operating in a three-dimensional milieu. Because of this, there is a steep learning curve to acquire endoscopic dexterity and three-dimensional orientation. Finally, bimanual operation requires the use of an articulated endoscope holder or the commitment of the co-surgeon to hold the endoscope. One of the limitations of the operative microscope is that the angle of view is determined by the distance of the lens to the skull, retractor, or obstructing tissue, which is a function of the lens focal length; the longer the focal length, the narrower the viewing angle. During most microsurgical procedures, the focal distance varies between 200 and 400 mm. Using a previous analogy, if one looks through a door's keyhole at close range, nearly the entire room on the opposite side of the door can be seen, although nothing can be seen when the hole is viewed from a long distance. This is similar to what happens when using the endoscope with focal lengths ranging from 5 to 20 mm: a wider angle of view can be achieved. Based on their, experience the authors believe that endoscopes can be used safely during neuro-otologic surgery. As an adjunct to or substitution for the operative microscope, this modality does improve visualization of bony, neural, and vascular structures while minimizing cerebellar retraction.

Hand hygiene and healthcare system change within multi-modal promotion: a narrative review.

PubMed

Allegranzi, B; Sax, H; Pittet, D

2013-02-01

Many factors may influence the level of compliance with hand hygiene recommendations by healthcare workers. Lack of products and facilities as well as their inappropriate and non-ergonomic location represent important barriers. Targeted actions aimed at making hand hygiene practices feasible during healthcare delivery by ensuring that the necessary infrastructure is in place, defined as 'system change', are essential to improve hand hygiene in healthcare. In particular, access to alcohol-based hand rubs (AHRs) enables appropriate and timely hand hygiene performance at the point of care. The feasibility and impact of system change within multi-modal strategies have been demonstrated both at institutional level and on a large scale. The introduction of AHRs overcomes some important barriers to best hand hygiene practices and is associated with higher compliance, especially when integrated within multi-modal strategies. Several studies demonstrated the association between AHR consumption and reduction in healthcare-associated infection, in particular, meticillin-resistant Staphylococcus aureus bacteraemia. Recent reports demonstrate the feasibility and success of system change implementation on a large scale. The World Health Organization and other investigators have reported the challenges and encouraging results of implementing hand hygiene improvement strategies, including AHR introduction, in settings with limited resources. This review summarizes the available evidence demonstrating the need for system change and its importance within multi-modal hand hygiene improvement strategies. This topic is also discussed in a global perspective and highlights some controversial issues. Copyright © 2013 The Healthcare Infection Society. Published by Elsevier Ltd. All rights reserved.

An evaluation of the effectiveness of a multi-modal intervention in frail and pre-frail older people with type 2 diabetes--the MID-Frail study: study protocol for a randomised controlled trial.

PubMed

Rodríguez-Mañas, Leocadio; Bayer, Antony J; Kelly, Mark; Zeyfang, Andrej; Izquierdo, Mikel; Laosa, Olga; Hardman, Timothy C; Sinclair, Alan J; Moreira, Severina; Cook, Justin

2014-01-24

Diabetes, a highly prevalent, chronic disease, is associated with increasing frailty and functional decline in older people, with concomitant personal, social, and public health implications. We describe the rationale and methods of the multi-modal intervention in diabetes in frailty (MID-Frail) study. The MID-Frail study is an open, randomised, multicentre study, with random allocation by clusters (each trial site) to a usual care group or an intervention group. A total of 1,718 subjects will be randomised with each site enrolling on average 14 or 15 subjects. The primary objective of the study is to evaluate, in comparison with usual clinical practice, the effectiveness of a multi-modal intervention (specific clinical targets, education, diet, and resistance training exercise) in frail and pre-frail subjects aged ≥70 years with type 2 diabetes in terms of the difference in function 2 years post-randomisation. Difference in function will be measured by changes in a summary ordinal score on the short physical performance battery (SPPB) of at least one point. Secondary outcomes include daily activities, economic evaluation, and quality of life. The MID-Frail study will provide evidence on the clinical, functional, social, and economic impact of a multi-modal approach in frail and pre-frail older people with type 2 diabetes. ClinicalTrials.gov: NCT01654341.

X-ray/EUV optics for astronomy, microscopy, polarimetry, and projection lithography; Proceedings of the Meeting, San Diego, CA, July 9-13, 1990

NASA Technical Reports Server (NTRS)

Hoover, Richard B. (Editor); Walker, Arthur B. C., Jr. (Editor)

1991-01-01

Topics discussed in this issue include the fabrication of multilayer X-ray/EUV coatings; the design, characterization, and test of multilayer X-ray/EUV coatings; multilayer X-ray/EUV monochromators and imaging microscopes; X-ray/EUV telescopes; the test and calibration performance of X-ray/EUV instruments; XUV/soft X-ray projection lithography; X-ray/EUV space observatories and missions; X-ray/EUV telescopes for solar research; X-ray/EUV polarimetry; X-ray/EUV spectrographs; and X-ray/EUV filters and gratings. Papers are presented on the deposition-controlled uniformity of multilayer mirrors, interfaces in Mo/Si multilayers, the design and analysis of an aspherical multilayer imaging X-ray microscope, recent developments in the production of thin X-ray reflecting foils, and the ultraprecise scanning technology. Consideration is also given to an active sun telescope array, the fabrication and performance at 1.33 nm of a 0.24-micron-period multilayer grating, a cylindrical proportional counter for X-ray polarimetry, and the design and analysis of the reflection grating arrays for the X-Ray Multi-Mirror Mission.

Prussian blue nanocubes: multi-functional nanoparticles for multimodal imaging and image-guided therapy (Conference Presentation)

NASA Astrophysics Data System (ADS)

Cook, Jason R.; Dumani, Diego S.; Kubelick, Kelsey P.; Luci, Jeffrey; Emelianov, Stanislav Y.

2017-03-01

Imaging modalities utilize contrast agents to improve morphological visualization and to assess functional and molecular/cellular information. Here we present a new type of nanometer scale multi-functional particle that can be used for multi-modal imaging and therapeutic applications. Specifically, we synthesized monodisperse 20 nm Prussian Blue Nanocubes (PBNCs) with desired optical absorption in the near-infrared region and superparamagnetic properties. PBNCs showed excellent contrast in photoacoustic (700 nm wavelength) and MR (3T) imaging. Furthermore, photostability was assessed by exposing the PBNCs to nearly 1,000 laser pulses (5 ns pulse width) with up to 30 mJ/cm2 laser fluences. The PBNCs exhibited insignificant changes in photoacoustic signal, demonstrating enhanced robustness compared to the commonly used gold nanorods (substantial photodegradation with fluences greater than 5 mJ/cm2). Furthermore, the PBNCs exhibited superparamagnetism with a magnetic saturation of 105 emu/g, a 5x improvement over superparamagnetic iron-oxide (SPIO) nanoparticles. PBNCs exhibited enhanced T2 contrast measured using 3T clinical MRI. Because of the excellent optical absorption and magnetism, PBNCs have potential uses in other imaging modalities including optical tomography, microscopy, magneto-motive OCT/ultrasound, etc. In addition to multi-modal imaging, the PBNCs are multi-functional and, for example, can be used to enhance magnetic delivery and as therapeutic agents. Our initial studies show that stem cells can be labeled with PBNCs to perform image-guided magnetic delivery. Overall, PBNCs can act as imaging/therapeutic agents in diverse applications including cancer, cardiovascular disease, ophthalmology, and tissue engineering. Furthermore, PBNCs are based on FDA approved Prussian Blue thus potentially easing clinical translation of PBNCs.

Eyecup scope—optical recordings of light stimulus-evoked fluorescence signals in the retina

PubMed Central

Hausselt, Susanne E.; Breuninger, Tobias; Castell, Xavier; Denk, Winfried; Margolis, David J.; Detwiler, Peter B.

2009-01-01

Dendritic signals play an essential role in processing visual information in the retina. To study them in neurites too small for electrical recording, we developed an instrument that combines a multi-photon (MP) microscope with a through-the-objective high-resolution visual stimulator. An upright microscope was designed that uses the objective lens for both MP imaging and delivery of visual stimuli to functionally intact retinal explants or eyecup preparations. The stimulator consists of a miniature liquid-crystal-on-silicon display coupled into the optical path of an infrared-excitation laser-scanning microscope. A pair of custom-made dichroic filters allows light from the excitation laser and three spectral bands (‘colors’) from the stimulator to reach the retina, leaving two intermediate bands for fluorescence imaging. Special optics allow displacement of the stimulator focus relative to the imaging focus. Spatially resolved changes in calcium-indicator fluorescence in response to visual stimuli were recorded in dendrites of different types of mammalian retinal neurons. PMID:19023590

Heat Source Characterization In A TREAT Fuel Particle Using Coupled Neutronics Binary Collision Monte-Carlo Calculations

DOE Office of Scientific and Technical Information (OSTI.GOV)

Schunert, Sebastian; Schwen, Daniel; Ghassemi, Pedram

This work presents a multi-physics, multi-scale approach to modeling the Transient Test Reactor (TREAT) currently prepared for restart at the Idaho National Laboratory. TREAT fuel is made up of microscopic fuel grains (r ˜ 20µm) dispersed in a graphite matrix. The novelty of this work is in coupling a binary collision Monte-Carlo (BCMC) model to the Finite Element based code Moose for solving a microsopic heat-conduction problem whose driving source is provided by the BCMC model tracking fission fragment energy deposition. This microscopic model is driven by a transient, engineering scale neutronics model coupled to an adiabatic heating model. Themore » macroscopic model provides local power densities and neutron energy spectra to the microscpic model. Currently, no feedback from the microscopic to the macroscopic model is considered. TREAT transient 15 is used to exemplify the capabilities of the multi-physics, multi-scale model, and it is found that the average fuel grain temperature differs from the average graphite temperature by 80 K despite the low-power transient. The large temperature difference has strong implications on the Doppler feedback a potential LEU TREAT core would see, and it underpins the need for multi-physics, multi-scale modeling of a TREAT LEU core.« less

Acoustic metamaterials with synergetic coupling

NASA Astrophysics Data System (ADS)

Ma, Fuyin; Huang, Meng; Wu, Jiu Hui

2017-12-01

In this paper, we propose a general design concept for acoustic metamaterials that introduces a ubiquitous synergetic behavior into the design procedure, in which the structure of the design is driven by its functional requirements. Since the physical properties of the widely used, resonant-type metamaterials are mainly determined by the eigenmodes of the structure, we first introduce the design concept through the modal displacement distributions on two typical plate-type structures. Next, by employing broadband sound attenuations that involve both the insulation and absorption as the typical targets, two synergetic coupling behaviors are systematically revealed among the dense resonant modes and multi-cell. Furthermore, through plate-type multiple-cell structures assembled from nine oscillators, the design is shown to realize strong broadband attenuations with either the average sound transmission loss (STL) below 2000 Hz higher than 40 dB or the absorption approximately 0.99 in the range of 400-700 Hz wherein the average absorption below 800 Hz remains higher than 0.8. Finally, two multi-cell plate-type samples are fabricated and then used experimentally to measure the STLs in support of the proposed synergetic coupling design method. Both the computational and experimental results demonstrate that the proposed synergetic design concept could effectively initiate a design for metamaterials that offer a new degree of freedom for broadband sound attenuations.

Multi-compartment microscopic diffusion imaging

PubMed Central

Kaden, Enrico; Kelm, Nathaniel D.; Carson, Robert P.; Does, Mark D.; Alexander, Daniel C.

2017-01-01

This paper introduces a multi-compartment model for microscopic diffusion anisotropy imaging. The aim is to estimate microscopic features specific to the intra- and extra-neurite compartments in nervous tissue unconfounded by the effects of fibre crossings and orientation dispersion, which are ubiquitous in the brain. The proposed MRI method is based on the Spherical Mean Technique (SMT), which factors out the neurite orientation distribution and thus provides direct estimates of the microscopic tissue structure. This technique can be immediately used in the clinic for the assessment of various neurological conditions, as it requires only a widely available off-the-shelf sequence with two b-shells and high-angular gradient resolution achievable within clinically feasible scan times. To demonstrate the developed method, we use high-quality diffusion data acquired with a bespoke scanner system from the Human Connectome Project. This study establishes the normative values of the new biomarkers for a large cohort of healthy young adults, which may then support clinical diagnostics in patients. Moreover, we show that the microscopic diffusion indices offer direct sensitivity to pathological tissue alterations, exemplified in a preclinical animal model of Tuberous Sclerosis Complex (TSC), a genetic multi-organ disorder which impacts brain microstructure and hence may lead to neurological manifestations such as autism, epilepsy and developmental delay. PMID:27282476

Design and Optimization of Composite Automotive Hatchback Using Integrated Material-Structure-Process-Performance Method

NASA Astrophysics Data System (ADS)

Yang, Xudong; Sun, Lingyu; Zhang, Cheng; Li, Lijun; Dai, Zongmiao; Xiong, Zhenkai

2018-03-01

The application of polymer composites as a substitution of metal is an effective approach to reduce vehicle weight. However, the final performance of composite structures is determined not only by the material types, structural designs and manufacturing process, but also by their mutual restrict. Hence, an integrated "material-structure-process-performance" method is proposed for the conceptual and detail design of composite components. The material selection is based on the principle of composite mechanics such as rule of mixture for laminate. The design of component geometry, dimension and stacking sequence is determined by parametric modeling and size optimization. The selection of process parameters are based on multi-physical field simulation. The stiffness and modal constraint conditions were obtained from the numerical analysis of metal benchmark under typical load conditions. The optimal design was found by multi-discipline optimization. Finally, the proposed method was validated by an application case of automotive hatchback using carbon fiber reinforced polymer. Compared with the metal benchmark, the weight of composite one reduces 38.8%, simultaneously, its torsion and bending stiffness increases 3.75% and 33.23%, respectively, and the first frequency also increases 44.78%.

Beyond RGB: Very high resolution urban remote sensing with multimodal deep networks

NASA Astrophysics Data System (ADS)

Audebert, Nicolas; Le Saux, Bertrand; Lefèvre, Sébastien

2018-06-01

In this work, we investigate various methods to deal with semantic labeling of very high resolution multi-modal remote sensing data. Especially, we study how deep fully convolutional networks can be adapted to deal with multi-modal and multi-scale remote sensing data for semantic labeling. Our contributions are threefold: (a) we present an efficient multi-scale approach to leverage both a large spatial context and the high resolution data, (b) we investigate early and late fusion of Lidar and multispectral data, (c) we validate our methods on two public datasets with state-of-the-art results. Our results indicate that late fusion make it possible to recover errors steaming from ambiguous data, while early fusion allows for better joint-feature learning but at the cost of higher sensitivity to missing data.

A Novel, Minimally-Invasive Approach to Repair Degenerative Disk Disease in an Ovine Model Using Injectable Polymethyl-Methacrylate and Bovine Collagen (PMMA/BC)

PubMed Central

Feldman, Erica; Narayan, Anisha; Taylor, William

2016-01-01

Background : The natural, inflammatory repair processes of an injured intervertebral degenerative disc can propagate further injury and destruction. While there are many different treatment modalities of the pain related to degenerative disc disease, none are actually reparative in nature. Treatment strategies to repair a degenerative disc without inducing a destructive inflammatory milieu have been elusive.  Purpose: The purpose of this experiment is to discover the feasibility of reconstructing an injured intervertebral disc using an injected, inert polymer as the foundation for endogenous collagen growth. Study Design: In this ovine model of six subjects in total, we introduce a modality where a large inert polymer, polymethyl methacrylate (PMMA), in conjunction bovine collagen (BC) is injected into the intervertebral disc. Following six months of observation, histologic specimens were evaluated macroscopically and microscopically for evidence of a benefit of the injectable PMMA/BC. Methods: We obtained six merino sheep for this study. Concentric injuries were made to four of their lumbar intervertebral discs. Two of those levels were treated with a percutaneous injection of 0.3 cc of PMMA/BC. The remaining lumbar levels were left untreated and were our controls. After six months, all subjects were sacrificed. Their four levels were extracted and were examined macroscopically and microscopically. Results: All subjects tolerated the lumbar injury and percutaneous injection of PMMA/BC well. After the six month interval, all subjects have demonstrated an intact architecture of their lumbar disc height at the macroscopic and microscopic level. Microscopically, there was no evidence of external migration of the PMMA/BC microspheres, nor was there any evidence of an inflammatory response by its presence. Notably, the PMMA/BC microspheres were well-incorporated into the concentric disc tears and had undergone endogenous collagen formation in its environment. Treatment levels were revealing for maintenance of disc height without evidence of an ongoing degeneration. The controlled levels were revealing for continued disc degeneration with loss of disc height and evolving injury at the level of the concentric tear. Conclusions: This ovine model demonstrates a novel and promising technique for prevention and arrest of lumbar intervertebral disc degeneration. PMID:27630802

Pancreatic tissue assessment using fluorescence and reflectance spectroscopy

NASA Astrophysics Data System (ADS)

Chandra, Malavika; Heidt, David; Simeone, Diane; McKenna, Barbara; Scheiman, James; Mycek, Mary-Ann

2007-07-01

The ability of multi-modal optical spectroscopy to detect signals from pancreatic tissue was demonstrated by studying human pancreatic cancer xenografts in mice and freshly excised human pancreatic tumor tissue. Measured optical spectra and fluorescence decays were correlated with tissue morphological and biochemical properties. The measured spectral features and decay times correlated well with expected pathological differences in normal, pancreatitis and adenocarcinoma tissue states. The observed differences between the fluorescence and reflectance properties of normal, pancreatitis and adenocarcinoma tissue indicate a possible application of multi-modal optical spectroscopy to differentiating between the three tissue classifications.

Novel minimally invasive multi-modality monitoring modalities in neurocritical care.

PubMed

Al-Mufti, Fawaz; Smith, Brendan; Lander, Megan; Damodara, Nitesh; Nuoman, Rolla; El-Ghanem, Mohammad; Kamal, Naveed; Al-Marsoummi, Sarmad; Alzubaidi, Basim; Nuoaman, Halla; Foreman, Brandon; Amuluru, Krishna; Gandhi, Chirag D

2018-07-15

Elevated intracranial pressure (ICP) following brain injury contributes to poor outcomes for patients, primarily by reducing the caliber of cerebral vasculature, and thereby reducing cerebral blood flow. Careful monitoring of ICP is critical in these patients in order to determine prognosis, implement treatment when ICP becomes elevated, and to judge responsiveness to treatment. Currently, the gold standard for monitoring is invasive pressure transducers, usually an intraventricular monitor, which presents significant risk of infection and hemorrhage. These risks made discovering non-invasive methods for monitoring ICP and cerebral perfusion a priority for researchers. Herein we sought to review recent publications on novel minimally invasive multi-modality monitoring techniques that provide surrogate data on ICP, cerebral oxygenation, metabolism and blood flow. While limitations in various forms preclude them from supplanting the use of invasive monitors, these modalities represent useful screening tools within our armamentarium that may be invaluable when the risks of invasive monitoring outweigh the associated benefits. Copyright © 2018 Elsevier B.V. All rights reserved.

Bi-orthogonality relations for fluid-filled elastic cylindrical shells: Theory, generalisations and application to construct tailored Green's matrices

NASA Astrophysics Data System (ADS)

Ledet, Lasse S.; Sorokin, Sergey V.

2018-03-01

The paper addresses the classical problem of time-harmonic forced vibrations of a fluid-filled cylindrical shell considered as a multi-modal waveguide carrying infinitely many waves. The forced vibration problem is solved using tailored Green's matrices formulated in terms of eigenfunction expansions. The formulation of Green's matrix is based on special (bi-)orthogonality relations between the eigenfunctions, which are derived here for the fluid-filled shell. Further, the relations are generalised to any multi-modal symmetric waveguide. Using the orthogonality relations the transcendental equation system is converted into algebraic modal equations that can be solved analytically. Upon formulation of Green's matrices the solution space is studied in terms of completeness and convergence (uniformity and rate). Special features and findings exposed only through this modal decomposition method are elaborated and the physical interpretation of the bi-orthogonality relation is discussed in relation to the total energy flow which leads to derivation of simplified equations for the energy flow components.

Analysis and characterization of high-resolution and high-aspect-ratio imaging fiber bundles.

PubMed

Motamedi, Nojan; Karbasi, Salman; Ford, Joseph E; Lomakin, Vitaliy

2015-11-10

High-contrast imaging fiber bundles (FBs) are characterized and modeled for wide-angle and high-resolution imaging applications. Scanning electron microscope images of FB cross sections are taken to measure physical parameters and verify the variations of irregular fibers due to the fabrication process. Modal analysis tools are developed that include irregularities in the fiber core shapes and provide results in agreement with experimental measurements. The modeling demonstrates that the irregular fibers significantly outperform a perfectly regular "ideal" array. Using this method, FBs are designed that can provide high contrast with core pitches of only a few wavelengths of the guided light. Structural modifications of the commercially available FB can reduce the core pitch by 60% for higher resolution image relay.

Moving Toward the Light: Using New Technology to Answer Old Questions

PubMed Central

LUCITTI, JENNIFER L.; DICKINSON, MARY E.

2006-01-01

Fluorescence microscopy has become a principle methodology in the field of developmental biology. Recent technological advances have led to the design of high-speed and high-resolution confocal and multiphoton microscopes that enable researchers to obtain three- and four-dimensional information in living cells and whole embryos. Paralleling this progress, the development of stable and bright vital fluorescent probes has revolutionized the ability to track individual cells in vitro and in vivo and to visualize intercellular and subcellular molecular interactions in real time. Combining imaging modalities and labeling techniques that are increasingly unobtrusive to cell and whole animal function, our understanding of how proteins interact, tissues take form, and organs synchronize to create a functioning animal is reaching a whole new level. PMID:16690954

Synthesis and evaluation of multi-wall carbon nanotube-paclitaxel complex as an anti-cancer agent.

PubMed

Ghasemvand, Fariba; Biazar, Esmaeil; Tavakolifard, Sara; Khaledian, Mohammad; Rahmanzadeh, Saeid; Momenzadeh, Daruosh; Afroosheh, Roshanak; Zarkalami, Faezeh; Shabannezhad, Marjan; Hesami Tackallou, Saeed; Massoudi, Nilofar; Heidari Keshel, Saeed

2016-01-01

The aim of this study was to design multi-walled carbon nanotubes (MWCNTs) loaded with paclitaxel (PTX) anti-cancer drug and investigate its anti-cancerous efficacy of human gastric cancer. Carbon nanotubes (CNTs) represent a novel nano-materials applied in various fields such as drug delivery due to their unique chemical properties and high drug loading. In this study, multi-walled carbon nanotubes (MWCNTs) pre-functionalized covalently with a paclitaxel (PTX) as an anti-cancer drug and evaluated by different analyses including, scanning electron microscope (SEM), particle size analyzer and cellular analyses. A well conjugated of anti-cancer drug on the carbon nanotube surfaces was shown. This study demonstrates that the MWCN-PTX complex is a potentially useful system for delivery of anti-cancer drugs. The flow cytometry, CFU and MTT assay results have disclosed that MWCNT/PTXs might promote apoptosis in MKN-45 gastric adenocarcinoma cell line. According to results, our simple method can be designed a candidate material for chemotherapy. It has presented a few bio-related applications including, their successful use as a nano-carriers for drug transport.

Hyperspectral imaging with laser-scanning sum-frequency generation microscopy

PubMed Central

Hanninen, Adam; Shu, Ming Wai; Potma, Eric O.

2017-01-01

Vibrationally sensitive sum-frequency generation (SFG) microscopy is a chemically selective imaging technique sensitive to non-centrosymmetric molecular arrangements in biological samples. The routine use of SFG microscopy has been hampered by the difficulty of integrating the required mid-infrared excitation light into a conventional, laser-scanning nonlinear optical (NLO) microscope. In this work, we describe minor modifications to a regular laser-scanning microscope to accommodate SFG microscopy as an imaging modality. We achieve vibrationally sensitive SFG imaging of biological samples with sub-μm resolution at image acquisition rates of 1 frame/s, almost two orders of magnitude faster than attained with previous point-scanning SFG microscopes. Using the fast scanning capability, we demonstrate hyperspectral SFG imaging in the CH-stretching vibrational range and point out its use in the study of molecular orientation and arrangement in biologically relevant samples. We also show multimodal imaging by combining SFG microscopy with second-harmonic generation (SHG) and coherent anti-Stokes Raman scattering (CARS) on the same imaging platfrom. This development underlines that SFG microscopy is a unique modality with a spatial resolution and image acquisition time comparable to that of other NLO imaging techniques, making point-scanning SFG microscopy a valuable member of the NLO imaging family. PMID:28966861

Smartphone based hand-held quantitative phase microscope using the transport of intensity equation method.

PubMed

Meng, Xin; Huang, Huachuan; Yan, Keding; Tian, Xiaolin; Yu, Wei; Cui, Haoyang; Kong, Yan; Xue, Liang; Liu, Cheng; Wang, Shouyu

2016-12-20

In order to realize high contrast imaging with portable devices for potential mobile healthcare, we demonstrate a hand-held smartphone based quantitative phase microscope using the transport of intensity equation method. With a cost-effective illumination source and compact microscope system, multi-focal images of samples can be captured by the smartphone's camera via manual focusing. Phase retrieval is performed using a self-developed Android application, which calculates sample phases from multi-plane intensities via solving the Poisson equation. We test the portable microscope using a random phase plate with known phases, and to further demonstrate its performance, a red blood cell smear, a Pap smear and monocot root and broad bean epidermis sections are also successfully imaged. Considering its advantages as an accurate, high-contrast, cost-effective and field-portable device, the smartphone based hand-held quantitative phase microscope is a promising tool which can be adopted in the future in remote healthcare and medical diagnosis.

Compact, cost-effective and field-portable microscope prototype based on MISHELF microscopy

NASA Astrophysics Data System (ADS)

Sanz, Martín; Picazo-Bueno, José Ángel; Granero, Luis; García, Javier; Micó, Vicente

2017-02-01

We report on a reduced cost, portable and compact prototype design of lensless holographic microscope with an illumination/detection scheme based on wavelength multiplexing, working with single hologram acquisition and using a fast convergence algorithm for image processing. All together, MISHELF (initials coming from Multi-Illumination Single-Holographic-Exposure Lensless Fresnel) microscopy allows the recording of three Fresnel domain diffraction patterns in a single camera snap-shot incoming from illuminating the sample with three coherent lights at once. Previous implementations have proposed an illumination/detection procedure based on a tuned (illumination wavelengths centered at the maximum sensitivity of the camera detection channels) configuration but here we report on a detuned (non-centered ones) scheme resulting in prototype miniaturization and cost reduction. Thus, MISHELF microscopy in combination with a novel and fast iterative algorithm allows high-resolution (μm range) phase-retrieved (twin image elimination) quantitative phase imaging of dynamic events (video rate recording speed). The performance of this microscope prototype is validated through experiments using both amplitude (USAF resolution test) and complex (live swine sperm cells and flowing microbeads) samples. The proposed method becomes in an alternative instrument improving some capabilities of existing lensless microscopes.

Compact, cost-effective and field-portable microscope prototype based on MISHELF microscopy

PubMed Central

Sanz, Martín; Picazo-Bueno, José Ángel; Granero, Luis; García, Javier; Micó, Vicente

2017-01-01

We report on a reduced cost, portable and compact prototype design of lensless holographic microscope with an illumination/detection scheme based on wavelength multiplexing, working with single hologram acquisition and using a fast convergence algorithm for image processing. All together, MISHELF (initials coming from Multi-Illumination Single-Holographic-Exposure Lensless Fresnel) microscopy allows the recording of three Fresnel domain diffraction patterns in a single camera snap-shot incoming from illuminating the sample with three coherent lights at once. Previous implementations have proposed an illumination/detection procedure based on a tuned (illumination wavelengths centered at the maximum sensitivity of the camera detection channels) configuration but here we report on a detuned (non-centered ones) scheme resulting in prototype miniaturization and cost reduction. Thus, MISHELF microscopy in combination with a novel and fast iterative algorithm allows high-resolution (μm range) phase-retrieved (twin image elimination) quantitative phase imaging of dynamic events (video rate recording speed). The performance of this microscope prototype is validated through experiments using both amplitude (USAF resolution test) and complex (live swine sperm cells and flowing microbeads) samples. The proposed method becomes in an alternative instrument improving some capabilities of existing lensless microscopes. PMID:28233829

Performance evaluation of a compact PET/SPECT/CT tri-modality system for small animal imaging applications

NASA Astrophysics Data System (ADS)

Wei, Qingyang; Wang, Shi; Ma, Tianyu; Wu, Jing; Liu, Hui; Xu, Tianpeng; Xia, Yan; Fan, Peng; Lyu, Zhenlei; Liu, Yaqiang

2015-06-01

PET, SPECT and CT imaging techniques are widely used in preclinical small animal imaging applications. In this paper, we present a compact small animal PET/SPECT/CT tri-modality system. A dual-functional, shared detector design is implemented which enables PET and SPECT imaging with a same LYSO ring detector. A multi-pinhole collimator is mounted on the system and inserted into the detector ring in SPECT imaging mode. A cone-beam CT consisting of a micro focus X-ray tube and a CMOS detector is implemented. The detailed design and the performance evaluations are reported in this paper. In PET imaging mode, the measured NEMA based spatial resolution is 2.12 mm (FWHM), and the sensitivity at the central field of view (CFOV) is 3.2%. The FOV size is 50 mm (∅)×100 mm (L). The SPECT has a spatial resolution of 1.32 mm (FWHM) and an average sensitivity of 0.031% at the center axial, and a 30 mm (∅)×90 mm (L) FOV. The CT spatial resolution is 8.32 lp/mm @10%MTF, and the contrast discrimination function value is 2.06% with 1.5 mm size cubic box object. In conclusion, a compact, tri-modality PET/SPECT/CT system was successfully built with low cost and high performance.

Visual exploration and analysis of human-robot interaction rules

NASA Astrophysics Data System (ADS)

Zhang, Hui; Boyles, Michael J.

2013-01-01

We present a novel interaction paradigm for the visual exploration, manipulation and analysis of human-robot interaction (HRI) rules; our development is implemented using a visual programming interface and exploits key techniques drawn from both information visualization and visual data mining to facilitate the interaction design and knowledge discovery process. HRI is often concerned with manipulations of multi-modal signals, events, and commands that form various kinds of interaction rules. Depicting, manipulating and sharing such design-level information is a compelling challenge. Furthermore, the closed loop between HRI programming and knowledge discovery from empirical data is a relatively long cycle. This, in turn, makes design-level verification nearly impossible to perform in an earlier phase. In our work, we exploit a drag-and-drop user interface and visual languages to support depicting responsive behaviors from social participants when they interact with their partners. For our principal test case of gaze-contingent HRI interfaces, this permits us to program and debug the robots' responsive behaviors through a graphical data-flow chart editor. We exploit additional program manipulation interfaces to provide still further improvement to our programming experience: by simulating the interaction dynamics between a human and a robot behavior model, we allow the researchers to generate, trace and study the perception-action dynamics with a social interaction simulation to verify and refine their designs. Finally, we extend our visual manipulation environment with a visual data-mining tool that allows the user to investigate interesting phenomena such as joint attention and sequential behavioral patterns from multiple multi-modal data streams. We have created instances of HRI interfaces to evaluate and refine our development paradigm. As far as we are aware, this paper reports the first program manipulation paradigm that integrates visual programming interfaces, information visualization, and visual data mining methods to facilitate designing, comprehending, and evaluating HRI interfaces.

ultraLM and miniLM: Locator tools for smart tracking of fluorescent cells in correlative light and electron microscopy.

PubMed

Brama, Elisabeth; Peddie, Christopher J; Wilkes, Gary; Gu, Yan; Collinson, Lucy M; Jones, Martin L

2016-12-13

In-resin fluorescence (IRF) protocols preserve fluorescent proteins in resin-embedded cells and tissues for correlative light and electron microscopy, aiding interpretation of macromolecular function within the complex cellular landscape. Dual-contrast IRF samples can be imaged in separate fluorescence and electron microscopes, or in dual-modality integrated microscopes for high resolution correlation of fluorophore to organelle. IRF samples also offer a unique opportunity to automate correlative imaging workflows. Here we present two new locator tools for finding and following fluorescent cells in IRF blocks, enabling future automation of correlative imaging. The ultraLM is a fluorescence microscope that integrates with an ultramicrotome, which enables 'smart collection' of ultrathin sections containing fluorescent cells or tissues for subsequent transmission electron microscopy or array tomography. The miniLM is a fluorescence microscope that integrates with serial block face scanning electron microscopes, which enables 'smart tracking' of fluorescent structures during automated serial electron image acquisition from large cell and tissue volumes.

Multi-Modality Cascaded Convolutional Neural Networks for Alzheimer's Disease Diagnosis.

PubMed

Liu, Manhua; Cheng, Danni; Wang, Kundong; Wang, Yaping

2018-03-23

Accurate and early diagnosis of Alzheimer's disease (AD) plays important role for patient care and development of future treatment. Structural and functional neuroimages, such as magnetic resonance images (MRI) and positron emission tomography (PET), are providing powerful imaging modalities to help understand the anatomical and functional neural changes related to AD. In recent years, machine learning methods have been widely studied on analysis of multi-modality neuroimages for quantitative evaluation and computer-aided-diagnosis (CAD) of AD. Most existing methods extract the hand-craft imaging features after image preprocessing such as registration and segmentation, and then train a classifier to distinguish AD subjects from other groups. This paper proposes to construct cascaded convolutional neural networks (CNNs) to learn the multi-level and multimodal features of MRI and PET brain images for AD classification. First, multiple deep 3D-CNNs are constructed on different local image patches to transform the local brain image into more compact high-level features. Then, an upper high-level 2D-CNN followed by softmax layer is cascaded to ensemble the high-level features learned from the multi-modality and generate the latent multimodal correlation features of the corresponding image patches for classification task. Finally, these learned features are combined by a fully connected layer followed by softmax layer for AD classification. The proposed method can automatically learn the generic multi-level and multimodal features from multiple imaging modalities for classification, which are robust to the scale and rotation variations to some extent. No image segmentation and rigid registration are required in pre-processing the brain images. Our method is evaluated on the baseline MRI and PET images of 397 subjects including 93 AD patients, 204 mild cognitive impairment (MCI, 76 pMCI +128 sMCI) and 100 normal controls (NC) from Alzheimer's Disease Neuroimaging Initiative (ADNI) database. Experimental results show that the proposed method achieves an accuracy of 93.26% for classification of AD vs. NC and 82.95% for classification pMCI vs. NC, demonstrating the promising classification performance.

Sensei: A Multi-Modal Framework for Assessing Stress Resiliency

DTIC Science & Technology

2013-05-01

Modal Framework for Assessing Stress Resiliency (May 1-31, 2013) From: Ajay Divakaran, Technical Leader Jeffrey Lubin, Senior Research Scientist...17 (May 2013): Task 3.1: Capture Behavioral Stress Markers in Real-Time in Lab Environment with graded exposure to ICT’s scenarios MAC 1-6...Modal Framework for Assessing Stress Resiliency 5a. CONTRACT NUMBER 5b. GRANT NUMBER 5c. PROGRAM ELEMENT NUMBER 6. AUTHOR(S) 5d. PROJECT NUMBER

Performance evaluation of image segmentation algorithms on microscopic image data.

PubMed

Beneš, Miroslav; Zitová, Barbara

2015-01-01

In our paper, we present a performance evaluation of image segmentation algorithms on microscopic image data. In spite of the existence of many algorithms for image data partitioning, there is no universal and 'the best' method yet. Moreover, images of microscopic samples can be of various character and quality which can negatively influence the performance of image segmentation algorithms. Thus, the issue of selecting suitable method for a given set of image data is of big interest. We carried out a large number of experiments with a variety of segmentation methods to evaluate the behaviour of individual approaches on the testing set of microscopic images (cross-section images taken in three different modalities from the field of art restoration). The segmentation results were assessed by several indices used for measuring the output quality of image segmentation algorithms. In the end, the benefit of segmentation combination approach is studied and applicability of achieved results on another representatives of microscopic data category - biological samples - is shown. © 2014 The Authors Journal of Microscopy © 2014 Royal Microscopical Society.

PARO robot affects diverse interaction modalities in group sensory therapy for older adults with dementia.

PubMed

Šabanović, Selma; Bennett, Casey C; Chang, Wan-Ling; Huber, Lesa

2013-06-01

We evaluated the seal-like robot PARO in the context of multi-sensory behavioral therapy in a local nursing home. Participants were 10 elderly nursing home residents with varying levels of dementia. We report three principle findings from our observations of interactions between the residents, PARO, and a therapist during seven weekly therapy sessions. Firstly, we show PARO provides indirect benefits for users by increasing their activity in particular modalities of social interaction, including visual, verbal, and physical interaction, which vary between primary and non-primary interactors. Secondly, PARO's positive effects on older adults' activity levels show steady growth over the duration of our study, suggesting they are not due to short-term "novelty effects." Finally, we show a variety of ways in which individual participants interacted with PARO and relate this to the "interpretive flexibility" of its design.

Multi-Sensor Based State Prediction for Personal Mobility Vehicles

PubMed Central

Gupta, Pankaj; Umata, Ichiro; Watanabe, Atsushi; Even, Jani; Suyama, Takayuki; Ishii, Shin

2016-01-01

This paper presents a study on multi-modal human emotional state detection while riding a powered wheelchair (PMV; Personal Mobility Vehicle) in an indoor labyrinth-like environment. The study reports findings on the habituation of human stress response during self-driving. In addition, the effects of “loss of controllability”, change in the role of the driver to a passenger, are investigated via an autonomous driving modality. The multi-modal emotional state detector sensing framework consists of four sensing devices: electroencephalograph (EEG), heart inter-beat interval (IBI), galvanic skin response (GSR) and stressor level lever (in the case of autonomous riding). Physiological emotional state measurement characteristics are organized by time-scale, in terms of capturing slower changes (long-term) and quicker changes from moment-to-moment. Experimental results with fifteen participants regarding subjective emotional state reports and commercial software measurements validated the proposed emotional state detector. Short-term GSR and heart signal characterizations captured moment-to-moment emotional state during autonomous riding (Spearman correlation; ρ = 0.6, p < 0.001). Short-term GSR and EEG characterizations reliably captured moment-to-moment emotional state during self-driving (Classification accuracy; 69.7). Finally, long-term GSR and heart characterizations were confirmed to reliably capture slow changes during autonomous riding and also of emotional state during participant resting state. The purpose of this study and the exploration of various algorithms and sensors in a structured framework is to provide a comprehensive background for multi-modal emotional state prediction experiments and/or applications. Additional discussion regarding the feasibility and utility of the possibilities of these concepts are given. PMID:27732589

Multi-Sensor Based State Prediction for Personal Mobility Vehicles.

PubMed

Abdur-Rahim, Jamilah; Morales, Yoichi; Gupta, Pankaj; Umata, Ichiro; Watanabe, Atsushi; Even, Jani; Suyama, Takayuki; Ishii, Shin

2016-01-01

This paper presents a study on multi-modal human emotional state detection while riding a powered wheelchair (PMV; Personal Mobility Vehicle) in an indoor labyrinth-like environment. The study reports findings on the habituation of human stress response during self-driving. In addition, the effects of "loss of controllability", change in the role of the driver to a passenger, are investigated via an autonomous driving modality. The multi-modal emotional state detector sensing framework consists of four sensing devices: electroencephalograph (EEG), heart inter-beat interval (IBI), galvanic skin response (GSR) and stressor level lever (in the case of autonomous riding). Physiological emotional state measurement characteristics are organized by time-scale, in terms of capturing slower changes (long-term) and quicker changes from moment-to-moment. Experimental results with fifteen participants regarding subjective emotional state reports and commercial software measurements validated the proposed emotional state detector. Short-term GSR and heart signal characterizations captured moment-to-moment emotional state during autonomous riding (Spearman correlation; ρ = 0.6, p < 0.001). Short-term GSR and EEG characterizations reliably captured moment-to-moment emotional state during self-driving (Classification accuracy; 69.7). Finally, long-term GSR and heart characterizations were confirmed to reliably capture slow changes during autonomous riding and also of emotional state during participant resting state. The purpose of this study and the exploration of various algorithms and sensors in a structured framework is to provide a comprehensive background for multi-modal emotional state prediction experiments and/or applications. Additional discussion regarding the feasibility and utility of the possibilities of these concepts are given.

Multimodal nonlinear microscope based on a compact fiber-format laser source

NASA Astrophysics Data System (ADS)

Crisafi, Francesco; Kumar, Vikas; Perri, Antonio; Marangoni, Marco; Cerullo, Giulio; Polli, Dario

2018-01-01

We present a multimodal non-linear optical (NLO) laser-scanning microscope, based on a compact fiber-format excitation laser and integrating coherent anti-Stokes Raman scattering (CARS), stimulated Raman scattering (SRS) and two-photon-excitation fluorescence (TPEF) on a single platform. We demonstrate its capabilities in simultaneously acquiring CARS and SRS images of a blend of 6-μm poly(methyl methacrylate) beads and 3-μm polystyrene beads. We then apply it to visualize cell walls and chloroplast of an unprocessed fresh leaf of Elodea aquatic plant via SRS and TPEF modalities, respectively. The presented NLO microscope, developed in house using off-the-shelf components, offers full accessibility to the optical path and ensures its easy re-configurability and flexibility.

Microscope-integrated optical coherence tomography: A new surgical tool in vitreoretinal surgery.

PubMed

Jayadev, Chaitra; Dabir, Supriya; Vinekar, Anand; Shah, Urmil; Vaid, Tania; Yadav, Naresh Kumar

2015-05-01

Optical coherence tomography (OCT) has revolutionized imaging of ocular structures and various disease conditions. Though it has been used in the clinic for some decades, the OCT has only recently found its way into the operating theater. Early attempts at intraoperative OCT, hand-held and microscope mounted, have already improved our understanding of the surgical pathology and the role it might play in surgical decision-making. The microscope-integrated OCT now allows seamless, high-resolution, real-time imaging of surgical maneuvers from the incision to wound closure. Visualization of instruments and intraoperative tissue manipulation are possible with this in vivo modality and, therefore, help improve the outcome of surgery. In this article, we describe the advantages it offers during various vitreoretinal procedures.

Data management integration for biomedical core facilities

NASA Astrophysics Data System (ADS)

Zhang, Guo-Qiang; Szymanski, Jacek; Wilson, David

2007-03-01

We present the design, development, and pilot-deployment experiences of MIMI, a web-based, Multi-modality Multi-Resource Information Integration environment for biomedical core facilities. This is an easily customizable, web-based software tool that integrates scientific and administrative support for a biomedical core facility involving a common set of entities: researchers; projects; equipments and devices; support staff; services; samples and materials; experimental workflow; large and complex data. With this software, one can: register users; manage projects; schedule resources; bill services; perform site-wide search; archive, back-up, and share data. With its customizable, expandable, and scalable characteristics, MIMI not only provides a cost-effective solution to the overarching data management problem of biomedical core facilities unavailable in the market place, but also lays a foundation for data federation to facilitate and support discovery-driven research.

Optical microscope using an interferometric source of two-color, two-beam entangled photons

DOEpatents

Dress, William B.; Kisner, Roger A.; Richards, Roger K.

2004-07-13

Systems and methods are described for an optical microscope using an interferometric source of multi-color, multi-beam entangled photons. A method includes: downconverting a beam of coherent energy to provide a beam of multi-color entangled photons; converging two spatially resolved portions of the beam of multi-color entangled photons into a converged multi-color entangled photon beam; transforming at least a portion of the converged multi-color entangled photon beam by interaction with a sample to generate an entangled photon specimen beam; and combining the entangled photon specimen beam with an entangled photon reference beam within a single beamsplitter. An apparatus includes: a multi-refringent device providing a beam of multi-color entangled photons; a condenser device optically coupled to the multi-refringent device, the condenser device converging two spatially resolved portions of the beam of multi-color entangled photons into a converged multi-color entangled photon beam; a beam probe director and specimen assembly optically coupled to the condenser device; and a beam splitter optically coupled to the beam probe director and specimen assembly, the beam splitter combining an entangled photon specimen beam from the beam probe director and specimen assembly with an entangled photon reference beam.

Widely tunable semiconductor lasers with three interferometric arms.

PubMed

Su, Guan-Lin; Wu, Ming C

2017-09-04

We present a comprehensive study for a new three-branch widely tunable semiconductor laser based on a self-imaging, lossless multi-mode interference (MMI) coupler. We have developed a general theoretical framework that is applicable to all types of interferometric lasers. Our analysis showed that the three-branch laser offers high side-mode suppression ratios (SMSRs) while maintaining a wide tuning range and a low threshold modal gain of the lasing mode. We also present the design rules for tuning over the dense-wavelength division multiplexing grid over the C-band.

Human-computer interaction for alert warning and attention allocation systems of the multimodal watchstation

NASA Astrophysics Data System (ADS)

Obermayer, Richard W.; Nugent, William A.

2000-11-01

The SPAWAR Systems Center San Diego is currently developing an advanced Multi-Modal Watchstation (MMWS); design concepts and software from this effort are intended for transition to future United States Navy surface combatants. The MMWS features multiple flat panel displays and several modes of user interaction, including voice input and output, natural language recognition, 3D audio, stylus and gestural inputs. In 1999, an extensive literature review was conducted on basic and applied research concerned with alerting and warning systems. After summarizing that literature, a human computer interaction (HCI) designer's guide was prepared to support the design of an attention allocation subsystem (AAS) for the MMWS. The resultant HCI guidelines are being applied in the design of a fully interactive AAS prototype. An overview of key findings from the literature review, a proposed design methodology with illustrative examples, and an assessment of progress made in implementing the HCI designers guide are presented.

Optics clustered to output unique solutions: A multi-laser facility for combined single molecule and ensemble microscopy

NASA Astrophysics Data System (ADS)

Clarke, David T.; Botchway, Stanley W.; Coles, Benjamin C.; Needham, Sarah R.; Roberts, Selene K.; Rolfe, Daniel J.; Tynan, Christopher J.; Ward, Andrew D.; Webb, Stephen E. D.; Yadav, Rahul; Zanetti-Domingues, Laura; Martin-Fernandez, Marisa L.

2011-09-01

Optics clustered to output unique solutions (OCTOPUS) is a microscopy platform that combines single molecule and ensemble imaging methodologies. A novel aspect of OCTOPUS is its laser excitation system, which consists of a central core of interlocked continuous wave and pulsed laser sources, launched into optical fibres and linked via laser combiners. Fibres are plugged into wall-mounted patch panels that reach microscopy end-stations in adjacent rooms. This allows multiple tailor-made combinations of laser colours and time characteristics to be shared by different end-stations minimising the need for laser duplications. This setup brings significant benefits in terms of cost effectiveness, ease of operation, and user safety. The modular nature of OCTOPUS also facilitates the addition of new techniques as required, allowing the use of existing lasers in new microscopes while retaining the ability to run the established parts of the facility. To date, techniques interlinked are multi-photon/multicolour confocal fluorescence lifetime imaging for several modalities of fluorescence resonance energy transfer (FRET) and time-resolved anisotropy, total internal reflection fluorescence, single molecule imaging of single pair FRET, single molecule fluorescence polarisation, particle tracking, and optical tweezers. Here, we use a well-studied system, the epidermal growth factor receptor network, to illustrate how OCTOPUS can aid in the investigation of complex biological phenomena.

Using Multi-Media Projects to Foster Teacher Candidates' Multiple Literacy Skills

ERIC Educational Resources Information Center

Lawrence, Salika A.

2010-01-01

This article describes the strategies used to incorporate multi-modal technology literacy experiences into a graduate level course for literacy specialists. The candidates created a multi-media project in response to literature. Their projects revealed that the teacher candidates used a variety of sources to create the project but the Internet was…

Fluorescently labeled therapeutic antibodies for detection of microscopic melanoma

PubMed Central

Day, Kristine E.; Beck, Lauren N.; Deep, Nicholas L.; Kovar, Joy; Zinn, Kurt R; Rosenthal, Eben L.

2013-01-01

Objective Detection of microscopic disease during surgical resection of melanoma remains a significant challenge. To assess real-time optical imaging for visualization of microscopic cancer, we evaluated three FDA-approved therapeutic monoclonal antibodies. Study Design Prospective, basic science Methods Melanoma cell lines (A375 and SKMEL5) were xenografted into the ears of immunodeficient mice. Bevacizumab, panitumumab, tocilizumab, or a non-specific IgG were covalently linked to a near-infrared (NIR) fluorescent probe (IRDye800CW) and systemically injected. Primary tumors were imaged and then resected under fluorescent guidance using the SPY, an NIR imaging system used in plastic and reconstructive surgeries to evaluate perfusion. Mice were also imaged with the Pearl Impulse small animal imager, an NIR imaging system designed for use with IRDye800CW. Post-resection, small tissue fragments were fluorescently imaged and presence of tumor subsequently confirmed by correlation with histology. Results All fluorescently-labeled therapeutic monoclonal antibodies could adequately delineate tumor from normal tissue based on tumor-to-background ratios (TBR) compared to IgG-IRDye800CW. On serial imaging, panitumumab achieved the highest TBRs with both SPY and Pearl (3.8 and 6.6). When used to guide resections, the antibody-dye conjugates generated TBRs in the range of 1.3-2.2 (average=1.6) using the SPY and 1.9-6.3 (average=2.7) using the Pearl. There was no significant difference amongst the antibodies with either imaging modality or cell line (one-way ANOVA). Conclusion Our data suggests that FDA approved antibodies may be suitable targeting agents for the intraoperative fluorescent detection of melanoma. Level of Evidence N/A PMID:23616260

Bedside functional brain imaging in critically-ill children using high-density EEG source modeling and multi-modal sensory stimulation.

PubMed

Eytan, Danny; Pang, Elizabeth W; Doesburg, Sam M; Nenadovic, Vera; Gavrilovic, Bojan; Laussen, Peter; Guerguerian, Anne-Marie

2016-01-01

Acute brain injury is a common cause of death and critical illness in children and young adults. Fundamental management focuses on early characterization of the extent of injury and optimizing recovery by preventing secondary damage during the days following the primary injury. Currently, bedside technology for measuring neurological function is mainly limited to using electroencephalography (EEG) for detection of seizures and encephalopathic features, and evoked potentials. We present a proof of concept study in patients with acute brain injury in the intensive care setting, featuring a bedside functional imaging set-up designed to map cortical brain activation patterns by combining high density EEG recordings, multi-modal sensory stimulation (auditory, visual, and somatosensory), and EEG source modeling. Use of source-modeling allows for examination of spatiotemporal activation patterns at the cortical region level as opposed to the traditional scalp potential maps. The application of this system in both healthy and brain-injured participants is demonstrated with modality-specific source-reconstructed cortical activation patterns. By combining stimulation obtained with different modalities, most of the cortical surface can be monitored for changes in functional activation without having to physically transport the subject to an imaging suite. The results in patients in an intensive care setting with anatomically well-defined brain lesions suggest a topographic association between their injuries and activation patterns. Moreover, we report the reproducible application of a protocol examining a higher-level cortical processing with an auditory oddball paradigm involving presentation of the patient's own name. This study reports the first successful application of a bedside functional brain mapping tool in the intensive care setting. This application has the potential to provide clinicians with an additional dimension of information to manage critically-ill children and adults, and potentially patients not suited for magnetic resonance imaging technologies.

Fiducial marker for correlating images

DOEpatents

Miller, Lisa Marie [Rocky Point, NY; Smith, Randy J [Wading River, NY; Warren, John B [Port Jefferson, NY; Elliott, Donald [Hampton Bays, NY

2011-06-21

The invention relates to a fiducial marker having a marking grid that is used to correlate and view images produced by different imaging modalities or different imaging and viewing modalities. More specifically, the invention relates to the fiducial marking grid that has a grid pattern for producing either a viewing image and/or a first analytical image that can be overlaid with at least one other second analytical image in order to view a light path or to image different imaging modalities. Depending on the analysis, the grid pattern has a single layer of a certain thickness or at least two layers of certain thicknesses. In either case, the grid pattern is imageable by each imaging or viewing modality used in the analysis. Further, when viewing a light path, the light path of the analytical modality cannot be visualized by viewing modality (e.g., a light microscope objective). By correlating these images, the ability to analyze a thin sample that is, for example, biological in nature but yet contains trace metal ions is enhanced. Specifically, it is desired to analyze both the organic matter of the biological sample and the trace metal ions contained within the biological sample without adding or using extrinsic labels or stains.

Biological applications of confocal fluorescence polarization microscopy

NASA Astrophysics Data System (ADS)

Bigelow, Chad E.

Fluorescence polarization microscopy is a powerful modality capable of sensing changes in the physical properties and local environment of fluorophores. In this thesis we present new applications for the technique in cancer diagnosis and treatment and explore the limits of the modality in scattering media. We describe modifications to our custom-built confocal fluorescence microscope that enable dual-color imaging, optical fiber-based confocal spectroscopy and fluorescence polarization imaging. Experiments are presented that indicate the performance of the instrument for all three modalities. The limits of confocal fluorescence polarization imaging in scattering media are explored and the microscope parameters necessary for accurate polarization images in this regime are determined. A Monte Carlo routine is developed to model the effect of scattering on images. Included in it are routines to track the polarization state of light using the Mueller-Stokes formalism and a model for fluorescence generation that includes sampling the excitation light polarization ellipse, Brownian motion of excited-state fluorophores in solution, and dipole fluorophore emission. Results from this model are compared to experiments performed on a fluorophore-embedded polymer rod in a turbid medium consisting of polystyrene microspheres in aqueous suspension. We demonstrate the utility of the fluorescence polarization imaging technique for removal of contaminating autofluorescence and for imaging photodynamic therapy drugs in cell monolayers. Images of cells expressing green fluorescent protein are extracted from contaminating fluorescein emission. The distribution of meta-tetrahydroxypheny1chlorin in an EMT6 cell monolayer is also presented. A new technique for imaging enzyme activity is presented that is based on observing changes in the anisotropy of fluorescently-labeled substrates. Proof-of-principle studies are performed in a model system consisting of fluorescently labeled bovine serum albumin attached to sepharose beads. The action of trypsin and proteinase K on the albumin is monitored to demonstrate validity of the technique. Images of the processing of the albumin in J774 murine macrophages are also presented indicating large intercellular differences in enzyme activity. Future directions for the technique are also presented, including the design of enzyme probes specific for prostate specific antigen based on fluorescently-labeled dendrimers. A technique for enzyme imaging based on extracellular autofluorescence is also proposed.

Multi-Scale Low-Entropy Method for Optimizing the Processing Parameters during Automated Fiber Placement

PubMed Central

Han, Zhenyu; Sun, Shouzheng; Fu, Hongya; Fu, Yunzhong

2017-01-01

Automated fiber placement (AFP) process includes a variety of energy forms and multi-scale effects. This contribution proposes a novel multi-scale low-entropy method aiming at optimizing processing parameters in an AFP process, where multi-scale effect, energy consumption, energy utilization efficiency and mechanical properties of micro-system could be taken into account synthetically. Taking a carbon fiber/epoxy prepreg as an example, mechanical properties of macro–meso–scale are obtained by Finite Element Method (FEM). A multi-scale energy transfer model is then established to input the macroscopic results into the microscopic system as its boundary condition, which can communicate with different scales. Furthermore, microscopic characteristics, mainly micro-scale adsorption energy, diffusion coefficient entropy–enthalpy values, are calculated under different processing parameters based on molecular dynamics method. Low-entropy region is then obtained in terms of the interrelation among entropy–enthalpy values, microscopic mechanical properties (interface adsorbability and matrix fluidity) and processing parameters to guarantee better fluidity, stronger adsorption, lower energy consumption and higher energy quality collaboratively. Finally, nine groups of experiments are carried out to verify the validity of the simulation results. The results show that the low-entropy optimization method can reduce void content effectively, and further improve the mechanical properties of laminates. PMID:28869520

Multi-Scale Low-Entropy Method for Optimizing the Processing Parameters during Automated Fiber Placement.

PubMed

Han, Zhenyu; Sun, Shouzheng; Fu, Hongya; Fu, Yunzhong

2017-09-03

Automated fiber placement (AFP) process includes a variety of energy forms and multi-scale effects. This contribution proposes a novel multi-scale low-entropy method aiming at optimizing processing parameters in an AFP process, where multi-scale effect, energy consumption, energy utilization efficiency and mechanical properties of micro-system could be taken into account synthetically. Taking a carbon fiber/epoxy prepreg as an example, mechanical properties of macro-meso-scale are obtained by Finite Element Method (FEM). A multi-scale energy transfer model is then established to input the macroscopic results into the microscopic system as its boundary condition, which can communicate with different scales. Furthermore, microscopic characteristics, mainly micro-scale adsorption energy, diffusion coefficient entropy-enthalpy values, are calculated under different processing parameters based on molecular dynamics method. Low-entropy region is then obtained in terms of the interrelation among entropy-enthalpy values, microscopic mechanical properties (interface adsorbability and matrix fluidity) and processing parameters to guarantee better fluidity, stronger adsorption, lower energy consumption and higher energy quality collaboratively. Finally, nine groups of experiments are carried out to verify the validity of the simulation results. The results show that the low-entropy optimization method can reduce void content effectively, and further improve the mechanical properties of laminates.

Simulating electron wave dynamics in graphene superlattices exploiting parallel processing advantages

NASA Astrophysics Data System (ADS)

Rodrigues, Manuel J.; Fernandes, David E.; Silveirinha, Mário G.; Falcão, Gabriel

2018-01-01

This work introduces a parallel computing framework to characterize the propagation of electron waves in graphene-based nanostructures. The electron wave dynamics is modeled using both "microscopic" and effective medium formalisms and the numerical solution of the two-dimensional massless Dirac equation is determined using a Finite-Difference Time-Domain scheme. The propagation of electron waves in graphene superlattices with localized scattering centers is studied, and the role of the symmetry of the microscopic potential in the electron velocity is discussed. The computational methodologies target the parallel capabilities of heterogeneous multi-core CPU and multi-GPU environments and are built with the OpenCL parallel programming framework which provides a portable, vendor agnostic and high throughput-performance solution. The proposed heterogeneous multi-GPU implementation achieves speedup ratios up to 75x when compared to multi-thread and multi-core CPU execution, reducing simulation times from several hours to a couple of minutes.

Quantitative reconstructions in multi-modal photoacoustic and optical coherence tomography imaging

NASA Astrophysics Data System (ADS)

Elbau, P.; Mindrinos, L.; Scherzer, O.

2018-01-01

In this paper we perform quantitative reconstruction of the electric susceptibility and the Grüneisen parameter of a non-magnetic linear dielectric medium using measurement of a multi-modal photoacoustic and optical coherence tomography system. We consider the mathematical model presented in Elbau et al (2015 Handbook of Mathematical Methods in Imaging ed O Scherzer (New York: Springer) pp 1169-204), where a Fredholm integral equation of the first kind for the Grüneisen parameter was derived. For the numerical solution of the integral equation we consider a Galerkin type method.

Deep learning for hybrid EEG-fNIRS brain-computer interface: application to motor imagery classification.

PubMed

Chiarelli, Antonio Maria; Croce, Pierpaolo; Merla, Arcangelo; Zappasodi, Filippo

2018-06-01

Brain-computer interface (BCI) refers to procedures that link the central nervous system to a device. BCI was historically performed using electroencephalography (EEG). In the last years, encouraging results were obtained by combining EEG with other neuroimaging technologies, such as functional near infrared spectroscopy (fNIRS). A crucial step of BCI is brain state classification from recorded signal features. Deep artificial neural networks (DNNs) recently reached unprecedented complex classification outcomes. These performances were achieved through increased computational power, efficient learning algorithms, valuable activation functions, and restricted or back-fed neurons connections. By expecting significant overall BCI performances, we investigated the capabilities of combining EEG and fNIRS recordings with state-of-the-art deep learning procedures. We performed a guided left and right hand motor imagery task on 15 subjects with a fixed classification response time of 1 s and overall experiment length of 10 min. Left versus right classification accuracy of a DNN in the multi-modal recording modality was estimated and it was compared to standalone EEG and fNIRS and other classifiers. At a group level we obtained significant increase in performance when considering multi-modal recordings and DNN classifier with synergistic effect. BCI performances can be significantly improved by employing multi-modal recordings that provide electrical and hemodynamic brain activity information, in combination with advanced non-linear deep learning classification procedures.

Artificial redirection of sensation from prosthetic fingers to the phantom hand map on transradial amputees: vibrotactile versus mechanotactile sensory feedback.

PubMed

Antfolk, Christian; D'Alonzo, Marco; Controzzi, Marco; Lundborg, Göran; Rosén, Birgitta; Sebelius, Fredrik; Cipriani, Christian

2013-01-01

This work assesses the ability of transradial amputees to discriminate multi-site tactile stimuli in sensory discrimination tasks. It compares different sensory feedback modalities using an artificial hand prosthesis in: 1) a modality matched paradigm where pressure recorded on the five fingertips of the hand was fed back as pressure stimulation on five target points on the residual limb; and 2) a modality mismatched paradigm where the pressures were transformed into mechanical vibrations and fed back. Eight transradial amputees took part in the study and were divided in two groups based on the integrity of their phantom map; group A had a complete phantom map on the residual limb whereas group B had an incomplete or nonexisting map. The ability in localizing stimuli was compared with that of 10 healthy subjects using the vibration feedback and 11 healthy subjects using the pressure feedback (in a previous study), on their forearms, in similar experiments. Results demonstrate that pressure stimulation surpassed vibrotactile stimulation in multi-site sensory feedback discrimination. Furthermore, we demonstrate that subjects with a detailed phantom map had the best discrimination performance and even surpassed healthy participants for both feedback paradigms whereas group B had the worst performance overall. Finally, we show that placement of feedback devices on a complete phantom map improves multi-site sensory feedback discrimination, independently of the feedback modality.

Deep learning for hybrid EEG-fNIRS brain–computer interface: application to motor imagery classification

NASA Astrophysics Data System (ADS)

Chiarelli, Antonio Maria; Croce, Pierpaolo; Merla, Arcangelo; Zappasodi, Filippo

2018-06-01

Objective. Brain–computer interface (BCI) refers to procedures that link the central nervous system to a device. BCI was historically performed using electroencephalography (EEG). In the last years, encouraging results were obtained by combining EEG with other neuroimaging technologies, such as functional near infrared spectroscopy (fNIRS). A crucial step of BCI is brain state classification from recorded signal features. Deep artificial neural networks (DNNs) recently reached unprecedented complex classification outcomes. These performances were achieved through increased computational power, efficient learning algorithms, valuable activation functions, and restricted or back-fed neurons connections. By expecting significant overall BCI performances, we investigated the capabilities of combining EEG and fNIRS recordings with state-of-the-art deep learning procedures. Approach. We performed a guided left and right hand motor imagery task on 15 subjects with a fixed classification response time of 1 s and overall experiment length of 10 min. Left versus right classification accuracy of a DNN in the multi-modal recording modality was estimated and it was compared to standalone EEG and fNIRS and other classifiers. Main results. At a group level we obtained significant increase in performance when considering multi-modal recordings and DNN classifier with synergistic effect. Significance. BCI performances can be significantly improved by employing multi-modal recordings that provide electrical and hemodynamic brain activity information, in combination with advanced non-linear deep learning classification procedures.

A vessel segmentation method for multi-modality angiographic images based on multi-scale filtering and statistical models.

PubMed

Lu, Pei; Xia, Jun; Li, Zhicheng; Xiong, Jing; Yang, Jian; Zhou, Shoujun; Wang, Lei; Chen, Mingyang; Wang, Cheng

2016-11-08

Accurate segmentation of blood vessels plays an important role in the computer-aided diagnosis and interventional treatment of vascular diseases. The statistical method is an important component of effective vessel segmentation; however, several limitations discourage the segmentation effect, i.e., dependence of the image modality, uneven contrast media, bias field, and overlapping intensity distribution of the object and background. In addition, the mixture models of the statistical methods are constructed relaying on the characteristics of the image histograms. Thus, it is a challenging issue for the traditional methods to be available in vessel segmentation from multi-modality angiographic images. To overcome these limitations, a flexible segmentation method with a fixed mixture model has been proposed for various angiography modalities. Our method mainly consists of three parts. Firstly, multi-scale filtering algorithm was used on the original images to enhance vessels and suppress noises. As a result, the filtered data achieved a new statistical characteristic. Secondly, a mixture model formed by three probabilistic distributions (two Exponential distributions and one Gaussian distribution) was built to fit the histogram curve of the filtered data, where the expectation maximization (EM) algorithm was used for parameters estimation. Finally, three-dimensional (3D) Markov random field (MRF) were employed to improve the accuracy of pixel-wise classification and posterior probability estimation. To quantitatively evaluate the performance of the proposed method, two phantoms simulating blood vessels with different tubular structures and noises have been devised. Meanwhile, four clinical angiographic data sets from different human organs have been used to qualitatively validate the method. To further test the performance, comparison tests between the proposed method and the traditional ones have been conducted on two different brain magnetic resonance angiography (MRA) data sets. The results of the phantoms were satisfying, e.g., the noise was greatly suppressed, the percentages of the misclassified voxels, i.e., the segmentation error ratios, were no more than 0.3%, and the Dice similarity coefficients (DSCs) were above 94%. According to the opinions of clinical vascular specialists, the vessels in various data sets were extracted with high accuracy since complete vessel trees were extracted while lesser non-vessels and background were falsely classified as vessel. In the comparison experiments, the proposed method showed its superiority in accuracy and robustness for extracting vascular structures from multi-modality angiographic images with complicated background noises. The experimental results demonstrated that our proposed method was available for various angiographic data. The main reason was that the constructed mixture probability model could unitarily classify vessel object from the multi-scale filtered data of various angiography images. The advantages of the proposed method lie in the following aspects: firstly, it can extract the vessels with poor angiography quality, since the multi-scale filtering algorithm can improve the vessel intensity in the circumstance such as uneven contrast media and bias field; secondly, it performed well for extracting the vessels in multi-modality angiographic images despite various signal-noises; and thirdly, it was implemented with better accuracy, and robustness than the traditional methods. Generally, these traits declare that the proposed method would have significant clinical application.

Modeling, Modal Properties, and Mesh Stiffness Variation Instabilities of Planetary Gears

NASA Technical Reports Server (NTRS)

Parker, Robert G.; Lin, Jian; Krantz, Timothy L. (Technical Monitor)

2001-01-01

Planetary gear noise and vibration are primary concerns in their applications in helicopters, automobiles, aircraft engines, heavy machinery and marine vehicles. Dynamic analysis is essential to the noise and vibration reduction. This work analytically investigates some critical issues and advances the understanding of planetary gear dynamics. A lumped-parameter model is built for the dynamic analysis of general planetary gears. The unique properties of the natural frequency spectra and vibration modes are rigorously characterized. These special structures apply for general planetary gears with cyclic symmetry and, in practically important case, systems with diametrically opposed planets. The special vibration properties are useful for subsequent research. Taking advantage of the derived modal properties, the natural frequency and vibration mode sensitivities to design parameters are investigated. The key parameters include mesh stiffnesses, support/bearing stiffnesses, component masses, moments of inertia, and operating speed. The eigen-sensitivities are expressed in simple, closed-form formulae associated with modal strain and kinetic energies. As disorders (e.g., mesh stiffness variation. manufacturing and assembling errors) disturb the cyclic symmetry of planetary gears, their effects on the free vibration properties are quantitatively examined. Well-defined veering rules are derived to identify dramatic changes of natural frequencies and vibration modes under parameter variations. The knowledge of free vibration properties, eigen-sensitivities, and veering rules provide important information to effectively tune the natural frequencies and optimize structural design to minimize noise and vibration. Parametric instabilities excited by mesh stiffness variations are analytically studied for multi-mesh gear systems. The discrepancies of previous studies on parametric instability of two-stage gear chains are clarified using perturbation and numerical methods. The operating conditions causing parametric instabilities are expressed in closed-form suitable for design guidance. Using the well-defined modal properties of planetary gears, the effects of mesh parameters on parametric instability are analytically identified. Simple formulae are obtained to suppress particular instabilities by adjusting contact ratios and mesh phasing.

Working Memory and Speech Recognition in Noise Under Ecologically Relevant Listening Conditions: Effects of Visual Cues and Noise Type Among Adults With Hearing Loss

PubMed Central

Stewart, Erin K.; Wu, Yu-Hsiang; Bishop, Christopher; Bentler, Ruth A.; Tremblay, Kelly

2017-01-01

Purpose This study evaluated the relationship between working memory (WM) and speech recognition in noise with different noise types as well as in the presence of visual cues. Method Seventy-six adults with bilateral, mild to moderately severe sensorineural hearing loss (mean age: 69 years) participated. Using a cross-sectional design, 2 measures of WM were taken: a reading span measure, and Word Auditory Recognition and Recall Measure (Smith, Pichora-Fuller, & Alexander, 2016). Speech recognition was measured with the Multi-Modal Lexical Sentence Test for Adults (Kirk et al., 2012) in steady-state noise and 4-talker babble, with and without visual cues. Testing was under unaided conditions. Results A linear mixed model revealed visual cues and pure-tone average as the only significant predictors of Multi-Modal Lexical Sentence Test outcomes. Neither WM measure nor noise type showed a significant effect. Conclusion The contribution of WM in explaining unaided speech recognition in noise was negligible and not influenced by noise type or visual cues. We anticipate that with audibility partially restored by hearing aids, the effects of WM will increase. For clinical practice to be affected, more significant effect sizes are needed. PMID:28744550

Exact free vibration of multi-step Timoshenko beam system with several attachments

NASA Astrophysics Data System (ADS)

Farghaly, S. H.; El-Sayed, T. A.

2016-05-01

This paper deals with the analysis of the natural frequencies, mode shapes of an axially loaded multi-step Timoshenko beam combined system carrying several attachments. The influence of system design and the proposed sub-system non-dimensional parameters on the combined system characteristics are the major part of this investigation. The effect of material properties, rotary inertia and shear deformation of the beam system for each span are included. The end masses are elastically supported against rotation and translation at an offset point from the point of attachment. A sub-system having two degrees of freedom is located at the beam ends and at any of the intermediate stations and acts as a support and/or a suspension. The boundary conditions of the ordinary differential equation governing the lateral deflections and slope due to bending of the beam system including the shear force term, due to the sub-system, have been formulated. Exact global coefficient matrices for the combined modal frequencies, the modal shape and for the discrete sub-system have been derived. Based on these formulae, detailed parametric studies of the combined system are carried out. The applied mathematical model is valid for wide range of applications especially in mechanical, naval and structural engineering fields.

Multi-modal highlight generation for sports videos using an information-theoretic excitability measure

NASA Astrophysics Data System (ADS)

Hasan, Taufiq; Bořil, Hynek; Sangwan, Abhijeet; L Hansen, John H.

2013-12-01

The ability to detect and organize `hot spots' representing areas of excitement within video streams is a challenging research problem when techniques rely exclusively on video content. A generic method for sports video highlight selection is presented in this study which leverages both video/image structure as well as audio/speech properties. Processing begins where the video is partitioned into small segments and several multi-modal features are extracted from each segment. Excitability is computed based on the likelihood of the segmental features residing in certain regions of their joint probability density function space which are considered both exciting and rare. The proposed measure is used to rank order the partitioned segments to compress the overall video sequence and produce a contiguous set of highlights. Experiments are performed on baseball videos based on signal processing advancements for excitement assessment in the commentators' speech, audio energy, slow motion replay, scene cut density, and motion activity as features. Detailed analysis on correlation between user excitability and various speech production parameters is conducted and an effective scheme is designed to estimate the excitement level of commentator's speech from the sports videos. Subjective evaluation of excitability and ranking of video segments demonstrate a higher correlation with the proposed measure compared to well-established techniques indicating the effectiveness of the overall approach.

MO-E-BRB-03: Panel Member

DOE Office of Scientific and Technical Information (OSTI.GOV)

Salter, B.

2016-06-15

In this interactive session, lung SBRT patient cases will be presented to highlight real-world considerations for ensuring safe and accurate treatment delivery. An expert panel of speakers will discuss challenges specific to lung SBRT including patient selection, patient immobilization techniques, 4D CT simulation and respiratory motion management, target delineation for treatment planning, online treatment alignment, and established prescription regimens and OAR dose limits. Practical examples of cases, including the patient flow thought the clinical process are presented and audience participation will be encouraged. This panel session is designed to provide case demonstration and review for lung SBRT in terms ofmore » (1) clinical appropriateness in patient selection, (2) strategies for simulation, including 4D and respiratory motion management, and (3) applying multi imaging modality (4D CT imaging, MRI, PET) for tumor volume delineation and motion extent, and (4) image guidance in treatment delivery. Learning Objectives: Understand the established requirements for patient selection in lung SBRT Become familiar with the various immobilization strategies for lung SBRT, including technology for respiratory motion management Understand the benefits and pitfalls of applying multi imaging modality (4D CT imaging, MRI, PET) for tumor volume delineation and motion extent determination for lung SBRT Understand established prescription regimes and OAR dose limits.« less

MO-E-BRB-01: Panel Member

DOE Office of Scientific and Technical Information (OSTI.GOV)

Benedict, S.

2016-06-15

In this interactive session, lung SBRT patient cases will be presented to highlight real-world considerations for ensuring safe and accurate treatment delivery. An expert panel of speakers will discuss challenges specific to lung SBRT including patient selection, patient immobilization techniques, 4D CT simulation and respiratory motion management, target delineation for treatment planning, online treatment alignment, and established prescription regimens and OAR dose limits. Practical examples of cases, including the patient flow thought the clinical process are presented and audience participation will be encouraged. This panel session is designed to provide case demonstration and review for lung SBRT in terms ofmore » (1) clinical appropriateness in patient selection, (2) strategies for simulation, including 4D and respiratory motion management, and (3) applying multi imaging modality (4D CT imaging, MRI, PET) for tumor volume delineation and motion extent, and (4) image guidance in treatment delivery. Learning Objectives: Understand the established requirements for patient selection in lung SBRT Become familiar with the various immobilization strategies for lung SBRT, including technology for respiratory motion management Understand the benefits and pitfalls of applying multi imaging modality (4D CT imaging, MRI, PET) for tumor volume delineation and motion extent determination for lung SBRT Understand established prescription regimes and OAR dose limits.« less

MO-E-BRB-00: PANEL DISCUSSION: SBRT/SRS Case Studies - Lung

DOE Office of Scientific and Technical Information (OSTI.GOV)

NONE

2016-06-15

In this interactive session, lung SBRT patient cases will be presented to highlight real-world considerations for ensuring safe and accurate treatment delivery. An expert panel of speakers will discuss challenges specific to lung SBRT including patient selection, patient immobilization techniques, 4D CT simulation and respiratory motion management, target delineation for treatment planning, online treatment alignment, and established prescription regimens and OAR dose limits. Practical examples of cases, including the patient flow thought the clinical process are presented and audience participation will be encouraged. This panel session is designed to provide case demonstration and review for lung SBRT in terms ofmore » (1) clinical appropriateness in patient selection, (2) strategies for simulation, including 4D and respiratory motion management, and (3) applying multi imaging modality (4D CT imaging, MRI, PET) for tumor volume delineation and motion extent, and (4) image guidance in treatment delivery. Learning Objectives: Understand the established requirements for patient selection in lung SBRT Become familiar with the various immobilization strategies for lung SBRT, including technology for respiratory motion management Understand the benefits and pitfalls of applying multi imaging modality (4D CT imaging, MRI, PET) for tumor volume delineation and motion extent determination for lung SBRT Understand established prescription regimes and OAR dose limits.« less

A new approach of building 3D visualization framework for multimodal medical images display and computed assisted diagnosis

NASA Astrophysics Data System (ADS)

Li, Zhenwei; Sun, Jianyong; Zhang, Jianguo

2012-02-01

As more and more CT/MR studies are scanning with larger volume of data sets, more and more radiologists and clinician would like using PACS WS to display and manipulate these larger data sets of images with 3D rendering features. In this paper, we proposed a design method and implantation strategy to develop 3D image display component not only with normal 3D display functions but also with multi-modal medical image fusion as well as compute-assisted diagnosis of coronary heart diseases. The 3D component has been integrated into the PACS display workstation of Shanghai Huadong Hospital, and the clinical practice showed that it is easy for radiologists and physicians to use these 3D functions such as multi-modalities' (e.g. CT, MRI, PET, SPECT) visualization, registration and fusion, and the lesion quantitative measurements. The users were satisfying with the rendering speeds and quality of 3D reconstruction. The advantages of the component include low requirements for computer hardware, easy integration, reliable performance and comfortable application experience. With this system, the radiologists and the clinicians can manipulate with 3D images easily, and use the advanced visualization tools to facilitate their work with a PACS display workstation at any time.

Multi-scale diffuse interface modeling of multi-component two-phase flow with partial miscibility

NASA Astrophysics Data System (ADS)

Kou, Jisheng; Sun, Shuyu

2016-08-01

In this paper, we introduce a diffuse interface model to simulate multi-component two-phase flow with partial miscibility based on a realistic equation of state (e.g. Peng-Robinson equation of state). Because of partial miscibility, thermodynamic relations are used to model not only interfacial properties but also bulk properties, including density, composition, pressure, and realistic viscosity. As far as we know, this effort is the first time to use diffuse interface modeling based on equation of state for modeling of multi-component two-phase flow with partial miscibility. In numerical simulation, the key issue is to resolve the high contrast of scales from the microscopic interface composition to macroscale bulk fluid motion since the interface has a nanoscale thickness only. To efficiently solve this challenging problem, we develop a multi-scale simulation method. At the microscopic scale, we deduce a reduced interfacial equation under reasonable assumptions, and then we propose a formulation of capillary pressure, which is consistent with macroscale flow equations. Moreover, we show that Young-Laplace equation is an approximation of this capillarity formulation, and this formulation is also consistent with the concept of Tolman length, which is a correction of Young-Laplace equation. At the macroscopical scale, the interfaces are treated as discontinuous surfaces separating two phases of fluids. Our approach differs from conventional sharp-interface two-phase flow model in that we use the capillary pressure directly instead of a combination of surface tension and Young-Laplace equation because capillarity can be calculated from our proposed capillarity formulation. A compatible condition is also derived for the pressure in flow equations. Furthermore, based on the proposed capillarity formulation, we design an efficient numerical method for directly computing the capillary pressure between two fluids composed of multiple components. Finally, numerical tests are carried out to verify the effectiveness of the proposed multi-scale method.

Multi-scale diffuse interface modeling of multi-component two-phase flow with partial miscibility

DOE Office of Scientific and Technical Information (OSTI.GOV)

Kou, Jisheng; Sun, Shuyu, E-mail: shuyu.sun@kaust.edu.sa; School of Mathematics and Statistics, Xi'an Jiaotong University, Xi'an 710049

2016-08-01

In this paper, we introduce a diffuse interface model to simulate multi-component two-phase flow with partial miscibility based on a realistic equation of state (e.g. Peng–Robinson equation of state). Because of partial miscibility, thermodynamic relations are used to model not only interfacial properties but also bulk properties, including density, composition, pressure, and realistic viscosity. As far as we know, this effort is the first time to use diffuse interface modeling based on equation of state for modeling of multi-component two-phase flow with partial miscibility. In numerical simulation, the key issue is to resolve the high contrast of scales from themore » microscopic interface composition to macroscale bulk fluid motion since the interface has a nanoscale thickness only. To efficiently solve this challenging problem, we develop a multi-scale simulation method. At the microscopic scale, we deduce a reduced interfacial equation under reasonable assumptions, and then we propose a formulation of capillary pressure, which is consistent with macroscale flow equations. Moreover, we show that Young–Laplace equation is an approximation of this capillarity formulation, and this formulation is also consistent with the concept of Tolman length, which is a correction of Young–Laplace equation. At the macroscopical scale, the interfaces are treated as discontinuous surfaces separating two phases of fluids. Our approach differs from conventional sharp-interface two-phase flow model in that we use the capillary pressure directly instead of a combination of surface tension and Young–Laplace equation because capillarity can be calculated from our proposed capillarity formulation. A compatible condition is also derived for the pressure in flow equations. Furthermore, based on the proposed capillarity formulation, we design an efficient numerical method for directly computing the capillary pressure between two fluids composed of multiple components. Finally, numerical tests are carried out to verify the effectiveness of the proposed multi-scale method.« less

Touching is believing: interrogating halide perovskite solar cells at the nanoscale via scanning probe microscopy

NASA Astrophysics Data System (ADS)

Li, Jiangyu; Huang, Boyuan; Nasr Esfahani, Ehsan; Wei, Linlin; Yao, Jianjun; Zhao, Jinjin; Chen, Wei

2017-10-01

Halide perovskite solar cells based on CH3NH3PbI3 and related materials have emerged as the most exciting development in the next generation photovoltaic technologies, yet the microscopic phenomena involving photo-carriers, ionic defects, spontaneous polarization, and molecular vibration and rotation interacting with numerous grains, grain boundaries, and interfaces are still inadequately understood. In fact, there is still need for an effective method to interrogate the local photovoltaic properties of halide perovskite solar cells that can be directly traced to their microstructures on one hand and linked to their device performance on the other hand. In this perspective, we propose that scanning probe microscopy (SPM) techniques have great potential to realize such promises at the nanoscale, and highlight some of the recent progresses and challenges along this line of investigation toward local probing of photocurrent, work function, ionic activities, polarization switching, and chemical degradation. We also emphasize the importance of multi-modality imaging, in-operando scanning, big data analysis, and multidisciplinary collaboration for further studies toward fully understanding of these complex systems.

A correlative optical microscopy and scanning electron microscopy approach to locating nanoparticles in brain tumors.

PubMed

Kempen, Paul J; Kircher, Moritz F; de la Zerda, Adam; Zavaleta, Cristina L; Jokerst, Jesse V; Mellinghoff, Ingo K; Gambhir, Sanjiv S; Sinclair, Robert

2015-01-01

The growing use of nanoparticles in biomedical applications, including cancer diagnosis and treatment, demands the capability to exactly locate them within complex biological systems. In this work a correlative optical and scanning electron microscopy technique was developed to locate and observe multi-modal gold core nanoparticle accumulation in brain tumor models. Entire brain sections from mice containing orthotopic brain tumors injected intravenously with nanoparticles were imaged using both optical microscopy to identify the brain tumor, and scanning electron microscopy to identify the individual nanoparticles. Gold-based nanoparticles were readily identified in the scanning electron microscope using backscattered electron imaging as bright spots against a darker background. This information was then correlated to determine the exact location of the nanoparticles within the brain tissue. The nanoparticles were located only in areas that contained tumor cells, and not in the surrounding healthy brain tissue. This correlative technique provides a powerful method to relate the macro- and micro-scale features visible in light microscopy with the nanoscale features resolvable in scanning electron microscopy. Copyright © 2014 Elsevier Ltd. All rights reserved.

Overview of multi-input frequency domain modal testing methods with an emphasis on sine testing

NASA Technical Reports Server (NTRS)

Rost, Robert W.; Brown, David L.

1988-01-01

An overview of the current state of the art multiple-input, multiple-output modal testing technology is discussed. A very brief review of the current time domain methods is given. A detailed review of frequency and spatial domain methods is presented with an emphasis on sine testing.

Towards an intelligent framework for multimodal affective data analysis.

PubMed

Poria, Soujanya; Cambria, Erik; Hussain, Amir; Huang, Guang-Bin

2015-03-01

An increasingly large amount of multimodal content is posted on social media websites such as YouTube and Facebook everyday. In order to cope with the growth of such so much multimodal data, there is an urgent need to develop an intelligent multi-modal analysis framework that can effectively extract information from multiple modalities. In this paper, we propose a novel multimodal information extraction agent, which infers and aggregates the semantic and affective information associated with user-generated multimodal data in contexts such as e-learning, e-health, automatic video content tagging and human-computer interaction. In particular, the developed intelligent agent adopts an ensemble feature extraction approach by exploiting the joint use of tri-modal (text, audio and video) features to enhance the multimodal information extraction process. In preliminary experiments using the eNTERFACE dataset, our proposed multi-modal system is shown to achieve an accuracy of 87.95%, outperforming the best state-of-the-art system by more than 10%, or in relative terms, a 56% reduction in error rate. Copyright © 2014 Elsevier Ltd. All rights reserved.

Simple and inexpensive microfluidic devices for the generation of monodisperse multiple emulsions

NASA Astrophysics Data System (ADS)

Li, Er Qiang; Zhang, Jia Ming; Thoroddsen, Sigurdur T.

2014-01-01

Droplet-based microfluidic devices have become a preferred versatile platform for various fields in physics, chemistry and biology. Polydimethylsiloxane soft lithography, the mainstay for fabricating microfluidic devices, usually requires the usage of expensive apparatus and a complex manufacturing procedure. Here, we report the design and fabrication of simple and inexpensive microfluidic devices based on microscope glass slides and pulled glass capillaries, for generating monodisperse multiple emulsions. The advantages of our method lie in a simple manufacturing procedure, inexpensive processing equipment and flexibility in the surface modification of the designed microfluidic devices. Different types of devices have been designed and tested and the experimental results demonstrated their robustness for preparing monodisperse single, double, triple and multi-component emulsions.

Multi-modal neuroimaging of adolescents with non-suicidal self-injury: Amygdala functional connectivity.

PubMed

Westlund Schreiner, Melinda; Klimes-Dougan, Bonnie; Mueller, Bryon A; Eberly, Lynn E; Reigstad, Kristina M; Carstedt, Patricia A; Thomas, Kathleen M; Hunt, Ruskin H; Lim, Kelvin O; Cullen, Kathryn R

2017-10-15

Non-suicidal self-injury (NSSI) is a significant mental health problem among adolescents. Research is needed to clarify the neurobiology of NSSI and identify candidate neurobiological targets for interventions. Based on prior research implicating heightened negative affect and amygdala hyperactivity in NSSI, we pursued a systems approach to characterize amygdala functional connectivity networks during rest (resting-state functional connectivity [RSFC)]) and a task (task functional connectivity [TFC]) in adolescents with NSSI. We examined amygdala networks in female adolescents with NSSI and healthy controls (n = 45) using resting-state fMRI and a negative emotion face-matching fMRI task designed to activate the amygdala. Connectivity analyses included amygdala RSFC, amygdala TFC, and psychophysiological interactions (PPI) between amygdala connectivity and task conditions. Compared to healthy controls, adolescents with NSSI showed atypical amygdala-frontal connectivity during rest and task; greater amygdala RSFC in supplementary motor area (SMA) and dorsal anterior cingulate; and differential amygdala-occipital connectivity between rest and task. After correcting for depression symptoms, amygdala-SMA RSFC abnormalities, among others, remained significant. This study's limitations include its cross-sectional design and its absence of a psychiatric control group. Using a multi-modal approach, we identified widespread amygdala circuitry anomalies in adolescents with NSSI. While deficits in amygdala-frontal connectivity (driven by depression symptoms) replicates prior work in depression, hyperconnectivity between amygdala and SMA (independent of depression symptoms) has not been previously reported. This circuit may represent an important mechanism underlying the link between negative affect and habitual behaviors. These abnormalities may represent intervention targets for adolescents with NSSI. Copyright © 2017 Elsevier B.V. All rights reserved.

Analysis of vibration characteristics of opening device for deepwater robot cabin door and study of its structural optimization design

NASA Astrophysics Data System (ADS)

Zeng, Baoping; Liu, Jipeng; Zhang, Yu; Gong, Yajun; Hu, Sanbao

2017-12-01

Deepwater robots are important devices for human to explore the sea, which is being under development towards intellectualization, multitasking, long-endurance and large depth along with the development of science and technology. As far as a deep-water robot is concerned, its mechanical systems is an important subsystem because not only it influences the instrument measuring precision and shorten the service life of cabin devices but also its overlarge vibration and noise lead to disadvantageous effects to marine life within the operational area. Therefore, vibration characteristics shall be key factor for the deep-water robot system design. The sample collection and recycling system of some certain deepwater robot in a mechanism for opening the underwater cabin door for external operation and recycling test equipment is focused in this study. For improving vibration characteristics of locations of the cabin door during opening processes, a vibration model was established to the opening system; and the structural optimization design was carried out to its important structures by utilizing the multi-objective shape optimization and topology optimization method based on analysis of the system vibration. Analysis of characteristics of exciting forces causing vibration was first carried out, which include characteristics of dynamic loads within the hinge clearances and due to friction effects and the fluid dynamic exciting forces during processes of opening the cabin door. Moreover, vibration acceleration responses for a few important locations of the devices for opening the cabin cover were deduced by utilizing the modal synthesis method so that its rigidity and modal frequency may be one primary factor influencing the system vibration performances based on analysis of weighted acceleration responses. Thus, optimization design was carried out to the cabin cover by utilizing the multi-objective topology optimization method to perform reduction of weighted accelerations of key structure locations.

Machine learning approaches for integrating clinical and imaging features in late-life depression classification and response prediction.

PubMed

Patel, Meenal J; Andreescu, Carmen; Price, Julie C; Edelman, Kathryn L; Reynolds, Charles F; Aizenstein, Howard J

2015-10-01

Currently, depression diagnosis relies primarily on behavioral symptoms and signs, and treatment is guided by trial and error instead of evaluating associated underlying brain characteristics. Unlike past studies, we attempted to estimate accurate prediction models for late-life depression diagnosis and treatment response using multiple machine learning methods with inputs of multi-modal imaging and non-imaging whole brain and network-based features. Late-life depression patients (medicated post-recruitment) (n = 33) and older non-depressed individuals (n = 35) were recruited. Their demographics and cognitive ability scores were recorded, and brain characteristics were acquired using multi-modal magnetic resonance imaging pretreatment. Linear and nonlinear learning methods were tested for estimating accurate prediction models. A learning method called alternating decision trees estimated the most accurate prediction models for late-life depression diagnosis (87.27% accuracy) and treatment response (89.47% accuracy). The diagnosis model included measures of age, Mini-mental state examination score, and structural imaging (e.g. whole brain atrophy and global white mater hyperintensity burden). The treatment response model included measures of structural and functional connectivity. Combinations of multi-modal imaging and/or non-imaging measures may help better predict late-life depression diagnosis and treatment response. As a preliminary observation, we speculate that the results may also suggest that different underlying brain characteristics defined by multi-modal imaging measures-rather than region-based differences-are associated with depression versus depression recovery because to our knowledge this is the first depression study to accurately predict both using the same approach. These findings may help better understand late-life depression and identify preliminary steps toward personalized late-life depression treatment. Copyright © 2015 John Wiley & Sons, Ltd.

Evaluating the efficacy of an integrated motivational interviewing and multi-modal exercise intervention for youth with major depression: Healthy Body, Healthy Mind randomised controlled trial protocol.

PubMed

Nasstasia, Yasmina; Baker, Amanda L; Halpin, Sean A; Hides, Leanne; Lewin, Terry J; Kelly, Brian J; Callister, Robin

2018-03-01

Recent meta-analytic reviews suggest exercise can reduce depression severity among adults with major depressive disorder (MDD); however, efficacy studies with depressed youth are limited. Few studies have investigated the efficacy of multi-modal exercise interventions in this population, addressed treatment engagement, or explored the differential effects of exercise on depressive symptom profiles. This paper describes the study protocol and recruitment pattern for an assessor blinded, two-arm randomised controlled trial investigating the efficacy of an integrated motivational interviewing (MI) and multi-modal exercise intervention in youth diagnosed with MDD. Associations between depressive symptom profiles (cognitive, somatic and affective) and psychological, physiological (fitness), and biological (blood biomarker) outcomes will also be examined. Participants aged 15-25 years with current MDD were recruited. Eligible participants were randomised and stratified according to gender and depression severity to either an immediate or delayed (control) group. The immediate group received a brief MI intervention followed by a 12-week small group exercise intervention (3 times per week for 1 h), all delivered by personal trainers. The delayed control group received the same intervention 12-weeks later. Both groups were reassessed at mid-treatment or mid-control, post-treatment or post-control, and follow-up (12 weeks post-treatment). 68 participants were recruited and randomly allocated to an intervention group. This trial will increase our understanding of the efficacy of multi-modal exercise interventions for depression and the specific effects of exercise on depressive symptom profiles. It also offers a novel contribution by addressing treatment engagement in exercise efficacy trials in youth with MDD.

Optimal model-based sensorless adaptive optics for epifluorescence microscopy.

PubMed

Pozzi, Paolo; Soloviev, Oleg; Wilding, Dean; Vdovin, Gleb; Verhaegen, Michel

2018-01-01

We report on a universal sample-independent sensorless adaptive optics method, based on modal optimization of the second moment of the fluorescence emission from a point-like excitation. Our method employs a sample-independent precalibration, performed only once for the particular system, to establish the direct relation between the image quality and the aberration. The method is potentially applicable to any form of microscopy with epifluorescence detection, including the practically important case of incoherent fluorescence emission from a three dimensional object, through minor hardware modifications. We have applied the technique successfully to a widefield epifluorescence microscope and to a multiaperture confocal microscope.

Multi-disciplinary optimization of aeroservoelastic systems

NASA Technical Reports Server (NTRS)

Karpel, Mordechay

1991-01-01

New methods were developed for efficient aeroservoelastic analysis and optimization. The main target was to develop a method for investigating large structural variations using a single set of modal coordinates. This task was accomplished by basing the structural modal coordinates on normal modes calculated with a set of fictitious masses loading the locations of anticipated structural changes. The following subject areas are covered: (1) modal coordinates for aeroelastic analysis with large local structural variations; and (2) time simulation of flutter with large stiffness changes.

Integrating Iris and Signature Traits for Personal Authentication Using User-Specific Weighting

PubMed Central

Viriri, Serestina; Tapamo, Jules R.

2012-01-01

Biometric systems based on uni-modal traits are characterized by noisy sensor data, restricted degrees of freedom, non-universality and are susceptible to spoof attacks. Multi-modal biometric systems seek to alleviate some of these drawbacks by providing multiple evidences of the same identity. In this paper, a user-score-based weighting technique for integrating the iris and signature traits is presented. This user-specific weighting technique has proved to be an efficient and effective fusion scheme which increases the authentication accuracy rate of multi-modal biometric systems. The weights are used to indicate the importance of matching scores output by each biometrics trait. The experimental results show that our biometric system based on the integration of iris and signature traits achieve a false rejection rate (FRR) of 0.08% and a false acceptance rate (FAR) of 0.01%. PMID:22666032

Cross-Modal Correspondence Among Vision, Audition, and Touch in Natural Objects: An Investigation of the Perceptual Properties of Wood.

PubMed

Kanaya, Shoko; Kariya, Kenji; Fujisaki, Waka

2016-10-01

Certain systematic relationships are often assumed between information conveyed from multiple sensory modalities; for instance, a small figure and a high pitch may be perceived as more harmonious. This phenomenon, termed cross-modal correspondence, may result from correlations between multi-sensory signals learned in daily experience of the natural environment. If so, we would observe cross-modal correspondences not only in the perception of artificial stimuli but also in perception of natural objects. To test this hypothesis, we reanalyzed data collected previously in our laboratory examining perceptions of the material properties of wood using vision, audition, and touch. We compared participant evaluations of three perceptual properties (surface brightness, sharpness of sound, and smoothness) of the wood blocks obtained separately via vision, audition, and touch. Significant positive correlations were identified for all properties in the audition-touch comparison, and for two of the three properties regarding in the vision-touch comparison. By contrast, no properties exhibited significant positive correlations in the vision-audition comparison. These results suggest that we learn correlations between multi-sensory signals through experience; however, the strength of this statistical learning is apparently dependent on the particular combination of sensory modalities involved. © The Author(s) 2016.

Abuse of disabled parking: Reforming public's attitude through persuasive multimedia strategy

NASA Astrophysics Data System (ADS)

Yahaya, W. A. J. W.; Zain, M. Z. M.

2014-02-01

Attitude is one of the factors that contribute to the abuse of disabled parking. The attitude's components are affective, cognitive and behavioral and may be formed in various ways including learning and persuasion. Using learning and persuasion approach, this study has produced a persuasive multimedia aiming to form a positive attitude toward disabled persons in order to minimize the rate of disabled parking abuse. The persuasive multimedia was developed using Principle of Social Learning draws from Persuasive Technology as learning strategy at macro persuasion level, and modality and redundancy principles draw from Multimedia Learning Principles as design strategy at micro persuasion level. In order to measure the effectiveness of the persuasive multimedia, 93 respondents were selected in a 2 × 2 quasi experimental research design for experiment. Attitude components of affective, cognitive and behavioral were measured using adapted instrument from the Multi Dimensional Attitudes Scale toward Persons With Disabilities (MAS). Result of the study shows that the persuasive multimedia which designed based on Social Learning Theory at macro persuasion level is capable of forming positive attitude toward disabled person. The cognitive component of the attitude found to be the most responsive component. In term of design strategy at the micro persuasion level, modality found to be the most significant strategy compare to redundancy. While males are more responsive to the persuasive multimedia compare to females.

New bone post-processing tools in forensic imaging: a multi-reader feasibility study to evaluate detection time and diagnostic accuracy in rib fracture assessment.

PubMed

Glemser, Philip A; Pfleiderer, Michael; Heger, Anna; Tremper, Jan; Krauskopf, Astrid; Schlemmer, Heinz-Peter; Yen, Kathrin; Simons, David

2017-03-01

The aim of this multi-reader feasibility study was to evaluate new post-processing CT imaging tools in rib fracture assessment of forensic cases by analyzing detection time and diagnostic accuracy. Thirty autopsy cases (20 with and 10 without rib fractures in autopsy) were randomly selected and included in this study. All cases received a native whole body CT scan prior to the autopsy procedure, which included dissection and careful evaluation of each rib. In addition to standard transverse sections (modality A), CT images were subjected to a reconstruction algorithm to compute axial labelling of the ribs (modality B) as well as "unfolding" visualizations of the rib cage (modality C, "eagle tool"). Three radiologists with different clinical and forensic experience who were blinded to autopsy results evaluated all cases in a random manner of modality and case. Rib fracture assessment of each reader was evaluated compared to autopsy and a CT consensus read as radiologic reference. A detailed evaluation of relevant test parameters revealed a better accordance to the CT consensus read as to the autopsy. Modality C was the significantly quickest rib fracture detection modality despite slightly reduced statistic test parameters compared to modalities A and B. Modern CT post-processing software is able to shorten reading time and to increase sensitivity and specificity compared to standard autopsy alone. The eagle tool as an easy to use tool is suited for an initial rib fracture screening prior to autopsy and can therefore be beneficial for forensic pathologists.

A nanocomposite of Au-AgI core/shell dimer as a dual-modality contrast agent for x-ray computed tomography and photoacoustic imaging

DOE Office of Scientific and Technical Information (OSTI.GOV)

Orza, Anamaria; Wu, Hui; Li, Yuancheng

Purpose: To develop a core/shell nanodimer of gold (core) and silver iodine (shell) as a dual-modal contrast-enhancing agent for biomarker targeted x-ray computed tomography (CT) and photoacoustic imaging (PAI) applications. Methods: The gold and silver iodine core/shell nanodimer (Au/AgICSD) was prepared by fusing together components of gold, silver, and iodine. The physicochemical properties of Au/AgICSD were then characterized using different optical and imaging techniques (e.g., HR- transmission electron microscope, scanning transmission electron microscope, x-ray photoelectron spectroscopy, energy-dispersive x-ray spectroscopy, Z-potential, and UV-vis). The CT and PAI contrast-enhancing effects were tested and then compared with a clinically used CT contrast agentmore » and Au nanoparticles. To confer biocompatibility and the capability for efficient biomarker targeting, the surface of the Au/AgICSD nanodimer was modified with the amphiphilic diblock polymer and then functionalized with transferrin for targeting transferrin receptor that is overexpressed in various cancer cells. Cytotoxicity of the prepared Au/AgICSD nanodimer was also tested with both normal and cancer cell lines. Results: The characterizations of prepared Au/AgI core/shell nanostructure confirmed the formation of Au/AgICSD nanodimers. Au/AgICSD nanodimer is stable in physiological conditions for in vivo applications. Au/AgICSD nanodimer exhibited higher contrast enhancement in both CT and PAI for dual-modality imaging. Moreover, transferrin functionalized Au/AgICSD nanodimer showed specific binding to the tumor cells that have a high level of expression of the transferrin receptor. Conclusions: The developed Au/AgICSD nanodimer can be used as a potential biomarker targeted dual-modal contrast agent for both or combined CT and PAI molecular imaging.« less

Changing paradigm from one target one ligand towards multi target directed ligand design for key drug targets of Alzheimer disease: An important role of Insilco methods in multi target directed ligands design.

PubMed

Kumar, Akhil; Tiwari, Ashish; Sharma, Ashok

2018-03-15

Alzheimer disease (AD) is now considered as a multifactorial neurodegenerative disorder and rapidly increasing to an alarming situation and causing higher death rate. One target one ligand hypothesis is not able to provide complete solution of AD due to multifactorial nature of disease and one target one drug seems to fail to provide better treatment against AD. Moreover, current available treatments are limited and most of the upcoming treatments under clinical trials are based on modulating single target. So the current AD drug discovery research shifting towards new approach for better solution that simultaneously modulate more than one targets in the neurodegenerative cascade. This can be achieved by network pharmacology, multi-modal therapies, multifaceted, and/or the more recently proposed term "multi-targeted designed drugs. Drug discovery project is tedious, costly and long term project. Moreover, multi target AD drug discovery added extra challenges such as good binding affinity of ligands for multiple targets, optimal ADME/T properties, no/less off target side effect and crossing of the blood brain barrier. These hurdles may be addressed by insilico methods for efficient solution in less time and cost as computational methods successfully applied to single target drug discovery project. Here we are summarizing some of the most prominent and computationally explored single target against AD and further we discussed successful example of dual or multiple inhibitors for same targets. Moreover we focused on ligand and structure based computational approach to design MTDL against AD. However is not an easy task to balance dual activity in a single molecule but computational approach such as virtual screening docking, QSAR, simulation and free energy are useful in future MTDLs drug discovery alone or in combination with fragment based method. However, rational and logical implementations of computational drug designing methods are capable of assisting AD drug discovery and play an important role in optimizing multi-target drug discovery. Copyright© Bentham Science Publishers; For any queries, please email at epub@benthamscience.org.

Dual modality virtual colonoscopy workstation: design, implementation, and preliminary evaluation

NASA Astrophysics Data System (ADS)

Chen, Dongqing; Meissner, Michael

2006-03-01

The aim of this study is to develop a virtual colonoscopy (VC) workstation that supports both CT (computed tomography) and MR (magnetic resonance) imaging procedures. The workflow should be optimized and be able to take advantage of both image modalities. The technological break through is at the real-time volume rendering of spatial-intensity-inhomogeneous MR images to achieve high quality 3D endoluminal view. VC aims at visualizing CT or MR tomography images for detection of colonic polyp and lesion. It is also called as CT/MR colonography based on the imaging modality that is employed. The published results of large scale clinical trial demonstrated more than 90% of sensitivity on polyp detection for certain CT colonography (CTC) workstation. A drawback of the CT colonoscopy is the radiation exposure. MR colonography (MRC) is free from the X-ray radiation. It achieved almost 100% specificity for polyp detection in published trials. The better tissue contrast in MR image allows the accurate diagnosis of inflammatory bowel disease also, which is usually difficult in CTC. At present, most of the VC workstations are designed for CT examination. They are not able to display multi-sequence MR series concurrently in a single application. The automatic correlation between 2D and 3D view is not available due to the difficulty of 3D model building for MR images. This study aims at enhancing a commercial VC product that was successfully used for CTC to equally support dark-lumen protocol MR procedure also.

Quantitative multi-modality imaging analysis of a bioabsorbable poly-L-lactic acid stent design in the acute phase: a comparison between 2- and 3D-QCA, QCU and QMSCT-CA.

PubMed

Bruining, Nico; Tanimoto, Shuzou; Otsuka, Masato; Weustink, Annick; Ligthart, Jurgen; de Winter, Sebastiaan; van Mieghem, Carlos; Nieman, Koen; de Feyter, Pim J; van Domburg, Ron T; Serruys, Patrick W

2008-08-01

To investigate if three-dimensional (3D) based quantitative techniques are comparable to each other and to explore possible differences with respect to the reference method of 2D-QCA in the acute phase and to study whether non-invasive MSCT could potentially be applied to quantify luminal dimensions of a stented coronary segment with a novel bioabsorable drug-eluting stent made of poly-l-lactic-acid (PLLA). Quantitative imaging data derived from 16 patients enrolled at our institution in a first-in-man trial (ABSORB) receiving a biodegradable stent and who were imaged with standard coronary angiography and intravascular ultrasound were compared. Shortly, after stenting the patients also underwent a MSCT procedure. Standard 2D-QCA showed significant smaller stent lengths (p < 0.01). Although, the absolute measured stent diameters and areas by 2D-QCA tend to be smaller, the differences failed to be statistically different when compared to the 3D based quantitative modalities. Measurements made by non-invasive QMSCT-CA of implanted PLLA stents appeared to be comparable to the other 3D modalities without significant differences. Three-dimensional based quantitative analyses showed similar results quantifying luminal dimensions as compared to 2D-QCA during an evaluation of a new bioabsorbable coronary stent design in the acute phase. Furthermore, in biodegradable stents made of PLLA, non-invasive QMSCT-CA can be used to quantify luminal dimensions.

Interior tomography in microscopic CT with image reconstruction constrained by full field of view scan at low spatial resolution

NASA Astrophysics Data System (ADS)

Luo, Shouhua; Shen, Tao; Sun, Yi; Li, Jing; Li, Guang; Tang, Xiangyang

2018-04-01

In high resolution (microscopic) CT applications, the scan field of view should cover the entire specimen or sample to allow complete data acquisition and image reconstruction. However, truncation may occur in projection data and results in artifacts in reconstructed images. In this study, we propose a low resolution image constrained reconstruction algorithm (LRICR) for interior tomography in microscopic CT at high resolution. In general, the multi-resolution acquisition based methods can be employed to solve the data truncation problem if the project data acquired at low resolution are utilized to fill up the truncated projection data acquired at high resolution. However, most existing methods place quite strict restrictions on the data acquisition geometry, which greatly limits their utility in practice. In the proposed LRICR algorithm, full and partial data acquisition (scan) at low and high resolutions, respectively, are carried out. Using the image reconstructed from sparse projection data acquired at low resolution as the prior, a microscopic image at high resolution is reconstructed from the truncated projection data acquired at high resolution. Two synthesized digital phantoms, a raw bamboo culm and a specimen of mouse femur, were utilized to evaluate and verify performance of the proposed LRICR algorithm. Compared with the conventional TV minimization based algorithm and the multi-resolution scout-reconstruction algorithm, the proposed LRICR algorithm shows significant improvement in reduction of the artifacts caused by data truncation, providing a practical solution for high quality and reliable interior tomography in microscopic CT applications. The proposed LRICR algorithm outperforms the multi-resolution scout-reconstruction method and the TV minimization based reconstruction for interior tomography in microscopic CT.

Programmable Colored Illumination Microscopy (PCIM): A practical and flexible optical staining approach for microscopic contrast enhancement

NASA Astrophysics Data System (ADS)

Zuo, Chao; Sun, Jiasong; Feng, Shijie; Hu, Yan; Chen, Qian

2016-03-01

Programmable colored illumination microscopy (PCIM) has been proposed as a flexible optical staining technique for microscopic contrast enhancement. In this method, we replace the condenser diaphragm of a conventional microscope with a programmable thin film transistor-liquid crystal display (TFT-LCD). By displaying different patterns on the LCD, numerous established imaging modalities can be realized, such as bright field, dark field, phase contrast, oblique illumination, and Rheinberg illuminations, which conventionally rely on intricate alterations in the respective microscope setups. Furthermore, the ease of modulating both the color and the intensity distribution at the aperture of the condenser opens the possibility to combine multiple microscopic techniques, or even realize completely new methods for optical color contrast staining, such as iridescent dark-field and iridescent phase-contrast imaging. The versatility and effectiveness of PCIM is demonstrated by imaging of several transparent colorless specimens, such as unstained lung cancer cells, diatom, textile fibers, and a cryosection of mouse kidney. Finally, the potentialities of PCIM for RGB-splitting imaging with stained samples are also explored by imaging stained red blood cells and a histological section.

Multi-modal spectroscopic imaging with synchrotron light to study mechanisms of brain disease

NASA Astrophysics Data System (ADS)

Summers, Kelly L.; Fimognari, Nicholas; Hollings, Ashley; Kiernan, Mitchell; Lam, Virginie; Tidy, Rebecca J.; Takechi, Ryu; George, Graham N.; Pickering, Ingrid J.; Mamo, John C.; Harris, Hugh H.; Hackett, Mark J.

2017-04-01

The international health care costs associated with Alzheimer's disease (AD) and dementia have been predicted to reach $2 trillion USD by 2030. As such, there is urgent need to develop new treatments and diagnostic methods to stem an international health crisis. A major limitation to therapy and diagnostic development is the lack of complete understanding about the disease mechanisms. Spectroscopic methods at synchrotron light sources, such as FTIR, XRF, and XAS, offer a "multi-modal imaging platform" to reveal a wealth of important biochemical information in situ within ex vivo tissue sections, to increase our understanding of disease mechanisms.

Results from the commissioning of a multi-modal endoscope for ultrasound and time of flight PET

DOE Office of Scientific and Technical Information (OSTI.GOV)

Bugalho, Ricardo

2015-07-01

The EndoTOFPET-US collaboration has developed a multi-modal imaging system combining Ultrasound with Time-of-Flight Positron Emission Tomography into an endoscopic imaging device. The objective of the project is to obtain a coincidence time resolution of about 200 ps FWHM and to achieve about 1 mm spatial resolution of the PET system, while integrating all the components in a very compact detector suitable for endoscopic use. This scanner aims to be exploited for diagnostic and surgical oncology, as well as being instrumental in the clinical test of new biomarkers especially targeted for prostate and pancreatic cancer. (authors)

Multi-detector CT imaging in the postoperative orthopedic patient with metal hardware.

PubMed

Vande Berg, Bruno; Malghem, Jacques; Maldague, Baudouin; Lecouvet, Frederic

2006-12-01

Multi-detector CT imaging (MDCT) becomes routine imaging modality in the assessment of the postoperative orthopedic patients with metallic instrumentation that degrades image quality at MR imaging. This article reviews the physical basis and CT appearance of such metal-related artifacts. It also addresses the clinical value of MDCT in postoperative orthopedic patients with emphasis on fracture healing, spinal fusion or arthrodesis, and joint replacement. MDCT imaging shows limitations in the assessment of the bone marrow cavity and of the soft tissues for which MR imaging remains the imaging modality of choice despite metal-related anatomic distortions and signal alteration.

Multi-Omics Factor Analysis-a framework for unsupervised integration of multi-omics data sets.

PubMed

Argelaguet, Ricard; Velten, Britta; Arnol, Damien; Dietrich, Sascha; Zenz, Thorsten; Marioni, John C; Buettner, Florian; Huber, Wolfgang; Stegle, Oliver

2018-06-20

Multi-omics studies promise the improved characterization of biological processes across molecular layers. However, methods for the unsupervised integration of the resulting heterogeneous data sets are lacking. We present Multi-Omics Factor Analysis (MOFA), a computational method for discovering the principal sources of variation in multi-omics data sets. MOFA infers a set of (hidden) factors that capture biological and technical sources of variability. It disentangles axes of heterogeneity that are shared across multiple modalities and those specific to individual data modalities. The learnt factors enable a variety of downstream analyses, including identification of sample subgroups, data imputation and the detection of outlier samples. We applied MOFA to a cohort of 200 patient samples of chronic lymphocytic leukaemia, profiled for somatic mutations, RNA expression, DNA methylation and ex vivo drug responses. MOFA identified major dimensions of disease heterogeneity, including immunoglobulin heavy-chain variable region status, trisomy of chromosome 12 and previously underappreciated drivers, such as response to oxidative stress. In a second application, we used MOFA to analyse single-cell multi-omics data, identifying coordinated transcriptional and epigenetic changes along cell differentiation. © 2018 The Authors. Published under the terms of the CC BY 4.0 license.

Micro/Nanomechanical characterization of multi-walled carbon nanotubes reinforced epoxy composite.

PubMed

Cui, Peng; Wang, Xinnan; Tangpong, X W

2012-11-01

In this paper, the mechanical properties of 1 wt.% multi-walled carbon nanotubes (MWCNTs) reinforced epoxy nanocomposites were characterized using a self-designed micro/nano three point bending tester that was on an atomic force microscope (AFM) to in situ observe MWCNTs movement on the sample surface under loading. The migration of an individual MWCNT at the surface of the nanocomposite was tracked to address the nanomechanical reinforcing mechanism of the nanocomposites. Through morphology analysis of the nanocomposite via scanning electron microscopy, AFM, and digital image correlation technique, it was found that the MWCNTs agglomerate and the bundles were the main factors for limiting the bending strength of the composites. The agglomeration/bundle effect was included in the Halpin-Tsai model to account for the elastic modulus of the nanocomposites.

Intraoperative imaging-guided cancer surgery: from current fluorescence molecular imaging methods to future multi-modality imaging technology.

PubMed

Chi, Chongwei; Du, Yang; Ye, Jinzuo; Kou, Deqiang; Qiu, Jingdan; Wang, Jiandong; Tian, Jie; Chen, Xiaoyuan

2014-01-01

Cancer is a major threat to human health. Diagnosis and treatment using precision medicine is expected to be an effective method for preventing the initiation and progression of cancer. Although anatomical and functional imaging techniques such as radiography, computed tomography (CT), magnetic resonance imaging (MRI) and positron emission tomography (PET) have played an important role for accurate preoperative diagnostics, for the most part these techniques cannot be applied intraoperatively. Optical molecular imaging is a promising technique that provides a high degree of sensitivity and specificity in tumor margin detection. Furthermore, existing clinical applications have proven that optical molecular imaging is a powerful intraoperative tool for guiding surgeons performing precision procedures, thus enabling radical resection and improved survival rates. However, detection depth limitation exists in optical molecular imaging methods and further breakthroughs from optical to multi-modality intraoperative imaging methods are needed to develop more extensive and comprehensive intraoperative applications. Here, we review the current intraoperative optical molecular imaging technologies, focusing on contrast agents and surgical navigation systems, and then discuss the future prospects of multi-modality imaging technology for intraoperative imaging-guided cancer surgery.

Intraoperative Imaging-Guided Cancer Surgery: From Current Fluorescence Molecular Imaging Methods to Future Multi-Modality Imaging Technology

PubMed Central

Chi, Chongwei; Du, Yang; Ye, Jinzuo; Kou, Deqiang; Qiu, Jingdan; Wang, Jiandong; Tian, Jie; Chen, Xiaoyuan

2014-01-01

Cancer is a major threat to human health. Diagnosis and treatment using precision medicine is expected to be an effective method for preventing the initiation and progression of cancer. Although anatomical and functional imaging techniques such as radiography, computed tomography (CT), magnetic resonance imaging (MRI) and positron emission tomography (PET) have played an important role for accurate preoperative diagnostics, for the most part these techniques cannot be applied intraoperatively. Optical molecular imaging is a promising technique that provides a high degree of sensitivity and specificity in tumor margin detection. Furthermore, existing clinical applications have proven that optical molecular imaging is a powerful intraoperative tool for guiding surgeons performing precision procedures, thus enabling radical resection and improved survival rates. However, detection depth limitation exists in optical molecular imaging methods and further breakthroughs from optical to multi-modality intraoperative imaging methods are needed to develop more extensive and comprehensive intraoperative applications. Here, we review the current intraoperative optical molecular imaging technologies, focusing on contrast agents and surgical navigation systems, and then discuss the future prospects of multi-modality imaging technology for intraoperative imaging-guided cancer surgery. PMID:25250092

Smoking Cessation: Uni-Modal and Multi-Modal Hypnotic and Non-Hypnotic Approaches.

ERIC Educational Resources Information Center

Habicht, Manuela H.

A survey of Queensland's population in 1993 determined that 24% of the adults were smokers. National data compiled in 1992 indicated that 72% of the drug-related deaths were related to tobacco use. In light of the need for effective smoking cessation approaches, a literature review was undertaken to determine the efficacy of hypnotic and…

77 FR 20097 - Intent To Prepare an Environmental Impact Statement for the Georgia Multi-Modal Passenger Terminal

Federal Register 2010, 2011, 2012, 2013, 2014

2012-04-03

... Smart, Federal Transit Administration, 230 Peachtree Street NW., Suite 800, Atlanta, GA 30327. Telephone: 404-865-5607. Email: brian.smart@dot.gov . SUPPLEMENTARY INFORMATION: In accordance with Section 6002...-city, regional and local modal services. At the same time, the Gulch creates a large void in the...

Joint modality fusion and temporal context exploitation for semantic video analysis

NASA Astrophysics Data System (ADS)

Papadopoulos, Georgios Th; Mezaris, Vasileios; Kompatsiaris, Ioannis; Strintzis, Michael G.

2011-12-01

In this paper, a multi-modal context-aware approach to semantic video analysis is presented. Overall, the examined video sequence is initially segmented into shots and for every resulting shot appropriate color, motion and audio features are extracted. Then, Hidden Markov Models (HMMs) are employed for performing an initial association of each shot with the semantic classes that are of interest separately for each modality. Subsequently, a graphical modeling-based approach is proposed for jointly performing modality fusion and temporal context exploitation. Novelties of this work include the combined use of contextual information and multi-modal fusion, and the development of a new representation for providing motion distribution information to HMMs. Specifically, an integrated Bayesian Network is introduced for simultaneously performing information fusion of the individual modality analysis results and exploitation of temporal context, contrary to the usual practice of performing each task separately. Contextual information is in the form of temporal relations among the supported classes. Additionally, a new computationally efficient method for providing motion energy distribution-related information to HMMs, which supports the incorporation of motion characteristics from previous frames to the currently examined one, is presented. The final outcome of this overall video analysis framework is the association of a semantic class with every shot. Experimental results as well as comparative evaluation from the application of the proposed approach to four datasets belonging to the domains of tennis, news and volleyball broadcast video are presented.

Recommended procedures and methodology of coal description

USGS Publications Warehouse

Chao, E.C.; Minkin, J.A.; Thompson, C.L.

1983-01-01

This document is the result of a workshop on coal description held for the Branch of Coal Resources of the U.S. Geological Survey in March 1982. It has been prepared to aid and encourage the field-oriented coal scientist to participate directly in petrographic coal-description activities. The objectives and past and current practices of coal description vary widely. These are briefly reviewed and illustrated with examples. Sampling approaches and techniques for collecting columnar samples of fresh coal are also discussed. The recommended procedures and methodology emphasize the fact that obtaining a good megascopic description of a coal bed is much better done in the laboratory with a binocular microscope and under good lighting conditions after the samples have been cut and quickly prepared. For better observation and cross-checking using a petrographic microscope for identification purposes, an in-place polishing procedure (requiring less than 2 min) is routinely used. Methods for using both the petrographic microscope and an automated image analysis system are also included for geologists who have access to such instruments. To describe the material characteristics of a coal bed in terms of microlithotypes or lithotypes, a new nomenclature of (V), (E), (1), (M). (S). (X1). (X2) and so on is used. The microscopic description of the modal composition of a megascopically observed lithologic type is expressed in terms of (VEIM); subscripts are used to denote the volume percentage of each constituent present. To describe a coal-bed profile, semiquantitative data (without microscopic study) and quantitative data (with microscopic study) are presented in ready-to-understand form. The average total composition of any thickness interval or of the entire coal bed can be plotted on a triangular diagram having V, E, and I+ M +S as the apices. The modal composition of any mixed lithologies such as (X1), (X2), and so on can also be plotted on such a triangular ternary diagram. Such diagrams can be used either for tracing compositional variations throughout a single coal-bed profile or for comparing variations between different coal beds.

Structural imaging of mild traumatic brain injury may not be enough: overview of functional and metabolic imaging of mild traumatic brain injury.

PubMed

Shin, Samuel S; Bales, James W; Edward Dixon, C; Hwang, Misun

2017-04-01

A majority of patients with traumatic brain injury (TBI) present as mild injury with no findings on conventional clinical imaging methods. Due to this difficulty of imaging assessment on mild TBI patients, there has been much emphasis on the development of diffusion imaging modalities such as diffusion tensor imaging (DTI). However, basic science research in TBI shows that many of the functional and metabolic abnormalities in TBI may be present even in the absence of structural damage. Moreover, structural damage may be present at a microscopic and molecular level that is not detectable by structural imaging modality. The use of functional and metabolic imaging modalities can provide information on pathological changes in mild TBI patients that may not be detected by structural imaging. Although there are various differences in protocols of positron emission tomography (PET), single photon emission computed tomography (SPECT), functional magnetic resonance imaging (fMRI), electroencephalography (EEG), and magnetoencephalography (MEG) methods, these may be important modalities to be used in conjunction with structural imaging in the future in order to detect and understand the pathophysiology of mild TBI. In this review, studies of mild TBI patients using these modalities that detect functional and metabolic state of the brain are discussed. Each modality's advantages and disadvantages are compared, and potential future applications of using combined modalities are explored.

Development of HiLo Microscope and its use in In-Vivo Applications

NASA Astrophysics Data System (ADS)

Patel, Shreyas J.

The functionality of achieving optical sectioning in biomedical research is invaluable as it allows for visualization of a biological sample at different depths while being free of background scattering. Most current microscopy techniques that offer optical sectioning, unfortunately, require complex instrumentation and thus are generally costly. HiLo microscopy, on the other hand, offers the same functionality and advantage at a relatively low cost. Hence, the work described in this thesis involves the design, build, and application of a HiLo microscope. More specifically, a standalone HiLo microscope was built in addition to implementing HiLo microscopy on a standard fluorescence microscope. In HiLo microscopy, optical sectioning is achieved by acquiring two different types of images per focal plane. One image is acquired under uniform illumination and the other is acquired under speckle illumination. These images are processed using an algorithm that extracts in-focus information and removes features and glare that occur as a result of background fluorescence. To show the benefits of the HiLo microscopy, several imaging experiments on various samples were performed under a HiLo microscope and compared against a traditional fluorescence microscope and a confocal microscope, which is considered the gold standard in optical imaging. In-vitro and ex-vivo imaging was performed on a set of pollen grains, and optically cleared mouse brain and heart slices. Each of these experiments showed great reduction in background scattering at different depths under HiLo microscopy. More importantly, HiLo imaging of optically cleared heart slice demonstrated emergence of different vasculature at different depths. Reduction of out-of-focus light increased the spatial resolution and allowed better visualization of capillary vessels. Furthermore, HiLo imaging was tested in an in-vivo model of a rodent dorsal window chamber model. When imaging the same sample under confocal microscope, the results were comparable between the two modalities. Additionally, a method of achieving blood flow maps at different depth using a combination of HiLo and LSI imaging is also discussed. The significance of this combined technique could help categorize blood flow to particular depths; this can help improve outcomes of medical treatments such pulse dye laser and photodynamic therapy treatments.

Visual tracking for multi-modality computer-assisted image guidance

NASA Astrophysics Data System (ADS)

Basafa, Ehsan; Foroughi, Pezhman; Hossbach, Martin; Bhanushali, Jasmine; Stolka, Philipp

2017-03-01

With optical cameras, many interventional navigation tasks previously relying on EM, optical, or mechanical guidance can be performed robustly, quickly, and conveniently. We developed a family of novel guidance systems based on wide-spectrum cameras and vision algorithms for real-time tracking of interventional instruments and multi-modality markers. These navigation systems support the localization of anatomical targets, support placement of imaging probe and instruments, and provide fusion imaging. The unique architecture - low-cost, miniature, in-hand stereo vision cameras fitted directly to imaging probes - allows for an intuitive workflow that fits a wide variety of specialties such as anesthesiology, interventional radiology, interventional oncology, emergency medicine, urology, and others, many of which see increasing pressure to utilize medical imaging and especially ultrasound, but have yet to develop the requisite skills for reliable success. We developed a modular system, consisting of hardware (the Optical Head containing the mini cameras) and software (components for visual instrument tracking with or without specialized visual features, fully automated marker segmentation from a variety of 3D imaging modalities, visual observation of meshes of widely separated markers, instant automatic registration, and target tracking and guidance on real-time multi-modality fusion views). From these components, we implemented a family of distinct clinical and pre-clinical systems (for combinations of ultrasound, CT, CBCT, and MRI), most of which have international regulatory clearance for clinical use. We present technical and clinical results on phantoms, ex- and in-vivo animals, and patients.

Multi-modal diffuse optical techniques for breast cancer neoadjuvant chemotherapy monitoring (Conference Presentation)

NASA Astrophysics Data System (ADS)

Cochran, Jeffrey M.; Busch, David R.; Ban, Han Y.; Kavuri, Venkaiah C.; Schweiger, Martin J.; Arridge, Simon R.; Yodh, Arjun G.

2017-02-01

We present high spatial density, multi-modal, parallel-plate Diffuse Optical Tomography (DOT) imaging systems for the purpose of breast tumor detection. One hybrid instrument provides time domain (TD) and continuous wave (CW) DOT at 64 source fiber positions. The TD diffuse optical spectroscopy with PMT- detection produces low-resolution images of absolute tissue scattering and absorption while the spatially dense array of CCD-coupled detector fibers (108 detectors) provides higher-resolution CW images of relative tissue optical properties. Reconstruction of the tissue optical properties, along with total hemoglobin concentration and tissue oxygen saturation, is performed using the TOAST software suite. Comparison of the spatially-dense DOT images and MR images allows for a robust validation of DOT against an accepted clinical modality. Additionally, the structural information from co-registered MR images is used as a spatial prior to improve the quality of the functional optical images and provide more accurate quantification of the optical and hemodynamic properties of tumors. We also present an optical-only imaging system that provides frequency domain (FD) DOT at 209 source positions with full CCD detection and incorporates optical fringe projection profilometry to determine the breast boundary. This profilometry serves as a spatial constraint, improving the quality of the DOT reconstructions while retaining the benefits of an optical-only device. We present initial images from both human subjects and phantoms to display the utility of high spatial density data and multi-modal information in DOT reconstruction with the two systems.

Whole-body diffusion-weighted MR image stitching and alignment to anatomical MRI

NASA Astrophysics Data System (ADS)

Ceranka, Jakub; Polfliet, Mathias; Lecouvet, Frederic; Michoux, Nicolas; Vandemeulebroucke, Jef

2017-02-01

Whole-body diffusion-weighted (WB-DW) MRI in combination with anatomical MRI has shown a great poten- tial in bone and soft tissue tumour detection, evaluation of lymph nodes and treatment response assessment. Because of the vast body coverage, whole-body MRI is acquired in separate stations, which are subsequently combined into a whole-body image. However, inter-station and inter-modality image misalignments can occur due to image distortions and patient motion during acquisition, which may lead to inaccurate representations of patient anatomy and hinder visual assessment. Automated and accurate whole-body image formation and alignment of the multi-modal MRI images is therefore crucial. We investigated several registration approaches for the formation or stitching of the whole-body image stations, followed by a deformable alignment of the multi- modal whole-body images. We compared a pairwise approach, where diffusion-weighted (DW) image stations were sequentially aligned to a reference station (pelvis), to a groupwise approach, where all stations were simultaneously mapped to a common reference space while minimizing the overall transformation. For each, a choice of input images and corresponding metrics was investigated. Performance was evaluated by assessing the quality of the obtained whole-body images, and by verifying the accuracy of the alignment with whole-body anatomical sequences. The groupwise registration approach provided the best compromise between the formation of WB- DW images and multi-modal alignment. The fully automated method was found to be robust, making its use in the clinic feasible.

Investigating common coding of observed and executed actions in the monkey brain using cross-modal multi-variate fMRI classification.

PubMed

Fiave, Prosper Agbesi; Sharma, Saloni; Jastorff, Jan; Nelissen, Koen

2018-05-19

Mirror neurons are generally described as a neural substrate hosting shared representations of actions, by simulating or 'mirroring' the actions of others onto the observer's own motor system. Since single neuron recordings are rarely feasible in humans, it has been argued that cross-modal multi-variate pattern analysis (MVPA) of non-invasive fMRI data is a suitable technique to investigate common coding of observed and executed actions, allowing researchers to infer the presence of mirror neurons in the human brain. In an effort to close the gap between monkey electrophysiology and human fMRI data with respect to the mirror neuron system, here we tested this proposal for the first time in the monkey. Rhesus monkeys either performed reach-and-grasp or reach-and-touch motor acts with their right hand in the dark or observed videos of human actors performing similar motor acts. Unimodal decoding showed that both executed or observed motor acts could be decoded from numerous brain regions. Specific portions of rostral parietal, premotor and motor cortices, previously shown to house mirror neurons, in addition to somatosensory regions, yielded significant asymmetric action-specific cross-modal decoding. These results validate the use of cross-modal multi-variate fMRI analyses to probe the representations of own and others' actions in the primate brain and support the proposed mapping of others' actions onto the observer's own motor cortices. Copyright © 2018 Elsevier Inc. All rights reserved.

Upgrade of a Scanning Confocal Microscope to a Single-Beam Path STED Microscope

PubMed Central

Klauss, André; König, Marcelle; Hille, Carsten

2015-01-01

By overcoming the diffraction limit in light microscopy, super-resolution techniques, such as stimulated emission depletion (STED) microscopy, are experiencing an increasing impact on life sciences. High costs and technically demanding setups, however, may still hinder a wider distribution of this innovation in biomedical research laboratories. As far-field microscopy is the most widely employed microscopy modality in the life sciences, upgrading already existing systems seems to be an attractive option for achieving diffraction-unlimited fluorescence microscopy in a cost-effective manner. Here, we demonstrate the successful upgrade of a commercial time-resolved confocal fluorescence microscope to an easy-to-align STED microscope in the single-beam path layout, previously proposed as “easy-STED”, achieving lateral resolution < λ/10 corresponding to a five-fold improvement over a confocal modality. For this purpose, both the excitation and depletion laser beams pass through a commercially available segmented phase plate that creates the STED-doughnut light distribution in the focal plane, while leaving the excitation beam unaltered when implemented into the joint beam path. Diffraction-unlimited imaging of 20 nm-sized fluorescent beads as reference were achieved with the wavelength combination of 635 nm excitation and 766 nm depletion. To evaluate the STED performance in biological systems, we compared the popular phalloidin-coupled fluorescent dyes Atto647N and Abberior STAR635 by labeling F-actin filaments in vitro as well as through immunofluorescence recordings of microtubules in a complex epithelial tissue. Here, we applied a recently proposed deconvolution approach and showed that images obtained from time-gated pulsed STED microscopy may benefit concerning the signal-to-background ratio, from the joint deconvolution of sub-images with different spatial information which were extracted from offline time gating. PMID:26091552

Diagnosis of cervical cancer cell taken from scanning electron and atomic force microscope images of the same patients using discrete wavelet entropy energy and Jensen Shannon, Hellinger, Triangle Measure classifier.

PubMed

Aytac Korkmaz, Sevcan

2016-05-05

The aim of this article is to provide early detection of cervical cancer by using both Atomic Force Microscope (AFM) and Scanning Electron Microscope (SEM) images of same patient. When the studies in the literature are examined, it is seen that the AFM and SEM images of the same patient are not used together for early diagnosis of cervical cancer. AFM and SEM images can be limited when using only one of them for the early detection of cervical cancer. Therefore, multi-modality solutions which give more accuracy results than single solutions have been realized in this paper. Optimum feature space has been obtained by Discrete Wavelet Entropy Energy (DWEE) applying to the 3×180 AFM and SEM images. Then, optimum features of these images are classified with Jensen Shannon, Hellinger, and Triangle Measure (JHT) Classifier for early diagnosis of cervical cancer. However, between classifiers which are Jensen Shannon, Hellinger, and triangle distance have been validated the measures via relationships. Afterwards, accuracy diagnosis of normal, benign, and malign cervical cancer cell was found by combining mean success rates of Jensen Shannon, Hellinger, and Triangle Measure which are connected with each other. Averages of accuracy diagnosis for AFM and SEM images by averaging the results obtained from these 3 classifiers are found as 98.29% and 97.10%, respectively. It has been observed that AFM images for early diagnosis of cervical cancer have higher performance than SEM images. Also in this article, surface roughness of malign AFM images in the result of the analysis made for the AFM images, according to the normal and benign AFM images is observed as larger, If the volume of particles has found as smaller. Copyright © 2016 Elsevier B.V. All rights reserved.

From SHG to mid-infrared SPDC generation in strained silicon waveguides

NASA Astrophysics Data System (ADS)

Castellan, Claudio; Trenti, Alessandro; Mancinelli, Mattia; Marchesini, Alessandro; Ghulinyan, Mher; Pucker, Georg; Pavesi, Lorenzo

2017-08-01

The centrosymmetric crystalline structure of Silicon inhibits second order nonlinear optical processes in this material. We report here that, by breaking the silicon symmetry with a stressing silicon nitride over-layer, Second Harmonic Generation (SHG) is obtained in suitably designed waveguides where multi-modal phase-matching is achieved. The modeling of the generated signal provides an effective strain-induced second order nonlinear coefficient of χ(2) = (0.30 +/- 0.02) pm/V. Our work opens also interesting perspectives on the reverse process, the Spontaneous Parametric Down Conversion (SPDC), through which it is possible to generate mid-infrared entangled photon pairs.

A novel intravital multi-harmonic generation microscope for early diagnosis of oral cancer

NASA Astrophysics Data System (ADS)

Cheng, Yu-Hsiang; Lin, Chih-Feng; Shih, Ting-Fang; Sun, Chi-Kuang

2013-03-01

Oral cancer is one of the most frequently diagnosed human cancers and leading causes of cancer death all over the world, but the prognosis and overall survival rate are still poor because of delay in diagnosis and lack of early intervention. The failure of early diagnosis is due to insufficiency of proper diagnostic and screening tools and most patients are reluctant to undergo biopsy. Optical virtual biopsy techniques, for imaging cells and tissues at microscopic details capable of differentiating benign from malignant lesions non-invasively, are thus highly desirable. A novel multi-harmonic generation microscope, excited by a 1260 nm Cr:forsterite laser, with second and third harmonic signals demonstrating collagen fiber distribution and cell morphology in a sub-micron resolution, was developed for clinical use. To achieve invivo observation inside the human oral cavity, a small objective probe with a suction capability was carefully designed for patients' comfort and stability. By remotely changing its focus point, the same objective can image the mucosa surface with a low magnification, illuminated by side light-emitting diodes, with a charge-coupled device (CCD) for site location selection before the harmonic generation biopsy was applied. Furthermore, the slow galvanometer mirror and the fast resonant mirror provide a 30 fps frame rate for high-speed real-time observation and the z-motor of this system is triggered at the same rate to provide fast 3D scanning, again ensuring patients' comfort. Focusing on the special cytological and morphological changes of the oral epithelial cells, our preliminary result disclosed excellent consistency with traditional histopathology studies.

A digital 3D atlas of the marmoset brain based on multi-modal MRI.

PubMed

Liu, Cirong; Ye, Frank Q; Yen, Cecil Chern-Chyi; Newman, John D; Glen, Daniel; Leopold, David A; Silva, Afonso C

2018-04-01

The common marmoset (Callithrix jacchus) is a New-World monkey of growing interest in neuroscience. Magnetic resonance imaging (MRI) is an essential tool to unveil the anatomical and functional organization of the marmoset brain. To facilitate identification of regions of interest, it is desirable to register MR images to an atlas of the brain. However, currently available atlases of the marmoset brain are mainly based on 2D histological data, which are difficult to apply to 3D imaging techniques. Here, we constructed a 3D digital atlas based on high-resolution ex-vivo MRI images, including magnetization transfer ratio (a T1-like contrast), T2w images, and multi-shell diffusion MRI. Based on the multi-modal MRI images, we manually delineated 54 cortical areas and 16 subcortical regions on one hemisphere of the brain (the core version). The 54 cortical areas were merged into 13 larger cortical regions according to their locations to yield a coarse version of the atlas, and also parcellated into 106 sub-regions using a connectivity-based parcellation method to produce a refined atlas. Finally, we compared the new atlas set with existing histology atlases and demonstrated its applications in connectome studies, and in resting state and stimulus-based fMRI. The atlas set has been integrated into the widely-distributed neuroimaging data analysis software AFNI and SUMA, providing a readily usable multi-modal template space with multi-level anatomical labels (including labels from the Paxinos atlas) that can facilitate various neuroimaging studies of marmosets. Published by Elsevier Inc.

Advances in combined endoscopic fluorescence confocal microscopy and optical coherence tomography

NASA Astrophysics Data System (ADS)

Risi, Matthew D.

Confocal microendoscopy provides real-time high resolution cellular level images via a minimally invasive procedure. Results from an ongoing clinical study to detect ovarian cancer with a novel confocal fluorescent microendoscope are presented. As an imaging modality, confocal fluorescence microendoscopy typically requires exogenous fluorophores, has a relatively limited penetration depth (100 μm), and often employs specialized aperture configurations to achieve real-time imaging in vivo. Two primary research directions designed to overcome these limitations and improve diagnostic capability are presented. Ideal confocal imaging performance is obtained with a scanning point illumination and confocal aperture, but this approach is often unsuitable for real-time, in vivo biomedical imaging. By scanning a slit aperture in one direction, image acquisition speeds are greatly increased, but at the cost of a reduction in image quality. The design, implementation, and experimental verification of a custom multi-point-scanning modification to a slit-scanning multi-spectral confocal microendoscope is presented. This new design improves the axial resolution while maintaining real-time imaging rates. In addition, the multi-point aperture geometry greatly reduces the effects of tissue scatter on imaging performance. Optical coherence tomography (OCT) has seen wide acceptance and FDA approval as a technique for ophthalmic retinal imaging, and has been adapted for endoscopic use. As a minimally invasive imaging technique, it provides morphological characteristics of tissues at a cellular level without requiring the use of exogenous fluorophores. OCT is capable of imaging deeper into biological tissue (˜1-2 mm) than confocal fluorescence microscopy. A theoretical analysis of the use of a fiber-bundle in spectral-domain OCT systems is presented. The fiber-bundle enables a flexible endoscopic design and provides fast, parallelized acquisition of the optical coherence tomography data. However, the multi-mode characteristic of the fibers in the fiber-bundle affects the depth sensitivity of the imaging system. A description of light interference in a multi-mode fiber is presented along with numerical simulations and experimental studies to illustrate the theoretical analysis.

Training Medical Novices in Spinal Microsurgery: Does the Modality Matter? A Pilot Study Comparing Traditional Microscopic Surgery and a Novel Robotic Optoelectronic Visualization Tool

PubMed Central

Tubbs, R. Shane; Page, Jeni; Chapman, Alexandra; Burgess, Brittni; Laws, Tyler; Warren, Haylie; Oskouian, Rod J

2016-01-01

The operative microscope has been a staple instrument in the neurosurgical operating room over the last 50 years. With advances in optoelectronics, options such as robotically controlled high magnification have become available. Such robotically controlled optoelectronic systems may offer new opportunities in surgical technique and teaching. However, traditionally trained surgeons may find it hard to accept newer technologies due to an inherent bias emerging from their previous background. We, therefore, studied how a medically naïve population in a pilot study would meet set microsurgical goals in a cadaver experiment using either a conventional operative microscope or BrightMatter™ Servo system, ​a robotically controlled optoelectronic system (Synaptive Medical, Toronto, Ontario, Canada). We found that the relative ease in teaching medical novices with a robotically controlled optoelectronic system was more valuable when compared to using a modern-day surgical microscope. PMID:26973804

Development of multi-class, multi-criteria bicycle traffic assignment models and solution algorithms

DOT National Transportation Integrated Search

2015-08-31

Cycling is gaining popularity both as a mode of travel in urban communities and as an alternative mode to private motorized vehicles due to its wide range of benefits (health, environmental, and economical). However, this change in modal share is not...

Preparing and Restoring Composite Resin Restorations. The Advantage of High Magnification Loupes or the Dental Surgical Operating Microscope.

PubMed

Mamoun, John

2015-01-01

Use of magnification, such as 6x to 8x binocular surgical loupes or the surgical operating microscope, combined with co-axial illumination, may facilitate the creation of stable composite resin restorations that are less likely to develop caries, cracks or margin stains over years of service. Microscopes facilitate observation of clinically relevant microscopic visual details, such as microscopic amounts of demineralization or caries at preparation margins; microscopic areas of soft, decayed tooth structure; microscopic amounts of moisture contamination of the preparation during bonding; or microscopic marginal gaps in the composite. Preventing microscope-level errors in composite fabrication can result in a composite restoration that, at initial placement, appears perfect when viewed under 6x to 8x magnification and which also is free of secondary caries, marginal staining or cracks at multi-year follow-up visits.

Multi-spectral confocal microendoscope for in-vivo imaging

NASA Astrophysics Data System (ADS)

Rouse, Andrew Robert

The concept of in-vivo multi-spectral confocal microscopy is introduced. A slit-scanning multi-spectral confocal microendoscope (MCME) was built to demonstrate the technique. The MCME employs a flexible fiber-optic catheter coupled to a custom built slit-scan confocal microscope fitted with a custom built imaging spectrometer. The catheter consists of a fiber-optic imaging bundle linked to a miniature objective and focus assembly. The design and performance of the miniature objective and focus assembly are discussed. The 3mm diameter catheter may be used on its own or routed though the instrument channel of a commercial endoscope. The confocal nature of the system provides optical sectioning with 3mum lateral resolution and 30mum axial resolution. The prism based multi-spectral detection assembly is typically configured to collect 30 spectral samples over the visible chromatic range. The spectral sampling rate varies from 4nm/pixel at 490nm to 8nm/pixel at 660nm and the minimum resolvable wavelength difference varies from 7nm to 18nm over the same spectral range. Each of these characteristics are primarily dictated by the dispersive power of the prism. The MCME is designed to examine cellular structures during optical biopsy and to exploit the diagnostic information contained within the spectral domain. The primary applications for the system include diagnosis of disease in the gastro-intestinal tract and female reproductive system. Recent data from the grayscale imaging mode are presented. Preliminary multi-spectral results from phantoms, cell cultures, and excised human tissue are presented to demonstrate the potential of in-vivo multi-spectral imaging.

Fixed Base Modal Survey of the MPCV Orion European Service Module Structural Test Article

NASA Technical Reports Server (NTRS)

Winkel, James P.; Akers, J. C.; Suarez, Vicente J.; Staab, Lucas D.; Napolitano, Kevin L.

2017-01-01

Recently, the MPCV Orion European Service Module Structural Test Article (E-STA) underwent sine vibration testing using the multi-axis shaker system at NASA GRC Plum Brook Station Mechanical Vibration Facility (MVF). An innovative approach using measured constraint shapes at the interface of E-STA to the MVF allowed high-quality fixed base modal parameters of the E-STA to be extracted, which have been used to update the E-STA finite element model (FEM), without the need for a traditional fixed base modal survey. This innovative approach provided considerable program cost and test schedule savings. This paper documents this modal survey, which includes the modal pretest analysis sensor selection, the fixed base methodology using measured constraint shapes as virtual references and measured frequency response functions, and post-survey comparison between measured and analysis fixed base modal parameters.

Multiset singular value decomposition for joint analysis of multi-modal data: application to fingerprint analysis

NASA Astrophysics Data System (ADS)

Emge, Darren K.; Adalı, Tülay

2014-06-01

As the availability and use of imaging methodologies continues to increase, there is a fundamental need to jointly analyze data that is collected from multiple modalities. This analysis is further complicated when, the size or resolution of the images differ, implying that the observation lengths of each of modality can be highly varying. To address this expanding landscape, we introduce the multiset singular value decomposition (MSVD), which can perform a joint analysis on any number of modalities regardless of their individual observation lengths. Through simulations, the inter modal relationships across the different modalities which are revealed by the MSVD are shown. We apply the MSVD to forensic fingerprint analysis, showing that MSVD joint analysis successfully identifies relevant similarities for further analysis, significantly reducing the processing time required. This reduction, takes this technique from a laboratory method to a useful forensic tool with applications across the law enforcement and security regimes.

The Blended Finite Element Method for Multi-fluid Plasma Modeling

DTIC Science & Technology

2016-07-01

Briefing Charts 3. DATES COVERED (From - To) 07 June 2016 - 01 July 2016 4. TITLE AND SUBTITLE The Blended Finite Element Method for Multi-fluid Plasma...BLENDED FINITE ELEMENT METHOD FOR MULTI-FLUID PLASMA MODELING Éder M. Sousa1, Uri Shumlak2 1ERC INC., IN-SPACE PROPULSION BRANCH (RQRS) AIR FORCE RESEARCH...MULTI-FLUID PLASMA MODEL 2 BLENDED FINITE ELEMENT METHOD Blended Finite Element Method Nodal Continuous Galerkin Modal Discontinuous Galerkin Model

A 24-Week Multi-Modality Exercise Program Improves Executive Control in Older Adults with a Self-Reported Cognitive Complaint: Evidence from the Antisaccade Task.

PubMed

Heath, Matthew; Shellington, Erin; Titheridge, Sam; Gill, Dawn P; Petrella, Robert J

2017-01-01

Exercise programs involving aerobic and resistance training (i.e., multiple-modality) have shown promise in improving cognition and executive control in older adults at risk, or experiencing, cognitive decline. It is, however, unclear whether cognitive training within a multiple-modality program elicits an additive benefit to executive/cognitive processes. This is an important question to resolve in order to identify optimal training programs that delay, or ameliorate, executive deficits in persons at risk for further cognitive decline. In the present study, individuals with a self-reported cognitive complaint (SCC) participated in a 24-week multiple-modality (i.e., the M2 group) exercise intervention program. In addition, a separate group of individuals with a SCC completed the same aerobic and resistance training as the M2 group but also completed a cognitive-based stepping task (i.e., multiple-modality, mind-motor intervention: M4 group). Notably, pre- and post-intervention executive control was examined via the antisaccade task (i.e., eye movement mirror-symmetrical to a target). Antisaccades are an ideal tool for the study of individuals with subtle executive deficits because of its hands- and language-free nature and because the task's neural mechanisms are linked to neuropathology in cognitive decline (i.e., prefrontal cortex). Results showed that M2 and M4 group antisaccade reaction times reliably decreased from pre- to post-intervention and the magnitude of the decrease was consistent across groups. Thus, multi-modality exercise training improved executive performance in persons with a SCC independent of mind-motor training. Accordingly, we propose that multiple-modality training provides a sufficient intervention to improve executive control in persons with a SCC.

Development of an Experimental Rig for Investigation of Higher Order Modes in Ducts

NASA Technical Reports Server (NTRS)

Gerhold, Carl H.; Cabell, Randolph H.; Brown, Martha C.

2006-01-01

Continued progress to reduce fan noise emission from high bypass ratio engine ducts in aircraft increasingly relies on accurate description of the sound propagation in the duct. A project has been undertaken at NASA Langley Research Center to investigate the propagation of higher order modes in ducts with flow. This is a two-pronged approach, including development of analytic models (the subject of a separate paper) and installation of a laboratory-quality test rig. The purposes of the rig are to validate the analytical models and to evaluate novel duct acoustic liner concepts, both passive and active. The dimensions of the experimental rig test section scale to between 25% and 50% of the aft bypass ducts of most modern engines. The duct is of rectangular cross section so as to provide flexibility to design and fabricate test duct liner samples. The test section can accommodate flow paths that are straight through or offset from inlet to discharge, the latter design allowing investigation of the effect of curvature on sound propagation and duct liner performance. The maximum air flow rate through the duct is Mach 0.3. Sound in the duct is generated by an array of 16 high-intensity acoustic drivers. The signals to the loudspeaker array are generated by a multi-input/multi-output feedforward control system that has been developed for this project. The sound is sampled by arrays of flush-mounted microphones and a modal decomposition is performed at the frequency of sound generation. The data acquisition system consists of two arrays of flush-mounted microphones, one upstream of the test section and one downstream. The data are used to determine parameters such as the overall insertion loss of the test section treatment as well as the effect of the treatment on a modal basis such as mode scattering. The methodology used for modal decomposition is described, as is a description of the mode generation control system. Data are presented which demonstrate the performance of the controller to generate the desired mode while suppressing all other cut on modes in the duct.

Multi-Modal Surrogates for Retrieving and Making Sense of Videos: Is Synchronization between the Multiple Modalities Optimal?

ERIC Educational Resources Information Center

Song, Yaxiao

2010-01-01

Video surrogates can help people quickly make sense of the content of a video before downloading or seeking more detailed information. Visual and audio features of a video are primary information carriers and might become important components of video retrieval and video sense-making. In the past decades, most research and development efforts on…

Radiation and annealing response of WWER 440 beltline welding seams

NASA Astrophysics Data System (ADS)

Viehrig, Hans-Werner; Houska, Mario; Altstadt, Eberhard

2015-01-01

The focus of this paper is on the irradiation response and the effect of thermal annealing in weld materials extracted from decommissioned WWER 440 reactor pressure vessels of the nuclear power plant Greifswald. The characterisation is based on the measurement of the hardness, the yield stress, the Master Curve reference temperature, T0, and the Charpy-V transition temperature through the thickness of multi-layer beltline welding seams in the irradiated and the thermally annealed condition. Additionally, the weld bead structure was characterised by light microscopic studies. We observed a large variation in the through thickness T0 values in the irradiated as well as in thermally annealed condition. The T0 values measured with the T-S-oriented Charpy size SE(B) specimens cut from different thickness locations of the multilayer welding seams strongly depend on the intrinsic weld bead structure along the crack tip. The Master Curve, T0, and Charpy-V, TT47J, based ductile-to-brittle transition temperature progressions through the thickness of the multi-layer welding seam do not correspond to the forecast according to the Russian code. In general, the fracture toughness values at cleavage failure, KJc, measured on SE(B) specimens from the irradiated and large-scale thermally annealed beltline welding seams follow the Master Curve description, but more than the expected number lie outside the curves for 2% and 98% fracture probability. In this case the test standard ASTM E1921 indicates the investigated multi-layer weld metal as not uniform. The multi modal Master Curve based approach describes the temperature dependence of the specimen size adjusted KJc-1T values well. Thermal annealing at 475 °C for 152 h results in the expected decrease of the hardness and tensile strength and the shift of Master Curve and Charpy-V based ductile-to-brittle transition temperatures to lower values.

Interactive natural language acquisition in a multi-modal recurrent neural architecture

NASA Astrophysics Data System (ADS)

Heinrich, Stefan; Wermter, Stefan

2018-01-01

For the complex human brain that enables us to communicate in natural language, we gathered good understandings of principles underlying language acquisition and processing, knowledge about sociocultural conditions, and insights into activity patterns in the brain. However, we were not yet able to understand the behavioural and mechanistic characteristics for natural language and how mechanisms in the brain allow to acquire and process language. In bridging the insights from behavioural psychology and neuroscience, the goal of this paper is to contribute a computational understanding of appropriate characteristics that favour language acquisition. Accordingly, we provide concepts and refinements in cognitive modelling regarding principles and mechanisms in the brain and propose a neurocognitively plausible model for embodied language acquisition from real-world interaction of a humanoid robot with its environment. In particular, the architecture consists of a continuous time recurrent neural network, where parts have different leakage characteristics and thus operate on multiple timescales for every modality and the association of the higher level nodes of all modalities into cell assemblies. The model is capable of learning language production grounded in both, temporal dynamic somatosensation and vision, and features hierarchical concept abstraction, concept decomposition, multi-modal integration, and self-organisation of latent representations.

Accurate Learning with Few Atlases (ALFA): an algorithm for MRI neonatal brain extraction and comparison with 11 publicly available methods.

PubMed

Serag, Ahmed; Blesa, Manuel; Moore, Emma J; Pataky, Rozalia; Sparrow, Sarah A; Wilkinson, A G; Macnaught, Gillian; Semple, Scott I; Boardman, James P

2016-03-24

Accurate whole-brain segmentation, or brain extraction, of magnetic resonance imaging (MRI) is a critical first step in most neuroimage analysis pipelines. The majority of brain extraction algorithms have been developed and evaluated for adult data and their validity for neonatal brain extraction, which presents age-specific challenges for this task, has not been established. We developed a novel method for brain extraction of multi-modal neonatal brain MR images, named ALFA (Accurate Learning with Few Atlases). The method uses a new sparsity-based atlas selection strategy that requires a very limited number of atlases 'uniformly' distributed in the low-dimensional data space, combined with a machine learning based label fusion technique. The performance of the method for brain extraction from multi-modal data of 50 newborns is evaluated and compared with results obtained using eleven publicly available brain extraction methods. ALFA outperformed the eleven compared methods providing robust and accurate brain extraction results across different modalities. As ALFA can learn from partially labelled datasets, it can be used to segment large-scale datasets efficiently. ALFA could also be applied to other imaging modalities and other stages across the life course.

On modal cross-coupling in the asymptotic modal limit

NASA Astrophysics Data System (ADS)

Culver, Dean; Dowell, Earl

2018-03-01

The conditions under which significant modal cross-coupling occurs in dynamical systems responding to high-frequency, broadband forcing that excites many modes is studied. The modal overlap factor plays a key role in the analysis of these systems as the modal density (the ratio of number of modes to the frequency bandwidth) becomes large. The modal overlap factor is effectively the ratio of the width of a resonant peak (the damping ratio times the resonant frequency) to the average frequency interval between resonant peaks (or rather, the inverse of the modal density). It is shown that this parameter largely determines whether substantial modal cross-coupling occurs in a given system's response. Here, two prototypical systems are considered. The first is a simple rectangular plate whose significant modal cross-coupling is the exception rather than the norm. The second is a pair of rectangular plates attached at a point where significant modal cross-coupling is more likely to occur. We show that, for certain cases of modal density and damping, non-negligible cross coupling occurs in both systems. Under similar circumstances, the constraint force between the two plates in the latter system becomes broadband. The implications of this for using Asymptotic Modal Analysis (AMA) in multi-component systems are discussed.

MRI-guided fiber-based fluorescence molecular tomography for preclinical atherosclerosis imaging

NASA Astrophysics Data System (ADS)

Li, Baoqiang; Pouliot, Philippe; Lesage, Frederic

2014-09-01

Multi-modal imaging combining fluorescent molecular tomography (FMT) with MRI could provide information in these two modalities as well as optimize the recovery of functional information with MR-guidance. Here, we present a MRI-guided FMT system. An optical probe was designed consisting of a fiber plate on the top and bottom sides of the animal bed, respectively. In experiment, animal was installed between the two plates. Mounting fibers on each plate, transmission measuring could be conducted from both sides of the animal. Moreover, an accurate fluorescence reconstruction was achieved with MRI-derived anatomical guidance. The sensitivity of the FMT system was evaluated with a phantom showing that with long fibers, it was sufficient to detect 10nM Cy5.5 solution with ~28.5 dB in the phantom. The system was eventually used to image MMP activity involved in atherosclerosis with two ATX mice and two control mice. The reconstruction results were in agreement with ex vivo measurement.

Quasi-modal vibration control by means of active control bearings

NASA Technical Reports Server (NTRS)

Nonami, K.; Fleming, D. P.

1986-01-01

This paper investigates a design method of an active control bearing system with only velocity feedback. The study provides a new quasi-modal control method for a control system design of an active control bearing system in which feedback coefficients are determined on the basis of a modal analysis. Although the number of sensors and actuators is small, this quasi-modal control method produces a control effect close to an ideal modal control.

Development of a Dynamically Configurable,Object-Oriented Framework for Distributed, Multi-modal Computational Aerospace Systems Simulation

NASA Technical Reports Server (NTRS)

Afjeh, Abdollah A.; Reed, John A.

2003-01-01

This research is aimed at developing a neiv and advanced simulation framework that will significantly improve the overall efficiency of aerospace systems design and development. This objective will be accomplished through an innovative integration of object-oriented and Web-based technologies ivith both new and proven simulation methodologies. The basic approach involves Ihree major areas of research: Aerospace system and component representation using a hierarchical object-oriented component model which enables the use of multimodels and enforces component interoperability. Collaborative software environment that streamlines the process of developing, sharing and integrating aerospace design and analysis models. . Development of a distributed infrastructure which enables Web-based exchange of models to simplify the collaborative design process, and to support computationally intensive aerospace design and analysis processes. Research for the first year dealt with the design of the basic architecture and supporting infrastructure, an initial implementation of that design, and a demonstration of its application to an example aircraft engine system simulation.

Emotion Perception from Face, Voice, and Touch: Comparisons and Convergence

PubMed Central

Schirmer, Annett; Adolphs, Ralph

2017-01-01

Historically, research on emotion perception has focused on facial expressions, and findings from this modality have come to dominate our thinking about other modalities. Here, we examine emotion perception through a wider lens by comparing facial with vocal and tactile processing. We review stimulus characteristics and ensuing behavioral and brain responses, and show that audition and touch do not simply duplicate visual mechanisms. Each modality provides a distinct input channel and engages partly non-overlapping neuroanatomical systems with different processing specializations (e.g., specific emotions versus affect). Moreover, processing of signals across the different modalities converges, first into multi- and later into amodal representations that enable holistic emotion judgments. PMID:28173998

APEX_SCOPE: A graphical user interface for visualization of multi-modal data in inter-disciplinary studies.

PubMed

Kanbar, Lara J; Shalish, Wissam; Precup, Doina; Brown, Karen; Sant'Anna, Guilherme M; Kearney, Robert E

2017-07-01

In multi-disciplinary studies, different forms of data are often collected for analysis. For example, APEX, a study on the automated prediction of extubation readiness in extremely preterm infants, collects clinical parameters and cardiorespiratory signals. A variety of cardiorespiratory metrics are computed from these signals and used to assign a cardiorespiratory pattern at each time. In such a situation, exploratory analysis requires a visualization tool capable of displaying these different types of acquired and computed signals in an integrated environment. Thus, we developed APEX_SCOPE, a graphical tool for the visualization of multi-modal data comprising cardiorespiratory signals, automated cardiorespiratory metrics, automated respiratory patterns, manually classified respiratory patterns, and manual annotations by clinicians during data acquisition. This MATLAB-based application provides a means for collaborators to view combinations of signals to promote discussion, generate hypotheses and develop features.

Multi-parameter optimization of piezoelectric actuators for multi-mode active vibration control of cylindrical shells

NASA Astrophysics Data System (ADS)

Hu, K. M.; Li, Hua

2018-07-01

A novel technique for the multi-parameter optimization of distributed piezoelectric actuators is presented in this paper. The proposed method is designed to improve the performance of multi-mode vibration control in cylindrical shells. The optimization parameters of actuator patch configuration include position, size, and tilt angle. The modal control force of tilted orthotropic piezoelectric actuators is derived and the multi-parameter cylindrical shell optimization model is established. The linear quadratic energy index is employed as the optimization criterion. A geometric constraint is proposed to prevent overlap between tilted actuators, which is plugged into a genetic algorithm to search the optimal configuration parameters. A simply-supported closed cylindrical shell with two actuators serves as a case study. The vibration control efficiencies of various parameter sets are evaluated via frequency response and transient response simulations. The results show that the linear quadratic energy indexes of position and size optimization decreased by 14.0% compared to position optimization; those of position and tilt angle optimization decreased by 16.8%; and those of position, size, and tilt angle optimization decreased by 25.9%. It indicates that, adding configuration optimization parameters is an efficient approach to improving the vibration control performance of piezoelectric actuators on shells.

Modeling and simulation of dynamic ant colony's labor division for task allocation of UAV swarm

NASA Astrophysics Data System (ADS)

Wu, Husheng; Li, Hao; Xiao, Renbin; Liu, Jie

2018-02-01

The problem of unmanned aerial vehicle (UAV) task allocation not only has the intrinsic attribute of complexity, such as highly nonlinear, dynamic, highly adversarial and multi-modal, but also has a better practicability in various multi-agent systems, which makes it more and more attractive recently. In this paper, based on the classic fixed response threshold model (FRTM), under the idea of "problem centered + evolutionary solution" and by a bottom-up way, the new dynamic environmental stimulus, response threshold and transition probability are designed, and a dynamic ant colony's labor division (DACLD) model is proposed. DACLD allows a swarm of agents with a relatively low-level of intelligence to perform complex tasks, and has the characteristic of distributed framework, multi-tasks with execution order, multi-state, adaptive response threshold and multi-individual response. With the proposed model, numerical simulations are performed to illustrate the effectiveness of the distributed task allocation scheme in two situations of UAV swarm combat (dynamic task allocation with a certain number of enemy targets and task re-allocation due to unexpected threats). Results show that our model can get both the heterogeneous UAVs' real-time positions and states at the same time, and has high degree of self-organization, flexibility and real-time response to dynamic environments.

A low-power multi-modal body sensor network with application to epileptic seizure monitoring.

PubMed

Altini, Marco; Del Din, Silvia; Patel, Shyamal; Schachter, Steven; Penders, Julien; Bonato, Paolo

2011-01-01

Monitoring patients' physiological signals during their daily activities in the home environment is one of the challenge of the health care. New ultra-low-power wireless technologies could help to achieve this goal. In this paper we present a low-power, multi-modal, wearable sensor platform for the simultaneous recording of activity and physiological data. First we provide a description of the wearable sensor platform, and its characteristics with respect to power consumption. Second we present the preliminary results of the comparison between our sensors and a reference system, on healthy subjects, to test the reliability of the detected physiological (electrocardiogram and respiration) and electromyography signals.

Multi-modal cockpit interface for improved airport surface operations

NASA Technical Reports Server (NTRS)

Arthur, Jarvis J. (Inventor); Bailey, Randall E. (Inventor); Prinzel, III, Lawrence J. (Inventor); Kramer, Lynda J. (Inventor); Williams, Steven P. (Inventor)

2010-01-01

A system for multi-modal cockpit interface during surface operation of an aircraft comprises a head tracking device, a processing element, and a full-color head worn display. The processing element is configured to receive head position information from the head tracking device, to receive current location information of the aircraft, and to render a virtual airport scene corresponding to the head position information and the current aircraft location. The full-color head worn display is configured to receive the virtual airport scene from the processing element and to display the virtual airport scene. The current location information may be received from one of a global positioning system or an inertial navigation system.

Nanoscale welding of multi-walled carbon nanotubes by 1064 nm fiber laser

NASA Astrophysics Data System (ADS)

Yuan, Yanping; Liu, Zhi; Zhang, Kaihu; Han, Weina; Chen, Jimin

2018-07-01

This study proposes an efficient approach which uses 1064 nm continuous fiber laser to achieve nanoscale welding of crossed multi-walled carbon nanotubes (MWCNTs). By changing the irradiation time, different quality of nanoscale welding is obtained. The morphology changes are investigated by scanning electron microscope (SEM) and transmission electron microscope (TEM). The experiments demonstrate that better quality of MWCNTs nanoscale welding after 3 s irradiation can be obtained. It is found that new graphene layers between crossed nanotubes induced by laser make the nanoscale welding achieved due to the absorption of laser energy.

Multi-segment detector array for hybrid reflection-mode ultrasound and optoacoustic tomography (Conference Presentation)

NASA Astrophysics Data System (ADS)

Merčep, Elena; Burton, Neal C.; Deán-Ben, Xosé Luís.; Razansky, Daniel

2017-02-01

The complementary contrast of the optoacoustic (OA) and pulse-echo ultrasound (US) modalities makes the combined usage of these imaging technologies highly advantageous. Due to the different physical contrast mechanisms development of a detector array optimally suited for both modalities is one of the challenges to efficient implementation of a single OA-US imaging device. We demonstrate imaging performance of the first hybrid detector array whose novel design, incorporating array segments of linear and concave geometry, optimally supports image acquisition in both reflection-mode ultrasonography and optoacoustic tomography modes. Hybrid detector array has a total number of 256 elements and three segments of different geometry and variable pitch size: a central 128-element linear segment with pitch of 0.25mm, ideally suited for pulse-echo US imaging, and two external 64-elements segments with concave geometry and 0.6mm pitch optimized for OA image acquisition. Interleaved OA and US image acquisition with up to 25 fps is facilitated through a custom-made multiplexer unit. Spatial resolution of the transducer was characterized in numerical simulations and validated in phantom experiments and comprises 230 and 300 μm in the respective OA and US imaging modes. Imaging performance of the multi-segment detector array was experimentally shown in a series of imaging sessions with healthy volunteers. Employing mixed array geometries allows at the same time achieving excellent OA contrast with a large field of view, and US contrast for complementary structural features with reduced side-lobes and improved resolution. The newly designed hybrid detector array that comprises segments of linear and concave geometries optimally fulfills requirements for efficient US and OA imaging and may expand the applicability of the developed hybrid OPUS imaging technology and accelerate its clinical translation.

Teaching tobacco dependence treatment and counseling skills during medical school: rationale and design of the Medical Students helping patients Quit tobacco (MSQuit) group randomized controlled trial

PubMed Central

Hayes, Rashelle B.; Geller, Alan; Churchill, Linda; Jolicoeur, Denise; Murray, David M.; Shoben, Abigail; David, Sean P.; Adams, Michael; Okuyemi, Kola; Fauver, Randy; Gross, Robin; Leone, Frank; Xiao, Rui; Waugh, Jonathan; Crawford, Sybil; Ockene, Judith K.

2014-01-01

INTRODUCTION Physician-delivered tobacco treatment using the 5As is clinically recommended, yet its use has been limited. Lack of adequate training and confidence to provide tobacco treatment are cited as leading reasons for limited 5A use. Tobacco dependence treatment training while in medical school is recommended, but is minimally provided. The MSQuit trial (Medical Students helping patients Quit tobacco) aims to determine if a multi-modal and theoretically-guided tobacco educational intervention will improve tobacco dependence treatment skills (i.e. 5As) among medical students. METHODS/DESIGN 10 U.S. medical schools were pair-matched and randomized in a group-randomized controlled trial to evaluate whether a multi-modal educational (MME) intervention compared to traditional education (TE) will improve observed tobacco treatment skills. MME is primarily composed of TE approaches (i.e. didactics) plus a 1st year web-based course and preceptor-facilitated training during a 3rd year clerkship rotation. The primary outcome measure is an objective score on an Objective Structured Clinical Examination (OSCE) tobacco-counseling smoking case among 3rd year medical students from schools who implemented the MME or TE. DISCUSSION MSQuit is the first randomized to evaluate whether a tobacco treatment educational intervention implemented during medical school will improve medical students’ tobacco treatment skills. We hypothesize that the MME intervention will better prepare students in tobacco dependence treatment as measured by the OSCE. If a comprehensive tobacco treatment educational learning approach is effective, while also feasible and acceptable to implement, then medical schools may substantially influence skill development and use of the 5As among future physicians. PMID:24486635

An innovative multi dof TMD system for motorcycle handlebars designed to reduce structural vibrations and human exposure

NASA Astrophysics Data System (ADS)

Agostoni, S.; Cheli, F.; Leo, E.; Pezzola, M.

2012-08-01

Motor vehicle ride comfort is mainly affected by reciprocating engine inertia unbalances. These forces are transmitted to the driver through the main frame, the engine mounts, and the auxiliary sub systems—all components with which he physically comes into contact. On-road traction vehicle engines are mainly characterized by transient exercise. Thus, an excitation frequency range from 800 RPM (≈15 Hz for stationary vehicles) up to 15,000 RPM (≈250 Hz as a cut off condition) occurs. Several structural resonances are induced by the unbalancing forces spectrum, thus exposing the driver to amplified vibrations. The aim of this research is to reduce driver vibration exposure, by acting on the modal response of structures with which the driver comes into contact. An experimental methodology, capable of identifying local vibration modes was developed. The application of this methodology on a reference vehicle allows us to detect if/when/how the above mentioned resonances are excited. Numerical models were used to study structural modifications. In this article, a handlebar equipped with an innovative multi reciprocating tuned mass damper was optimized. All structural modifications were designed, developed and installed on a vehicle. Modal investigations were then performed in order to predict modification efficiency. Furthermore, functional solution efficiency was verified during sweep tests performed on a target vehicle, by means of a roller bench capable of replicating on-road loads. Three main investigation zones of the vehicle were detected and monitored using accelerometers: (1) engine mounts, to characterize vibration emissions; (2) bindings connecting the engine to the frame, in order to detect vibration transfer paths, with particular attention being paid to local dynamic amplifications due to compliances and (3) the terminal components with which the driver comes into contact.

Design and rationale of the medical students learning weight management counseling skills (MSWeight) group randomized controlled trial.

PubMed

Ockene, Judith K; Ashe, Karen M; Hayes, Rashelle B; Churchill, Linda C; Crawford, Sybil L; Geller, Alan C; Jolicoeur, Denise; Olendzki, Barbara C; Basco, Maria Theresa; Pendharkar, Jyothi A; Ferguson, Kristi J; Guck, Thomas P; Margo, Katherine L; Okuliar, Catherine A; Shaw, Monica A; Soleymani, Taraneh; Stadler, Diane D; Warrier, Sarita S; Pbert, Lori

2018-01-01

Physicians have an important role addressing the obesity epidemic. Lack of adequate teaching to provide weight management counseling (WMC) is cited as a reason for limited treatment. National guidelines have not been translated into an evidence-supported, competency-based curriculum in medical schools. Weight Management Counseling in Medical Schools: A Randomized Controlled Trial (MSWeight) is designed to determine if a multi-modal theoretically-guided WMC educational intervention improves observed counseling skills and secondarily improve perceived skills and self-efficacy among medical students compared to traditional education (TE). Eight U.S. medical schools were pair-matched and randomized in a group randomized controlled trial to evaluate whether a multi-modal education (MME) intervention compared to traditional education (TE) improves observed WMC skills. The MME intervention includes innovative components in years 1-3: a structured web-course; a role play exercise, WebPatientEncounter, and an enhanced outpatient internal medicine or family medicine clerkship. This evidence-supported curriculum uses the 5As framework to guide treatment and incorporates patient-centered counseling to engage the patient. The primary outcome is a comparison of scores on an Objective Structured Clinical Examination (OSCE) WMC case among third year medical students. The secondary outcome compares changes in scores of medical students from their first to third year on an assessment of perceived WMC skills and self-efficacy. MSWeight is the first RCT in medical schools to evaluate whether interventions integrated into the curriculum improve medical students' WMC skills. If this educational approach for teaching WMC is effective, feasible and acceptable it can affect how medical schools integrate WMC teaching into their curriculum. Copyright © 2017 Elsevier Inc. All rights reserved.

Non-invasive monitoring of chewing and swallowing for objective quantification of ingestive behavior.

PubMed

Sazonov, Edward; Schuckers, Stephanie; Lopez-Meyer, Paulo; Makeyev, Oleksandr; Sazonova, Nadezhda; Melanson, Edward L; Neuman, Michael

2008-05-01

A methodology of studying of ingestive behavior by non-invasive monitoring of swallowing (deglutition) and chewing (mastication) has been developed. The target application for the developed methodology is to study the behavioral patterns of food consumption and producing volumetric and weight estimates of energy intake. Monitoring is non-invasive based on detecting swallowing by a sound sensor located over laryngopharynx or by a bone-conduction microphone and detecting chewing through a below-the-ear strain sensor. Proposed sensors may be implemented in a wearable monitoring device, thus enabling monitoring of ingestive behavior in free-living individuals. In this paper, the goals in the development of this methodology are two-fold. First, a system comprising sensors, related hardware and software for multi-modal data capture is designed for data collection in a controlled environment. Second, a protocol is developed for manual scoring of chewing and swallowing for use as a gold standard. The multi-modal data capture was tested by measuring chewing and swallowing in 21 volunteers during periods of food intake and quiet sitting (no food intake). Video footage and sensor signals were manually scored by trained raters. Inter-rater reliability study for three raters conducted on the sample set of five subjects resulted in high average intra-class correlation coefficients of 0.996 for bites, 0.988 for chews and 0.98 for swallows. The collected sensor signals and the resulting manual scores will be used in future research as a gold standard for further assessment of sensor design, development of automatic pattern recognition routines and study of the relationship between swallowing/chewing and ingestive behavior.

Sensor modeling and demonstration of a multi-object spectrometer for performance-driven sensing

NASA Astrophysics Data System (ADS)

Kerekes, John P.; Presnar, Michael D.; Fourspring, Kenneth D.; Ninkov, Zoran; Pogorzala, David R.; Raisanen, Alan D.; Rice, Andrew C.; Vasquez, Juan R.; Patel, Jeffrey P.; MacIntyre, Robert T.; Brown, Scott D.

2009-05-01

A novel multi-object spectrometer (MOS) is being explored for use as an adaptive performance-driven sensor that tracks moving targets. Developed originally for astronomical applications, the instrument utilizes an array of micromirrors to reflect light to a panchromatic imaging array. When an object of interest is detected the individual micromirrors imaging the object are tilted to reflect the light to a spectrometer to collect a full spectrum. This paper will present example sensor performance from empirical data collected in laboratory experiments, as well as our approach in designing optical and radiometric models of the MOS channels and the micromirror array. Simulation of moving vehicles in a highfidelity, hyperspectral scene is used to generate a dynamic video input for the adaptive sensor. Performance-driven algorithms for feature-aided target tracking and modality selection exploit multiple electromagnetic observables to track moving vehicle targets.

Depth-resolved imaging of colon tumor using optical coherence tomography and fluorescence laminar optical tomography (Conference Presentation)

NASA Astrophysics Data System (ADS)

Tang, Qinggong; Frank, Aaron; Wang, Jianting; Chen, Chao-wei; Jin, Lily; Lin, Jon; Chan, Joanne M.; Chen, Yu

2016-03-01

Early detection of neoplastic changes remains a critical challenge in clinical cancer diagnosis and treatment. Many cancers arise from epithelial layers such as those of the gastrointestinal (GI) tract. Current standard endoscopic technology is unable to detect those subsurface lesions. Since cancer development is associated with both morphological and molecular alterations, imaging technologies that can quantitative image tissue's morphological and molecular biomarkers and assess the depth extent of a lesion in real time, without the need for tissue excision, would be a major advance in GI cancer diagnostics and therapy. In this research, we investigated the feasibility of multi-modal optical imaging including high-resolution optical coherence tomography (OCT) and depth-resolved high-sensitivity fluorescence laminar optical tomography (FLOT) for structural and molecular imaging. APC (adenomatous polyposis coli) mice model were imaged using OCT and FLOT and the correlated histopathological diagnosis was obtained. Quantitative structural (the scattering coefficient) and molecular imaging parameters (fluorescence intensity) from OCT and FLOT images were developed for multi-parametric analysis. This multi-modal imaging method has demonstrated the feasibility for more accurate diagnosis with 87.4% (87.3%) for sensitivity (specificity) which gives the most optimal diagnosis (the largest area under receiver operating characteristic (ROC) curve). This project results in a new non-invasive multi-modal imaging platform for improved GI cancer detection, which is expected to have a major impact on detection, diagnosis, and characterization of GI cancers, as well as a wide range of epithelial cancers.

A versatile clearing agent for multi-modal brain imaging

PubMed Central

Costantini, Irene; Ghobril, Jean-Pierre; Di Giovanna, Antonino Paolo; Mascaro, Anna Letizia Allegra; Silvestri, Ludovico; Müllenbroich, Marie Caroline; Onofri, Leonardo; Conti, Valerio; Vanzi, Francesco; Sacconi, Leonardo; Guerrini, Renzo; Markram, Henry; Iannello, Giulio; Pavone, Francesco Saverio

2015-01-01

Extensive mapping of neuronal connections in the central nervous system requires high-throughput µm-scale imaging of large volumes. In recent years, different approaches have been developed to overcome the limitations due to tissue light scattering. These methods are generally developed to improve the performance of a specific imaging modality, thus limiting comprehensive neuroanatomical exploration by multi-modal optical techniques. Here, we introduce a versatile brain clearing agent (2,2′-thiodiethanol; TDE) suitable for various applications and imaging techniques. TDE is cost-efficient, water-soluble and low-viscous and, more importantly, it preserves fluorescence, is compatible with immunostaining and does not cause deformations at sub-cellular level. We demonstrate the effectiveness of this method in different applications: in fixed samples by imaging a whole mouse hippocampus with serial two-photon tomography; in combination with CLARITY by reconstructing an entire mouse brain with light sheet microscopy and in translational research by imaging immunostained human dysplastic brain tissue. PMID:25950610

The multi-modal Australian ScienceS Imaging and Visualization Environment (MASSIVE) high performance computing infrastructure: applications in neuroscience and neuroinformatics research

PubMed Central

Goscinski, Wojtek J.; McIntosh, Paul; Felzmann, Ulrich; Maksimenko, Anton; Hall, Christopher J.; Gureyev, Timur; Thompson, Darren; Janke, Andrew; Galloway, Graham; Killeen, Neil E. B.; Raniga, Parnesh; Kaluza, Owen; Ng, Amanda; Poudel, Govinda; Barnes, David G.; Nguyen, Toan; Bonnington, Paul; Egan, Gary F.

2014-01-01

The Multi-modal Australian ScienceS Imaging and Visualization Environment (MASSIVE) is a national imaging and visualization facility established by Monash University, the Australian Synchrotron, the Commonwealth Scientific Industrial Research Organization (CSIRO), and the Victorian Partnership for Advanced Computing (VPAC), with funding from the National Computational Infrastructure and the Victorian Government. The MASSIVE facility provides hardware, software, and expertise to drive research in the biomedical sciences, particularly advanced brain imaging research using synchrotron x-ray and infrared imaging, functional and structural magnetic resonance imaging (MRI), x-ray computer tomography (CT), electron microscopy and optical microscopy. The development of MASSIVE has been based on best practice in system integration methodologies, frameworks, and architectures. The facility has: (i) integrated multiple different neuroimaging analysis software components, (ii) enabled cross-platform and cross-modality integration of neuroinformatics tools, and (iii) brought together neuroimaging databases and analysis workflows. MASSIVE is now operational as a nationally distributed and integrated facility for neuroinfomatics and brain imaging research. PMID:24734019

Stability metrics for multi-source biomedical data based on simplicial projections from probability distribution distances.

PubMed

Sáez, Carlos; Robles, Montserrat; García-Gómez, Juan M

2017-02-01

Biomedical data may be composed of individuals generated from distinct, meaningful sources. Due to possible contextual biases in the processes that generate data, there may exist an undesirable and unexpected variability among the probability distribution functions (PDFs) of the source subsamples, which, when uncontrolled, may lead to inaccurate or unreproducible research results. Classical statistical methods may have difficulties to undercover such variabilities when dealing with multi-modal, multi-type, multi-variate data. This work proposes two metrics for the analysis of stability among multiple data sources, robust to the aforementioned conditions, and defined in the context of data quality assessment. Specifically, a global probabilistic deviation and a source probabilistic outlyingness metrics are proposed. The first provides a bounded degree of the global multi-source variability, designed as an estimator equivalent to the notion of normalized standard deviation of PDFs. The second provides a bounded degree of the dissimilarity of each source to a latent central distribution. The metrics are based on the projection of a simplex geometrical structure constructed from the Jensen-Shannon distances among the sources PDFs. The metrics have been evaluated and demonstrated their correct behaviour on a simulated benchmark and with real multi-source biomedical data using the UCI Heart Disease data set. The biomedical data quality assessment based on the proposed stability metrics may improve the efficiency and effectiveness of biomedical data exploitation and research.

System identification of timber masonry walls using shaking table test

NASA Astrophysics Data System (ADS)

Roy, Timir B.; Guerreiro, Luis; Bagchi, Ashutosh

2017-04-01

Dynamic study is important in order to design, repair and rehabilitation of structures. It has played an important role in the behavior characterization of structures; such as: bridges, dams, high rise buildings etc. There had been substantial development in this area over the last few decades, especially in the field of dynamic identification techniques of structural systems. Frequency Domain Decomposition (FDD) and Time Domain Decomposition are most commonly used methods to identify modal parameters; such as: natural frequency, modal damping and mode shape. The focus of the present research is to study the dynamic characteristics of typical timber masonry walls commonly used in Portugal. For that purpose, a multi-storey structural prototype of such wall has been tested on a seismic shake table at the National Laboratory for Civil Engineering, Portugal (LNEC). Signal processing has been performed of the output response, which is collected from the shaking table experiment of the prototype using accelerometers. In the present work signal processing of the output response, based on the input response has been done in two ways: FDD and Stochastic Subspace Identification (SSI). In order to estimate the values of the modal parameters, algorithms for FDD are formulated and parametric functions for the SSI are computed. Finally, estimated values from both the methods are compared to measure the accuracy of both the techniques.

Multimodal fusion of brain imaging data: A key to finding the missing link(s) in complex mental illness

PubMed Central

Calhoun, Vince D; Sui, Jing

2016-01-01

It is becoming increasingly clear that combining multi-modal brain imaging data is able to provide more information for individual subjects by exploiting the rich multimodal information that exists. However, the number of studies that do true multimodal fusion (i.e. capitalizing on joint information among modalities) is still remarkably small given the known benefits. In part, this is because multi-modal studies require broader expertise in collecting, analyzing, and interpreting the results than do unimodal studies. In this paper, we start by introducing the basic reasons why multimodal data fusion is important and what it can do, and importantly how it can help us avoid wrong conclusions and help compensate for imperfect brain imaging studies. We also discuss the challenges that need to be confronted for such approaches to be more widely applied by the community. We then provide a review of the diverse studies that have used multimodal data fusion (primarily focused on psychosis) as well as provide an introduction to some of the existing analytic approaches. Finally, we discuss some up-and-coming approaches to multi-modal fusion including deep learning and multimodal classification which show considerable promise. Our conclusion is that multimodal data fusion is rapidly growing, but it is still underutilized. The complexity of the human brain coupled with the incomplete measurement provided by existing imaging technology makes multimodal fusion essential in order to mitigate against misdirection and hopefully provide a key to finding the missing link(s) in complex mental illness. PMID:27347565

Multimodal fusion of brain imaging data: A key to finding the missing link(s) in complex mental illness.

PubMed

Calhoun, Vince D; Sui, Jing

2016-05-01

It is becoming increasingly clear that combining multi-modal brain imaging data is able to provide more information for individual subjects by exploiting the rich multimodal information that exists. However, the number of studies that do true multimodal fusion (i.e. capitalizing on joint information among modalities) is still remarkably small given the known benefits. In part, this is because multi-modal studies require broader expertise in collecting, analyzing, and interpreting the results than do unimodal studies. In this paper, we start by introducing the basic reasons why multimodal data fusion is important and what it can do, and importantly how it can help us avoid wrong conclusions and help compensate for imperfect brain imaging studies. We also discuss the challenges that need to be confronted for such approaches to be more widely applied by the community. We then provide a review of the diverse studies that have used multimodal data fusion (primarily focused on psychosis) as well as provide an introduction to some of the existing analytic approaches. Finally, we discuss some up-and-coming approaches to multi-modal fusion including deep learning and multimodal classification which show considerable promise. Our conclusion is that multimodal data fusion is rapidly growing, but it is still underutilized. The complexity of the human brain coupled with the incomplete measurement provided by existing imaging technology makes multimodal fusion essential in order to mitigate against misdirection and hopefully provide a key to finding the missing link(s) in complex mental illness.

Generalized topology for resonators having N commensurate harmonics

NASA Astrophysics Data System (ADS)

Danzi, Francesco; Gibert, James M.; Frulla, Giacomo; Cestino, Enrico

2018-04-01

Despite the ubiquity of both linear and nonlinear multimember resonators in MEMS and kinetic energy harvesting devices very few research efforts examine the orientation of members in the resonator on its dynamic behavior. Previous efforts to design this type of resonator constrains the members to have relative orientations that are 0○ or 90○ to each other, i.e., the elements are connected inline with adjoining members or are perpendicular to adjoining members. The work expands upon the existing body of research by considering the effect of the relative orientation between members on the dynamic behavior of the system. In this manuscript, we derive a generalized reduced-order model for the design of a multi-member planar resonator that has integer multiple modal frequencies. The model is based on a Rayleigh Ritz approximation where the number of degrees of freedom equals the number of structural members in the resonator. The analysis allows the generation of design curves, representing all the possible solutions for modal frequencies that are commensurate. The generalized model, valid for an N-DOF structure, is then restricted for a 2- and 3-DOF system/member resonator, where the linear dynamic behavior of the resonator is investigated in depth. Furthermore, this analysis demonstrates a rule of thumb; relaxing restrictions on the relative orientation of members in a planar structure, allows the structure to exhibit exactly N commensurable frequencies if it contains N members.

Structural Brain Atlases: Design, Rationale, and Applications in Normal and Pathological Cohorts

PubMed Central

Mandal, Pravat K.; Mahajan, Rashima; Dinov, Ivo D.

2015-01-01

Structural magnetic resonance imaging (MRI) provides anatomical information about the brain in healthy as well as in diseased conditions. On the other hand, functional MRI (fMRI) provides information on the brain activity during performance of a specific task. Analysis of fMRI data requires the registration of the data to a reference brain template in order to identify the activated brain regions. Brain templates also find application in other neuroimaging modalities, such as diffusion tensor imaging and multi-voxel spectroscopy. Further, there are certain differences (e.g., brain shape and size) in the brains of populations of different origin and during diseased conditions like in Alzheimer’s disease (AD), population and disease-specific brain templates may be considered crucial for accurate registration and subsequent analysis of fMRI as well as other neuroimaging data. This manuscript provides a comprehensive review of the history, construction and application of brain atlases. A chronological outline of the development of brain template design, starting from the Talairach and Tournoux atlas to the Chinese brain template (to date), along with their respective detailed construction protocols provides the backdrop to this manuscript. The manuscript also provides the automated workflow-based protocol for designing a population-specific brain atlas from structural MRI data using LONI Pipeline graphical workflow environment. We conclude by discussing the scope of brain templates as a research tool and their application in various neuroimaging modalities. PMID:22647262

The Effects of Multimedia Content Design Modalities on Students' Motivation and Achievement in History

ERIC Educational Resources Information Center

Park, Sanghoon; Braud, Allison

2017-01-01

This study examined the effects of different multimedia design modalities on middle-school students' motivation and achievement in history and also sought to determine whether an interaction effect on achievement occurs between students' prior knowledge and the different multimedia design modalities. Two groups of eighth-grade students enrolled in…

SU-E-J-110: A Novel Level Set Active Contour Algorithm for Multimodality Joint Segmentation/Registration Using the Jensen-Rényi Divergence.

PubMed

Markel, D; Naqa, I El; Freeman, C; Vallières, M

2012-06-01

To present a novel joint segmentation/registration for multimodality image-guided and adaptive radiotherapy. A major challenge to this framework is the sensitivity of many segmentation or registration algorithms to noise. Presented is a level set active contour based on the Jensen-Renyi (JR) divergence to achieve improved noise robustness in a multi-modality imaging space. To present a novel joint segmentation/registration for multimodality image-guided and adaptive radiotherapy. A major challenge to this framework is the sensitivity of many segmentation or registration algorithms to noise. Presented is a level set active contour based on the Jensen-Renyi (JR) divergence to achieve improved noise robustness in a multi-modality imaging space. It was found that JR divergence when used for segmentation has an improved robustness to noise compared to using mutual information, or other entropy-based metrics. The MI metric failed at around 2/3 the noise power than the JR divergence. The JR divergence metric is useful for the task of joint segmentation/registration of multimodality images and shows improved results compared entropy based metric. The algorithm can be easily modified to incorporate non-intensity based images, which would allow applications into multi-modality and texture analysis. © 2012 American Association of Physicists in Medicine.

A multi-modal approach to assessing recovery in youth athletes following concussion.

PubMed

Reed, Nick; Murphy, James; Dick, Talia; Mah, Katie; Paniccia, Melissa; Verweel, Lee; Dobney, Danielle; Keightley, Michelle

2014-09-25

Concussion is one of the most commonly reported injuries amongst children and youth involved in sport participation. Following a concussion, youth can experience a range of short and long term neurobehavioral symptoms (somatic, cognitive and emotional/behavioral) that can have a significant impact on one's participation in daily activities and pursuits of interest (e.g., school, sports, work, family/social life, etc.). Despite this, there remains a paucity in clinically driven research aimed specifically at exploring concussion within the youth sport population, and more specifically, multi-modal approaches to measuring recovery. This article provides an overview of a novel and multi-modal approach to measuring recovery amongst youth athletes following concussion. The presented approach involves the use of both pre-injury/baseline testing and post-injury/follow-up testing to assess performance across a wide variety of domains (post-concussion symptoms, cognition, balance, strength, agility/motor skills and resting state heart rate variability). The goal of this research is to gain a more objective and accurate understanding of recovery following concussion in youth athletes (ages 10-18 years). Findings from this research can help to inform the development and use of improved approaches to concussion management and rehabilitation specific to the youth sport community.

Alternative magnetic flux leakage modalities for pipeline inspection

DOE Office of Scientific and Technical Information (OSTI.GOV)

Katragadda, G.; Lord, W.; Sun, Y.S.

1996-05-01

Increasing quality consciousness is placing higher demands on the accuracy and reliability of inspection systems used in defect detection and characterization. Nondestructive testing techniques often rely on using multi-transducer approaches to obtain greater defect sensitivity. This paper investigates the possibility of taking advantage of alternative modalities associated with the standard magnetic flux leakage tool to obtain additional defect information, while still using a single excitation source.

Sensei: A Multi-Modal Framework for Assessing Stress Resiliency

DTIC Science & Technology

2013-02-01

Modal Framework for Assessing Stress Resiliency (February 1-28, 2013) From: Ajay Divakaran, Technical Leader Jeffrey Lubin, Senior Research...Progress and Accomplishments for Period 14 (February 2013): Task 3.1: Capture Behavioral Stress Markers in Real-Time in Lab Environment with...each data stream for each subject. In addition to these lab accomplishments, we also fine-tuned the timing of the Stroop /PDT presentations to

Multi-modality imaging: Bird's-eye view from the 2014 American Heart Association Scientific Sessions.

PubMed

AlJaroudi, Wael A; Einstein, Andrew J; Chaudhry, Farooq A; Lloyd, Steven G; Hage, Fadi G

2015-04-01

A large number of studies were presented at the 2014 American Heart Association Scientific Sessions. In this review, we will summarize key studies in nuclear cardiology, computed tomography, echocardiography, and cardiac magnetic resonance imaging. This brief review will be helpful for readers of the Journal who are interested in being updated on the latest research covering these imaging modalities.

Detection of relationships among multi-modal brain imaging meta-features via information flow.

PubMed

Miller, Robyn L; Vergara, Victor M; Calhoun, Vince D

2018-01-15

Neuroscientists and clinical researchers are awash in data from an ever-growing number of imaging and other bio-behavioral modalities. This flow of brain imaging data, taken under resting and various task conditions, combines with available cognitive measures, behavioral information, genetic data plus other potentially salient biomedical and environmental information to create a rich but diffuse data landscape. The conditions being studied with brain imaging data are often extremely complex and it is common for researchers to employ more than one imaging, behavioral or biological data modality (e.g., genetics) in their investigations. While the field has advanced significantly in its approach to multimodal data, the vast majority of studies still ignore joint information among two or more features or modalities. We propose an intuitive framework based on conditional probabilities for understanding information exchange between features in what we are calling a feature meta-space; that is, a space consisting of many individual featurae spaces. Features can have any dimension and can be drawn from any data source or modality. No a priori assumptions are made about the functional form (e.g., linear, polynomial, exponential) of captured inter-feature relationships. We demonstrate the framework's ability to identify relationships between disparate features of varying dimensionality by applying it to a large multi-site, multi-modal clinical dataset, balance between schizophrenia patients and controls. In our application it exposes both expected (previously observed) relationships, and novel relationships rarely considered investigated by clinical researchers. To the best of our knowledge there is not presently a comparably efficient way to capture relationships of indeterminate functional form between features of arbitrary dimension and type. We are introducing this method as an initial foray into a space that remains relatively underpopulated. The framework we propose is powerful, intuitive and very efficiently provides a high-level overview of a massive data space. In our application it exposes both expected relationships and relationships very rarely considered worth investigating by clinical researchers. Copyright © 2017 Elsevier B.V. All rights reserved.

An image database management system for conducting CAD research

NASA Astrophysics Data System (ADS)

Gruszauskas, Nicholas; Drukker, Karen; Giger, Maryellen L.

2007-03-01

The development of image databases for CAD research is not a trivial task. The collection and management of images and their related metadata from multiple sources is a time-consuming but necessary process. By standardizing and centralizing the methods in which these data are maintained, one can generate subsets of a larger database that match the specific criteria needed for a particular research project in a quick and efficient manner. A research-oriented management system of this type is highly desirable in a multi-modality CAD research environment. An online, webbased database system for the storage and management of research-specific medical image metadata was designed for use with four modalities of breast imaging: screen-film mammography, full-field digital mammography, breast ultrasound and breast MRI. The system was designed to consolidate data from multiple clinical sources and provide the user with the ability to anonymize the data. Input concerning the type of data to be stored as well as desired searchable parameters was solicited from researchers in each modality. The backbone of the database was created using MySQL. A robust and easy-to-use interface for entering, removing, modifying and searching information in the database was created using HTML and PHP. This standardized system can be accessed using any modern web-browsing software and is fundamental for our various research projects on computer-aided detection, diagnosis, cancer risk assessment, multimodality lesion assessment, and prognosis. Our CAD database system stores large amounts of research-related metadata and successfully generates subsets of cases that match the user's desired search criteria.

3DSEM++: Adaptive and intelligent 3D SEM surface reconstruction.

PubMed

Tafti, Ahmad P; Holz, Jessica D; Baghaie, Ahmadreza; Owen, Heather A; He, Max M; Yu, Zeyun

2016-08-01

Structural analysis of microscopic objects is a longstanding topic in several scientific disciplines, such as biological, mechanical, and materials sciences. The scanning electron microscope (SEM), as a promising imaging equipment has been around for decades to determine the surface properties (e.g., compositions or geometries) of specimens by achieving increased magnification, contrast, and resolution greater than one nanometer. Whereas SEM micrographs still remain two-dimensional (2D), many research and educational questions truly require knowledge and facts about their three-dimensional (3D) structures. 3D surface reconstruction from SEM images leads to remarkable understanding of microscopic surfaces, allowing informative and qualitative visualization of the samples being investigated. In this contribution, we integrate several computational technologies including machine learning, contrario methodology, and epipolar geometry to design and develop a novel and efficient method called 3DSEM++ for multi-view 3D SEM surface reconstruction in an adaptive and intelligent fashion. The experiments which have been performed on real and synthetic data assert the approach is able to reach a significant precision to both SEM extrinsic calibration and its 3D surface modeling. Copyright © 2016 Elsevier Ltd. All rights reserved.

High speed, precision motion strategies for lightweight structures

NASA Technical Reports Server (NTRS)

Book, Wayne J.

1987-01-01

Abstracts of published papers and dissertations generated during the reporting period are compiled. Work on fine motion control was completed. Specifically, real time control of flexible manipulator vibrations were experimentally investigated. A linear model based on the application of Lagrangian dynamics to a rigid body mode and a series of separable flexible modes was examined with respect to model order requirements, and modal candidate selection. State feedback control laws were implemented based upon linear quadratic regulator design. Specification of the closed loop poles in the regulator design process was obtained by inclusion of a prescribed degree of stability in the manipulator model. Work on gross motion planning and control is also summarized. A systematic method to symbolically derive the full nonlinear dynamic equations of motion of multi-link flexible manipulators was developed.

Dynamic characteristics of the blisk with synchronized switch damping based on negative capacitor

NASA Astrophysics Data System (ADS)

Liu, J.; Li, L.; Huang, X.; Jezequel, L.

2017-10-01

In this paper, we propose a method to suppress the vibration of the integral bladed disk ('blisk' for short) in aero-engines using synchronized switch damping based on negative capacitor (SSDNC). Different from the classical piezoelectric shunt damping, SSDNC is a type of nonlinear piezoelectric damping. A multi-harmonic balance method combined with the alternating frequency/time method (MHBM-AFT) is used to predict and further analyze the dynamic characteristics of the electromechanical system, and an arc-length continuation technique is used to improve the convergence of the method. In order to validate the algorithm as well as to recognize the characteristics of the system with SSDNC, a two degree-of-freedom (2-DOF) system with SSDNC is studied at first. The nonlinear complex modal information is calculated and compared with those of the corresponding system with a linear RL shunt circuit. The results indicate that the natural frequencies and modal damping ratio do not change with the modal amplitude, which means that SSDNC has the same modal damping corresponding to different system energy levels. In addition, SSDNC can improve the damping level of all the modes nearly without affecting the natural frequencies of the system. Then, the forced response of the blisk with SSDNC in the frequency domain is calculated and analyzed, including a tuned blisk, which is excited by the traveling wave excitation with a single harmonic and multi-harmonic, and a mistuned blisk, which is excited by traveling wave excitation with a single harmonic and multi-harmonic. We present two advantages of the SSDNC technique when compared with piezoelectric shunt damping. First, SSDNC can suppress the vibration of the blisk under a multi-harmonic wideband the traveling wave, and second, the vibration suppression performance of SSDNC is insensitive to the mistuning of mechanical parameters of the blisk. The results will be of great significance in overcoming the problem of the amplitude magnification induced by the inevitable mistuning of the blisk in aero-engines.

Systems medicine and integrated care to combat chronic noncommunicable diseases

PubMed Central

2011-01-01

We propose an innovative, integrated, cost-effective health system to combat major non-communicable diseases (NCDs), including cardiovascular, chronic respiratory, metabolic, rheumatologic and neurologic disorders and cancers, which together are the predominant health problem of the 21st century. This proposed holistic strategy involves comprehensive patient-centered integrated care and multi-scale, multi-modal and multi-level systems approaches to tackle NCDs as a common group of diseases. Rather than studying each disease individually, it will take into account their intertwined gene-environment, socio-economic interactions and co-morbidities that lead to individual-specific complex phenotypes. It will implement a road map for predictive, preventive, personalized and participatory (P4) medicine based on a robust and extensive knowledge management infrastructure that contains individual patient information. It will be supported by strategic partnerships involving all stakeholders, including general practitioners associated with patient-centered care. This systems medicine strategy, which will take a holistic approach to disease, is designed to allow the results to be used globally, taking into account the needs and specificities of local economies and health systems. PMID:21745417

Finite element methods in a simulation code for offshore wind turbines

NASA Astrophysics Data System (ADS)

Kurz, Wolfgang

1994-06-01

Offshore installation of wind turbines will become important for electricity supply in future. Wind conditions above sea are more favorable than on land and appropriate locations on land are limited and restricted. The dynamic behavior of advanced wind turbines is investigated with digital simulations to reduce time and cost in development and design phase. A wind turbine can be described and simulated as a multi-body system containing rigid and flexible bodies. Simulation of the non-linear motion of such a mechanical system using a multi-body system code is much faster than using a finite element code. However, a modal representation of the deformation field has to be incorporated in the multi-body system approach. The equations of motion of flexible bodies due to deformation are generated by finite element calculations. At Delft University of Technology the simulation code DUWECS has been developed which simulates the non-linear behavior of wind turbines in time domain. The wind turbine is divided in subcomponents which are represented by modules (e.g. rotor, tower etc.).

Cloud-based processing of multi-spectral imaging data

NASA Astrophysics Data System (ADS)

Bernat, Amir S.; Bolton, Frank J.; Weiser, Reuven; Levitz, David

2017-03-01

Multispectral imaging holds great promise as a non-contact tool for the assessment of tissue composition. Performing multi - spectral imaging on a hand held mobile device would allow to bring this technology and with it knowledge to low resource settings to provide a state of the art classification of tissue health. This modality however produces considerably larger data sets than white light imaging and requires preliminary image analysis for it to be used. The data then needs to be analyzed and logged, while not requiring too much of the system resource or a long computation time and battery use by the end point device. Cloud environments were designed to allow offloading of those problems by allowing end point devices (smartphones) to offload computationally hard tasks. For this end we present a method where the a hand held device based around a smartphone captures a multi - spectral dataset in a movie file format (mp4) and compare it to other image format in size, noise and correctness. We present the cloud configuration used for segmenting images to frames where they can later be used for further analysis.