Sample records for multimodal em cirurgia

  1. Profilaxia da trombose venosa profunda em cirurgia bariátrica: estudo comparativo com doses diferentes de heparina de baixo peso molecular

    PubMed Central

    Goslan, Carlos José; Baretta, Giórgio Alfredo Pedroso; de Souza, Hemuara Grasiela Pestana; Orsi, Bruna Zanin; Zanoni, Esdras Camargo A.; Lopes, Marco Antonio Gimenez; Engelhorn, Carlos Alberto

    2018-01-01

    Resumo Contexto A cirurgia bariátrica é considerada a melhor opção para o tratamento da obesidade, cujos pacientes são considerados de alto risco para fenômenos tromboembólicos. Objetivos Comparar o uso de doses diferentes de heparina de baixo peso molecular (HBPM) na profilaxia da trombose venosa profunda (TVP) em pacientes candidatos à cirurgia bariátrica em relação ao risco de TVP, alteração na dosagem do fator anti-Xa e sangramento pré ou pós-operatório. Métodos Estudo comparativo transversal em pacientes submetidos à cirurgia bariátrica distribuídos em dois grupos, que receberam doses de HBPM de 40 mg (grupo controle, GC) e 80 mg (grupo de estudo, GE). Foram avaliados por ultrassonografia vascular e dosagem de KPTT, TAP, plaquetas e fator anti-Xa. Resultados Foram avaliados 60 pacientes, sendo 34 no GC e 26 no GE. Foi observada diferença significativa somente no peso (p = 0,003) e índice de massa corporal (p = 0,018) no GE em relação ao GC. Não houve diferença na dosagem de KPTT, TAP, plaquetas e fator anti-Xa entre os grupos. Não foram detectados TVP ou sangramentos significativos em ambos os grupos. Conclusões Não houve diferença estatisticamente significativa na utilização de doses maiores de HBPM na profilaxia da TVP em pacientes candidatos à cirurgia bariátrica em relação ao risco de TVP, dosagem do fator anti-Xa e sangramento pré ou pós-operatório.

  2. Perfil farmacoterapêutico de pacientes obesos no pós-operatório de cirurgia bariátrica

    PubMed Central

    Kovaleski, Elenara Simoni; Schroeder, Helena; Krause, Mauricio; Dani, Caroline; Bock, Patrícia Martins

    2016-01-01

    Resumo Contexto A obesidade pode estar relacionada a doenças como diabetes, hipertensão arterial e dislipidemia. A cirurgia bariátrica é um dos tratamentos mais eficazes, levando à diminuição de peso e comorbidades. Objetivo Avaliar o perfil metabólico e farmacoterapêutico de pacientes obesos após cirurgia bariátrica. Métodos Trata-se de um estudo observacional transversal retrospectivo, realizado em um hospital localizado na cidade de Porto Alegre, RS, Brasil. Foram avaliados 70 prontuários de pacientes que realizaram cirurgia bariátrica, nos períodos de antes de 2 meses e mais de 6 meses após a cirurgia bariátrica. A análise estatística foi realizada no programa SPSS 17.0®. Resultados A pressão arterial inicial foi de 130/85 mmHg, passando para 120/80 mmHg (p < 0,01). Com relação ao perfil metabólico antes de dois meses, o HDL foi de 34 mg/dL, o colesterol total foi de 195,07 ± 40,17 mg/dL, o LDL foi de 118,22 ± 41,28 mg/dL, os triglicerídeos foram de 141,09 ± 43,39 mg/dL, e a glicemia de jejum foi de 90 mg/dL. Após 6 meses de cirurgia, os valores passaram para 43 mg/dL, 133,67 ± 28,14 mg/dL, 65,53 ± 24,3 mg/dL, 104,41 ± 29,6 mg/dL, e 77 mg/dL, respectivamente (p < 0,01). Com relação ao uso de medicamentos, 41% utilizaram anti-hipertensivos, 39% utilizaram hipolipemiantes, 10% utilizaram hipoglicemiantes orais e 97% utilizaram suplementos antes dos 2 meses de cirurgia. Após os 6 meses, os percentuais foram alterados para 21%, 19%, 9% e 99%, respectivamente. Conclusões O estudo mostra o sucesso da cirurgia bariátrica em pacientes obesos com comorbidades, revelando melhora no perfil metabólico e redução na utilização de medicamentos para tratamento de comorbidades. PMID:29930588

  3. Multimodality Prediction of Chaotic Time Series with Sparse Hard-Cut EM Learning of the Gaussian Process Mixture Model

    NASA Astrophysics Data System (ADS)

    Zhou, Ya-Tong; Fan, Yu; Chen, Zi-Yi; Sun, Jian-Cheng

    2017-05-01

    The contribution of this work is twofold: (1) a multimodality prediction method of chaotic time series with the Gaussian process mixture (GPM) model is proposed, which employs a divide and conquer strategy. It automatically divides the chaotic time series into multiple modalities with different extrinsic patterns and intrinsic characteristics, and thus can more precisely fit the chaotic time series. (2) An effective sparse hard-cut expectation maximization (SHC-EM) learning algorithm for the GPM model is proposed to improve the prediction performance. SHC-EM replaces a large learning sample set with fewer pseudo inputs, accelerating model learning based on these pseudo inputs. Experiments on Lorenz and Chua time series demonstrate that the proposed method yields not only accurate multimodality prediction, but also the prediction confidence interval. SHC-EM outperforms the traditional variational learning in terms of both prediction accuracy and speed. In addition, SHC-EM is more robust and insusceptible to noise than variational learning. Supported by the National Natural Science Foundation of China under Grant No 60972106, the China Postdoctoral Science Foundation under Grant No 2014M561053, the Humanity and Social Science Foundation of Ministry of Education of China under Grant No 15YJA630108, and the Hebei Province Natural Science Foundation under Grant No E2016202341.

  4. Alternative Fuels Data Center: Multi-Modal Transportation

    Science.gov Websites

    <em>examples> of resources to help travelers use multi-modal transportation. OpenTripPlanner Map - an online transportation modes including transit (bus or train), walking, and bicycling 511 - a <em>one>-stop source from the of alternative transportation modes. A 2010 evaluation by the Oregon Transportation <em>Research> and

  5. Comparação entre cirurgia aberta e endovascular no tratamento do aneurisma da artéria poplítea: uma revisão

    PubMed Central

    Gonçalves, Ana Fernanda Fagundes; Pelek, Carlos Augusto; Nogueira, Lorena Slusarz; de Carvalho, Renan Francisco; Stumpf, Matheo Augusto Morandi; Gomes, Ricardo Zanetti; Kluthcovsky, Ana Claudia Garabeli Cavalli

    2018-01-01

    Resumo Os aneurismas de artéria poplítea correspondem a 70% dos aneurismas periféricos e o tratamento é cirúrgico, com controvérsias sobre os resultados da via endovascular. Este estudo objetivou realizar uma revisão da literatura sobre a comparação entre cirurgia aberta e endovascular no tratamento dos aneurismas da artéria poplítea. A pesquisa foi realizada utilizando os termos apropriados nos portais de periódicos LILACS e MEDLINE, com a seleção de 15 artigos. Um total de 5.166 procedimentos cirúrgicos foram comparados, sendo 3.930 cirurgias abertas e 1.236 cirurgias endovasculares. A cirurgia aberta com bypass venoso continua sendo o padrão-ouro. A cirurgia endovascular apresenta menor tempo de internação e é uma opção viável em pacientes eletivos, com baixa expectativa de vida, alto risco cirúrgico, comorbidades e mais idosos, desde que tenham anatomia favorável para o procedimento. Contudo, são necessários estudos de longo prazo para estabelecer os reais benefícios e indicações das duas técnicas, como o ensaio clínico randomizado controlado.

  6. Basic Research Investigations into Multimode Laser and EM Launchers for Affordable, Rapid Access to Space (Volumes 1 and 2)

    DTIC Science & Technology

    2010-08-31

    The physics and operating principles for TEA C02 lasers can be found in several useful references (Patel, 1968; Siegman , 1986; Svelto, 1998 and...AND SUBTITLE 5a. CONTRACT NUMBER F A9550-05-1-0392 "Basic Research Investigations into Multimode Laser and 5b. GRANT NUMBER EM Launchers for...pulsed airbreathing/rocket laser propulsion. investigates the physics of laser energy deposition into stationary and hypersonic working fluids

  7. Robust Multimodal Dictionary Learning

    PubMed Central

    Cao, Tian; Jojic, Vladimir; Modla, Shannon; Powell, Debbie; Czymmek, Kirk; Niethammer, Marc

    2014-01-01

    We propose a robust multimodal dictionary learning method for multimodal images. Joint dictionary learning for both modalities may be impaired by lack of correspondence between image modalities in training data, for example due to areas of low quality in one of the modalities. Dictionaries learned with such non-corresponding data will induce uncertainty about image representation. In this paper, we propose a probabilistic model that accounts for image areas that are poorly corresponding between the image modalities. We cast the problem of learning a dictionary in presence of problematic image patches as a likelihood maximization problem and solve it with a variant of the EM algorithm. Our algorithm iterates identification of poorly corresponding patches and re-finements of the dictionary. We tested our method on synthetic and real data. We show improvements in image prediction quality and alignment accuracy when using the method for multimodal image registration. PMID:24505674

  8. Multimodal Speaker Diarization.

    PubMed

    Noulas, A; Englebienne, G; Krose, B J A

    2012-01-01

    We present a novel probabilistic framework that fuses information coming from the audio and video modality to perform speaker diarization. The proposed framework is a Dynamic Bayesian Network (DBN) that is an extension of a factorial Hidden Markov Model (fHMM) and models the people appearing in an audiovisual recording as multimodal entities that generate observations in the audio stream, the video stream, and the joint audiovisual space. The framework is very robust to different contexts, makes no assumptions about the location of the recording equipment, and does not require labeled training data as it acquires the model parameters using the Expectation Maximization (EM) algorithm. We apply the proposed model to two meeting videos and a news broadcast video, all of which come from publicly available data sets. The results acquired in speaker diarization are in favor of the proposed multimodal framework, which outperforms the single modality analysis results and improves over the state-of-the-art audio-based speaker diarization.

  9. Multimodal Event Detection in Twitter Hashtag Networks

    DOE PAGES

    Yilmaz, Yasin; Hero, Alfred O.

    2016-07-01

    In this study, event detection in a multimodal Twitter dataset is considered. We treat the hashtags in the dataset as instances with two modes: text and geolocation features. The text feature consists of a bag-of-words representation. The geolocation feature consists of geotags (i.e., geographical coordinates) of the tweets. Fusing the multimodal data we aim to detect, in terms of topic and geolocation, the interesting events and the associated hashtags. To this end, a generative latent variable model is assumed, and a generalized expectation-maximization (EM) algorithm is derived to learn the model parameters. The proposed method is computationally efficient, and lendsmore » itself to big datasets. Lastly, experimental results on a Twitter dataset from August 2014 show the efficacy of the proposed method.« less

  10. The Intersection of Multimodality and Critical Perspective: Multimodality as Subversion

    ERIC Educational Resources Information Center

    Huang, Shin-ying

    2015-01-01

    This study explores the relevance of multimodality to critical media literacy. It is based on the understanding that communication is intrinsically multimodal and multimodal communication is inherently social and ideological. By analysing two English-language learners' multimodal ensembles, the study reports on how multimodality contributes to a…

  11. Multimodal Interfaces: Literature Review of Ecological Interface Design, Multimodal Perception and Attention, and Intelligent Adaptive Multimodal Interfaces

    DTIC Science & Technology

    2010-05-01

    Multimodal Interfaces Literature Review of Ecological Interface Design , Multimodal Perception and Attention, and Intelligent... Design , Multimodal Perception and Attention, and Intelligent Adaptive Multimodal Interfaces Wayne Giang, Sathya Santhakumaran, Ehsan Masnavi, Doug...Advanced Interface Design Laboratory, E2-1303N 200 University Avenue West Waterloo, Ontario Canada N2L 3G1 Contract Project Manager: Dr. Catherine

  12. A multimodal parallel architecture: A cognitive framework for multimodal interactions.

    PubMed

    Cohn, Neil

    2016-01-01

    Human communication is naturally multimodal, and substantial focus has examined the semantic correspondences in speech-gesture and text-image relationships. However, visual narratives, like those in comics, provide an interesting challenge to multimodal communication because the words and/or images can guide the overall meaning, and both modalities can appear in complicated "grammatical" sequences: sentences use a syntactic structure and sequential images use a narrative structure. These dual structures create complexity beyond those typically addressed by theories of multimodality where only a single form uses combinatorial structure, and also poses challenges for models of the linguistic system that focus on single modalities. This paper outlines a broad theoretical framework for multimodal interactions by expanding on Jackendoff's (2002) parallel architecture for language. Multimodal interactions are characterized in terms of their component cognitive structures: whether a particular modality (verbal, bodily, visual) is present, whether it uses a grammatical structure (syntax, narrative), and whether it "dominates" the semantics of the overall expression. Altogether, this approach integrates multimodal interactions into an existing framework of language and cognition, and characterizes interactions between varying complexity in the verbal, bodily, and graphic domains. The resulting theoretical model presents an expanded consideration of the boundaries of the "linguistic" system and its involvement in multimodal interactions, with a framework that can benefit research on corpus analyses, experimentation, and the educational benefits of multimodality. Copyright © 2015.

  13. Learning multimodal dictionaries.

    PubMed

    Monaci, Gianluca; Jost, Philippe; Vandergheynst, Pierre; Mailhé, Boris; Lesage, Sylvain; Gribonval, Rémi

    2007-09-01

    Real-world phenomena involve complex interactions between multiple signal modalities. As a consequence, humans are used to integrate at each instant perceptions from all their senses in order to enrich their understanding of the surrounding world. This paradigm can be also extremely useful in many signal processing and computer vision problems involving mutually related signals. The simultaneous processing of multimodal data can, in fact, reveal information that is otherwise hidden when considering the signals independently. However, in natural multimodal signals, the statistical dependencies between modalities are in general not obvious. Learning fundamental multimodal patterns could offer deep insight into the structure of such signals. In this paper, we present a novel model of multimodal signals based on their sparse decomposition over a dictionary of multimodal structures. An algorithm for iteratively learning multimodal generating functions that can be shifted at all positions in the signal is proposed, as well. The learning is defined in such a way that it can be accomplished by iteratively solving a generalized eigenvector problem, which makes the algorithm fast, flexible, and free of user-defined parameters. The proposed algorithm is applied to audiovisual sequences and it is able to discover underlying structures in the data. The detection of such audio-video patterns in audiovisual clips allows to effectively localize the sound source on the video in presence of substantial acoustic and visual distractors, outperforming state-of-the-art audiovisual localization algorithms.

  14. Multi-Modalities Sensor Science

    DTIC Science & Technology

    2015-02-28

    enhanced multi-mode sensor science. bio -sensing, cross-discipling, multi-physics, nano-technology sailing He +46-8790 8465 1 Final Report for SOARD Project...spectroscopy, nano-technology, biophotonics and multi-physics modeling to produce adaptable bio -nanostructure enhanced multi-mode sensor science. 1...adaptable bio -nanostructure enhanced multi-mode sensor science. The accomplishments includes 1) A General Method for Designing a Radome to Enhance

  15. Multimode Directional Coupler

    NASA Technical Reports Server (NTRS)

    Simons, Rainee N. (Inventor); Wintucky, Edwin G. (Inventor)

    2016-01-01

    A multimode directional coupler is provided. In some embodiments, the multimode directional coupler is configured to receive a primary signal and a secondary signal at a first port of a primary waveguide. The primary signal is configured to propagate through the primary waveguide and be outputted at a second port of the primary waveguide. The multimode directional coupler also includes a secondary waveguide configured to couple the secondary signal from the primary waveguide with no coupling of the primary signal into the secondary waveguide. The secondary signal is configured to propagate through the secondary waveguide and be outputted from a port of the secondary waveguide.

  16. Multimodal Learning Clubs

    ERIC Educational Resources Information Center

    Casey, Heather

    2012-01-01

    Multimodal learning clubs link principles of motivation and engagement with 21st century technological tools and texts to support content area learning. The author describes how a sixth grade health teacher and his class incorporated multimodal learning clubs into a unit of study on human body systems. The students worked collaboratively online…

  17. Radiolabeled Nanoparticles for Multimodality Tumor Imaging

    PubMed Central

    Xing, Yan; Zhao, Jinhua; Conti, Peter S.; Chen, Kai

    2014-01-01

    Each imaging modality has its own unique strengths. Multimodality imaging, taking advantages of strengths from two or more imaging modalities, can provide overall structural, functional, and molecular information, offering the prospect of improved diagnostic and therapeutic monitoring abilities. The devices of molecular imaging with multimodality and multifunction are of great value for cancer diagnosis and treatment, and greatly accelerate the development of radionuclide-based multimodal molecular imaging. Radiolabeled nanoparticles bearing intrinsic properties have gained great interest in multimodality tumor imaging over the past decade. Significant breakthrough has been made toward the development of various radiolabeled nanoparticles, which can be used as novel cancer diagnostic tools in multimodality imaging systems. It is expected that quantitative multimodality imaging with multifunctional radiolabeled nanoparticles will afford accurate and precise assessment of biological signatures in cancer in a real-time manner and thus, pave the path towards personalized cancer medicine. This review addresses advantages and challenges in developing multimodality imaging probes by using different types of nanoparticles, and summarizes the recent advances in the applications of radiolabeled nanoparticles for multimodal imaging of tumor. The key issues involved in the translation of radiolabeled nanoparticles to the clinic are also discussed. PMID:24505237

  18. Construction of Multimodal Transport Information Platform

    NASA Astrophysics Data System (ADS)

    Wang, Ya; Cheng, Yu; Zhao, Zhi

    2018-06-01

    With the rapid development of economy, the volume of transportation in China is increasing, the opening process of the market is accelerating, the scale of enterprises is expanding, the service quality is being improved, and the container multimodal transport is developing continuously.The hardware infrastructure of container multimodal transport is improved obviously, but the network platform construction of multimodal transport is still insufficient.Taking Shandong region of China as an example, the present situation of container multimodal transport in Shandong area can no longer meet the requirement of rapid development of container, and the construction of network platform needs to be solved urgently. Therefore, this paper will briefly describe the conception of construction of multimodal transport network platform in Shandong area.In order to achieve the rapid development of multimodal transport.

  19. Tinnitus Multimodal Imaging

    DTIC Science & Technology

    2014-10-01

    1 AWARD NUMBER: W81XWH-13-1-0494 TITLE: Tinnitus Multimodal Imaging PRINCIPAL INVESTIGATOR...TYPE Annual 3. DATES COVERED 30 Sept 2013 – 29 Oct 2014 4. TITLE AND SUBTITLE 5a. CONTRACT NUMBER Tinnitus Multimodal Imaging...AVAILABILITY STATEMENT Approved for Public Release; Distribution Unlimited 13. SUPPLEMENTARY NOTES 14. ABSTRACT Tinnitus is a common auditory

  20. Skill training in multimodal virtual environments.

    PubMed

    Gopher, Daniel

    2012-01-01

    Multimodal, immersive, virtual reality (VR) techniques open new perspectives for perceptual-motor skill trainers. They also introduce new risks and dangers. This paper describes the benefits and pitfalls of multimodal training and the cognitive building blocks of a multimodal, VR training simulators.

  1. Practical multimodal care for cancer cachexia.

    PubMed

    Maddocks, Matthew; Hopkinson, Jane; Conibear, John; Reeves, Annie; Shaw, Clare; Fearon, Ken C H

    2016-12-01

    Cancer cachexia is common and reduces function, treatment tolerability and quality of life. Given its multifaceted pathophysiology a multimodal approach to cachexia management is advocated for, but can be difficult to realise in practice. We use a case-based approach to highlight practical approaches to the multimodal management of cachexia for patients across the cancer trajectory. Four cases with lung cancer spanning surgical resection, radical chemoradiotherapy, palliative chemotherapy and no anticancer treatment are presented. We propose multimodal care approaches that incorporate nutritional support, exercise, and anti-inflammatory agents, on a background of personalized oncology care and family-centred education. Collectively, the cases reveal that multimodal care is part of everyone's remit, often focuses on supported self-management, and demands buy-in from the patient and their family. Once operationalized, multimodal care approaches can be tested pragmatically, including alongside emerging pharmacological cachexia treatments. We demonstrate that multimodal care for cancer cachexia can be achieved using simple treatments and without a dedicated team of specialists. The sharing of advice between health professionals can help build collective confidence and expertise, moving towards a position in which every team member feels they can contribute towards multimodal care.

  2. Multimodal Career Education for Nursing Students.

    ERIC Educational Resources Information Center

    Southern, Stephen; Smith, Robert L.

    A multimodal career education model entitled BEST IDEA was field tested as an approach to the problem of retaining skilled nurses in the work force. Using multimodal assessment and intervention strategies derived from the multimodal behavior therapy of Arnold Lazarus, researchers developed an individualized career development assessment and…

  3. Locating the Semiotic Power of Multimodality

    ERIC Educational Resources Information Center

    Hull, Glynda A.; Nelson, Mark Evan

    2005-01-01

    This article reports research that attempts to characterize what is powerful about digital multimodal texts. Building from recent theoretical work on understanding the workings and implications of multimodal communication, the authors call for a continuing empirical investigation into the roles that digital multimodal texts play in real-world…

  4. Tinnitus Multimodal Imaging

    DTIC Science & Technology

    2015-10-01

    AWARD NUMBER: W81XWH-13-1-0494 TITLE: Tinnitus Multimodal Imaging PRINCIPAL INVESTIGATOR: Steven Wan Cheung CONTRACTING ORGANIZATION...NUMBER W81XWH-13-1-0494 Tinnitus Multimodal Imaging 5b. GRANT NUMBER 5c. PROGRAM ELEMENT NUMBER 6. AUTHOR(S) 5d. PROJECT NUMBER Steven W. Cheung...13. SUPPLEMENTARY NOTES 14. ABSTRACT Tinnitus is a common auditory perceptual disorder whose neural substrates are under intense debate. This project

  5. Multi-mode horn antenna simulation

    NASA Technical Reports Server (NTRS)

    Dod, L. R.; Wolf, J. D.

    1980-01-01

    Radiation patterns were computed for a circular multimode horn antenna using waveguide electric field radiation expressions. The circular multimode horn was considered as a possible reflector feed antenna for the Large Antenna Multifrequency Microwave Radiometer (LAMMR). This horn antenna uses a summation of the TE sub 11 deg and TM sub 11 deg modes to generate far field primary radiation patterns with equal E and H plane beamwidths and low sidelobes. A computer program for the radiation field expressions using the summation of waveguide radiation modes is described. The sensitivity of the multimode horn antenna radiation patterns to phase variations between the two modes is given. Sample radiation pattern calculations for a reflector feed horn for LAMMR are shown. The multimode horn antenna provides a low noise feed suitable for radiometric applications.

  6. Multi-Modality Phantom Development

    DOE Office of Scientific and Technical Information (OSTI.GOV)

    Huber, Jennifer S.; Peng, Qiyu; Moses, William W.

    2009-03-20

    Multi-modality imaging has an increasing role in the diagnosis and treatment of a large number of diseases, particularly if both functional and anatomical information are acquired and accurately co-registered. Hence, there is a resulting need for multi modality phantoms in order to validate image co-registration and calibrate the imaging systems. We present our PET-ultrasound phantom development, including PET and ultrasound images of a simple prostate phantom. We use agar and gelatin mixed with a radioactive solution. We also present our development of custom multi-modality phantoms that are compatible with PET, transrectal ultrasound (TRUS), MRI and CT imaging. We describe bothmore » our selection of tissue mimicking materials and phantom construction procedures. These custom PET-TRUS-CT-MRI prostate phantoms use agargelatin radioactive mixtures with additional contrast agents and preservatives. We show multi-modality images of these custom prostate phantoms, as well as discuss phantom construction alternatives. Although we are currently focused on prostate imaging, this phantom development is applicable to many multi-modality imaging applications.« less

  7. Multimodal sequence learning.

    PubMed

    Kemény, Ferenc; Meier, Beat

    2016-02-01

    While sequence learning research models complex phenomena, previous studies have mostly focused on unimodal sequences. The goal of the current experiment is to put implicit sequence learning into a multimodal context: to test whether it can operate across different modalities. We used the Task Sequence Learning paradigm to test whether sequence learning varies across modalities, and whether participants are able to learn multimodal sequences. Our results show that implicit sequence learning is very similar regardless of the source modality. However, the presence of correlated task and response sequences was required for learning to take place. The experiment provides new evidence for implicit sequence learning of abstract conceptual representations. In general, the results suggest that correlated sequences are necessary for implicit sequence learning to occur. Moreover, they show that elements from different modalities can be automatically integrated into one unitary multimodal sequence. Copyright © 2015 Elsevier B.V. All rights reserved.

  8. Multimodal Discourse Analysis of the Movie "Argo"

    ERIC Educational Resources Information Center

    Bo, Xu

    2018-01-01

    Based on multimodal discourse theory, this paper makes a multimodal discourse analysis of some shots in the movie "Argo" from the perspective of context of culture, context of situation and meaning of image. Results show that this movie constructs multimodal discourse through particular context, language and image, and successfully…

  9. Designing Multimodal Texts about the Middle Ages

    ERIC Educational Resources Information Center

    Insulander, Eva; Lindstrand, Fredrik; Selander, Staffan

    2017-01-01

    Multimedial and multimodal communication arouse interest in many fields of research today. By contrast, little attention is paid to multimodality in relation to designs for learning, especially in relation to representations of knowledge on an aggregated level. By analyzing three multimodal texts about the Middle Ages, including a textbook, a film…

  10. Multimode fiber devices with single-mode performance

    NASA Astrophysics Data System (ADS)

    Leon-Saval, S. G.; Birks, T. A.; Bland-Hawthorn, J.; Englund, M.

    2005-10-01

    A taper transition can couple light between a multimode fiber and several single-mode fibers. If the number of single-mode fibers matches the number of spatial modes in the multimode fiber, the transition can have low loss in both directions. This enables the high performance of single-mode fiber devices to be attained in multimode fibers. We report an experimental proof of concept by using photonic crystal fiber techniques to make the transitions, demonstrating a multimode fiber filter with the transmission spectrum of a single-mode fiber grating.

  11. Multimodal Diffuse Optical Imaging

    NASA Astrophysics Data System (ADS)

    Intes, Xavier; Venugopal, Vivek; Chen, Jin; Azar, Fred S.

    Diffuse optical imaging, particularly diffuse optical tomography (DOT), is an emerging clinical modality capable of providing unique functional information, at a relatively low cost, and with nonionizing radiation. Multimodal diffuse optical imaging has enabled a synergistic combination of functional and anatomical information: the quality of DOT reconstructions has been significantly improved by incorporating the structural information derived by the combined anatomical modality. In this chapter, we will review the basic principles of diffuse optical imaging, including instrumentation and reconstruction algorithm design. We will also discuss the approaches for multimodal imaging strategies that integrate DOI with clinically established modalities. The merit of the multimodal imaging approaches is demonstrated in the context of optical mammography, but the techniques described herein can be translated to other clinical scenarios such as brain functional imaging or muscle functional imaging.

  12. Microscopy with multimode fibers

    NASA Astrophysics Data System (ADS)

    Moser, Christophe; Papadopoulos, Ioannis; Farahi, Salma; Psaltis, Demetri

    2013-04-01

    Microscopes are usually thought of comprising imaging elements such as objectives and eye-piece lenses. A different type of microscope, used for endoscopy, consists of waveguiding elements such as fiber bundles, where each fiber in the bundle transports the light corresponding to one pixel in the image. Recently a new type of microscope has emerged that exploits the large number of propagating modes in a single multimode fiber. We have successfully produced fluorescence images of neural cells with sub-micrometer resolution via a 200 micrometer core multimode fiber. The method for achieving imaging consists of using digital phase conjugation to reproduce a focal spot at the tip of the multimode fiber. The image is formed by scanning the focal spot digitally and collecting the fluorescence point by point.

  13. Multimodal imaging of ischemic wounds

    NASA Astrophysics Data System (ADS)

    Zhang, Shiwu; Gnyawali, Surya; Huang, Jiwei; Liu, Peng; Gordillo, Gayle; Sen, Chandan K.; Xu, Ronald

    2012-12-01

    The wound healing process involves the reparative phases of inflammation, proliferation, and remodeling. Interrupting any of these phases may result in chronically unhealed wounds, amputation, or even patient death. Quantitative assessment of wound tissue ischemia, perfusion, and inflammation provides critical information for appropriate detection, staging, and treatment of chronic wounds. However, no method is available for noninvasive, simultaneous, and quantitative imaging of these tissue parameters. We integrated hyperspectral, laser speckle, and thermographic imaging modalities into a single setup for multimodal assessment of tissue oxygenation, perfusion, and inflammation characteristics. Advanced algorithms were developed for accurate reconstruction of wound oxygenation and appropriate co-registration between different imaging modalities. The multimodal wound imaging system was validated by an ongoing clinical trials approved by OSU IRB. In the clinical trial, a wound of 3mm in diameter was introduced on a healthy subject's lower extremity and the healing process was serially monitored by the multimodal imaging setup. Our experiments demonstrated the clinical usability of multimodal wound imaging.

  14. Multimodal Hip Hop Productions as Media Literacies

    ERIC Educational Resources Information Center

    Turner, K. C. Nat

    2012-01-01

    This study draws on ethnographic data from a year-long multimodal media production (MMP) course and the experience of an African American female adolescent who used the production of multimodal Hip Hop texts to express her creativity and growing socially conscious view of the world. The study demonstrates how students made meaning multimodally and…

  15. Mothers' multimodal information processing is modulated by multimodal interactions with their infants.

    PubMed

    Tanaka, Yukari; Fukushima, Hirokata; Okanoya, Kazuo; Myowa-Yamakoshi, Masako

    2014-10-17

    Social learning in infancy is known to be facilitated by multimodal (e.g., visual, tactile, and verbal) cues provided by caregivers. In parallel with infants' development, recent research has revealed that maternal neural activity is altered through interaction with infants, for instance, to be sensitive to infant-directed speech (IDS). The present study investigated the effect of mother- infant multimodal interaction on maternal neural activity. Event-related potentials (ERPs) of mothers were compared to non-mothers during perception of tactile-related words primed by tactile cues. Only mothers showed ERP modulation when tactile cues were incongruent with the subsequent words, and only when the words were delivered with IDS prosody. Furthermore, the frequency of mothers' use of those words was correlated with the magnitude of ERP differentiation between congruent and incongruent stimuli presentations. These results suggest that mother-infant daily interactions enhance multimodal integration of the maternal brain in parenting contexts.

  16. Mothers' multimodal information processing is modulated by multimodal interactions with their infants

    PubMed Central

    Tanaka, Yukari; Fukushima, Hirokata; Okanoya, Kazuo; Myowa-Yamakoshi, Masako

    2014-01-01

    Social learning in infancy is known to be facilitated by multimodal (e.g., visual, tactile, and verbal) cues provided by caregivers. In parallel with infants' development, recent research has revealed that maternal neural activity is altered through interaction with infants, for instance, to be sensitive to infant-directed speech (IDS). The present study investigated the effect of mother- infant multimodal interaction on maternal neural activity. Event-related potentials (ERPs) of mothers were compared to non-mothers during perception of tactile-related words primed by tactile cues. Only mothers showed ERP modulation when tactile cues were incongruent with the subsequent words, and only when the words were delivered with IDS prosody. Furthermore, the frequency of mothers' use of those words was correlated with the magnitude of ERP differentiation between congruent and incongruent stimuli presentations. These results suggest that mother-infant daily interactions enhance multimodal integration of the maternal brain in parenting contexts. PMID:25322936

  17. "Filming in Progress": New Spaces for Multimodal Designing

    ERIC Educational Resources Information Center

    Mills, Kathy A.

    2010-01-01

    Global trends call for new research to investigate multimodal designing mediated by new technologies and the implications for classroom spaces. This article addresses the relationship between new technologies, students' multimodal designing, and the social production of classroom spaces. Multimodal semiotics and sociological principles are applied…

  18. Multimode-singlemode-multimode fiber sensor for alcohol sensing application

    NASA Astrophysics Data System (ADS)

    Rofi'ah, Iftihatur; Hatta, A. M.; Sekartedjo, Sekartedjo

    2016-11-01

    Alcohol is volatile and flammable liquid which is soluble substances both on polar and non polar substances that has been used in some industrial sectors. Alcohol detection method now widely used one of them is the optical fiber sensor. In this paper used fiber optic sensor based on Multimode-Single-mode-Multimode (MSM) to detect alcohol solution at a concentration range of 0-3%. The working principle of sensor utilizes the modal interference between the core modes and the cladding modes, thus make the sensor sensitive to environmental changes. The result showed that characteristic of the sensor not affect the length of the single-mode fiber (SMF). We obtain that the sensor with a length of 5 mm of single-mode can sensing the alcohol with a sensitivity of 0.107 dB/v%.

  19. Programmable multimode quantum networks

    PubMed Central

    Armstrong, Seiji; Morizur, Jean-François; Janousek, Jiri; Hage, Boris; Treps, Nicolas; Lam, Ping Koy; Bachor, Hans-A.

    2012-01-01

    Entanglement between large numbers of quantum modes is the quintessential resource for future technologies such as the quantum internet. Conventionally, the generation of multimode entanglement in optics requires complex layouts of beamsplitters and phase shifters in order to transform the input modes into entangled modes. Here we report the highly versatile and efficient generation of various multimode entangled states with the ability to switch between different linear optics networks in real time. By defining our modes to be combinations of different spatial regions of one beam, we may use just one pair of multi-pixel detectors in order to measure multiple entangled modes. We programme virtual networks that are fully equivalent to the physical linear optics networks they are emulating. We present results for N=2 up to N=8 entangled modes here, including N=2, 3, 4 cluster states. Our approach introduces the highly sought after attributes of flexibility and scalability to multimode entanglement. PMID:22929783

  20. Nanoparticles in Higher-Order Multimodal Imaging

    NASA Astrophysics Data System (ADS)

    Rieffel, James Ki

    Imaging procedures are a cornerstone in our current medical infrastructure. In everything from screening, diagnostics, and treatment, medical imaging is perhaps our greatest tool in evaluating individual health. Recently, there has been tremendous increase in the development of multimodal systems that combine the strengths of complimentary imaging technologies to overcome their independent weaknesses. Clinically, this has manifested in the virtually universal manufacture of combined PET-CT scanners. With this push toward more integrated imaging, new contrast agents with multimodal functionality are needed. Nanoparticle-based systems are ideal candidates based on their unique size, properties, and diversity. In chapter 1, an extensive background on recent multimodal imaging agents capable of enhancing signal or contrast in three or more modalities is presented. Chapter 2 discusses the development and characterization of a nanoparticulate probe with hexamodal imaging functionality. It is my hope that the information contained in this thesis will demonstrate the many benefits of nanoparticles in multimodal imaging, and provide insight into the potential of fully integrated imaging.

  1. Visual tracking for multi-modality computer-assisted image guidance

    NASA Astrophysics Data System (ADS)

    Basafa, Ehsan; Foroughi, Pezhman; Hossbach, Martin; Bhanushali, Jasmine; Stolka, Philipp

    2017-03-01

    With optical cameras, many interventional navigation tasks previously relying on EM, optical, or mechanical guidance can be performed robustly, quickly, and conveniently. We developed a family of novel guidance systems based on wide-spectrum cameras and vision algorithms for real-time tracking of interventional instruments and multi-modality markers. These navigation systems support the localization of anatomical targets, support placement of imaging probe and instruments, and provide fusion imaging. The unique architecture - low-cost, miniature, in-hand stereo vision cameras fitted directly to imaging probes - allows for an intuitive workflow that fits a wide variety of specialties such as anesthesiology, interventional radiology, interventional oncology, emergency medicine, urology, and others, many of which see increasing pressure to utilize medical imaging and especially ultrasound, but have yet to develop the requisite skills for reliable success. We developed a modular system, consisting of hardware (the Optical Head containing the mini cameras) and software (components for visual instrument tracking with or without specialized visual features, fully automated marker segmentation from a variety of 3D imaging modalities, visual observation of meshes of widely separated markers, instant automatic registration, and target tracking and guidance on real-time multi-modality fusion views). From these components, we implemented a family of distinct clinical and pre-clinical systems (for combinations of ultrasound, CT, CBCT, and MRI), most of which have international regulatory clearance for clinical use. We present technical and clinical results on phantoms, ex- and in-vivo animals, and patients.

  2. Towards an intelligent framework for multimodal affective data analysis.

    PubMed

    Poria, Soujanya; Cambria, Erik; Hussain, Amir; Huang, Guang-Bin

    2015-03-01

    An increasingly large amount of multimodal content is posted on social media websites such as YouTube and Facebook everyday. In order to cope with the growth of such so much multimodal data, there is an urgent need to develop an intelligent multi-modal analysis framework that can effectively extract information from multiple modalities. In this paper, we propose a novel multimodal information extraction agent, which infers and aggregates the semantic and affective information associated with user-generated multimodal data in contexts such as e-learning, e-health, automatic video content tagging and human-computer interaction. In particular, the developed intelligent agent adopts an ensemble feature extraction approach by exploiting the joint use of tri-modal (text, audio and video) features to enhance the multimodal information extraction process. In preliminary experiments using the eNTERFACE dataset, our proposed multi-modal system is shown to achieve an accuracy of 87.95%, outperforming the best state-of-the-art system by more than 10%, or in relative terms, a 56% reduction in error rate. Copyright © 2014 Elsevier Ltd. All rights reserved.

  3. Multimodal integration of anatomy and physiology classes: How instructors utilize multimodal teaching in their classrooms

    NASA Astrophysics Data System (ADS)

    McGraw, Gerald M., Jr.

    Multimodality is the theory of communication as it applies to social and educational semiotics (making meaning through the use of multiple signs and symbols). The term multimodality describes a communication methodology that includes multiple textual, aural, and visual applications (modes) that are woven together to create what is referred to as an artifact. Multimodal teaching methodology attempts to create a deeper meaning to course content by activating the higher cognitive areas of the student's brain, creating a more sustained retention of the information (Murray, 2009). The introduction of multimodality educational methodologies as a means to more optimally engage students has been documented within educational literature. However, studies analyzing the distribution and penetration into basic sciences, more specifically anatomy and physiology, have not been forthcoming. This study used a quantitative survey design to determine the degree to which instructors integrated multimodality teaching practices into their course curricula. The instrument used for the study was designed by the researcher based on evidence found in the literature and sent to members of three associations/societies for anatomy and physiology instructors: the Human Anatomy and Physiology Society; the iTeach Anatomy & Physiology Collaborate; and the American Physiology Society. Respondents totaled 182 instructor members of two- and four-year, private and public higher learning colleges collected from the three organizations collectively with over 13,500 members in over 925 higher learning institutions nationwide. The study concluded that the expansion of multimodal methodologies into anatomy and physiology classrooms is at the beginning of the process and that there is ample opportunity for expansion. Instructors continue to use lecture as their primary means of interaction with students. Email is still the major form of out-of-class communication for full-time instructors. Instructors with

  4. Survey of statewide multimodal transportation planning practices.

    DOT National Transportation Integrated Search

    2002-01-01

    Multimodal planning refers to planning for different modes of transportation (e.g., automobile, bus, bicycles, pedestrian, aviation, rail, waterways) and the connections among them. This study identified states thought to excel in multimodal planning...

  5. Prevalência de tromboembolismo pulmonar incidental em pacientes oncológicos: análise retrospectiva em grande centro

    PubMed Central

    Carneiro, Renata Mota; van Bellen, Bonno; Santana, Pablo Rydz Pinheiro; Gomes, Antônio Carlos Portugal

    2017-01-01

    Resumo Contexto Devido à maior aplicação de exames de imagem rotineiros, especialmente nos pacientes com neoplasia para controle da doença, vem aumentando o diagnóstico de tromboembolismo pulmonar (TEP) incidental, importante fator de morbimortalidade associado. Objetivo Identificar os casos de TEP incidental em pacientes oncológicos submetidos a tomografia computadorizada (TC) de tórax, correlacionando aspectos clínicos e fatores de risco associados. Métodos Estudo retrospectivo de todos os episódios de TEP ocorridos de janeiro de 2013 a junho de 2016, com seleção dos pacientes oncológicos e divisão deles em dois grupos: com suspeita clínica e sem suspeita clínica (incidentais) de embolia pulmonar. Resultados Foram avaliados 468 pacientes com TEP no período citado. Destes, 23,1% eram oncológicos, entre os quais 44,4% apresentaram achado incidental de embolia pulmonar na TC de tórax. Não houve diferença estatística entre os grupos para sexo, idade e tabagismo. Quanto à procedência, 58,3% dos pacientes sem suspeita clínica eram de origem ambulatorial e 41,7% com suspeita de TEP vinham do pronto-socorro (p < 0,001). As neoplasias mais prevalentes foram de pulmão (17,6%), intestino (15,7%) e mama (13,0%). Aqueles com achado incidental apresentaram significativamente mais metástases, sem diferença entre os grupos para realização de quimioterapia, radioterapia ou cirurgia recente. Quanto aos sintomas apresentados, 41,9% daqueles sem suspeita clínica tinham queixas sugestivas de TEP quando realizaram o exame. Conclusão TEP incidental é frequente em pacientes oncológicos, especialmente naqueles provenientes de seguimento ambulatorial e em estágios avançados da doença. Sintomas sugestivos de TEP estavam presentes em pacientes sem suspeita clínica ao realizarem a TC de tórax. PMID:29930652

  6. Molecular brain imaging in the multimodality era

    PubMed Central

    Price, Julie C

    2012-01-01

    Multimodality molecular brain imaging encompasses in vivo visualization, evaluation, and measurement of cellular/molecular processes. Instrumentation and software developments over the past 30 years have fueled advancements in multimodality imaging platforms that enable acquisition of multiple complementary imaging outcomes by either combined sequential or simultaneous acquisition. This article provides a general overview of multimodality neuroimaging in the context of positron emission tomography as a molecular imaging tool and magnetic resonance imaging as a structural and functional imaging tool. Several image examples are provided and general challenges are discussed to exemplify complementary features of the modalities, as well as important strengths and weaknesses of combined assessments. Alzheimer's disease is highlighted, as this clinical area has been strongly impacted by multimodality neuroimaging findings that have improved understanding of the natural history of disease progression, early disease detection, and informed therapy evaluation. PMID:22434068

  7. Evidence base for multimodal therapy in cachexia.

    PubMed

    Solheim, Tora S; Laird, Barry J A

    2012-12-01

    The lack of success of unimodal treatment studies in cachexia and the growing awareness that multiple components are responsible for the development of cachexia have led to the view that cachexia intervention should include multimodal treatment. The aim of this article is to examine the evidence for multimodal treatment in the management of cancer cachexia. There are some studies involving multimodal treatment that indicate significant effects on cachexia outcomes. There are, however, no randomized controlled trials to date that incorporate fully a structured exercise program, nutrition, good symptom treatment as well as drug treatment, to counteract the effects of altered metabolism. The effectiveness of any drug intervention for cancer cachexia probably will only be maximized if incorporated into multimodal treatment. Further, cachexia treatment trials should also aim to include patients at an early phase in their cachexia trajectory and use validated outcome measures.

  8. Design Options for Multimodal Web Applications

    NASA Astrophysics Data System (ADS)

    Stanciulescu, Adrian; Vanderdonckt, Jean

    The capabilities of multimodal applications running on the web are well de-lineated since they are mainly constrained by what their underlying standard mark up language offers, as opposed to hand-made multimodal applications. As the experience in developing such multimodal web applications is growing, the need arises to identify and define major design options of such application to pave the way to a structured development life cycle. This paper provides a design space of independent design options for multimodal web applications based on three types of modalities: graphical, vocal, tactile, and combined. On the one hand, these design options may provide designers with some explicit guidance on what to decide or not for their future user interface, while exploring various design alternatives. On the other hand, these design options have been implemented as graph transformations per-formed on a user interface model represented as a graph. Thanks to a transformation engine, it allows designers to play with the different values of each design option, to preview the results of the transformation, and to obtain the corresponding code on-demand

  9. The Role of Multimodal Analgesia in Spine Surgery.

    PubMed

    Kurd, Mark F; Kreitz, Tyler; Schroeder, Gregory; Vaccaro, Alexander R

    2017-04-01

    Optimal postoperative pain control allows for faster recovery, reduced complications, and improved patient satisfaction. Historically, pain management after spine surgery relied heavily on opioid medications. Multimodal regimens were developed to reduce opioid consumption and associated adverse effects. Multimodal approaches used in orthopaedic surgery of the lower extremity, especially joint arthroplasty, have been well described and studies have shown reduced opioid consumption, improved pain and function, and decreased length of stay. A growing body of evidence supports multimodal analgesia in spine surgery. Methods include the use of preemptive analgesia, NSAIDs, the neuromodulatory agents gabapentin and pregabalin, acetaminophen, and extended-action local anesthesia. The development of a standard approach to multimodal analgesia in spine surgery requires extensive assessment of the literature. Because a substantial number of spine surgeries are performed annually, a standardized approach to multimodal analgesia may provide considerable benefits, particularly in the context of the increased emphasis on accountability within the healthcare system.

  10. Joint Sparse Representation for Robust Multimodal Biometrics Recognition

    DTIC Science & Technology

    2012-01-01

    described in III. Experimental evaluations on a comprehensive multimodal dataset and a face database have been described in section V. Finally, in...WVU Multimodal Dataset The WVU multimodal dataset is a comprehensive collection of different biometric modalities such as fingerprint, iris, palmprint ...Martnez and R. Benavente, “The AR face database ,” CVC Technical Report, June 1998. [29] U. Park and A. Jain, “Face matching and retrieval using soft

  11. Multimodal Trip Planner System final evaluation report.

    DOT National Transportation Integrated Search

    2011-05-01

    This evaluation of the Multimodal Trip Planning System (MMTPS) is the culmination of a multi-year project evaluating the development and deployment of a multimodal trip planner in the Chicagoland area between 2004 and 2010. The report includes an ove...

  12. Multimodal pain stimulation of the gastrointestinal tract

    PubMed Central

    Drewes, Asbjørn Mohr; Gregersen, Hans

    2006-01-01

    Understanding and characterization of pain and other sensory symptoms are among the most important issues in the diagnosis and assessment of patient with gastrointestinal disorders. Methods to evoke and assess experimental pain have recently developed into a new area with the possibility for multimodal stimulation (e.g., electrical, mechanical, thermal and chemical stimulation) of different nerves and pain pathways in the human gut. Such methods mimic to a high degree the pain experienced in the clinic. Multimodal pain methods have increased our basic understanding of different peripheral receptors in the gut in health and disease. Together with advanced muscle analysis, the methods have increased our understanding of receptors sensitive to mechanical, chemical and temperature stimuli in diseases, such as systemic sclerosis and diabetes. The methods can also be used to unravel central pain mechanisms, such as those involved in allodynia, hyperalgesia and referred pain. Abnormalities in central pain mechanisms are often seen in patients with chronic gut pain and hence methods relying on multimodal pain stimulation may help to understand the symptoms in these patients. Sex differences have been observed in several diseases of the gut, and differences in central pain processing between males and females have been hypothesized using multimodal pain stimulations. Finally, multimodal methods have recently been used to gain more insight into the effect of drugs against pain in the GI tract. Hence, the multimodal methods undoubtedly represents a major step forward in the future characterization and treatment of patients with various diseases of the gut. PMID:16688791

  13. Adaptive multimodal interaction in mobile augmented reality: A conceptual framework

    NASA Astrophysics Data System (ADS)

    Abidin, Rimaniza Zainal; Arshad, Haslina; Shukri, Saidatul A'isyah Ahmad

    2017-10-01

    Recently, Augmented Reality (AR) is an emerging technology in many mobile applications. Mobile AR was defined as a medium for displaying information merged with the real world environment mapped with augmented reality surrounding in a single view. There are four main types of mobile augmented reality interfaces and one of them are multimodal interfaces. Multimodal interface processes two or more combined user input modes (such as speech, pen, touch, manual gesture, gaze, and head and body movements) in a coordinated manner with multimedia system output. In multimodal interface, many frameworks have been proposed to guide the designer to develop a multimodal applications including in augmented reality environment but there has been little work reviewing the framework of adaptive multimodal interface in mobile augmented reality. The main goal of this study is to propose a conceptual framework to illustrate the adaptive multimodal interface in mobile augmented reality. We reviewed several frameworks that have been proposed in the field of multimodal interfaces, adaptive interface and augmented reality. We analyzed the components in the previous frameworks and measure which can be applied in mobile devices. Our framework can be used as a guide for designers and developer to develop a mobile AR application with an adaptive multimodal interfaces.

  14. Analyzing a multimodal biometric system using real and virtual users

    NASA Astrophysics Data System (ADS)

    Scheidat, Tobias; Vielhauer, Claus

    2007-02-01

    Three main topics of recent research on multimodal biometric systems are addressed in this article: The lack of sufficiently large multimodal test data sets, the influence of cultural aspects and data protection issues of multimodal biometric data. In this contribution, different possibilities are presented to extend multimodal databases by generating so-called virtual users, which are created by combining single biometric modality data of different users. Comparative tests on databases containing real and virtual users based on a multimodal system using handwriting and speech are presented, to study to which degree the use of virtual multimodal databases allows conclusions with respect to recognition accuracy in comparison to real multimodal data. All tests have been carried out on databases created from donations from three different nationality groups. This allows to review the experimental results both in general and in context of cultural origin. The results show that in most cases the usage of virtual persons leads to lower accuracy than the usage of real users in terms of the measurement applied: the Equal Error Rate. Finally, this article will address the general question how the concept of virtual users may influence the data protection requirements for multimodal evaluation databases in the future.

  15. Performance Evaluation of Multimodal Multifeature Authentication System Using KNN Classification.

    PubMed

    Rajagopal, Gayathri; Palaniswamy, Ramamoorthy

    2015-01-01

    This research proposes a multimodal multifeature biometric system for human recognition using two traits, that is, palmprint and iris. The purpose of this research is to analyse integration of multimodal and multifeature biometric system using feature level fusion to achieve better performance. The main aim of the proposed system is to increase the recognition accuracy using feature level fusion. The features at the feature level fusion are raw biometric data which contains rich information when compared to decision and matching score level fusion. Hence information fused at the feature level is expected to obtain improved recognition accuracy. However, information fused at feature level has the problem of curse in dimensionality; here PCA (principal component analysis) is used to diminish the dimensionality of the feature sets as they are high dimensional. The proposed multimodal results were compared with other multimodal and monomodal approaches. Out of these comparisons, the multimodal multifeature palmprint iris fusion offers significant improvements in the accuracy of the suggested multimodal biometric system. The proposed algorithm is tested using created virtual multimodal database using UPOL iris database and PolyU palmprint database.

  16. Filter. Remix. Make.: Cultivating Adaptability through Multimodality

    ERIC Educational Resources Information Center

    Dusenberry, Lisa; Hutter, Liz; Robinson, Joy

    2015-01-01

    This article establishes traits of adaptable communicators in the 21st century, explains why adaptability should be a goal of technical communication educators, and shows how multimodal pedagogy supports adaptability. Three examples of scalable, multimodal assignments (infographics, research interviews, and software demonstrations) that evidence…

  17. Multimodal Narrative Inquiry: Six Teacher Candidates Respond

    ERIC Educational Resources Information Center

    Morawski, Cynthia M.; Rottmann, Jennifer

    2016-01-01

    In this paper we present findings of a study on the implementation of a multimodal teacher narrative inquiry component, theoretically grounded by Rosenblatt's theory of transaction analysis, methodologically supported by action research and practically enacted by narrative inquiry and multimodal learning. In particular, the component offered…

  18. New methods of multimode fiber interferometer signal processing

    NASA Astrophysics Data System (ADS)

    Vitrik, Oleg B.; Kulchin, Yuri N.; Maxaev, Oleg G.; Kirichenko, Oleg V.; Kamenev, Oleg T.; Petrov, Yuri S.

    1995-06-01

    New methods of multimode fiber interferometers signal processing are suggested. For scheme of single fiber multimode interferometers with two excited modes, the method based on using of special fiber unit is developed. This unit provides the modes interaction and further sum optical field filtering. As a result the amplitude of output signal is modulated by external influence on interferometer. The stabilization of interferometer sensitivity is achieved by using additional special modulation of output signal. For scheme of single fiber multimode interferometers with excitation of wide mode spectrum, the signal of intermode interference is registered by photodiode matrix and then special electronic unit performs correlation processing. For elimination of temperature destabilization, the registered signal is adopted to multimode interferometers optical signal temperature changes. The achieved parameters for double mode scheme: temporary stability--0.6% per hour, sensitivity to interferometer length deviations--3,2 nm; for multimode scheme: temperature stability--(0.5%)/(K), temporary nonstability--0.2% per hour, sensitivity to interferometer length deviations--20 nm, dynamic range--35 dB.

  19. Enhancing resource coordination for multi-modal evacuation planning.

    DOT National Transportation Integrated Search

    2013-01-01

    This research project seeks to increase knowledge about coordinating effective multi-modal evacuation for disasters. It does so by identifying, evaluating, and assessing : current transportation management approaches for multi-modal evacuation planni...

  20. Multimodal Freight Distribution to Support Increased Port Operations

    DOT National Transportation Integrated Search

    2016-10-01

    To support improved port operations, three different aspects of multimodal freight distribution are investigated: (i) Efficient load planning for double stack trains at inland ports; (ii) Optimization of a multimodal network for environmental sustain...

  1. MULTIMODAL IMAGING OF SYPHILITIC MULTIFOCAL RETINITIS.

    PubMed

    Curi, Andre L; Sarraf, David; Cunningham, Emmett T

    2015-01-01

    To describe multimodal imaging of syphilitic multifocal retinitis. Observational case series. Two patients developed multifocal retinitis after treatment of unrecognized syphilitic uveitis with systemic corticosteroids in the absence of appropriate antibiotic therapy. Multimodal imaging localized the foci of retinitis within the retina in contrast to superficial retinal precipitates that accumulate on the surface of the retina in eyes with untreated syphilitic uveitis. Although the retinitis resolved after treatment with systemic penicillin in both cases, vision remained poor in the patient with multifocal retinitis involving the macula. Treatment of unrecognized syphilitic uveitis with corticosteroids in the absence of antitreponemal treatment can lead to the development of multifocal retinitis. Multimodal imaging, and optical coherence tomography in particular, can be used to distinguish multifocal retinitis from superficial retinal precipitates or accumulations.

  2. Performance Evaluation of Multimodal Multifeature Authentication System Using KNN Classification

    PubMed Central

    Rajagopal, Gayathri; Palaniswamy, Ramamoorthy

    2015-01-01

    This research proposes a multimodal multifeature biometric system for human recognition using two traits, that is, palmprint and iris. The purpose of this research is to analyse integration of multimodal and multifeature biometric system using feature level fusion to achieve better performance. The main aim of the proposed system is to increase the recognition accuracy using feature level fusion. The features at the feature level fusion are raw biometric data which contains rich information when compared to decision and matching score level fusion. Hence information fused at the feature level is expected to obtain improved recognition accuracy. However, information fused at feature level has the problem of curse in dimensionality; here PCA (principal component analysis) is used to diminish the dimensionality of the feature sets as they are high dimensional. The proposed multimodal results were compared with other multimodal and monomodal approaches. Out of these comparisons, the multimodal multifeature palmprint iris fusion offers significant improvements in the accuracy of the suggested multimodal biometric system. The proposed algorithm is tested using created virtual multimodal database using UPOL iris database and PolyU palmprint database. PMID:26640813

  3. How Multimodality Works in Mathematical Activity: Young Children Graphing Motion

    ERIC Educational Resources Information Center

    Ferrara, Francesca

    2014-01-01

    This paper aims to contribute to discussions on the multimodal nature of cognition through an elaboration of the ways multimodal aspects of thinking are exploited by learners doing mathematics. Moving beyond the fact "that" multimodality occurs, this paper focuses on "how" it occurs, with particular attention drawn to the…

  4. Comparison of Virginia's multimodal transportation corridors using cost and demographic analyses.

    DOT National Transportation Integrated Search

    2006-01-01

    This effort was performed in support of VTrans2025, Virginia's long-range multimodal transportation plan, and the VTrans2025 Multimodal Advisory Committee. The effort develops a preliminary approach to evaluating multimodal and highway-only corridor ...

  5. River multimodal scenario for rehabilitation robotics.

    PubMed

    Munih, Marko; Novak, Domen; Milavec, Maja; Ziherl, Jaka; Olenšek, Andrej; Mihelj, Matjaž

    2011-01-01

    This paper presents the novel "River" multimodal rehabilitation robotics scenario that includes video, audio and haptic modalities. Elements contributing to intrinsic motivation are carefully joined in the three modalities to increase motivation of the user. The user first needs to perform a motor action, then receives a cognitive challenge that is solved with adequate motor activity. Audio includes environmental sounds, music and spoken instructions or encouraging statements. Sounds and music were classified according to the arousal-valence space. The haptic modality can provide catching, grasping, tunnel or adaptive assistance, all depending on the user's needs. The scenario was evaluated in 16 stroke users, who responded to it favourably according to the Intrinsic Motivation Inventory questionnaire. Additionally, the river multimodal environment seems to elicit higher motivation than a simpler apple pick-and-place multimodal task. © 2011 IEEE

  6. Radioactive Nanomaterials for Multimodality Imaging

    PubMed Central

    Chen, Daiqin; Dougherty, Casey A.; Yang, Dongzhi; Wu, Hongwei; Hong, Hao

    2016-01-01

    Nuclear imaging techniques, including primarily positron emission tomography (PET) and single-photon emission computed tomography (SPECT), can provide quantitative information for a biological event in vivo with ultra-high sensitivity, however, the comparatively low spatial resolution is their major limitation in clinical application. By convergence of nuclear imaging with other imaging modalities like computed tomography (CT), magnetic resonance imaging (MRI) and optical imaging, the hybrid imaging platforms can overcome the limitations from each individual imaging technique. Possessing versatile chemical linking ability and good cargo-loading capacity, radioactive nanomaterials can serve as ideal imaging contrast agents. In this review, we provide a brief overview about current state-of-the-art applications of radioactive nanomaterials in the circumstances of multimodality imaging. We present strategies for incorporation of radioisotope(s) into nanomaterials along with applications of radioactive nanomaterials in multimodal imaging. Advantages and limitations of radioactive nanomaterials for multimodal imaging applications are discussed. Finally, a future perspective of possible radioactive nanomaterial utilization is presented for improving diagnosis and patient management in a variety of diseases. PMID:27227167

  7. Multimode optical fibers: steady state mode exciter.

    PubMed

    Ikeda, M; Sugimura, A; Ikegami, T

    1976-09-01

    The steady state mode power distribution of the multimode graded index fiber was measured. A simple and effective steady state mode exciter was fabricated by an etching technique. Its insertion loss was 0.5 dB for an injection laser. Deviation in transmission characteristics of multimode graded index fibers can be avoided by using the steady state mode exciter.

  8. Mid-infrared multi-mode absorption spectroscopy, MUMAS, using difference frequency generation

    NASA Astrophysics Data System (ADS)

    Northern, Henry; O'Hagan, Seamus; Hamilton, Michelle L.; Ewart, Paul

    2015-03-01

    Multi-mode absorption spectroscopy of ammonia and methane at 3.3 μm has been demonstrated using a source of multi-mode mid-infrared radiation based on difference frequency generation. Multi-mode radiation at 1.56 μm from a diode-pumped Er:Yb:glass laser was mixed with a single-mode Nd:YAG laser at 1.06 μm in a periodically poled lithium niobate crystal to produce multi-mode radiation in the region of 3.3 μm. Detection, by direct multi-mode absorption, of NH3 and CH4 is reported for each species individually and also simultaneously in mixtures allowing measurements of partial pressures of each species.

  9. Critical Visual Literacy: Multimodal Communication across the Curriculum

    ERIC Educational Resources Information Center

    Duffelmeyer, Barb Blakely; Ellertson, Anthony

    2005-01-01

    "Critical Visual Literacy: Multimodal Communication Across the Curriculum" makes the case for expanding the pedagogical space and communication possibilities in undergraduate communication-intensive and linked (learning community) courses by allowing students to create multimodal texts that deal with civic and cultural and/or discipline…

  10. Multimode entanglement in reconfigurable graph states using optical frequency combs

    PubMed Central

    Cai, Y.; Roslund, J.; Ferrini, G.; Arzani, F.; Xu, X.; Fabre, C.; Treps, N.

    2017-01-01

    Multimode entanglement is an essential resource for quantum information processing and quantum metrology. However, multimode entangled states are generally constructed by targeting a specific graph configuration. This yields to a fixed experimental setup that therefore exhibits reduced versatility and scalability. Here we demonstrate an optical on-demand, reconfigurable multimode entangled state, using an intrinsically multimode quantum resource and a homodyne detection apparatus. Without altering either the initial squeezing source or experimental architecture, we realize the construction of thirteen cluster states of various sizes and connectivities as well as the implementation of a secret sharing protocol. In particular, this system enables the interrogation of quantum correlations and fluctuations for any multimode Gaussian state. This initiates an avenue for implementing on-demand quantum information processing by only adapting the measurement process and not the experimental layout. PMID:28585530

  11. Fiber Optic Temperature Sensor Based on Multimode Interference Effects

    NASA Astrophysics Data System (ADS)

    Aguilar-Soto, J. G.; Antonio-Lopez, J. E.; Sanchez-Mondragon, J. J.; May-Arrioja, D. A.

    2011-01-01

    A novel fiber optic temperature sensor based on multimode interference was designed, fabricated and tested. The sensor is very simple and inexpensive since we only need to splice a section of multimode fiber between two single mode fibers. Using this device a sensing range of 25°C to 375°C is demonstrated. We should also highlight that due to the pass-band filter response of MMI devices, multiplexing is rather simple by just changing the length of the multimode section.

  12. Teaching Visual Texts with the Multimodal Analysis Software

    ERIC Educational Resources Information Center

    Lim Fei, Victor; O'Halloran, Kay L.; Tan, Sabine; E., Marissa K. L.

    2015-01-01

    This exploratory study introduces the systemic approach and the explicit teaching of a meta-language to provide conceptual tools for students for the analysis and interpretation of multimodal texts. Equipping students with a set of specialised vocabulary with conventionalised meanings associated with specific choices in multimodal texts empowers…

  13. Multimodal Scaffolding in the Secondary English Classroom Curriculum

    ERIC Educational Resources Information Center

    Boche, Benjamin; Henning, Megan

    2015-01-01

    This article examines the topic of multimodal scaffolding in the secondary English classroom curriculum through the viewpoint of one teacher's experiences. With technology becoming more commonplace and readily available in the English classroom, we must pinpoint specific and tangible ways to help teachers use and teach multimodalities in their…

  14. Multimodal imaging of cutaneous wound tissue

    NASA Astrophysics Data System (ADS)

    Zhang, Shiwu; Gnyawali, Surya; Huang, Jiwei; Ren, Wenqi; Gordillo, Gayle; Sen, Chandan K.; Xu, Ronald

    2015-01-01

    Quantitative assessment of wound tissue ischemia, perfusion, and inflammation provides critical information for appropriate detection, staging, and treatment of chronic wounds. However, few methods are available for simultaneous assessment of these tissue parameters in a noninvasive and quantitative fashion. We integrated hyperspectral, laser speckle, and thermographic imaging modalities in a single-experimental setup for multimodal assessment of tissue oxygenation, perfusion, and inflammation characteristics. Algorithms were developed for appropriate coregistration between wound images acquired by different imaging modalities at different times. The multimodal wound imaging system was validated in an occlusion experiment, where oxygenation and perfusion maps of a healthy subject's upper extremity were continuously monitored during a postocclusive reactive hyperemia procedure and compared with standard measurements. The system was also tested in a clinical trial where a wound of three millimeters in diameter was introduced on a healthy subject's lower extremity and the healing process was continuously monitored. Our in vivo experiments demonstrated the clinical feasibility of multimodal cutaneous wound imaging.

  15. Model regulations and plan amendments for multimodal transportation districts

    DOT National Transportation Integrated Search

    2004-02-01

    In 1999, the Florida legislature enabled local governments to establish Multimodal Transportation Districts (MMTD) in their comprehensive plan as a means of promoting a high quality multimodal environment within selected urban areas. The Florida Depa...

  16. Multimodal freight investment criteria.

    DOT National Transportation Integrated Search

    2010-07-01

    Literature was reviewed on multi-modal investment criteria for freight projects, examining measures and techniques for quantifying project benefits and costs, as well as ways to describe the economic importance of freight transportation. : A limited ...

  17. Pseudo-circulator implemented as a multimode fiber coupler

    NASA Astrophysics Data System (ADS)

    Bulota, F.; Bélanger, P.; Leduc, M.; Boudoux, C.; Godbout, N.

    2016-03-01

    We present a linear all-fiber device exhibiting the functionality of a circulator, albeit for multimode fibers. We define a pseudo-circulator as a linear three-port component that transfers most of a multimode light signal from Port 1 to Port 2, and from Port 2 to Port 3. Unlike a traditional circulator which depends on a nonlinear phenomenon to achieve a non-reciprocal behavior, our device is a linear component that seemingly breaks the principle of reciprocity by exploiting the variations of etendue of the multimode fibers in the coupler. The pseudo-circulator is implemented as a 2x2 asymmetric multimode fiber coupler, fabricated using the fusion-tapering technique. The coupler is asymmetric in its transverse fused section. The two multimode fibers differ in area, thus favoring the transfer of light from the smaller to the bigger fiber. The desired difference of area is obtained by tapering one of the fiber before the fusion process. Using this technique, we have successfully fabricated a pseudo-circulator surpassing in efficiency a 50/50 beam-splitter. In all the visible and near-IR spectrum, the transmission ratio exceeds 77% from Port 1 to Port 2, and 80% from Port 2 to Port 3. The excess loss is less than 0.5 dB, regardless of the entry port.

  18. Fracturing Writing Spaces: Multimodal Storytelling Ignites Process Writing

    ERIC Educational Resources Information Center

    Lenters, Kimberly; Winters, Kari-Lynn

    2013-01-01

    In this paper, we explore the affordances of literature-based, arts-infused and digital media processes for students, as multimodal practices take centre stage in an English Language Arts unit on fractured fairy tales. The study takes up the challenge of addressing multimodal literacy instruction and research in ways that utilize a range of…

  19. Generating Multimodal References

    ERIC Educational Resources Information Center

    van der Sluis, Ielka; Krahmer, Emiel

    2007-01-01

    This article presents a new computational model for the generation of multimodal referring expressions (REs), based on observations in human communication. The algorithm is an extension of the graph-based algorithm proposed by Krahmer, van Erk, and Verleg (2003) and makes use of a so-called Flashlight Model for pointing. The Flashlight Model…

  20. Multimode waveguide speckle patterns for compressive sensing.

    PubMed

    Valley, George C; Sefler, George A; Justin Shaw, T

    2016-06-01

    Compressive sensing (CS) of sparse gigahertz-band RF signals using microwave photonics may achieve better performances with smaller size, weight, and power than electronic CS or conventional Nyquist rate sampling. The critical element in a CS system is the device that produces the CS measurement matrix (MM). We show that passive speckle patterns in multimode waveguides potentially provide excellent MMs for CS. We measure and calculate the MM for a multimode fiber and perform simulations using this MM in a CS system. We show that the speckle MM exhibits the sharp phase transition and coherence properties needed for CS and that these properties are similar to those of a sub-Gaussian MM with the same mean and standard deviation. We calculate the MM for a multimode planar waveguide and find dimensions of the planar guide that give a speckle MM with a performance similar to that of the multimode fiber. The CS simulations show that all measured and calculated speckle MMs exhibit a robust performance with equal amplitude signals that are sparse in time, in frequency, and in wavelets (Haar wavelet transform). The planar waveguide results indicate a path to a microwave photonic integrated circuit for measuring sparse gigahertz-band RF signals using CS.

  1. Coupling efficiency of laser beam to multimode fiber

    NASA Astrophysics Data System (ADS)

    Niu, Jinfu; Xu, Jianqiu

    2007-06-01

    The coupling efficiency of laser beam to multimode fiber is given by geometrical optics, and the relation between the maximum coupling efficiency and the beam propagation factor M2 is analyzed. An equivalent factor MF2 for the multimode fiber is introduced to characterize the fiber coupling capability. The coupling efficiency of laser beam to multimode fiber is calculated in respect of the ratio M2/MF2 by the overlapping integral theory. The optimal coupling efficiency can be roughly estimated by the ratio of M2 to MF2 but with a large error range. The deviation comes from the lacks of information on the detail of phase and intensity profile in the beam factor M2.

  2. Multimodal Nonlinear Optical Microscopy

    PubMed Central

    Yue, Shuhua; Slipchenko, Mikhail N.; Cheng, Ji-Xin

    2013-01-01

    Because each nonlinear optical (NLO) imaging modality is sensitive to specific molecules or structures, multimodal NLO imaging capitalizes the potential of NLO microscopy for studies of complex biological tissues. The coupling of multiphoton fluorescence, second harmonic generation, and coherent anti-Stokes Raman scattering (CARS) has allowed investigation of a broad range of biological questions concerning lipid metabolism, cancer development, cardiovascular disease, and skin biology. Moreover, recent research shows the great potential of using CARS microscope as a platform to develop more advanced NLO modalities such as electronic-resonance-enhanced four-wave mixing, stimulated Raman scattering, and pump-probe microscopy. This article reviews the various approaches developed for realization of multimodal NLO imaging as well as developments of new NLO modalities on a CARS microscope. Applications to various aspects of biological and biomedical research are discussed. PMID:24353747

  3. Multimodal Career Counseling: An Application of the "BASIC ID."

    ERIC Educational Resources Information Center

    Smith, Robert L.; Southern, Stephen

    1980-01-01

    The multimodal career counseling model is a logical extension of Lazarus' multimodal behavior therapy through the assessment of seven modalities that affect the career of the individual. Interventions may be directed at the early decision-making stage or when difficulties are encountered. (Author)

  4. Multi-mode of Four and Six Wave Parametric Amplified Process

    NASA Astrophysics Data System (ADS)

    Zhu, Dayu; Yang, Yiheng; Zhang, Da; Liu, Ruizhou; Ma, Danmeng; Li, Changbiao; Zhang, Yanpeng

    2017-03-01

    Multiple quantum modes in correlated fields are essential for future quantum information processing and quantum computing. Here we report the generation of multi-mode phenomenon through parametric amplified four- and six-wave mixing processes in a rubidium atomic ensemble. The multi-mode properties in both frequency and spatial domains are studied. On one hand, the multi-mode behavior is dominantly controlled by the intensity of external dressing effect, or nonlinear phase shift through internal dressing effect, in frequency domain; on the other hand, the multi-mode behavior is visually demonstrated from the images of the biphoton fields directly, in spatial domain. Besides, the correlation of the two output fields is also demonstrated in both domains. Our approach supports efficient applications for scalable quantum correlated imaging.

  5. Multi-mode of Four and Six Wave Parametric Amplified Process.

    PubMed

    Zhu, Dayu; Yang, Yiheng; Zhang, Da; Liu, Ruizhou; Ma, Danmeng; Li, Changbiao; Zhang, Yanpeng

    2017-03-03

    Multiple quantum modes in correlated fields are essential for future quantum information processing and quantum computing. Here we report the generation of multi-mode phenomenon through parametric amplified four- and six-wave mixing processes in a rubidium atomic ensemble. The multi-mode properties in both frequency and spatial domains are studied. On one hand, the multi-mode behavior is dominantly controlled by the intensity of external dressing effect, or nonlinear phase shift through internal dressing effect, in frequency domain; on the other hand, the multi-mode behavior is visually demonstrated from the images of the biphoton fields directly, in spatial domain. Besides, the correlation of the two output fields is also demonstrated in both domains. Our approach supports efficient applications for scalable quantum correlated imaging.

  6. A triple hybrid micropower generator with simultaneous multi-mode energy harvesting

    NASA Astrophysics Data System (ADS)

    Uluşan, H.; Chamanian, S.; Pathirana, W. P. M. R.; Zorlu, Ö.; Muhtaroğlu, A.; Külah, H.

    2018-01-01

    This study presents a triple hybrid energy harvesting system that combines harvested power from thermoelectric (TE), vibration-based electromagnetic (EM) and piezoelectric (PZT) harvesters into a single DC supply. A power management circuit is designed and implemented in 180 nm standard CMOS technology based on the distinct requirements of each harvester, and is terminated with a Schottky diode to avoid reverse current flow. The system topology hence supports simultaneous power generation and delivery from low and high frequency vibrations as well as temperature differences in the environment. The ultra-low DC voltage harvested from TE generator is boosted with a cross-coupled charge-pump driven by an LC oscillator with fully-integrated center-tapped differential inductors. The EM harvester output was rectified with a self-powered and low drop-out AC/DC doubler circuit. The PZT interface electronics benefits from peak-to-peak cycle of the harvested voltage through a negative voltage converter followed by synchronous power extraction and DC-to-DC conversion through internal switches, and an external inductor. The hybrid system was tested with a wearable in-house EM energy harvester placed wrist of a jogger, a commercial low volume PZT harvester, and DC supply as the TE generator output. The system generates more than 1.2 V output for load resistances higher than 50 kΩ, which corresponds to 24 μW to power wearable sensors. Simultaneous multi-mode operation achieves higher voltage and power compared to stand-alone harvesting circuits, and generates up to 110 μW of output power. This is the first hybrid harvester circuit that simultaneously extracts energy from three independent sources, and delivers a single DC output.

  7. Multimodal optoacoustic and multiphoton fluorescence microscopy

    NASA Astrophysics Data System (ADS)

    Sela, Gali; Razansky, Daniel; Shoham, Shy

    2013-03-01

    Multiphoton microscopy is a powerful imaging modality that enables structural and functional imaging with cellular and sub-cellular resolution, deep within biological tissues. Yet, its main contrast mechanism relies on extrinsically administered fluorescent indicators. Here we developed a system for simultaneous multimodal optoacoustic and multiphoton fluorescence 3D imaging, which attains both absorption and fluorescence-based contrast by integrating an ultrasonic transducer into a two-photon laser scanning microscope. The system is readily shown to enable acquisition of multimodal microscopic images of fluorescently labeled targets and cell cultures as well as intrinsic absorption-based images of pigmented biological tissue. During initial experiments, it was further observed that that detected optoacoustically-induced response contains low frequency signal variations, presumably due to cavitation-mediated signal generation by the high repetition rate (80MHz) near IR femtosecond laser. The multimodal system may provide complementary structural and functional information to the fluorescently labeled tissue, by superimposing optoacoustic images of intrinsic tissue chromophores, such as melanin deposits, pigmentation, and hemoglobin or other extrinsic particle or dye-based markers highly absorptive in the NIR spectrum.

  8. Multimodal Estimation of Distribution Algorithms.

    PubMed

    Yang, Qiang; Chen, Wei-Neng; Li, Yun; Chen, C L Philip; Xu, Xiang-Min; Zhang, Jun

    2016-02-15

    Taking the advantage of estimation of distribution algorithms (EDAs) in preserving high diversity, this paper proposes a multimodal EDA. Integrated with clustering strategies for crowding and speciation, two versions of this algorithm are developed, which operate at the niche level. Then these two algorithms are equipped with three distinctive techniques: 1) a dynamic cluster sizing strategy; 2) an alternative utilization of Gaussian and Cauchy distributions to generate offspring; and 3) an adaptive local search. The dynamic cluster sizing affords a potential balance between exploration and exploitation and reduces the sensitivity to the cluster size in the niching methods. Taking advantages of Gaussian and Cauchy distributions, we generate the offspring at the niche level through alternatively using these two distributions. Such utilization can also potentially offer a balance between exploration and exploitation. Further, solution accuracy is enhanced through a new local search scheme probabilistically conducted around seeds of niches with probabilities determined self-adaptively according to fitness values of these seeds. Extensive experiments conducted on 20 benchmark multimodal problems confirm that both algorithms can achieve competitive performance compared with several state-of-the-art multimodal algorithms, which is supported by nonparametric tests. Especially, the proposed algorithms are very promising for complex problems with many local optima.

  9. Composition at Washington State University: Building a Multimodal Bricolage

    ERIC Educational Resources Information Center

    Ericsson, Patricia; Hunter, Leeann Downing; Macklin, Tialitha Michelle; Edwards, Elizabeth Sue

    2016-01-01

    Multimodal pedagogy is increasingly accepted among composition scholars. However, putting such pedagogy into practice presents significant challenges. In this profile of Washington State University's first-year composition program, we suggest a multi-vocal and multi-theoretical approach to addressing the challenges of multimodal pedagogy. Patricia…

  10. Delivery of ultrashort spatially focused pulses through a multimode fiber

    NASA Astrophysics Data System (ADS)

    Morales-Delgado, Edgar E.; Papadopoulos, Ioannis N.; Farahi, Salma; Psaltis, Demetri; Moser, Christophe

    2015-08-01

    Multimode optical fibers potentially allow the transmission of larger amounts of information than their single mode counterparts because of their high number of supported modes. However, propagation of a light pulse through a multimode fiber suffers from spatial distortions due to the superposition of the various exited modes and from time broadening due to modal dispersion. We present a method based on digital phase conjugation to selectively excite in a multimode fiber specific optical fiber modes that follow similar optical paths as they travel through the fiber. The excited modes interfere constructively at the fiber output generating an ultrashort spatially focused pulse. The excitation of a limited number of modes following similar optical paths limits modal dispersion, allowing the transmission of the ultrashort pulse. We have experimentally demonstrated the delivery of a focused spot of pulse width equal to 500 fs through a 30 cm, 200 micrometer core step index multimode fiber. The results of this study show that two-photon imaging capability can be added to ultra-thin lensless endoscopy using commercial multimode fibers.

  11. In vivo multimodal nonlinear optical imaging of mucosal tissue

    NASA Astrophysics Data System (ADS)

    Sun, Ju; Shilagard, Tuya; Bell, Brent; Motamedi, Massoud; Vargas, Gracie

    2004-05-01

    We present a multimodal nonlinear imaging approach to elucidate microstructures and spectroscopic features of oral mucosa and submucosa in vivo. The hamster buccal pouch was imaged using 3-D high resolution multiphoton and second harmonic generation microscopy. The multimodal imaging approach enables colocalization and differentiation of prominent known spectroscopic and structural features such as keratin, epithelial cells, and submucosal collagen at various depths in tissue. Visualization of cellular morphology and epithelial thickness are in excellent agreement with histological observations. These results suggest that multimodal nonlinear optical microscopy can be an effective tool for studying the physiology and pathology of mucosal tissue.

  12. Multimode optical fiber

    DOEpatents

    Bigot-Astruc, Marianne; Molin, Denis; Sillard, Pierre

    2014-11-04

    A depressed graded-index multimode optical fiber includes a central core, an inner depressed cladding, a depressed trench, an outer depressed cladding, and an outer cladding. The central core has an alpha-index profile. The depressed claddings limit the impact of leaky modes on optical-fiber performance characteristics (e.g., bandwidth, core size, and/or numerical aperture).

  13. Multimodal versus Unimodal Instruction in a Complex Learning Context.

    ERIC Educational Resources Information Center

    Gellevij, Mark; van der Meij, Hans; de Jong, Ton; Pieters, Jules

    2002-01-01

    Compared multimodal instruction with text and pictures with unimodal text-only instruction as 44 college students used a visual or textual manual to learn a complex software application. Results initially support dual coding theory and indicate that multimodal instruction led to better performance than unimodal instruction. (SLD)

  14. Multimodal Pedagogies in Diverse Classrooms: Representation, Rights and Resources

    ERIC Educational Resources Information Center

    Stein, Pippa

    2012-01-01

    Multimodal Pedagogies in Diverse Classrooms examines how the classroom can become a democratic space founded on the integration of different histories, modes of representation, feelings, languages and discourses, and is essential reading for anyone interested in the connection between multimodality, pedagogy, democracy and social justice in…

  15. Using a Multimodal Learning System to Support Music Instruction

    ERIC Educational Resources Information Center

    Yu, Pao-Ta; Lai, Yen-Shou; Tsai, Hung-Hsu; Chang, Yuan-Hou

    2010-01-01

    This paper describes a multimodality approach that helps primary-school students improve their learning performance during music instruction. Multimedia instruction is an effective way to help learners create meaningful knowledge and to make referential connections between mental representations. This paper proposes a multimodal, dual-channel,…

  16. Individual Multimodal Therapy for Weight Loss: A Case Example.

    ERIC Educational Resources Information Center

    Kilmartin, Christopher; Robbins, Steven

    1987-01-01

    Presents a case study highlighting a treatment model based on a multimodal conceptualization. Suggests that individual multimodal therapy provides a comprehensive approach to the treatment of overeating, helping to target social and emotional issues related to eating disorders as well as the eating behaviors themselves. (Author/ABB)

  17. The Study on the Optimization of Container Multimodal Transport Business Process in Shandong

    NASA Astrophysics Data System (ADS)

    Wang, Fengmei; Gong, Xiaoyi; Ni, Yingying; Zhan, Jun; Che, Huiping

    2018-06-01

    Shandong is a coastal city with good location advantages. As a hub port for international trade goods and a port of transhipment, shandong's demand for multimodal transport is more urgent. By selecting the suitable non-water port and the multimodal transport carrier to improve the efficiency of multimodal transport, the purpose of saving the time of logistics is achieved, thus reducing the logistics cost.It branch out through Shandongt, and it can reach the central region of China, can reach the Western remote area ,too. This paper puts forward the optimization scheme of the business process of container multimodal transport. The optimization of freight forwarding business process is analyzed. The multimodal transport model in Shandong was designed. Finally, the optimal approach of multimodal transport in Shandong is put forward.

  18. Photoacoustic-Based Multimodal Nanoprobes: from Constructing to Biological Applications.

    PubMed

    Gao, Duyang; Yuan, Zhen

    2017-01-01

    Multimodal nanoprobes have attracted intensive attentions since they can integrate various imaging modalities to obtain complementary merits of single modality. Meanwhile, recent interest in laser-induced photoacoustic imaging is rapidly growing due to its unique advantages in visualizing tissue structure and function with high spatial resolution and satisfactory imaging depth. In this review, we summarize multimodal nanoprobes involving photoacoustic imaging. In particular, we focus on the method to construct multimodal nanoprobes. We have divided the synthetic methods into two types. First, we call it "one for all" concept, which involves intrinsic properties of the element in a single particle. Second, "all in one" concept, which means integrating different functional blocks in one particle. Then, we simply introduce the applications of the multifunctional nanoprobes for in vivo imaging and imaging-guided tumor therapy. At last, we discuss the advantages and disadvantages of the present methods to construct the multimodal nanoprobes and share our viewpoints in this area.

  19. Tunable multimode-interference bandpass fiber filter.

    PubMed

    Antonio-Lopez, J E; Castillo-Guzman, A; May-Arrioja, D A; Selvas-Aguilar, R; Likamwa, P

    2010-02-01

    We report on a wavelength-tunable filter based on multimode interference (MMI) effects. A typical MMI filter consists of a multimode fiber (MMF) spliced between two single-mode fibers (SMF). The peak wavelength response of the filter exhibits a linear dependence when the length of the MMF is modified. Therefore a capillary tube filled with refractive-index-matching liquid is used to effectively increase the length of the MMF, and thus wavelength tuning is achieved. Using this filter a ring-based tunable erbium-doped fiber laser is demonstrated with a tunability of 30 nm, covering the full C-band.

  20. A Multimodal Discourse Analysis of Tmall's Double Eleven Advertisement

    ERIC Educational Resources Information Center

    Hu, Chunyu; Luo, Mengxi

    2016-01-01

    From the 1990s, the multimodal turn in discourse studies makes multimodal discourse analysis a popular topic in linguistics and communication studies. An important approach to applying Systemic Functional Linguistics to non-verbal modes is Visual Grammar initially proposed by Kress and van Leeuwen (1996). Considering that commercial advertisement…

  1. Optical/MRI Multimodality Molecular Imaging

    NASA Astrophysics Data System (ADS)

    Ma, Lixin; Smith, Charles; Yu, Ping

    2007-03-01

    Multimodality molecular imaging that combines anatomical and functional information has shown promise in development of tumor-targeted pharmaceuticals for cancer detection or therapy. We present a new multimodality imaging technique that combines fluorescence molecular tomography (FMT) and magnetic resonance imaging (MRI) for in vivo molecular imaging of preclinical tumor models. Unlike other optical/MRI systems, the new molecular imaging system uses parallel phase acquisition based on heterodyne principle. The system has a higher accuracy of phase measurements, reduced noise bandwidth, and an efficient modulation of the fluorescence diffuse density waves. Fluorescent Bombesin probes were developed for targeting breast cancer cells and prostate cancer cells. Tissue phantom and small animal experiments were performed for calibration of the imaging system and validation of the targeting probes.

  2. Global optimization of multimode interference structure for ratiometric wavelength measurement

    NASA Astrophysics Data System (ADS)

    Wang, Qian; Farrell, Gerald; Hatta, Agus Muhamad

    2007-07-01

    The multimode interference structure is conventionally used as a splitter/combiner. In this paper, it is optimised as an edge filter for ratiometric wavelength measurement, which can be used in demodulation of fiber Bragg grating sensing. The global optimization algorithm-adaptive simulated annealing is introduced in the design of multimode interference structure including the length and width of the multimode waveguide section, and positions of the input and output waveguides. The designed structure shows a suitable spectral response for wavelength measurement and a good fabrication tolerance.

  3. Indigenous Ways with Literacies: Transgenerational, Multimodal, Placed, and Collective

    ERIC Educational Resources Information Center

    Mills, Kathy A.; Davis-Warra, John; Sewell, Marlene; Anderson, Mikayla

    2016-01-01

    This research describes some of the salient features of Indigenous ways of working with multimodal literacies in digital contexts of use that emerged within an Indigenous school community with the oversight of Aboriginal Elders. This is significant because the use of multimodal literacy practices among a growing number of Indigenous school…

  4. Object recognition through a multi-mode fiber

    NASA Astrophysics Data System (ADS)

    Takagi, Ryosuke; Horisaki, Ryoichi; Tanida, Jun

    2017-04-01

    We present a method of recognizing an object through a multi-mode fiber. A number of speckle patterns transmitted through a multi-mode fiber are provided to a classifier based on machine learning. We experimentally demonstrated binary classification of face and non-face targets based on the method. The measurement process of the experimental setup was random and nonlinear because a multi-mode fiber is a typical strongly scattering medium and any reference light was not used in our setup. Comparisons between three supervised learning methods, support vector machine, adaptive boosting, and neural network, are also provided. All of those learning methods achieved high accuracy rates at about 90% for the classification. The approach presented here can realize a compact and smart optical sensor. It is practically useful for medical applications, such as endoscopy. Also our study indicated a promising utilization of artificial intelligence, which has rapidly progressed, for reducing optical and computational costs in optical sensing systems.

  5. Tinnitus Multimodal Imaging

    DTIC Science & Technology

    2016-12-01

    images were segmented into gray and white matter images and spatially normalized to the MNI template (3 mm isotropic voxels) using the DARTEL toolbox in...AWARD NUMBER: W81XWH-13-1-0494 TITLE: Tinnitus Multimodal Imaging PRINCIPAL INVESTIGATOR: Steven Wan Cheung CONTRACTING ORGANIZATION... Medical Research and Materiel Command Fort Detrick, Maryland 21702-5012 DISTRIBUTION STATEMENT: Approved for Public Release; Distribution Unlimited

  6. The dynamics of multimodal integration: The averaging diffusion model.

    PubMed

    Turner, Brandon M; Gao, Juan; Koenig, Scott; Palfy, Dylan; L McClelland, James

    2017-12-01

    We combine extant theories of evidence accumulation and multi-modal integration to develop an integrated framework for modeling multimodal integration as a process that unfolds in real time. Many studies have formulated sensory processing as a dynamic process where noisy samples of evidence are accumulated until a decision is made. However, these studies are often limited to a single sensory modality. Studies of multimodal stimulus integration have focused on how best to combine different sources of information to elicit a judgment. These studies are often limited to a single time point, typically after the integration process has occurred. We address these limitations by combining the two approaches. Experimentally, we present data that allow us to study the time course of evidence accumulation within each of the visual and auditory domains as well as in a bimodal condition. Theoretically, we develop a new Averaging Diffusion Model in which the decision variable is the mean rather than the sum of evidence samples and use it as a base for comparing three alternative models of multimodal integration, allowing us to assess the optimality of this integration. The outcome reveals rich individual differences in multimodal integration: while some subjects' data are consistent with adaptive optimal integration, reweighting sources of evidence as their relative reliability changes during evidence integration, others exhibit patterns inconsistent with optimality.

  7. A Multimodal Discourse Analysis of a Yoruba Song-Drama

    ERIC Educational Resources Information Center

    Olateju, Moji. A.

    2015-01-01

    This paper presents a multimodal discourse analysis of a story that has been turned into a Yoruba song-drama, highlighting the ideational, interpersonal and textual aspects of the song-drama. The data is a short song-drama meant to teach children importunity, determination and hard work through persistence. The multimodal and narrative conventions…

  8. Multimodal Behavior Therapy: Case Study of a High School Student.

    ERIC Educational Resources Information Center

    Seligman, Linda

    1981-01-01

    A case study of a high school student concerned with weight problems illustrates multimodal behavior therapy and its use in a high school setting. Multimodal therapy allows the school counselor to maximize referral sources while emphasizing growth and actualization. (JAC)

  9. Process for Assembly of Multimode Hydrophone Ceramic Stack

    DTIC Science & Technology

    2016-09-20

    PROCESS FOR ASSEMBLY OF MULTIMODE HYDROPHONE CERAMIC STACK STATEMENT OF GOVERNMENT INTEREST [0001] The invention described herein may be...invention relates to a method of assembly for a multimode acoustic hydrophone. (2) Description of the Prior Art [0004] An acoustic hydrophone can...performance difference of a hydrophone that does not have uniform axial stress/voltage on each ring, when the hydrophone is assembled and FIG. 13 thru FIG

  10. Multimodal Image Registration through Simultaneous Segmentation.

    PubMed

    Aganj, Iman; Fischl, Bruce

    2017-11-01

    Multimodal image registration facilitates the combination of complementary information from images acquired with different modalities. Most existing methods require computation of the joint histogram of the images, while some perform joint segmentation and registration in alternate iterations. In this work, we introduce a new non-information-theoretical method for pairwise multimodal image registration, in which the error of segmentation - using both images - is considered as the registration cost function. We empirically evaluate our method via rigid registration of multi-contrast brain magnetic resonance images, and demonstrate an often higher registration accuracy in the results produced by the proposed technique, compared to those by several existing methods.

  11. Content-based TV sports video retrieval using multimodal analysis

    NASA Astrophysics Data System (ADS)

    Yu, Yiqing; Liu, Huayong; Wang, Hongbin; Zhou, Dongru

    2003-09-01

    In this paper, we propose content-based video retrieval, which is a kind of retrieval by its semantical contents. Because video data is composed of multimodal information streams such as video, auditory and textual streams, we describe a strategy of using multimodal analysis for automatic parsing sports video. The paper first defines the basic structure of sports video database system, and then introduces a new approach that integrates visual stream analysis, speech recognition, speech signal processing and text extraction to realize video retrieval. The experimental results for TV sports video of football games indicate that the multimodal analysis is effective for video retrieval by quickly browsing tree-like video clips or inputting keywords within predefined domain.

  12. Multi-Modal Hallucinations and Cognitive Function in Parkinson's Disease

    PubMed Central

    Katzen, Heather; Myerson, Connie; Papapetropoulos, Spiridon; Nahab, Fatta; Gallo, Bruno; Levin, Bonnie

    2010-01-01

    Background/Aims Hallucinations have been linked to a constellation of cognitive deficits in Parkinson's disease (PD), but it is not known whether multi-modal hallucinations are associated with greater neuropsychological dysfunction. Methods 152 idiopathic PD patients were categorized based on the presence or absence of hallucinations and then were further subdivided into visual-only (VHonly; n = 35) or multi-modal (VHplus; n = 12) hallucination groups. All participants underwent detailed neuropsychological assessment. Results Participants with hallucinations performed more poorly on select neuropsychological measures and exhibited more mood symptoms. There were no differences between VHonly and VHplus groups. Conclusions PD patients with multi-modal hallucinations are not at greater risk for neuropsychological impairment than those with single-modal hallucinations. PMID:20689283

  13. A Framework and Toolkit for the Construction of Multimodal Learning Interfaces

    DTIC Science & Technology

    1998-04-29

    human communication modalities in the context of a broad class of applications, specifically those that support state manipulation via parameterized actions. The multimodal semantic model is also the basis for a flexible, domain independent, incrementally trainable multimodal interpretation algorithm based on a connectionist network. The second major contribution is an application framework consisting of reusable components and a modular, distributed system architecture. Multimodal application developers can assemble the components in the framework into a new application,

  14. Towards the future : the promise of intermodal and multimodal transportation systems

    DOT National Transportation Integrated Search

    1995-02-01

    Issues relating to intermodal and multimodal transportation systems are introduced and defined. Intermodal and multimodal transportation solutons are assessed within the framework of legislative efforts such as Intermodal Surface Transportation Effic...

  15. Relational Multimodal Freight Database Webinar

    DOT National Transportation Integrated Search

    2012-02-01

    The relational Multimodal Freight Database (MFD) was developed as part of Texas Department : of Transportation (TxDOT) Research Project 0-6297 entitled Freight Planning Factors Impacting : Texas Commodity Flows, conducted by the Center for Transporta...

  16. Using Multimodal Writing to Motivate Struggling Students to Write

    ERIC Educational Resources Information Center

    Darrington, Brett; Dousay, Tonia

    2014-01-01

    One of the reasons that many secondary students fail English classes is because they are not motivated to write. This literature review was conducted to look into the use of multimodal works to increase the motivation for struggling students to write. Change theory was used to evaluate the benefits of multimodal works compared to more traditional…

  17. Joint sparse representation for robust multimodal biometrics recognition.

    PubMed

    Shekhar, Sumit; Patel, Vishal M; Nasrabadi, Nasser M; Chellappa, Rama

    2014-01-01

    Traditional biometric recognition systems rely on a single biometric signature for authentication. While the advantage of using multiple sources of information for establishing the identity has been widely recognized, computational models for multimodal biometrics recognition have only recently received attention. We propose a multimodal sparse representation method, which represents the test data by a sparse linear combination of training data, while constraining the observations from different modalities of the test subject to share their sparse representations. Thus, we simultaneously take into account correlations as well as coupling information among biometric modalities. A multimodal quality measure is also proposed to weigh each modality as it gets fused. Furthermore, we also kernelize the algorithm to handle nonlinearity in data. The optimization problem is solved using an efficient alternative direction method. Various experiments show that the proposed method compares favorably with competing fusion-based methods.

  18. Osm-Oriented Method of Multimodal Route Planning

    NASA Astrophysics Data System (ADS)

    Li, X.; Wu, Q.; Chen, L.; Xiong, W.; Jing, N.

    2015-07-01

    With the increasing pervasiveness of basic facilitate of transportation and information, the need of multimodal route planning is becoming more essential in the fields of communication and transportation, urban planning, logistics management, etc. This article mainly described an OSM-oriented method of multimodal route planning. Firstly, it introduced how to extract the information we need from OSM data and build proper network model and storage model; then it analysed the accustomed cost standard adopted by most travellers; finally, we used shortest path algorithm to calculate the best route with multiple traffic means.

  19. ITOHealth: a multimodal middleware-oriented integrated architecture for discovering medical entities.

    PubMed

    Alor-Hernández, Giner; Sánchez-Cervantes, José Luis; Juárez-Martínez, Ulises; Posada-Gómez, Rubén; Cortes-Robles, Guillermo; Aguilar-Laserre, Alberto

    2012-03-01

    Emergency healthcare is one of the emerging application domains for information services, which requires highly multimodal information services. The time of consuming pre-hospital emergency process is critical. Therefore, the minimization of required time for providing primary care and consultation to patients is one of the crucial factors when trying to improve the healthcare delivery in emergency situations. In this sense, dynamic location of medical entities is a complex process that needs time and it can be critical when a person requires medical attention. This work presents a multimodal location-based system for locating and assigning medical entities called ITOHealth. ITOHealth provides a multimodal middleware-oriented integrated architecture using a service-oriented architecture in order to provide information of medical entities in mobile devices and web browsers with enriched interfaces providing multimodality support. ITOHealth's multimodality is based on the use of Microsoft Agent Characters, the integration of natural language voice to the characters, and multi-language and multi-characters support providing an advantage for users with visual impairments.

  20. An atlas-based multimodal registration method for 2D images with discrepancy structures.

    PubMed

    Lv, Wenchao; Chen, Houjin; Peng, Yahui; Li, Yanfeng; Li, Jupeng

    2018-06-04

    An atlas-based multimodal registration method for 2-dimension images with discrepancy structures was proposed in this paper. Atlas was utilized for complementing the discrepancy structure information in multimodal medical images. The scheme includes three steps: floating image to atlas registration, atlas to reference image registration, and field-based deformation. To evaluate the performance, a frame model, a brain model, and clinical images were employed in registration experiments. We measured the registration performance by the squared sum of intensity differences. Results indicate that this method is robust and performs better than the direct registration for multimodal images with discrepancy structures. We conclude that the proposed method is suitable for multimodal images with discrepancy structures. Graphical Abstract An Atlas-based multimodal registration method schematic diagram.

  1. A new piezoelectric energy harvesting design concept: multimodal energy harvesting skin.

    PubMed

    Lee, Soobum; Youn, Byeng D

    2011-03-01

    This paper presents an advanced design concept for a piezoelectric energy harvesting (EH), referred to as multimodal EH skin. This EH design facilitates the use of multimodal vibration and enhances power harvesting efficiency. The multimodal EH skin is an extension of our previous work, EH skin, which was an innovative design paradigm for a piezoelectric energy harvester: a vibrating skin structure and an additional thin piezoelectric layer in one device. A computational (finite element) model of the multilayered assembly - the vibrating skin structure and piezoelectric layer - is constructed and the optimal topology and/or shape of the piezoelectric layer is found for maximum power generation from multiple vibration modes. A design rationale for the multimodal EH skin was proposed: designing a piezoelectric material distribution and external resistors. In the material design step, the piezoelectric material is segmented by inflection lines from multiple vibration modes of interests to minimize voltage cancellation. The inflection lines are detected using the voltage phase. In the external resistor design step, the resistor values are found for each segment to maximize power output. The presented design concept, which can be applied to any engineering system with multimodal harmonic-vibrating skins, was applied to two case studies: an aircraft skin and a power transformer panel. The excellent performance of multimodal EH skin was demonstrated, showing larger power generation than EH skin without segmentation or unimodal EH skin.

  2. Multimodal Semiosis in Science Read-Alouds: Extending Beyond Text Delivery

    NASA Astrophysics Data System (ADS)

    Oliveira, Alandeom W.; Rivera, Seema; Glass, Rory; Mastroianni, Michael; Wizner, Francine; Amodeo, Vincent

    2014-10-01

    This study examines elementary teachers reading children's science books aloud to students in the US. Our findings show that science read-aloud semiosis (meaning-making) extends beyond text delivery. In addition to making a written text orally available to students, teachers also deploy different types of gestures (pointing and iconic gesticulation) and pictorial representations (narrative and conceptual) as they scaffold students' understandings. Further, teachers are shown to engage in two distinct forms of meaning-making: multimodal description and multimodal explanation. A conceptual framework is proposed that elementary science educators can use to systematically incorporate multimodality into aloud reading practices.

  3. Increased discriminability of authenticity from multimodal laughter is driven by auditory information.

    PubMed

    Lavan, Nadine; McGettigan, Carolyn

    2017-10-01

    We present an investigation of the perception of authenticity in audiovisual laughter, in which we contrast spontaneous and volitional samples and examine the contributions of unimodal affective information to multimodal percepts. In a pilot study, we demonstrate that listeners perceive spontaneous laughs as more authentic than volitional ones, both in unimodal (audio-only, visual-only) and multimodal contexts (audiovisual). In the main experiment, we show that the discriminability of volitional and spontaneous laughter is enhanced for multimodal laughter. Analyses of relationships between affective ratings and the perception of authenticity show that, while both unimodal percepts significantly predict evaluations of audiovisual laughter, it is auditory affective cues that have the greater influence on multimodal percepts. We discuss differences and potential mismatches in emotion signalling through voices and faces, in the context of spontaneous and volitional behaviour, and highlight issues that should be addressed in future studies of dynamic multimodal emotion processing.

  4. Multimodal Research: Addressing the Complexity of Multimodal Environments and the Challenges for CALL

    ERIC Educational Resources Information Center

    Tan, Sabine; O'Halloran, Kay L.; Wignell, Peter

    2016-01-01

    Multimodality, the study of the interaction of language with other semiotic resources such as images and sound resources, has significant implications for computer assisted language learning (CALL) with regards to understanding the impact of digital environments on language teaching and learning. In this paper, we explore recent manifestations of…

  5. Interactivity in Educational Apps for Young Children: A Multimodal Analysis

    ERIC Educational Resources Information Center

    Blitz-Raith, Alexandra H.; Liu, Jianxin

    2017-01-01

    Interactivity is an important indicator of an educational app's reception. Since most educational apps are multimodal, it justifies a methodological initiative to understand meaningful involvement of multimodality in enacting and even amplifying interactivity in an educational app. Yet research so far has largely concentrated on algorithm…

  6. Applications of Elpasolites as a Multimode Radiation Sensor

    NASA Astrophysics Data System (ADS)

    Guckes, Amber

    This study consists of both computational and experimental investigations. The computational results enabled detector design selections and confirmed experimental results. The experimental results determined that the CLYC scintillation detector can be applied as a functional and field-deployable multimode radiation sensor. The computational study utilized MCNP6 code to investigate the response of CLYC to various incident radiations and to determine the feasibility of its application as a handheld multimode sensor and as a single-scintillator collimated directional detection system. These simulations include: • Characterization of the response of the CLYC scintillator to gamma-rays and neutrons; • Study of the isotopic enrichment of 7Li versus 6Li in the CLYC for optimal detection of both thermal neutrons and fast neutrons; • Analysis of collimator designs to determine the optimal collimator for the single CLYC sensor directional detection system to assay gamma rays and neutrons; Simulations of a handheld CLYC multimode sensor and a single CLYC scintillator collimated directional detection system with the optimized collimator to determine the feasibility of detecting nuclear materials that could be encountered during field operations. These nuclear materials include depleted uranium, natural uranium, low-enriched uranium, highly-enriched uranium, reactor-grade plutonium, and weapons-grade plutonium. The experimental study includes the design, construction, and testing of both a handheld CLYC multimode sensor and a single CLYC scintillator collimated directional detection system. Both were designed in the Inventor CAD software and based on results of the computational study to optimize its performance. The handheld CLYC multimode sensor is modular, scalable, low?power, and optimized for high count rates. Commercial?off?the?shelf components were used where possible in order to optimize size, increase robustness, and minimize cost. The handheld CLYC multimode

  7. Multimodal Imaging of the Normal Eye.

    PubMed

    Kawali, Ankush; Pichi, Francesco; Avadhani, Kavitha; Invernizzi, Alessandro; Hashimoto, Yuki; Mahendradas, Padmamalini

    2017-10-01

    Multimodal imaging is the concept of "bundling" images obtained from various imaging modalities, viz., fundus photograph, fundus autofluorescence imaging, infrared (IR) imaging, simultaneous fluorescein and indocyanine angiography, optical coherence tomography (OCT), and, more recently, OCT angiography. Each modality has its pros and cons as well as its limitations. Combination of multiple imaging techniques will overcome their individual weaknesses and give a comprehensive picture. Such approach helps in accurate localization of a lesion and understanding the pathology in posterior segment. It is important to know imaging of normal eye before one starts evaluating pathology. This article describes multimodal imaging modalities in detail and discusses healthy eye features as seen on various imaging modalities mentioned above.

  8. Multimode-Optical-Fiber Imaging Probe

    NASA Technical Reports Server (NTRS)

    Jackson, Deborah

    1999-01-01

    Currently, endoscopic surgery uses single-mode fiber-bundles to obtain in vivo image information inside the orifices of the body. This limits their use to the larger natural orifices and to surgical procedures where there is plenty of room for manipulation. The knee joint, for example, can be easily viewed with a fiber optic viewer, but joints in the finger cannot. However, there are a host of smaller orifices where fiber endoscopy would play an important role if a cost effective fiber probe were developed with small enough dimensions (less than or equal to 250 microns). Examples of beneficiaries of micro-endoscopes are the treatment of the Eustatian tube of the middle ear, the breast ducts, tear ducts, coronary arteries, fallopian tubes, as well as the treatment of salivary duct parotid disease, and the neuro endoscopy of the ventricles and spinal canal. This work describes an approach for recovering images from tightly confined spaces using multimode. The concept draws upon earlier works that concentrated on image recovery after two-way transmission through a multimode fiber as well as work that demonstrated the recovery of images after one-way transmission through a multimode fiber. Both relied on generating a phase conjugated wavefront, which was predistorted with the characteristics of the fiber. The approach described here also relies on generating a phase conjugated wavefront, but utilizes two fibers to capture the image at some intermediate point (accessible by the fibers, but which is otherwise visually inaccessible).

  9. New Technologies, New Possibilities for the Arts and Multimodality in English Language Arts

    ERIC Educational Resources Information Center

    Williams, Wendy R.

    2014-01-01

    This article discusses the arts, multimodality, and new technologies in English language arts. It then turns to the example of the illuminated text--a multimodal book report consisting of animated text, music, and images--to consider how art, multimodality, and technology can work together to support students' reading of literature and inspire…

  10. Quantitative multimodality imaging in cancer research and therapy.

    PubMed

    Yankeelov, Thomas E; Abramson, Richard G; Quarles, C Chad

    2014-11-01

    Advances in hardware and software have enabled the realization of clinically feasible, quantitative multimodality imaging of tissue pathophysiology. Earlier efforts relating to multimodality imaging of cancer have focused on the integration of anatomical and functional characteristics, such as PET-CT and single-photon emission CT (SPECT-CT), whereas more-recent advances and applications have involved the integration of multiple quantitative, functional measurements (for example, multiple PET tracers, varied MRI contrast mechanisms, and PET-MRI), thereby providing a more-comprehensive characterization of the tumour phenotype. The enormous amount of complementary quantitative data generated by such studies is beginning to offer unique insights into opportunities to optimize care for individual patients. Although important technical optimization and improved biological interpretation of multimodality imaging findings are needed, this approach can already be applied informatively in clinical trials of cancer therapeutics using existing tools. These concepts are discussed herein.

  11. Sharing a Multimodal Corpus to Study Webcam-Mediated Language Teaching

    ERIC Educational Resources Information Center

    Guichon, Nicolas

    2017-01-01

    This article proposes a methodology to create a multimodal corpus that can be shared with a group of researchers in order to analyze synchronous online pedagogical interactions. Epistemological aspects involved in studying online interactions from a multimodal and semiotic perspective are addressed. Then, issues and challenges raised by corpus…

  12. Toward multimodal signal detection of adverse drug reactions.

    PubMed

    Harpaz, Rave; DuMouchel, William; Schuemie, Martijn; Bodenreider, Olivier; Friedman, Carol; Horvitz, Eric; Ripple, Anna; Sorbello, Alfred; White, Ryen W; Winnenburg, Rainer; Shah, Nigam H

    2017-12-01

    Improving mechanisms to detect adverse drug reactions (ADRs) is key to strengthening post-marketing drug safety surveillance. Signal detection is presently unimodal, relying on a single information source. Multimodal signal detection is based on jointly analyzing multiple information sources. Building on, and expanding the work done in prior studies, the aim of the article is to further research on multimodal signal detection, explore its potential benefits, and propose methods for its construction and evaluation. Four data sources are investigated; FDA's adverse event reporting system, insurance claims, the MEDLINE citation database, and the logs of major Web search engines. Published methods are used to generate and combine signals from each data source. Two distinct reference benchmarks corresponding to well-established and recently labeled ADRs respectively are used to evaluate the performance of multimodal signal detection in terms of area under the ROC curve (AUC) and lead-time-to-detection, with the latter relative to labeling revision dates. Limited to our reference benchmarks, multimodal signal detection provides AUC improvements ranging from 0.04 to 0.09 based on a widely used evaluation benchmark, and a comparative added lead-time of 7-22 months relative to labeling revision dates from a time-indexed benchmark. The results support the notion that utilizing and jointly analyzing multiple data sources may lead to improved signal detection. Given certain data and benchmark limitations, the early stage of development, and the complexity of ADRs, it is currently not possible to make definitive statements about the ultimate utility of the concept. Continued development of multimodal signal detection requires a deeper understanding the data sources used, additional benchmarks, and further research on methods to generate and synthesize signals. Copyright © 2017 Elsevier Inc. All rights reserved.

  13. Multimodality bonchoscopic imaging of tracheopathica osteochondroplastica

    NASA Astrophysics Data System (ADS)

    Colt, Henri; Murgu, Septimiu D.; Ahn, Yeh-Chan; Brenner, Matt

    2009-05-01

    Results of a commercial optical coherence tomography system used as part of a multimodality diagnostic bronchoscopy platform are presented for a 61-year-old patient with central airway obstruction from tracheopathica osteochondroplastica. Comparison to results of white-light bronchoscopy, histology, and endobronchial ultrasound examination are accompanied by a discussion of resolution, penetration depth, contrast, and field of view of these imaging modalities. White-light bronchoscopy revealed irregularly shaped, firm submucosal nodules along cartilaginous structures of the anterior and lateral walls of the trachea, sparing the muscular posterior membrane. Endobronchial ultrasound showed a hyperechoic density of 0.4 cm thickness. optical coherence tomography (OCT) was performed using a commercially available, compact time-domain OCT system (Niris System, Imalux Corp., Cleveland, Ohio) with a magnetically actuating probe (two-dimensional, front imaging, and inside actuation). Images showed epithelium, upper submucosa, and osseous submucosal nodule layers corresponding with histopathology. To our knowledge, this is the first time these commercially available systems are used as part of a multimodality bronchoscopy platform to study diagnostic imaging of a benign disease causing central airway obstruction. Further studies are needed to optimize these systems for pulmonary applications and to determine how new-generation imaging modalities will be integrated into a multimodality bronchoscopy platform.

  14. Medical Image Retrieval: A Multimodal Approach

    PubMed Central

    Cao, Yu; Steffey, Shawn; He, Jianbiao; Xiao, Degui; Tao, Cui; Chen, Ping; Müller, Henning

    2014-01-01

    Medical imaging is becoming a vital component of war on cancer. Tremendous amounts of medical image data are captured and recorded in a digital format during cancer care and cancer research. Facing such an unprecedented volume of image data with heterogeneous image modalities, it is necessary to develop effective and efficient content-based medical image retrieval systems for cancer clinical practice and research. While substantial progress has been made in different areas of content-based image retrieval (CBIR) research, direct applications of existing CBIR techniques to the medical images produced unsatisfactory results, because of the unique characteristics of medical images. In this paper, we develop a new multimodal medical image retrieval approach based on the recent advances in the statistical graphic model and deep learning. Specifically, we first investigate a new extended probabilistic Latent Semantic Analysis model to integrate the visual and textual information from medical images to bridge the semantic gap. We then develop a new deep Boltzmann machine-based multimodal learning model to learn the joint density model from multimodal information in order to derive the missing modality. Experimental results with large volume of real-world medical images have shown that our new approach is a promising solution for the next-generation medical imaging indexing and retrieval system. PMID:26309389

  15. Multimodal quantitative phase and fluorescence imaging of cell apoptosis

    NASA Astrophysics Data System (ADS)

    Fu, Xinye; Zuo, Chao; Yan, Hao

    2017-06-01

    Fluorescence microscopy, utilizing fluorescence labeling, has the capability to observe intercellular changes which transmitted and reflected light microscopy techniques cannot resolve. However, the parts without fluorescence labeling are not imaged. Hence, the processes simultaneously happen in these parts cannot be revealed. Meanwhile, fluorescence imaging is 2D imaging where information in the depth is missing. Therefore the information in labeling parts is also not complete. On the other hand, quantitative phase imaging is capable to image cells in 3D in real time through phase calculation. However, its resolution is limited by the optical diffraction and cannot observe intercellular changes below 200 nanometers. In this work, fluorescence imaging and quantitative phase imaging are combined to build a multimodal imaging system. Such system has the capability to simultaneously observe the detailed intercellular phenomenon and 3D cell morphology. In this study the proposed multimodal imaging system is used to observe the cell behavior in the cell apoptosis. The aim is to highlight the limitations of fluorescence microscopy and to point out the advantages of multimodal quantitative phase and fluorescence imaging. The proposed multimodal quantitative phase imaging could be further applied in cell related biomedical research, such as tumor.

  16. Resonance-induced multimodal body-size distributions in ecosystems

    PubMed Central

    Lampert, Adam; Tlusty, Tsvi

    2013-01-01

    The size of an organism reflects its metabolic rate, growth rate, mortality, and other important characteristics; therefore, the distribution of body size is a major determinant of ecosystem structure and function. Body-size distributions often are multimodal, with several peaks of abundant sizes, and previous studies suggest that this is the outcome of niche separation: species from distinct peaks avoid competition by consuming different resources, which results in selection of different sizes in each niche. However, this cannot explain many ecosystems with several peaks competing over the same niche. Here, we suggest an alternative, generic mechanism underlying multimodal size distributions, by showing that the size-dependent tradeoff between reproduction and resource utilization entails an inherent resonance that may induce multiple peaks, all competing over the same niche. Our theory is well fitted to empirical data in various ecosystems, in which both model and measurements show a multimodal, periodically peaked distribution at larger sizes, followed by a smooth tail at smaller sizes. Moreover, we show a universal pattern of size distributions, manifested in the collapse of data from ecosystems of different scales: phytoplankton in a lake, metazoans in a stream, and arthropods in forests. The demonstrated resonance mechanism is generic, suggesting that multimodal distributions of numerous ecological characters emerge from the interplay between local competition and global migration. PMID:23248320

  17. A multimodal image sensor system for identifying water stress in grapevines

    NASA Astrophysics Data System (ADS)

    Zhao, Yong; Zhang, Qin; Li, Minzan; Shao, Yongni; Zhou, Jianfeng; Sun, Hong

    2012-11-01

    Water stress is one of the most common limitations of fruit growth. Water is the most limiting resource for crop growth. In grapevines, as well as in other fruit crops, fruit quality benefits from a certain level of water deficit which facilitates to balance vegetative and reproductive growth and the flow of carbohydrates to reproductive structures. A multi-modal sensor system was designed to measure the reflectance signature of grape plant surfaces and identify different water stress levels in this paper. The multi-modal sensor system was equipped with one 3CCD camera (three channels in R, G, and IR). The multi-modal sensor can capture and analyze grape canopy from its reflectance features, and identify the different water stress levels. This research aims at solving the aforementioned problems. The core technology of this multi-modal sensor system could further be used as a decision support system that combines multi-modal sensory data to improve plant stress detection and identify the causes of stress. The images were taken by multi-modal sensor which could output images in spectral bands of near-infrared, green and red channel. Based on the analysis of the acquired images, color features based on color space and reflectance features based on image process method were calculated. The results showed that these parameters had the potential as water stress indicators. More experiments and analysis are needed to validate the conclusion.

  18. Managing Multimodal Data in Virtual World Research for Language Learning

    ERIC Educational Resources Information Center

    Palomeque, Cristina; Pujolà, Joan-Tomàs

    2018-01-01

    The study of multimodality in communication has attracted the attention of researchers studying online multimodal environments such as virtual worlds. Specifically, 3D virtual worlds have especially attracted the interest of educators and academics due to the multiplicity of verbal channels, which are often comprised of text and voice channels, as…

  19. Multiscale climate emulator of multimodal wave spectra: MUSCLE-spectra

    NASA Astrophysics Data System (ADS)

    Rueda, Ana; Hegermiller, Christie A.; Antolinez, Jose A. A.; Camus, Paula; Vitousek, Sean; Ruggiero, Peter; Barnard, Patrick L.; Erikson, Li H.; Tomás, Antonio; Mendez, Fernando J.

    2017-02-01

    Characterization of multimodal directional wave spectra is important for many offshore and coastal applications, such as marine forecasting, coastal hazard assessment, and design of offshore wave energy farms and coastal structures. However, the multivariate and multiscale nature of wave climate variability makes this complex problem tractable using computationally expensive numerical models. So far, the skill of statistical-downscaling model-based parametric (unimodal) wave conditions is limited in large ocean basins such as the Pacific. The recent availability of long-term directional spectral data from buoys and wave hindcast models allows for development of stochastic models that include multimodal sea-state parameters. This work introduces a statistical downscaling framework based on weather types to predict multimodal wave spectra (e.g., significant wave height, mean wave period, and mean wave direction from different storm systems, including sea and swells) from large-scale atmospheric pressure fields. For each weather type, variables of interest are modeled using the categorical distribution for the sea-state type, the Generalized Extreme Value (GEV) distribution for wave height and wave period, a multivariate Gaussian copula for the interdependence between variables, and a Markov chain model for the chronology of daily weather types. We apply the model to the southern California coast, where local seas and swells from both the Northern and Southern Hemispheres contribute to the multimodal wave spectrum. This work allows attribution of particular extreme multimodal wave events to specific atmospheric conditions, expanding knowledge of time-dependent, climate-driven offshore and coastal sea-state conditions that have a significant influence on local nearshore processes, coastal morphology, and flood hazards.

  20. Multiscale Climate Emulator of Multimodal Wave Spectra: MUSCLE-spectra

    NASA Astrophysics Data System (ADS)

    Rueda, A.; Hegermiller, C.; Alvarez Antolinez, J. A.; Camus, P.; Vitousek, S.; Ruggiero, P.; Barnard, P.; Erikson, L. H.; Tomas, A.; Mendez, F. J.

    2016-12-01

    Characterization of multimodal directional wave spectra is important for many offshore and coastal applications, such as marine forecasting, coastal hazard assessment, and design of offshore wave energy farms and coastal structures. However, the multivariate and multiscale nature of wave climate variability makes this problem complex yet tractable using computationally-expensive numerical models. So far, the skill of statistical-downscaling models based parametric (unimodal) wave conditions is limited in large ocean basins such as the Pacific. The recent availability of long-term directional spectral data from buoys and wave hindcast models allows for development of stochastic models that include multimodal sea-state parameters. This work introduces a statistical-downscaling framework based on weather types to predict multimodal wave spectra (e.g., significant wave height, mean wave period, and mean wave direction from different storm systems, including sea and swells) from large-scale atmospheric pressure fields. For each weather type, variables of interest are modeled using the categorical distribution for the sea-state type, the Generalized Extreme Value (GEV) distribution for wave height and wave period, a multivariate Gaussian copula for the interdependence between variables, and a Markov chain model for the chronology of daily weather types. We apply the model to the Southern California coast, where local seas and swells from both the Northern and Southern Hemispheres contribute to the multimodal wave spectrum. This work allows attribution of particular extreme multimodal wave events to specific atmospheric conditions, expanding knowledge of time-dependent, climate-driven offshore and coastal sea-state conditions that have a significant influence on local nearshore processes, coastal morphology, and flood hazards.

  1. Reliability of Travel Time: Challenges Posed by a Multimodal Transport Participation

    NASA Astrophysics Data System (ADS)

    Wanjek, Monika; Hauger, Georg

    2017-10-01

    Travel time reliability represents an essential component in individual decision making processes for transport participants, particularly regarding mode choices. As criteria that describe the quality of both transportation systems and transportation modes, travel time reliability is already frequently compiled, analysed and quoted as an argument. Currently, travel time reliability is solely mentioned on monomodal trips, while it has remained unconsidered on multimodal transport participation. Given the fact that multimodality gained significantly in importance, it is crucial to discuss how travel time reliability could be determined on multimodal trips. This paper points out the challenges that occur for applying travel time reliability on multimodal transport participation. Therefore, examples will be given within this paper. In order to illustrate theoretical ideas, trips and influencing factors that could be expected within the everyday transport behaviour of commuters in a (sub)urban area will be described.

  2. Multimodality: a basis for augmentative and alternative communication--psycholinguistic, cognitive, and clinical/educational aspects.

    PubMed

    Loncke, Filip T; Campbell, Jamie; England, Amanda M; Haley, Tanya

    2006-02-15

    Message generating is a complex process involving a number of processes, including the selection of modes to use. When expressing a message, human communicators typically use a combination of modes. This phenomenon is often termed multimodality. This article explores the use of models that explain multimodality as an explanatory framework for augmentative and alternative communication (AAC). Multimodality is analysed from a communication, psycholinguistic, and cognitive perspective. Theoretical and applied topics within AAC can be explained or described within the multimodality framework considering iconicity, simultaneous communication, lexical organization, and compatibility of communication modes. Consideration of multimodality is critical to understanding underlying processes in individuals who use AAC and individuals who interact with them.

  3. The Work of Comics Collaborations: Considerations of Multimodal Composition for Writing Scholarship and Pedagogy

    ERIC Educational Resources Information Center

    Scanlon, Molly J.

    2015-01-01

    Though multimodality is increasingly incorporated into our pedagogies and scholarship, explorations of collaborative multimodal composition are lacking. Existing literature on collaborative writing focuses predominately on texts either composed in singular modes or by a single author, neglecting the ways in which multimodal texts are composed…

  4. An integrated GIS-based data model for multimodal urban public transportation analysis and management

    NASA Astrophysics Data System (ADS)

    Chen, Shaopei; Tan, Jianjun; Ray, C.; Claramunt, C.; Sun, Qinqin

    2008-10-01

    Diversity is one of the main characteristics of transportation data collected from multiple sources or formats, which can be extremely complex and disparate. Moreover, these multimodal transportation data are usually characterised by spatial and temporal properties. Multimodal transportation network data modelling involves both an engineering and research domain that has attracted the design of a number of spatio-temporal data models in the geographic information system (GIS). However, the application of these specific models to multimodal transportation network is still a challenging task. This research addresses this challenge from both integrated multimodal data organization and object-oriented modelling perspectives, that is, how a complex urban transportation network should be organized, represented and modeled appropriately when considering a multimodal point of view, and using object-oriented modelling method. We proposed an integrated GIS-based data model for multimodal urban transportation network that lays a foundation to enhance the multimodal transportation network analysis and management. This modelling method organizes and integrates multimodal transit network data, and supports multiple representations for spatio-temporal objects and relationship as both visual and graphic views. The data model is expressed by using a spatio-temporal object-oriented modelling method, i.e., the unified modelling language (UML) extended to spatial and temporal plug-in for visual languages (PVLs), which provides an essential support to the spatio-temporal data modelling for transportation GIS.

  5. Advanced Multimodal Solutions for Information Presentation

    NASA Technical Reports Server (NTRS)

    Wenzel, Elizabeth M.; Godfroy-Cooper, Martine

    2018-01-01

    High-workload, fast-paced, and degraded sensory environments are the likeliest candidates to benefit from multimodal information presentation. For example, during EVA (Extra-Vehicular Activity) and telerobotic operations, the sensory restrictions associated with a space environment provide a major challenge to maintaining the situation awareness (SA) required for safe operations. Multimodal displays hold promise to enhance situation awareness and task performance by utilizing different sensory modalities and maximizing their effectiveness based on appropriate interaction between modalities. During EVA, the visual and auditory channels are likely to be the most utilized with tasks such as monitoring the visual environment, attending visual and auditory displays, and maintaining multichannel auditory communications. Previous studies have shown that compared to unimodal displays (spatial auditory or 2D visual), bimodal presentation of information can improve operator performance during simulated extravehicular activity on planetary surfaces for tasks as diverse as orientation, localization or docking, particularly when the visual environment is degraded or workload is increased. Tactile displays offer a third sensory channel that may both offload information processing effort and provide a means to capture attention when urgently required. For example, recent studies suggest that including tactile cues may result in increased orientation and alerting accuracy, improved task response time and decreased workload, as well as provide self-orientation cues in microgravity on the ISS (International Space Station). An important overall issue is that context-dependent factors like task complexity, sensory degradation, peripersonal vs. extrapersonal space operations, workload, experience level, and operator fatigue tend to vary greatly in complex real-world environments and it will be difficult to design a multimodal interface that performs well under all conditions. As a

  6. Remixing My Life: The Multimodal Literacy Memoir Assignment and STEM

    ERIC Educational Resources Information Center

    Pytash, Kristine E.; Kist, William; Testa, Elizabeth

    2017-01-01

    The authors explore the experiences and multimodal compositions of a student at a STEM (science, technology, engineering, and mathematics) high school who opted to take an elective course on multimodal autobiography. They document how her meaning making included her beliefs and perspectives about the world, as well as a finely developed aesthetic…

  7. The Effects of Multimodality through Storytelling Using Various Movie Clips

    ERIC Educational Resources Information Center

    Kim, SoHee

    2016-01-01

    This study examines the salient multimodal approaches for communicative competence and learners' reactions through storytelling tasks with three different modes: a silent movie clip, a movie clip with only sound effects, and a movie clip with sound effects and dialogue. In order to measure different multimodal effects and to define better delivery…

  8. A Multimodal Search Engine for Medical Imaging Studies.

    PubMed

    Pinho, Eduardo; Godinho, Tiago; Valente, Frederico; Costa, Carlos

    2017-02-01

    The use of digital medical imaging systems in healthcare institutions has increased significantly, and the large amounts of data in these systems have led to the conception of powerful support tools: recent studies on content-based image retrieval (CBIR) and multimodal information retrieval in the field hold great potential in decision support, as well as for addressing multiple challenges in healthcare systems, such as computer-aided diagnosis (CAD). However, the subject is still under heavy research, and very few solutions have become part of Picture Archiving and Communication Systems (PACS) in hospitals and clinics. This paper proposes an extensible platform for multimodal medical image retrieval, integrated in an open-source PACS software with profile-based CBIR capabilities. In this article, we detail a technical approach to the problem by describing its main architecture and each sub-component, as well as the available web interfaces and the multimodal query techniques applied. Finally, we assess our implementation of the engine with computational performance benchmarks.

  9. Students' Multimodal Construction of the Work-Energy Concept

    NASA Astrophysics Data System (ADS)

    Tang, Kok-Sing; Chee Tan, Seng; Yeo, Jennifer

    2011-09-01

    This article examines the role of multimodalities in representing the concept of work-energy by studying the collaborative discourse of a group of ninth-grade physics students engaging in an inquiry-based instruction. Theorising a scientific concept as a network of meaning relationships across semiotic modalities situated in human activity, this article analyses the students' interactions through their use of natural language, mathematical symbolism, depiction, and gestures, and examines the intertextual meanings made through the integration of these modalities. Results indicate that the thematic integration of multimodalities is both difficult and necessary for students in order to construct a scientific understanding that is congruent with the physics curriculum. More significantly, the difficulties in multimodal integration stem from the subtle differences in the categorical, quantitative, and spatial meanings of the work-energy concept whose contrasts are often not made explicit to the students. The implications of these analyses and findings for science teaching and educational research are discussed.

  10. Sensei: A Multi-Modal Framework for Assessing Stress Resiliency

    DTIC Science & Technology

    2013-04-30

    DATE MAY2013 2. REPORT TYPE 4. TITLE AND SUBTITLE Sensei: A Multi-Modal Framework for Assessing Stress Resiliency 6. AUTHOR(S) 7. PERFORMING...Report: Distribution A Page 1 of 3 SRI International (Sarnoff) Document Sensei: A Multi-Modal Framework for Assessing Stress Resiliency (April... Stress Markers in Real-Time in Lab Environment with graded exposure to ICT’s scenarios MAC 1-6 During this reporting period, we established

  11. Optical sensor in planar configuration based on multimode interference

    NASA Astrophysics Data System (ADS)

    Blahut, Marek

    2017-08-01

    In the paper a numerical analysis of optical sensors based on multimode interference in planar one-dimensional step-index configuration is presented. The structure consists in single-mode input and output waveguides and multimode waveguide which guide only few modes. Material parameters discussed refer to a SU8 polymer waveguide on SiO2 substrate. The optical system described will be designed to the analysis of biological substances.

  12. Multimode-Optical-Fiber Imaging Probe

    NASA Technical Reports Server (NTRS)

    Jackson, Deborah

    2000-01-01

    Currently, endoscopic surgery uses single-mode fiber-bundles to obtain in vivo image information inside orifices of the body. This limits their use to the larger natural bodily orifices and to surgical procedures where there is plenty of room for manipulation. The knee joint, for example can be easily viewed with a fiber optic viewer, but joints in the finger cannot. However, there are a host of smaller orifices where fiber endoscopy would play an important role if a cost effective fiber probe were developed with small enough dimensions (< 250 microns). Examples of beneficiaries of micro-endoscopes are the treatment of the Eustatian tube of the middle ear, the breast ducts, tear ducts, coronary arteries, fallopian tubes, as well as the treatment of salivary duct parotid disease, and the neuro endoscopy of the ventricles and spinal canal. To solve this problem, this work describes an approach for recovering images from. tightly confined spaces using multimode fibers and analytically demonstrates that the concept is sound. The proof of concept draws upon earlier works that concentrated on image recovery after two-way transmission through a multimode fiber as well as work that demonstrated the recovery of images after one-way transmission through a multimode fiber. Both relied on generating a phase conjugated wavefront which was predistorted with the characteristics of the fiber. The described approach also relies on generating a phase conjugated wavefront, but utilizes two fibers to capture the image at some intermediate point (accessible by the fibers, but which is otherwise visually unaccessible).

  13. Mid-infrared supercontinuum generation in multimode step index chalcogenide fiber

    NASA Astrophysics Data System (ADS)

    Ben Khalifa, Ameni; Ben Salem, Amine; Cherif, Rim; Zghal, Mourad

    2016-09-01

    In this paper, we propose a design of a high numerical aperture multimode hybrid step-index fiber for mid-infrared (mid- IR) supercontinuum generation (SCG) where two chalcogenide glass compositions As40Se60 and Ge10As23.4Se66.6 for the core and the cladding are selected, respectively. Aiming to get accurate modeling of the SCG by the fundamental mode, we solve the multimode generalized nonlinear Schrödinger equations and demonstrate nonlinear coupling and energy transfer between high order modes. The proposed study points out the impact of nonlinear mode coupling that should be taken into account in order to successfully predict the mid-infrared supercontinuum generation in highly nonlinear multimode fibers.

  14. Investigation of protein selectivity in multimodal chromatography using in silico designed Fab fragment variants.

    PubMed

    Karkov, Hanne Sophie; Krogh, Berit Olsen; Woo, James; Parimal, Siddharth; Ahmadian, Haleh; Cramer, Steven M

    2015-11-01

    In this study, a unique set of antibody Fab fragments was designed in silico and produced to examine the relationship between protein surface properties and selectivity in multimodal chromatographic systems. We hypothesized that multimodal ligands containing both hydrophobic and charged moieties would interact strongly with protein surface regions where charged groups and hydrophobic patches were in close spatial proximity. Protein surface property characterization tools were employed to identify the potential multimodal ligand binding regions on the Fab fragment of a humanized antibody and to evaluate the impact of mutations on surface charge and hydrophobicity. Twenty Fab variants were generated by site-directed mutagenesis, recombinant expression, and affinity purification. Column gradient experiments were carried out with the Fab variants in multimodal, cation-exchange, and hydrophobic interaction chromatographic systems. The results clearly indicated that selectivity in the multimodal system was different from the other chromatographic modes examined. Column retention data for the reduced charge Fab variants identified a binding site comprising light chain CDR1 as the main electrostatic interaction site for the multimodal and cation-exchange ligands. Furthermore, the multimodal ligand binding was enhanced by additional hydrophobic contributions as evident from the results obtained with hydrophobic Fab variants. The use of in silico protein surface property analyses combined with molecular biology techniques, protein expression, and chromatographic evaluations represents a previously undescribed and powerful approach for investigating multimodal selectivity with complex biomolecules. © 2015 Wiley Periodicals, Inc.

  15. Multimodal Neuroimaging in Schizophrenia: Description and Dissemination.

    PubMed

    Aine, C J; Bockholt, H J; Bustillo, J R; Cañive, J M; Caprihan, A; Gasparovic, C; Hanlon, F M; Houck, J M; Jung, R E; Lauriello, J; Liu, J; Mayer, A R; Perrone-Bizzozero, N I; Posse, S; Stephen, J M; Turner, J A; Clark, V P; Calhoun, Vince D

    2017-10-01

    In this paper we describe an open-access collection of multimodal neuroimaging data in schizophrenia for release to the community. Data were acquired from approximately 100 patients with schizophrenia and 100 age-matched controls during rest as well as several task activation paradigms targeting a hierarchy of cognitive constructs. Neuroimaging data include structural MRI, functional MRI, diffusion MRI, MR spectroscopic imaging, and magnetoencephalography. For three of the hypothesis-driven projects, task activation paradigms were acquired on subsets of ~200 volunteers which examined a range of sensory and cognitive processes (e.g., auditory sensory gating, auditory/visual multisensory integration, visual transverse patterning). Neuropsychological data were also acquired and genetic material via saliva samples were collected from most of the participants and have been typed for both genome-wide polymorphism data as well as genome-wide methylation data. Some results are also presented from the individual studies as well as from our data-driven multimodal analyses (e.g., multimodal examinations of network structure and network dynamics and multitask fMRI data analysis across projects). All data will be released through the Mind Research Network's collaborative informatics and neuroimaging suite (COINS).

  16. Quantum key distribution over an installed multimode optical fiber local area network.

    PubMed

    Namekata, Naoto; Mori, Shigehiko; Inoue, Shuichiro

    2005-12-12

    We have investigated the possibility of a multimode fiber link for a quantum channel. Transmission of light in an extremely underfilled mode distribution promises a single-mode-like behavior in the multimode fiber. To demonstrate the performance of the fiber link we performed quantum key distribution, on the basis of the BB84 four-state protocol, over 550 m of an installed multimode optical fiber local area network, and the quantum-bit-error rate of 1.09 percent was achieved.

  17. Multimodality Image Fusion-Guided Procedures: Technique, Accuracy, and Applications

    DOE Office of Scientific and Technical Information (OSTI.GOV)

    Abi-Jaoudeh, Nadine, E-mail: naj@mail.nih.gov; Kruecker, Jochen, E-mail: jochen.kruecker@philips.com; Kadoury, Samuel, E-mail: samuel.kadoury@polymtl.ca

    2012-10-15

    Personalized therapies play an increasingly critical role in cancer care: Image guidance with multimodality image fusion facilitates the targeting of specific tissue for tissue characterization and plays a role in drug discovery and optimization of tailored therapies. Positron-emission tomography (PET), magnetic resonance imaging (MRI), and contrast-enhanced computed tomography (CT) may offer additional information not otherwise available to the operator during minimally invasive image-guided procedures, such as biopsy and ablation. With use of multimodality image fusion for image-guided interventions, navigation with advanced modalities does not require the physical presence of the PET, MRI, or CT imaging system. Several commercially available methodsmore » of image-fusion and device navigation are reviewed along with an explanation of common tracking hardware and software. An overview of current clinical applications for multimodality navigation is provided.« less

  18. Field evaluation of a wearable multimodal soldier navigation system.

    PubMed

    Aaltonen, Iina; Laarni, Jari

    2017-09-01

    Challenging environments pose difficulties for terrain navigation, and therefore wearable and multimodal navigation systems have been proposed to overcome these difficulties. Few such navigation systems, however, have been evaluated in field conditions. We evaluated how a multimodal system can aid in navigating in a forest in the context of a military exercise. The system included a head-mounted display, headphones, and a tactile vibrating vest. Visual, auditory, and tactile modalities were tested and evaluated using unimodal, bimodal, and trimodal conditions. Questionnaires, interviews and observations were used to evaluate the advantages and disadvantages of each modality and their multimodal use. The guidance was considered easy to interpret and helpful in navigation. Simplicity of the displayed information was required, which was partially conflicting with the request for having both distance and directional information available. Copyright © 2017 Elsevier Ltd. All rights reserved.

  19. Seeing Academically Marginalized Students' Multimodal Designs from a Position of Strength

    ERIC Educational Resources Information Center

    Anderson, Kate T.; Stewart, Olivia G.; Kachorsky, Dani

    2017-01-01

    This article examines multimodal texts created by a cohort of academically marginalized secondary school students in Singapore as part of a language arts unit on persuasive composition. Using an interpretivist qualitative approach, we examine students' multimodal designs to highlight opportunities taken up for expanding literacy practices…

  20. Adaptive wavefront shaping for controlling nonlinear multimode interactions in optical fibres

    NASA Astrophysics Data System (ADS)

    Tzang, Omer; Caravaca-Aguirre, Antonio M.; Wagner, Kelvin; Piestun, Rafael

    2018-06-01

    Recent progress in wavefront shaping has enabled control of light propagation inside linear media to focus and image through scattering objects. In particular, light propagation in multimode fibres comprises complex intermodal interactions and rich spatiotemporal dynamics. Control of physical phenomena in multimode fibres and its applications are in their infancy, opening opportunities to take advantage of complex nonlinear modal dynamics. Here, we demonstrate a wavefront shaping approach for controlling nonlinear phenomena in multimode fibres. Using a spatial light modulator at the fibre input, real-time spectral feedback and a genetic algorithm optimization, we control a highly nonlinear multimode stimulated Raman scattering cascade and its interplay with four-wave mixing via a flexible implicit control on the superposition of modes coupled into the fibre. We show versatile spectrum manipulations including shifts, suppression, and enhancement of Stokes and anti-Stokes peaks. These demonstrations illustrate the power of wavefront shaping to control and optimize nonlinear wave propagation.

  1. The Effects of Multimodal Mobile Communications on Cooperative Team Interactions Executing Distributed Tasks

    DTIC Science & Technology

    2013-07-01

    AFRL-RH-WP-TP-2013-0046 The Effects of Multimodal Mobile Communications on Cooperative Team Interactions Executing Distributed Tasks Gregory...3. DATES COVERED (From - To) 31-07-13 Interim 01 August 2011 – 01 August 2013 4. TITLE AND SUBTITLE The Effects of Multimodal Mobile... multimodal communication capabilities can con- tribute to the effectiveness and efficiency of real-time, task outcome and per- formance. In this paper, we

  2. Semiconductor laser using multimode interference principle

    NASA Astrophysics Data System (ADS)

    Gong, Zisu; Yin, Rui; Ji, Wei; Wu, Chonghao

    2018-01-01

    Multimode interference (MMI) structure is introduced in semiconductor laser used in optical communication system to realize higher power and better temperature tolerance. Using beam propagation method (BPM), Multimode interference laser diode (MMI-LD) is designed and fabricated in InGaAsP/InP based material. As a comparison, conventional semiconductor laser using straight single-mode waveguide is also fabricated in the same wafer. With a low injection current (about 230 mA), the output power of the implemented MMI-LD is up to 2.296 mW which is about four times higher than the output power of the conventional semiconductor laser. The implemented MMI-LD exhibits stable output operating at the wavelength of 1.52 μm and better temperature tolerance when the temperature varies from 283.15 K to 293.15 K.

  3. Large-scale evaluation of multimodal biometric authentication using state-of-the-art systems.

    PubMed

    Snelick, Robert; Uludag, Umut; Mink, Alan; Indovina, Michael; Jain, Anil

    2005-03-01

    We examine the performance of multimodal biometric authentication systems using state-of-the-art Commercial Off-the-Shelf (COTS) fingerprint and face biometric systems on a population approaching 1,000 individuals. The majority of prior studies of multimodal biometrics have been limited to relatively low accuracy non-COTS systems and populations of a few hundred users. Our work is the first to demonstrate that multimodal fingerprint and face biometric systems can achieve significant accuracy gains over either biometric alone, even when using highly accurate COTS systems on a relatively large-scale population. In addition to examining well-known multimodal methods, we introduce new methods of normalization and fusion that further improve the accuracy.

  4. Multimodality Therapy and Liver Transplantation for Hepatocellular Carcinoma: A 14-Year Prospective Analysis of Outcomes

    PubMed Central

    Ramanathan, Rajesh; Sharma, Amit; Lee, David D; Behnke, Martha; Bornstein, Karen; Stravitz, R Todd; Sydnor, Malcolm; Fulcher, Ann; Cotterell, Adrian; Posner, Marc P; Fisher, Robert A

    2014-01-01

    Background Hepatocellular carcinoma is a major cause of death among patients with cirrhosis. A standardized approach of multimodality therapy with intent-to-treat by transplantation for all patients with hepatocellular carcinoma was instituted at our transplant center in 1997. Data were prospectively collected to evaluate the impact of multimodality therapy on post-transplant patient survival, tumor recurrence and patient survival without transplantation. Methods All patients with hepatocellular carcinoma were eligible for multimodality therapy. Multimodality therapy consisted of hepatic resection, radiofrequency ablation, transarterial chemoembolization, transarterial chemoinfusion, yttrium-90 microsphere radioembolization and sorafenib. Results 715 patients underwent multimodality therapy. 231 patients were included in the intent-to-treat with transplantation arm and 484 patients were treated with multimodality therapy or palliative therapy due to contraindications for transplantation. A 60.2% transplantation rate was achieved in the intent-to-treat with transplantation arm. Post-transplant survivals at 1- and 5-years were 97.1% and 72.5% respectively. Tumor recurrence rates at 1-, 3- and 5-years were 2.4%, 6.2% and 11.6% respectively. Patients with contraindications to transplant had increased 1- and 5-year survival from diagnosis with multimodality therapy compared to those not treated (73.1% and 46.5% vs. 15.5% and 4.4%, p<0.0001). Conclusions Using multimodality therapy prior to liver transplantation for hepatocellular carcinoma achieved low recurrence rates and post-transplant survival equivalent to patients with primary liver disease without hepatocellular carcinoma. Multimodality therapy may help identify patients with less active tumor biology and result in improved disease-free survival and organ utilization. PMID:24503764

  5. Driver Education for New Multimodal Facilities

    DOT National Transportation Integrated Search

    2016-05-24

    Local and state transportation agencies are redesigning roads to accommodate multimodal travel, including the addition of new configurations, infrastructures, and rules that may be unfamiliar to current drivers and other road users. Education and out...

  6. Multimodal transmission property in a liquid-filled photonic crystal fiber

    NASA Astrophysics Data System (ADS)

    Lin, Wei; Miao, Yinping; Song, Binbin; Zhang, Hao; Liu, Bo; Liu, Yange; Yan, Donglin

    2015-02-01

    The multimode interference (MMI) effect in a liquid-filled photonic crystal fiber (PCF) has been experimentally demonstrated by fully infiltrating the air-hole cladding of a solid-core PCF with the refractive index (RI) matching liquid whose RI is close to the silica background. Due to the weak mode confinement capability of the cladding region, several high-order modes are excited to establish the multimode interference effect. The multimode interferometer shows a good temperature tunability of 12.30 nm/K, which makes it a good candidate for a highly tunable optical filtering as well as temperature sensing applications. Furthermore, this MMI effect would have great promise in various applications such as highly sensitive multi-parameter sensing, tunable optically filtering, and surface-enhanced Raman scattering.

  7. An Emergent Bilingual Child's Multimodal Choices in Sociodramatic Play

    ERIC Educational Resources Information Center

    Bengochea, Alain; Sembiante, Sabrina F.; Gort, Mileidis

    2018-01-01

    In this case study, situated in a preschool classroom within an early childhood Spanish/English dual language programme, we examine how an emergent bilingual child engages with multimodal resources to participate in sociodramatic play discourses. Guided by sociocultural and critical discourse perspectives on multimodality, we analysed ways in…

  8. Multimodal Composing in Classrooms: Learning and Teaching for the Digital World

    ERIC Educational Resources Information Center

    Miller, Suzanne M., Ed.; McVee, Mary B., Ed.

    2012-01-01

    Taking a close look at multimodal composing as an essential new literacy in schools, this volume draws from contextualized case studies across educational contexts to provide detailed portraits of teachers and students at work in classrooms. Authors elaborate key issues in transforming classrooms with student multimodal composing, including…

  9. Multimodal hyperspectral optical microscopy

    DOE PAGES

    Novikova, Irina V.; Smallwood, Chuck R.; Gong, Yu; ...

    2017-09-02

    We describe a unique and convenient approach to multimodal hyperspectral optical microscopy, herein achieved by coupling a portable and transferable hyperspectral imager to various optical microscopes. The experimental and data analysis schemes involved in recording spectrally and spatially resolved fluorescence, dark field, and optical absorption micrographs are illustrated through prototypical measurements targeting selected model systems. Namely, hyperspectral fluorescence micrographs of isolated fluorescent beads are employed to ensure spectral calibration of our detector and to gauge the attainable spatial resolution of our measurements; the recorded images are diffraction-limited. Moreover, spatially over-sampled absorption spectroscopy of a single lipid (18:1 Liss Rhod PE)more » layer reveals that optical densities on the order of 10-3 may be resolved by spatially averaging the recorded optical signatures. We also briefly illustrate two applications of our setup in the general areas of plasmonics and cell biology. Most notably, we deploy hyperspectral optical absorption microscopy to identify and image algal pigments within a single live Tisochrysis lutea cell. Overall, this work paves the way for multimodal multidimensional spectral imaging measurements spanning the realms of several scientific disciples.« less

  10. Multimodal hyperspectral optical microscopy

    DOE Office of Scientific and Technical Information (OSTI.GOV)

    Novikova, Irina V.; Smallwood, Chuck R.; Gong, Yu

    We describe a unique and convenient approach to multimodal hyperspectral optical microscopy, herein achieved by coupling a portable and transferable hyperspectral imager to various optical microscopes. The experimental and data analysis schemes involved in recording spectrally and spatially resolved fluorescence, dark field, and optical absorption micrographs are illustrated through prototypical measurements targeting selected model systems. Namely, hyperspectral fluorescence micrographs of isolated fluorescent beads are employed to ensure spectral calibration of our detector and to gauge the attainable spatial resolution of our measurements; the recorded images are diffraction-limited. Moreover, spatially over-sampled absorption spectroscopy of a single lipid (18:1 Liss Rhod PE)more » layer reveals that optical densities on the order of 10-3 may be resolved by spatially averaging the recorded optical signatures. We also briefly illustrate two applications of our setup in the general areas of plasmonics and cell biology. Most notably, we deploy hyperspectral optical absorption microscopy to identify and image algal pigments within a single live Tisochrysis lutea cell. Overall, this work paves the way for multimodal multidimensional spectral imaging measurements spanning the realms of several scientific disciples.« less

  11. Multimodality as a Sociolinguistic Resource

    ERIC Educational Resources Information Center

    Collister, Lauren Brittany

    2013-01-01

    This work explores the use of multimodal communication in a community of expert "World of Warcraft"® players and its impact on politeness, identity, and relationships. Players in the community regularly communicated using three linguistic modes quasi-simultaneously: text chat, voice chat, and face-to-face interaction. Using the…

  12. Multimode-singlemode-multimode optical fiber sensor coated with novolac resin for detecting liquid phase alcohol

    NASA Astrophysics Data System (ADS)

    Marfu'ah, Amalia, Niza Rosyda; Hatta, Agus Muhamad; Pratama, Detak Yan

    2018-04-01

    Alcohol sensor based on multimode-singlemode-multimode (MSM) optical fiber with novolac resin as the external medium is proposed and demonstrated experimentally. Novolac resin swells when it is exposed by the alcohol. This effect causes a change in the polymer density leading to the refractive index's variation. The transmission light of the sensor depends on the refractive index of external medium. Based on the results, alcohol sensor based on MSM optical fiber structure using novolac resin has a higher sensitivity compared to the sensor without using novolac resin in the mixture of alcohol and distilled water. Alcohol sensor based on MSM optical fiber structure using novolac resin in the mixture of alcohol and distilled water with a singlemode fiber length of 5 mm has a sensitivity of 0.028972 dBm per % V/V, and in the mixture of alcohol and sugar solution of 10% w/w has a sensitivity of 0.005005 dBm per % V/V.

  13. Wind- and Rain-Induced Vibrations Impose Different Selection Pressures on Multimodal Signaling.

    PubMed

    Halfwerk, Wouter; Ryan, Michael J; Wilson, Preston S

    2016-09-01

    The world is a noisy place, and animals have evolved a myriad of strategies to communicate in it. Animal communication signals are, however, often multimodal; their components can be processed by multiple sensory systems, and noise can thus affect signal components across different modalities. We studied the effect of environmental noise on multimodal communication in the túngara frog (Physalaemus pustulosus). Males communicate with rivals using airborne sounds combined with call-induced water ripples. We tested males under control as well as noisy conditions in which we mimicked rain- and wind-induced vibrations on the water surface. Males responded more strongly to a multimodal playback in which sound and ripples were combined, compared to a unimodal sound-only playback, but only in the absence of rain and wind. Under windy conditions, males decreased their response to the multimodal playback, suggesting that wind noise interferes with the detection of rival ripples. Under rainy conditions, males increased their response, irrespective of signal playback, suggesting that different noise sources can have different impacts on communication. Our findings show that noise in an additional sensory channel can affect multimodal signal perception and thereby drive signal evolution, but not always in the expected direction.

  14. Multimode intravascular RF coil for MRI-guided interventions.

    PubMed

    Kurpad, Krishna N; Unal, Orhan

    2011-04-01

    To demonstrate the feasibility of using a single intravascular radiofrequency (RF) probe connected to the external magnetic resonance imaging (MRI) system via a single coaxial cable to perform active tip tracking and catheter visualization and high signal-to-noise ratio (SNR) intravascular imaging. A multimode intravascular RF coil was constructed on a 6F balloon catheter and interfaced to a 1.5T MRI scanner via a decoupling circuit. Bench measurements of coil impedances were followed by imaging experiments in saline and phantoms. The multimode coil behaves as an inductively coupled transmit coil. The forward-looking capability of 6 mm was measured. A greater than 3-fold increase in SNR compared to conventional imaging using optimized external coil was demonstrated. Simultaneous active tip tracking and catheter visualization was demonstrated. It is feasible to perform 1) active tip tracking, 2) catheter visualization, and 3) high SNR imaging using a single multimode intravascular RF coil that is connected to the external system via a single coaxial cable. Copyright © 2011 Wiley-Liss, Inc.

  15. High-resolution multimodal clinical multiphoton tomography of skin

    NASA Astrophysics Data System (ADS)

    König, Karsten

    2011-03-01

    This review focuses on multimodal multiphoton tomography based on near infrared femtosecond lasers. Clinical multiphoton tomographs for 3D high-resolution in vivo imaging have been placed into the market several years ago. The second generation of this Prism-Award winning High-Tech skin imaging tool (MPTflex) was introduced in 2010. The same year, the world's first clinical CARS studies have been performed with a hybrid multimodal multiphoton tomograph. In particular, non-fluorescent lipids and water as well as mitochondrial fluorescent NAD(P)H, fluorescent elastin, keratin, and melanin as well as SHG-active collagen has been imaged with submicron resolution in patients suffering from psoriasis. Further multimodal approaches include the combination of multiphoton tomographs with low-resolution wide-field systems such as ultrasound, optoacoustical, OCT, and dermoscopy systems. Multiphoton tomographs are currently employed in Australia, Japan, the US, and in several European countries for early diagnosis of skin cancer, optimization of treatment strategies, and cosmetic research including long-term testing of sunscreen nanoparticles as well as anti-aging products.

  16. Study on multimodal transport route under low carbon background

    NASA Astrophysics Data System (ADS)

    Liu, Lele; Liu, Jie

    2018-06-01

    Low-carbon environmental protection is the focus of attention around the world, scientists are constantly researching on production of carbon emissions and living carbon emissions. However, there is little literature about multimodal transportation based on carbon emission at home and abroad. Firstly, this paper introduces the theory of multimodal transportation, the multimodal transport models that didn't consider carbon emissions and consider carbon emissions are analyzed. On this basis, a multi-objective programming 0-1 programming model with minimum total transportation cost and minimum total carbon emission is proposed. The idea of weight is applied to Ideal point method for solving problem, multi-objective programming is transformed into a single objective function. The optimal solution of carbon emission to transportation cost under different weights is determined by a single objective function with variable weights. Based on the model and algorithm, an example is given and the results are analyzed.

  17. Modelling multimodal expression of emotion in a virtual agent.

    PubMed

    Pelachaud, Catherine

    2009-12-12

    Over the past few years we have been developing an expressive embodied conversational agent system. In particular, we have developed a model of multimodal behaviours that includes dynamism and complex facial expressions. The first feature refers to the qualitative execution of behaviours. Our model is based on perceptual studies and encompasses several parameters that modulate multimodal behaviours. The second feature, the model of complex expressions, follows a componential approach where a new expression is obtained by combining facial areas of other expressions. Lately we have been working on adding temporal dynamism to expressions. So far they have been designed statically, typically at their apex. Only full-blown expressions could be modelled. To overcome this limitation, we have defined a representation scheme that describes the temporal evolution of the expression of an emotion. It is no longer represented by a static definition but by a temporally ordered sequence of multimodal signals.

  18. Teachers' Integration of Multimodality into Classroom Practices for English Language Learners

    ERIC Educational Resources Information Center

    Choi, Jayoung; Yi, Youngjoo

    2016-01-01

    Despite the proven benefits of multimodal teaching and learning (i.e., through visual, sound, movement, print-based text, and technology) for students, little is known about how teachers of English language learners (ELLs) integrate multimodality into their existing curriculums. In this study, the authors examined how two teachers who had limited…

  19. Fock expansion of multimode pure Gaussian states

    DOE Office of Scientific and Technical Information (OSTI.GOV)

    Cariolaro, Gianfranco; Pierobon, Gianfranco, E-mail: gianfranco.pierobon@unipd.it

    2015-12-15

    The Fock expansion of multimode pure Gaussian states is derived starting from their representation as displaced and squeezed multimode vacuum states. The approach is new and appears to be simpler and more general than previous ones starting from the phase-space representation given by the characteristic or Wigner function. Fock expansion is performed in terms of easily evaluable two-variable Hermite–Kampé de Fériet polynomials. A relatively simple and compact expression for the joint statistical distribution of the photon numbers in the different modes is obtained. In particular, this result enables one to give a simple characterization of separable and entangled states, asmore » shown for two-mode and three-mode Gaussian states.« less

  20. Multi-Modal Treatment of Nocturnal Enuresis.

    ERIC Educational Resources Information Center

    Mohr, Caroline; Sharpley, Christopher F.

    1988-01-01

    The article reports a multimodal treatment of nocturnal enuresis and anxious behavior in a mildly mentally retarded woman. Behavioral treatment and removal of caffeine from the subject's diet eliminated both nocturnal enuresis and anxious behavior. (Author/DB)

  1. Multimodal solutions for large scale evacuations.

    DOT National Transportation Integrated Search

    2009-12-30

    In this research, a multimodal transportation model was developed attending the needs of emergency situations, : and the solutions provided by the model could be used to moderate congestion during such events. : The model incorporated features such a...

  2. Extrinsic Embryonic Sensory Stimulation Alters Multimodal Behavior and Cellular Activation

    PubMed Central

    Markham, Rebecca G.; Shimizu, Toru; Lickliter, Robert

    2009-01-01

    Embryonic vision is generated and maintained by spontaneous neuronal activation patterns, yet extrinsic stimulation also sculpts sensory development. Because the sensory and motor systems are interconnected in embryogenesis, how extrinsic sensory activation guides multimodal differentiation is an important topic. Further, it is unknown whether extrinsic stimulation experienced near sensory sensitivity onset contributes to persistent brain changes, ultimately affecting postnatal behavior. To determine the effects of extrinsic stimulation on multimodal development, we delivered auditory stimulation to bobwhite quail groups during early, middle, or late embryogenesis, and then tested postnatal behavioral responsiveness to auditory or visual cues. Auditory preference tendencies were more consistently toward the conspecific stimulus for animals stimulated during late embryogenesis. Groups stimulated during middle or late embryogenesis showed altered postnatal species-typical visual responsiveness, demonstrating a persistent multimodal effect. We also examined whether auditory-related brain regions are receptive to extrinsic input during middle embryogenesis by measuring postnatal cellular activation. Stimulated birds showed a greater number of ZENK-immunopositive cells per unit volume of brain tissue in deep optic tectum, a midbrain region strongly implicated in multimodal function. We observed similar results in the medial and caudomedial nidopallia in the telencephalon. There were no ZENK differences between groups in inferior colliculus or in caudolateral nidopallium, avian analog to prefrontal cortex. To our knowledge, these are the first results linking extrinsic stimulation delivered so early in embryogenesis to changes in postnatal multimodal behavior and cellular activation. The potential role of competitive interactions between the sensory and motor systems is discussed. PMID:18777564

  3. On the effects of multimodal information integration in multitasking.

    PubMed

    Stock, Ann-Kathrin; Gohil, Krutika; Huster, René J; Beste, Christian

    2017-07-07

    There have recently been considerable advances in our understanding of the neuronal mechanisms underlying multitasking, but the role of multimodal integration for this faculty has remained rather unclear. We examined this issue by comparing different modality combinations in a multitasking (stop-change) paradigm. In-depth neurophysiological analyses of event-related potentials (ERPs) were conducted to complement the obtained behavioral data. Specifically, we applied signal decomposition using second order blind identification (SOBI) to the multi-subject ERP data and source localization. We found that both general multimodal information integration and modality-specific aspects (potentially related to task difficulty) modulate behavioral performance and associated neurophysiological correlates. Simultaneous multimodal input generally increased early attentional processing of visual stimuli (i.e. P1 and N1 amplitudes) as well as measures of cognitive effort and conflict (i.e. central P3 amplitudes). Yet, tactile-visual input caused larger impairments in multitasking than audio-visual input. General aspects of multimodal information integration modulated the activity in the premotor cortex (BA 6) as well as different visual association areas concerned with the integration of visual information with input from other modalities (BA 19, BA 21, BA 37). On top of this, differences in the specific combination of modalities also affected performance and measures of conflict/effort originating in prefrontal regions (BA 6).

  4. Multimodal Representations: A Fifth-Grade Teacher Influences Students' Design and Production

    ERIC Educational Resources Information Center

    Shanahan, Lynn E.

    2013-01-01

    The purpose of this interpretive case study is to explore--through a close analysis of one fifth-grade class project--teacher's scaffolding and students' use of visual and linguistic modes when composing multimodally. Using Kress and van Leeuwen's multimodal theory of communication as a framework, this case study examines why teachers, whose…

  5. Multimodal Solutions for Large Scale Evacuation

    DOT National Transportation Integrated Search

    2009-12-30

    In this research, a multimodal transportation model was developed attending the needs of emergency situations, and the solutions provided by the model could be used to moderate congestion during such events. The model incorporated features such as la...

  6. In Situ Study on the Evolution of Multimodal Particle Size Distributions of ZnO Quantum Dots: Some General Rules for the Occurrence of Multimodalities.

    PubMed

    Schindler, Torben; Walter, Johannes; Peukert, Wolfgang; Segets, Doris; Unruh, Tobias

    2015-12-10

    Properties of small semiconductor nanoparticles (NPs) are strongly governed by their size. Precise characterization is a key requirement for tailored dispersities and thus for high-quality devices. Results of a careful analysis of particle size distributions (PSDs) of ZnO are presented combining advantages of UV/vis absorption spectroscopy, analytical ultracentrifugation, and small-angle X-ray scattering (SAXS). Our study reveals that careful cross-validation of these different methods is mandatory to end up with reliable resolution. PSDs of ZnO NPs are multimodal on a size range of 2-8 nm, a finding that is not yet sufficiently addressed. In the second part of our work the evolution of PSDs was studied using in situ SAXS. General principles for the appearance of multimodalities covering a temperature range between 15 and 45 °C were found which are solely determined by the aging state indicated by the size of the medium-sized fraction. Whenever this fraction exceeds a critical diameter, a new multimodality is identified, independent of the particular time-temperature combination. A fraction of larger particles aggregates first before a fraction of smaller particles is detected. Fixed multimodalities have not yet been addressed adequately and could only be evidenced due to careful size analysis.

  7. Connection Analysis of Different Modes in Multimodal Transport

    NASA Astrophysics Data System (ADS)

    Zhao, Zhi; Lu, Ya Ya; Liu, Xing Hua; Jiang, Ying; Zhang, Yan Zhou

    2018-06-01

    As the most advanced way of transport organization, container multimodal transport provides high quality and efficient systematic logistics transportation services in a wide range of freight transport activities. So it has been widely promoted worldwide. China is in a period of sustained and rapid economic development, which needs greater support from logistics, while the rationalization of multimodal transport enables the best transport area of each transportation mode to be reflected. This paper makes an analysis of the connection between united transportation of railway and highway, rail and water transport and untied transportation of highway and water.

  8. Effect of external index of refraction on multimode fiber couplers.

    PubMed

    Wang, G Z; Murphy, K A; Claus, R O

    1995-12-20

    The dependence of the performance of fused-taper multimode fiber couplers on the refractive index of the material surrounding the taper region has been investigated both theoretically and experimentally. It has been identified that for a 2 × 2 multimode fiber coupler there is a range of output-power-coupling ratios for which the effect of the external refractive index is negligible. When the coupler is tapered beyond this region, the performance becomes dependent on the external index of refraction and lossy. To analyze the multimode coupler-loss mechanism, we develop a two-dimensional ray-optics model that incorporates trapped cladding-mode loss and core-mode loss through frustrated total internal reflection.

    Computer-simulation results support the experimental observations. Related issues such as coupler fabrication and packaging are also discussed.

  9. Multimodal Feature Integration in the Angular Gyrus during Episodic and Semantic Retrieval

    PubMed Central

    Bonnici, Heidi M.; Richter, Franziska R.; Yazar, Yasemin

    2016-01-01

    Much evidence from distinct lines of investigation indicates the involvement of angular gyrus (AnG) in the retrieval of both episodic and semantic information, but the region's precise function and whether that function differs across episodic and semantic retrieval have yet to be determined. We used univariate and multivariate fMRI analysis methods to examine the role of AnG in multimodal feature integration during episodic and semantic retrieval. Human participants completed episodic and semantic memory tasks involving unimodal (auditory or visual) and multimodal (audio-visual) stimuli. Univariate analyses revealed the recruitment of functionally distinct AnG subregions during the retrieval of episodic and semantic information. Consistent with a role in multimodal feature integration during episodic retrieval, significantly greater AnG activity was observed during retrieval of integrated multimodal episodic memories compared with unimodal episodic memories. Multivariate classification analyses revealed that individual multimodal episodic memories could be differentiated in AnG, with classification accuracy tracking the vividness of participants' reported recollections, whereas distinct unimodal memories were represented in sensory association areas only. In contrast to episodic retrieval, AnG was engaged to a statistically equivalent degree during retrieval of unimodal and multimodal semantic memories, suggesting a distinct role for AnG during semantic retrieval. Modality-specific sensory association areas exhibited corresponding activity during both episodic and semantic retrieval, which mirrored the functional specialization of these regions during perception. The results offer new insights into the integrative processes subserved by AnG and its contribution to our subjective experience of remembering. SIGNIFICANCE STATEMENT Using univariate and multivariate fMRI analyses, we provide evidence that functionally distinct subregions of angular gyrus (An

  10. Developing single-laser sources for multimodal coherent anti-Stokes Raman scattering microscopy

    NASA Astrophysics Data System (ADS)

    Pegoraro, Adrian Frank

    Coherent anti-Stokes Raman scattering (CARS) microscopy has developed rapidly and is opening the door to new types of experiments. This work describes the development of new laser sources for CARS microscopy and their use for different applications. It is specifically focused on multimodal nonlinear optical microscopy—the simultaneous combination of different imaging techniques. This allows us to address a diverse range of applications, such as the study of biomaterials, fluid inclusions, atherosclerosis, hepatitis C infection in cells, and ice formation in cells. For these applications new laser sources are developed that allow for practical multimodal imaging. For example, it is shown that using a single Ti:sapphire oscillator with a photonic crystal fiber, it is possible to develop a versatile multimodal imaging system using optimally chirped laser pulses. This system can perform simultaneous two photon excited fluorescence, second harmonic generation, and CARS microscopy. The versatility of the system is further demonstrated by showing that it is possible to probe different Raman modes using CARS microscopy simply by changing a time delay between the excitation beams. Using optimally chirped pulses also enables further simplification of the laser system required by using a single fiber laser combined with nonlinear optical fibers to perform effective multimodal imaging. While these sources are useful for practical multimodal imaging, it is believed that for further improvements in CARS microscopy sensitivity, new excitation schemes are necessary. This has led to the design of a new, high power, extended cavity oscillator that should be capable of implementing new excitation schemes for CARS microscopy as well as other techniques. Our interest in multimodal imaging has led us to other areas of research as well. For example, a fiber-coupling scheme for signal collection in the forward direction is demonstrated that allows for fluorescence lifetime imaging

  11. Multimodal Feature Integration in the Angular Gyrus during Episodic and Semantic Retrieval.

    PubMed

    Bonnici, Heidi M; Richter, Franziska R; Yazar, Yasemin; Simons, Jon S

    2016-05-18

    Much evidence from distinct lines of investigation indicates the involvement of angular gyrus (AnG) in the retrieval of both episodic and semantic information, but the region's precise function and whether that function differs across episodic and semantic retrieval have yet to be determined. We used univariate and multivariate fMRI analysis methods to examine the role of AnG in multimodal feature integration during episodic and semantic retrieval. Human participants completed episodic and semantic memory tasks involving unimodal (auditory or visual) and multimodal (audio-visual) stimuli. Univariate analyses revealed the recruitment of functionally distinct AnG subregions during the retrieval of episodic and semantic information. Consistent with a role in multimodal feature integration during episodic retrieval, significantly greater AnG activity was observed during retrieval of integrated multimodal episodic memories compared with unimodal episodic memories. Multivariate classification analyses revealed that individual multimodal episodic memories could be differentiated in AnG, with classification accuracy tracking the vividness of participants' reported recollections, whereas distinct unimodal memories were represented in sensory association areas only. In contrast to episodic retrieval, AnG was engaged to a statistically equivalent degree during retrieval of unimodal and multimodal semantic memories, suggesting a distinct role for AnG during semantic retrieval. Modality-specific sensory association areas exhibited corresponding activity during both episodic and semantic retrieval, which mirrored the functional specialization of these regions during perception. The results offer new insights into the integrative processes subserved by AnG and its contribution to our subjective experience of remembering. Using univariate and multivariate fMRI analyses, we provide evidence that functionally distinct subregions of angular gyrus (AnG) contribute to the retrieval of

  12. Collaboration of Miniature Multi-Modal Mobile Smart Robots over a Network

    DTIC Science & Technology

    2015-08-14

    theoretical research on mathematics of failures in sensor-network-based miniature multimodal mobile robots and electromechanical systems. The views...theoretical research on mathematics of failures in sensor-network-based miniature multimodal mobile robots and electromechanical systems. The...independently evolving research directions based on physics-based models of mechanical, electromechanical and electronic devices, operational constraints

  13. Multi-mode Intravascular RF Coil for MRI-guided Interventions

    PubMed Central

    Kurpad, Krishna N.; Unal, Orhan

    2011-01-01

    Purpose To demonstrate the feasibility of using a single intravascular RF probe connected to the external MRI system via a single coaxial cable to perform active tip tracking and catheter visualization, and high SNR intravascular imaging. Materials and Methods A multi-mode intravascular RF coil was constructed on a 6F balloon catheter and interfaced to a 1.5T MRI scanner via a decoupling circuit. Bench measurements of coil impedances were followed by imaging experiments in saline and phantoms. Results The multi-mode coil behaves as an inductively-coupled transmit coil. Forward looking capability of 6mm is measured. Greater than 3-fold increase in SNR compared to conventional imaging using optimized external coil is demonstrated. Simultaneous active tip tracking and catheter visualization is demonstrated. Conclusions It is feasible to perform 1) active tip tracking, 2) catheter visualization, and 3) high SNR imaging using a single multi-mode intravascular RF coil that is connected to the external system via a single coaxial cable. PMID:21448969

  14. Fluorescence Imaging Topography Scanning System for intraoperative multimodal imaging

    PubMed Central

    Quang, Tri T.; Kim, Hye-Yeong; Bao, Forrest Sheng; Papay, Francis A.; Edwards, W. Barry; Liu, Yang

    2017-01-01

    Fluorescence imaging is a powerful technique with diverse applications in intraoperative settings. Visualization of three dimensional (3D) structures and depth assessment of lesions, however, are oftentimes limited in planar fluorescence imaging systems. In this study, a novel Fluorescence Imaging Topography Scanning (FITS) system has been developed, which offers color reflectance imaging, fluorescence imaging and surface topography scanning capabilities. The system is compact and portable, and thus suitable for deployment in the operating room without disturbing the surgical flow. For system performance, parameters including near infrared fluorescence detection limit, contrast transfer functions and topography depth resolution were characterized. The developed system was tested in chicken tissues ex vivo with simulated tumors for intraoperative imaging. We subsequently conducted in vivo multimodal imaging of sentinel lymph nodes in mice using FITS and PET/CT. The PET/CT/optical multimodal images were co-registered and conveniently presented to users to guide surgeries. Our results show that the developed system can facilitate multimodal intraoperative imaging. PMID:28437441

  15. Cross mode modulation in multimode fibers.

    PubMed

    Kroushkov, Dimitar I; Rademacher, Georg; Petermann, Klaus

    2013-05-15

    We show that Kerr nonlinearity induced intermodal power transfer in a particular mode group of a multimode fiber can be formulated by the same type of equation used to describe the effect of cross polarization modulation in single-mode fibers.

  16. A Multimodal Approach to Counselor Supervision.

    ERIC Educational Resources Information Center

    Ponterotto, Joseph G.; Zander, Toni A.

    1984-01-01

    Represents an initial effort to apply Lazarus's multimodal approach to a model of counselor supervision. Includes continuously monitoring the trainee's behavior, affect, sensations, images, cognitions, interpersonal functioning, and when appropriate, biological functioning (diet and drugs) in the supervisory process. (LLL)

  17. 2016 SmartWay Multimodal Carrier Tool Demonstration

    EPA Pesticide Factsheets

    This EPA presentation provides information on the SmartWay Transport Partnership Multimodal Tool; carrier categories, emission metrics, performance reports, completing the tool, data collection and usage, and the 2016 schedule.

  18. [Principles of fast track surgery. Multimodal perioperative therapy programme].

    PubMed

    Kehlet, H

    2009-08-01

    Recent evidence has documented that a combination of single-modality evidence-based care principles into a multimodal effort to enhance postoperative recovery (the fast track methodology) has led to enhanced recovery with reduced medical morbidity, need for hospitalisation and convalescence. Nevertheless, general implementation of fast track surgery has been relatively slow despite concomitant economic benefits. Further improvement in postoperative outcome may be obtained by developments within each care principle with a specific focus on minimally invasive surgery, effective multimodal, non-opioid analgesia and pharmacological stress reduction.

  19. Drusen Characterization with Multimodal Imaging

    PubMed Central

    Spaide, Richard F.; Curcio, Christine A.

    2010-01-01

    Summary Multimodal imaging findings and histological demonstration of soft drusen, cuticular drusen, and subretinal drusenoid deposits provided information used to develop a model explaining their imaging characteristics. Purpose To characterize the known appearance of cuticular drusen, subretinal drusenoid deposits (reticular pseudodrusen), and soft drusen as revealed by multimodal fundus imaging; to create an explanatory model that accounts for these observations. Methods Reported color, fluorescein angiographic, autofluorescence, and spectral domain optical coherence tomography (SD-OCT) images of patients with cuticular drusen, soft drusen, and subretinal drusenoid deposits were reviewed, as were actual images from affected eyes. Representative histological sections were examined. The geometry, location, and imaging characteristics of these lesions were evaluated. A hypothesis based on the Beer-Lambert Law of light absorption was generated to fit these observations. Results Cuticular drusen appear as numerous uniform round yellow-white punctate accumulations under the retinal pigment epithelium (RPE). Soft drusen are larger yellow-white dome-shaped mounds of deposit under the RPE. Subretinal drusenoid deposits are polymorphous light-grey interconnected accumulations above the RPE. Based on the model, both cuticular and soft drusen appear yellow due to the removal of shorter wavelength light by a double pass through the RPE. Subretinal drusenoid deposits, which are located on the RPE, are not subjected to short wavelength attenuation and therefore are more prominent when viewed with blue light. The location and morphology of extracellular material in relationship to the RPE, and associated changes to RPE morphology and pigmentation, appeared to be primary determinants of druse appearance in different imaging modalities. Conclusion Although cuticular drusen, subretinal drusenoid deposits, and soft drusen are composed of common components, they are distinguishable

  20. Adhesion of multimode adhesives to enamel and dentin after one year of water storage.

    PubMed

    Vermelho, Paulo Moreira; Reis, André Figueiredo; Ambrosano, Glaucia Maria Bovi; Giannini, Marcelo

    2017-06-01

    This study aimed to evaluate the ultramorphological characteristics of tooth-resin interfaces and the bond strength (BS) of multimode adhesive systems to enamel and dentin. Multimode adhesives (Scotchbond Universal (SBU) and All-Bond Universal) were tested in both self-etch and etch-and-rinse modes and compared to control groups (Optibond FL and Clearfil SE Bond (CSB)). Adhesives were applied to human molars and composite blocks were incrementally built up. Teeth were sectioned to obtain specimens for microtensile BS and TEM analysis. Specimens were tested after storage for either 24 h or 1 year. SEM analyses were performed to classify the failure pattern of beam specimens after BS testing. Etching increased the enamel BS of multimode adhesives; however, BS decreased after storage for 1 year. No significant differences in dentin BS were noted between multimode and control in either evaluation period. Storage for 1 year only reduced the dentin BS for SBU in self-etch mode. TEM analysis identified hybridization and interaction zones in dentin and enamel for all adhesives. Silver impregnation was detected on dentin-resin interfaces after storage of specimens for 1 year only with the SBU and CSB. Storage for 1 year reduced enamel BS when adhesives are applied on etched surface; however, BS of multimode adhesives did not differ from those of the control group. In dentin, no significant difference was noted between the multimode and control group adhesives, regardless of etching mode. In general, multimode adhesives showed similar behavior when compared to traditional adhesive techniques. Multimode adhesives are one-step self-etching adhesives that can also be used after enamel/dentin phosphoric acid etching, but each product may work better in specific conditions.

  1. Landmark Image Retrieval by Jointing Feature Refinement and Multimodal Classifier Learning.

    PubMed

    Zhang, Xiaoming; Wang, Senzhang; Li, Zhoujun; Ma, Shuai; Xiaoming Zhang; Senzhang Wang; Zhoujun Li; Shuai Ma; Ma, Shuai; Zhang, Xiaoming; Wang, Senzhang; Li, Zhoujun

    2018-06-01

    Landmark retrieval is to return a set of images with their landmarks similar to those of the query images. Existing studies on landmark retrieval focus on exploiting the geometries of landmarks for visual similarity matches. However, the visual content of social images is of large diversity in many landmarks, and also some images share common patterns over different landmarks. On the other side, it has been observed that social images usually contain multimodal contents, i.e., visual content and text tags, and each landmark has the unique characteristic of both visual content and text content. Therefore, the approaches based on similarity matching may not be effective in this environment. In this paper, we investigate whether the geographical correlation among the visual content and the text content could be exploited for landmark retrieval. In particular, we propose an effective multimodal landmark classification paradigm to leverage the multimodal contents of social image for landmark retrieval, which integrates feature refinement and landmark classifier with multimodal contents by a joint model. The geo-tagged images are automatically labeled for classifier learning. Visual features are refined based on low rank matrix recovery, and multimodal classification combined with group sparse is learned from the automatically labeled images. Finally, candidate images are ranked by combining classification result and semantic consistence measuring between the visual content and text content. Experiments on real-world datasets demonstrate the superiority of the proposed approach as compared to existing methods.

  2. Good Student/Bad Student: Situated Identities in the Figured Worlds of School and Creative Multimodal Production

    ERIC Educational Resources Information Center

    Jocius, Robin

    2017-01-01

    This study situates young adolescents' multimodal composing practices within two figured worlds--school and creative multimodal production. In a microanalysis of two focal students' multimodal processes and products, I trace how pedagogical, interactional, and semiotic resources both reified and challenged students' developing identities as…

  3. Volume curtaining: a focus+context effect for multimodal volume visualization

    NASA Astrophysics Data System (ADS)

    Fairfield, Adam J.; Plasencia, Jonathan; Jang, Yun; Theodore, Nicholas; Crawford, Neil R.; Frakes, David H.; Maciejewski, Ross

    2014-03-01

    In surgical preparation, physicians will often utilize multimodal imaging scans to capture complementary information to improve diagnosis and to drive patient-specific treatment. These imaging scans may consist of data from magnetic resonance imaging (MR), computed tomography (CT), or other various sources. The challenge in using these different modalities is that the physician must mentally map the two modalities together during the diagnosis and planning phase. Furthermore, the different imaging modalities will be generated at various resolutions as well as slightly different orientations due to patient placement during scans. In this work, we present an interactive system for multimodal data fusion, analysis and visualization. Developed with partners from neurological clinics, this work discusses initial system requirements and physician feedback at the various stages of component development. Finally, we present a novel focus+context technique for the interactive exploration of coregistered multi-modal data.

  4. Counseling Mexican Americans: A Multimodal Approach.

    ERIC Educational Resources Information Center

    Ponterotto, Joseph G.

    1987-01-01

    Describes a culturally sensitive and relevant therapeutic framework for nonminority and minority counselors working with clients of Mexican-American heritage. Uses Lazarus's multimodal approach as the basis. Examines the current status of Mexican-American mental health service delivery and use. (Author/ABB)

  5. A simultaneous multimodal imaging system for tissue functional parameters

    NASA Astrophysics Data System (ADS)

    Ren, Wenqi; Zhang, Zhiwu; Wu, Qiang; Zhang, Shiwu; Xu, Ronald

    2014-02-01

    Simultaneous and quantitative assessment of skin functional characteristics in different modalities will facilitate diagnosis and therapy in many clinical applications such as wound healing. However, many existing clinical practices and multimodal imaging systems are subjective, qualitative, sequential for multimodal data collection, and need co-registration between different modalities. To overcome these limitations, we developed a multimodal imaging system for quantitative, non-invasive, and simultaneous imaging of cutaneous tissue oxygenation and blood perfusion parameters. The imaging system integrated multispectral and laser speckle imaging technologies into one experimental setup. A Labview interface was developed for equipment control, synchronization, and image acquisition. Advanced algorithms based on a wide gap second derivative reflectometry and laser speckle contrast analysis (LASCA) were developed for accurate reconstruction of tissue oxygenation and blood perfusion respectively. Quantitative calibration experiments and a new style of skinsimulating phantom were designed to verify the accuracy and reliability of the imaging system. The experimental results were compared with a Moor tissue oxygenation and perfusion monitor. For In vivo testing, a post-occlusion reactive hyperemia (PORH) procedure in human subject and an ongoing wound healing monitoring experiment using dorsal skinfold chamber models were conducted to validate the usability of our system for dynamic detection of oxygenation and perfusion parameters. In this study, we have not only setup an advanced multimodal imaging system for cutaneous tissue oxygenation and perfusion parameters but also elucidated its potential for wound healing assessment in clinical practice.

  6. Multimodal medical information retrieval with unsupervised rank fusion.

    PubMed

    Mourão, André; Martins, Flávio; Magalhães, João

    2015-01-01

    Modern medical information retrieval systems are paramount to manage the insurmountable quantities of clinical data. These systems empower health care experts in the diagnosis of patients and play an important role in the clinical decision process. However, the ever-growing heterogeneous information generated in medical environments poses several challenges for retrieval systems. We propose a medical information retrieval system with support for multimodal medical case-based retrieval. The system supports medical information discovery by providing multimodal search, through a novel data fusion algorithm, and term suggestions from a medical thesaurus. Our search system compared favorably to other systems in 2013 ImageCLEFMedical. Copyright © 2014 Elsevier Ltd. All rights reserved.

  7. [A multimodal and multidisciplinary postoperative pain management concept].

    PubMed

    Ettrich, U; Seifert, J; Scharnagel, R; Günther, K P

    2007-06-01

    Under-treatment of acute postoperative pain can lead to chronic pain with neuronal plasticity and result in poor surgical outcomes. A multimodal approach is therefore necessary to reduce postoperative pain by combining various analgesics with a non-pharmacological strategy. The current use of multimodal approaches, even for the management of postoperative pain, can reduce the side effects of pharmaceutical therapy alone as well as reducing the length of hospital stay. Adequate pain control is an important prerequisite for the application of rehabilitation programmes and will thereby influence functional outcome. In addition, patient satisfaction, as a major benchmarking factor after surgical treatment, is significantly influenced by the quality of postoperative pain management.

  8. 2017 SmartWay Multimodal Carrier Tool Demonstration

    EPA Pesticide Factsheets

    This EPA presentation provides information on the SmartWay Multimodal Carrier Tool: its background and development, participation in the program, application process, emission metrics, tool demonstration, data collection, and schedule for 2017.

  9. Multimodal Teacher Input and Science Learning in a Middle School Sheltered Classroom

    ERIC Educational Resources Information Center

    Zhang, Ying

    2016-01-01

    This article reports the results of an ethnographic research about the multimodal science discourse in a sixth-grade sheltered classroom involving English Language Learners (ELLs) only. Drawing from the perspective of multimodality, this study examines how science learning is constructed in science lectures through multiple semiotic resources,…

  10. An Investigation on the Role of Multimodal Metaphors in e-Feedback Interfaces

    ERIC Educational Resources Information Center

    Rigas, Dimitrios; Alharbi, Abdulrhman

    2011-01-01

    Purpose: The purpose of this paper is to investigate the usability (effectiveness, efficiency and user satisfaction) of e-feedback interfaces. The experiment compares a traditional visual approach with a multimodal approach in order to determine the impact of multimodal metaphors upon the user's understanding, reasoning and engagement with the…

  11. Readings and Experiences of Multimodality

    ERIC Educational Resources Information Center

    Leander, Kevin M.; Aziz, Seemi; Botzakis, Stergios; Ehret, Christian; Landry, David; Rowsell, Jennifer

    2017-01-01

    Our understanding of reading--including reading multimodal texts--is always constrained or opened up by what we consider to be a text, what aspects of a reader's embodied activity we focus on, and how we draw a boundary around a reading event. This article brings together five literacy researchers who respond to a human-scale graphic novel,…

  12. Supervised learning based multimodal MRI brain tumour segmentation using texture features from supervoxels.

    PubMed

    Soltaninejad, Mohammadreza; Yang, Guang; Lambrou, Tryphon; Allinson, Nigel; Jones, Timothy L; Barrick, Thomas R; Howe, Franklyn A; Ye, Xujiong

    2018-04-01

    Accurate segmentation of brain tumour in magnetic resonance images (MRI) is a difficult task due to various tumour types. Using information and features from multimodal MRI including structural MRI and isotropic (p) and anisotropic (q) components derived from the diffusion tensor imaging (DTI) may result in a more accurate analysis of brain images. We propose a novel 3D supervoxel based learning method for segmentation of tumour in multimodal MRI brain images (conventional MRI and DTI). Supervoxels are generated using the information across the multimodal MRI dataset. For each supervoxel, a variety of features including histograms of texton descriptor, calculated using a set of Gabor filters with different sizes and orientations, and first order intensity statistical features are extracted. Those features are fed into a random forests (RF) classifier to classify each supervoxel into tumour core, oedema or healthy brain tissue. The method is evaluated on two datasets: 1) Our clinical dataset: 11 multimodal images of patients and 2) BRATS 2013 clinical dataset: 30 multimodal images. For our clinical dataset, the average detection sensitivity of tumour (including tumour core and oedema) using multimodal MRI is 86% with balanced error rate (BER) 7%; while the Dice score for automatic tumour segmentation against ground truth is 0.84. The corresponding results of the BRATS 2013 dataset are 96%, 2% and 0.89, respectively. The method demonstrates promising results in the segmentation of brain tumour. Adding features from multimodal MRI images can largely increase the segmentation accuracy. The method provides a close match to expert delineation across all tumour grades, leading to a faster and more reproducible method of brain tumour detection and delineation to aid patient management. Copyright © 2018 Elsevier B.V. All rights reserved.

  13. State deadbeat response and observability in multi-modal systems

    NASA Technical Reports Server (NTRS)

    Conner, L. T., Jr.; Stanford, D. P.

    1984-01-01

    Two aspects of multimodal systems are examined. It is shown that any completely controllable system with state dimension n not exceeding three allows a choice of feedback matrices resulting in a state deadbeat response. Some of the results presented here are valid for arbitrary n, and it is suggested that for all n the state deadbeat response can be obtained under the hypothesis of complete controllability. The controllability canonical form for a multimodal system is refined by introducing a notion of observability which is dual to controllability for these systems.

  14. Interaction between visual and chemical cues in a Liolaemus lizard: a multimodal approach.

    PubMed

    Vicente, Natalin S; Halloy, Monique

    2017-12-01

    Multimodal communication involves the use of signals and cues across two or more sensory modalities. The genus Liolaemus (Iguania: Liolaemidae) offers a great potential for studies on the ecology and evolution of multimodal communication, including visual and chemical signals. In this study, we analyzed the response of male and female Liolaemus pacha to chemical, visual and combined (multimodal) stimuli. Using cue-isolation tests, we registered the number of tongue flicks and headbob displays from exposure to signals in each modality. Number of tongue flicks was greater when a chemical stimulus was presented alone than in the presence of visual or multimodal stimuli. In contrast, headbob displays were fewer in number with visual and chemical stimuli alone, but significantly higher in number when combined. Female signallers triggered significantly more tongue flicks than male signallers, suggesting that chemical cues are involved in sexual recognition. We did not find an inhibition between chemical and visual cues. On the contrary, we observed a dominance of the chemical modality, because when presented with visual stimuli, lizards also responded with more tongue flicks than headbob displays. The total response produced by multimodal stimuli was similar to that of the chemical stimuli alone, possibly suggesting non-redundancy. We discuss whether the visual component of a multimodal signal could attract attention at a distance, increasing the effectiveness of transmission and reception of the information in chemical cues. Copyright © 2017 Elsevier GmbH. All rights reserved.

  15. THE ALCOHOL CONSUMPTION IS AMENDED AFTER BARIATRIC SURGERY? AN INTEGRATIVE REVIEW.

    PubMed

    Gregorio, Valeria Duarte; Lucchese, Roselma; Vera, Ivânia; Silva, Graciele C; Silva, Andrecia; Moraes, Rayrane Clarah Chaveiro

    Bariatric surgery has been an alternative when conservative methods of weight loss fail. Patients undergoing bariatric surgery have an increased risk of up to 6.5% of problems related to alcohol. Integrative review out to analyze the change of alcohol consumption in this public. Database was accessed from June of 2015 to January of 2016 by searching "bariatric surgery" AND "alcoholism", and their Portuguese equivalents. ScienceDirect, PubMed, Lilacs and Medline, besides manual search, were searched. To be included, the paper should have been published between 2005-2016 and related to bariatric surgery and alcoholism. Theses, dissertations, unpublished papers, case reports and theoretical studies were excluded, and a database was subsequently composed. In 2005 there was only a review of change in alcohol metabolism in patients undergoing bariatric surgery. There were no publications in 2006. In 2007, only one study was published, and it did not meet the inclusion criteria. In 2010, there was an increase of 13% in publications and of 20% in 2012, reaching 40% in 2013. The prevalence and incidence of alcohol consumption in relation to the postoperative time was six months to three years with higher incidence for follow-up treatment by men. Roux-en-Y gastric bypass showed greater association with increased consumption of alcohol during the postoperative period. Alcohol consumption proved to be essential to be faced in bariatric surgery. A cirurgia bariátrica tem-se mostrado alternativa para o insucesso dos métodos conservadores de emagrecimento. Pacientes submetidos a ela têm 6,5% aumento do risco de terem problemas relacionados ao álcool. Realizar revisão integrativa para verificar alteração do consumo de álcool neste publico. A base de dados Science Direct, PubMed, Lilacs, Medline e busca manual foram acessadas entre os meses de junho de 2015 a janeiro de 2016 com os descritores "cirurgia bariátrica" e "alcoolismo" e equivalentes em inglês Os critérios de

  16. Tunable all-fiber dissipative-soliton laser with a multimode interference filter.

    PubMed

    Zhang, Lei; Hu, Jinmeng; Wang, Jianhua; Feng, Yan

    2012-09-15

    We report on a tunable all-fiber dissipative-soliton laser with a multimode interference filter that consists of a multimode fiber spliced between two single-mode fibers. By carefully selecting the fiber parameters, a filter with a central wavelength at 1032 nm and a bandwidth of 7.6 nm is constructed and used for spectral filtering in an all-normal-dispersion mode-locked ytterbium-doped fiber laser based on nonlinear polarization evolution. The laser delivers 31 mW of average output power with positively chirped 7 ps pulses. The repetition rate of the pulses is 15.3 MHz, and pulse energy is 2.1 nJ. Tunable dissipative-soliton over 12 nm is achieved by applying tension to the single-mode-multimode-single-mode filter.

  17. Palmprint and Face Multi-Modal Biometric Recognition Based on SDA-GSVD and Its Kernelization

    PubMed Central

    Jing, Xiao-Yuan; Li, Sheng; Li, Wen-Qian; Yao, Yong-Fang; Lan, Chao; Lu, Jia-Sen; Yang, Jing-Yu

    2012-01-01

    When extracting discriminative features from multimodal data, current methods rarely concern themselves with the data distribution. In this paper, we present an assumption that is consistent with the viewpoint of discrimination, that is, a person's overall biometric data should be regarded as one class in the input space, and his different biometric data can form different Gaussians distributions, i.e., different subclasses. Hence, we propose a novel multimodal feature extraction and recognition approach based on subclass discriminant analysis (SDA). Specifically, one person's different bio-data are treated as different subclasses of one class, and a transformed space is calculated, where the difference among subclasses belonging to different persons is maximized, and the difference within each subclass is minimized. Then, the obtained multimodal features are used for classification. Two solutions are presented to overcome the singularity problem encountered in calculation, which are using PCA preprocessing, and employing the generalized singular value decomposition (GSVD) technique, respectively. Further, we provide nonlinear extensions of SDA based multimodal feature extraction, that is, the feature fusion based on KPCA-SDA and KSDA-GSVD. In KPCA-SDA, we first apply Kernel PCA on each single modal before performing SDA. While in KSDA-GSVD, we directly perform Kernel SDA to fuse multimodal data by applying GSVD to avoid the singular problem. For simplicity two typical types of biometric data are considered in this paper, i.e., palmprint data and face data. Compared with several representative multimodal biometrics recognition methods, experimental results show that our approaches outperform related multimodal recognition methods and KSDA-GSVD achieves the best recognition performance. PMID:22778600

  18. Palmprint and face multi-modal biometric recognition based on SDA-GSVD and its kernelization.

    PubMed

    Jing, Xiao-Yuan; Li, Sheng; Li, Wen-Qian; Yao, Yong-Fang; Lan, Chao; Lu, Jia-Sen; Yang, Jing-Yu

    2012-01-01

    When extracting discriminative features from multimodal data, current methods rarely concern themselves with the data distribution. In this paper, we present an assumption that is consistent with the viewpoint of discrimination, that is, a person's overall biometric data should be regarded as one class in the input space, and his different biometric data can form different Gaussians distributions, i.e., different subclasses. Hence, we propose a novel multimodal feature extraction and recognition approach based on subclass discriminant analysis (SDA). Specifically, one person's different bio-data are treated as different subclasses of one class, and a transformed space is calculated, where the difference among subclasses belonging to different persons is maximized, and the difference within each subclass is minimized. Then, the obtained multimodal features are used for classification. Two solutions are presented to overcome the singularity problem encountered in calculation, which are using PCA preprocessing, and employing the generalized singular value decomposition (GSVD) technique, respectively. Further, we provide nonlinear extensions of SDA based multimodal feature extraction, that is, the feature fusion based on KPCA-SDA and KSDA-GSVD. In KPCA-SDA, we first apply Kernel PCA on each single modal before performing SDA. While in KSDA-GSVD, we directly perform Kernel SDA to fuse multimodal data by applying GSVD to avoid the singular problem. For simplicity two typical types of biometric data are considered in this paper, i.e., palmprint data and face data. Compared with several representative multimodal biometrics recognition methods, experimental results show that our approaches outperform related multimodal recognition methods and KSDA-GSVD achieves the best recognition performance.

  19. Multimodal fusion of brain imaging data: A key to finding the missing link(s) in complex mental illness.

    PubMed

    Calhoun, Vince D; Sui, Jing

    2016-05-01

    It is becoming increasingly clear that combining multi-modal brain imaging data is able to provide more information for individual subjects by exploiting the rich multimodal information that exists. However, the number of studies that do true multimodal fusion (i.e. capitalizing on joint information among modalities) is still remarkably small given the known benefits. In part, this is because multi-modal studies require broader expertise in collecting, analyzing, and interpreting the results than do unimodal studies. In this paper, we start by introducing the basic reasons why multimodal data fusion is important and what it can do, and importantly how it can help us avoid wrong conclusions and help compensate for imperfect brain imaging studies. We also discuss the challenges that need to be confronted for such approaches to be more widely applied by the community. We then provide a review of the diverse studies that have used multimodal data fusion (primarily focused on psychosis) as well as provide an introduction to some of the existing analytic approaches. Finally, we discuss some up-and-coming approaches to multi-modal fusion including deep learning and multimodal classification which show considerable promise. Our conclusion is that multimodal data fusion is rapidly growing, but it is still underutilized. The complexity of the human brain coupled with the incomplete measurement provided by existing imaging technology makes multimodal fusion essential in order to mitigate against misdirection and hopefully provide a key to finding the missing link(s) in complex mental illness.

  20. Multimodal transportation best practices and model element.

    DOT National Transportation Integrated Search

    2014-06-01

    This report provides guidance in developing a multimodal transportation element of a local government comprehensive : plan. Two model elements were developed to address differences in statutory requirements for communities of different : sizes and pl...

  1. Systemic multimodal approach to speech therapy treatment in autistic children.

    PubMed

    Tamas, Daniela; Marković, Slavica; Milankov, Vesela

    2013-01-01

    Conditions in which speech therapy treatment is applied in autistic children are often not in accordance with characteristics of opinions and learning of people with autism. A systemic multimodal approach means motivating autistic people to develop their language speech skill through the procedure which allows reliving of their personal experience according to the contents that are presented in the their natural social environment. This research was aimed at evaluating the efficiency of speech treatment based on the systemic multimodal approach to the work with autistic children. The study sample consisted of 34 children, aged from 8 to 16 years, diagnosed to have different autistic disorders, whose results showed a moderate and severe clinical picture of autism on the Childhood Autism Rating Scale. The applied instruments for the evaluation of ability were the Childhood Autism Rating Scale and Ganzberg II test. The study subjects were divided into two groups according to the type of treatment: children who were covered by the continuing treatment and systemic multimodal approach in the treatment, and children who were covered by classical speech treatment. It is shown that the systemic multimodal approach in teaching autistic children affects the stimulation of communication, socialization, self-service and work as well as that the progress achieved in these areas of functioning was retainable after long time, too. By applying the systemic multimodal approach when dealing with autistic children and by comparing their achievements on tests applied before, during and after the application of this mode, it has been concluded that certain improvement has been achieved in the functionality within the diagnosed category. The results point to a possible direction in the creation of new methods, plans and programs in dealing with autistic children based on empirical and interactive learning.

  2. Multimodality therapy of local regional esophageal cancer.

    PubMed

    Kelsen, David P

    2005-12-01

    Recent trials regarding the use of multimodality therapy for patients with cancers of the esophagus and gastroesophageal junction have not conclusively shown benefit. Regimens containing cisplatin and fluorouracil administered preoperatively appear to be tolerable and do not increase operative morbidity or mortality when compared with surgery alone. Yet clinical trials have not clearly shown that such regimens improve outcome as measured by survival. Likewise, trials of postoperative chemoradiation have not reported a significant improvement in median or overall survival. The reasons for the lack of clinical benefit from multimodality therapy are not completely understood, but improvements in systemic therapy will probably be necessary before disease-free or overall survival improves substantially. Some new single agents such as the taxanes (docetaxel or paclitaxel) and the camptothecan analog irinotecan have shown modest activity for palliative therapy.

  3. Multimode interference tapered fiber refractive index sensors.

    PubMed

    Biazoli, Claudecir R; Silva, Susana; Franco, Marcos A R; Frazão, Orlando; Cordeiro, Cristiano M B

    2012-08-20

    Real-time monitoring of the fabrication process of tapering down a multimode-interference-based fiber structure is presented. The device is composed of a pure silica multimode fiber (MMF) with an initial 125 μm diameter spliced between two single-mode fibers. The process allows a thin MMF with adjustable parameters to obtain a high signal transmittance, arising from constructive interference among the guided modes at the output end of the MMF. Tapered structures with waist diameters as low as 55 μm were easily fabricated without the limitation of fragile splices or difficulty in controlling lateral fiber alignments. The sensing device is shown to be sensitive to the external environment, and a maximum sensitivity of 2946 nm/refractive index unit in the refractive index range of 1.42-1.43 was attained.

  4. Multimodal 2D Brain Computer Interface.

    PubMed

    Almajidy, Rand K; Boudria, Yacine; Hofmann, Ulrich G; Besio, Walter; Mankodiya, Kunal

    2015-08-01

    In this work we used multimodal, non-invasive brain signal recording systems, namely Near Infrared Spectroscopy (NIRS), disc electrode electroencephalography (EEG) and tripolar concentric ring electrodes (TCRE) electroencephalography (tEEG). 7 healthy subjects participated in our experiments to control a 2-D Brain Computer Interface (BCI). Four motor imagery task were performed, imagery motion of the left hand, the right hand, both hands and both feet. The signal slope (SS) of the change in oxygenated hemoglobin concentration measured by NIRS was used for feature extraction while the power spectrum density (PSD) of both EEG and tEEG in the frequency band 8-30Hz was used for feature extraction. Linear Discriminant Analysis (LDA) was used to classify different combinations of the aforementioned features. The highest classification accuracy (85.2%) was achieved by using features from all the three brain signals recording modules. The improvement in classification accuracy was highly significant (p = 0.0033) when using the multimodal signals features as compared to pure EEG features.

  5. Multimodal emotion perception after anterior temporal lobectomy (ATL)

    PubMed Central

    Milesi, Valérie; Cekic, Sezen; Péron, Julie; Frühholz, Sascha; Cristinzio, Chiara; Seeck, Margitta; Grandjean, Didier

    2014-01-01

    In the context of emotion information processing, several studies have demonstrated the involvement of the amygdala in emotion perception, for unimodal and multimodal stimuli. However, it seems that not only the amygdala, but several regions around it, may also play a major role in multimodal emotional integration. In order to investigate the contribution of these regions to multimodal emotion perception, five patients who had undergone unilateral anterior temporal lobe resection were exposed to both unimodal (vocal or visual) and audiovisual emotional and neutral stimuli. In a classic paradigm, participants were asked to rate the emotional intensity of angry, fearful, joyful, and neutral stimuli on visual analog scales. Compared with matched controls, patients exhibited impaired categorization of joyful expressions, whether the stimuli were auditory, visual, or audiovisual. Patients confused joyful faces with neutral faces, and joyful prosody with surprise. In the case of fear, unlike matched controls, patients provided lower intensity ratings for visual stimuli than for vocal and audiovisual ones. Fearful faces were frequently confused with surprised ones. When we controlled for lesion size, we no longer observed any overall difference between patients and controls in their ratings of emotional intensity on the target scales. Lesion size had the greatest effect on intensity perceptions and accuracy in the visual modality, irrespective of the type of emotion. These new findings suggest that a damaged amygdala, or a disrupted bundle between the amygdala and the ventral part of the occipital lobe, has a greater impact on emotion perception in the visual modality than it does in either the vocal or audiovisual one. We can surmise that patients are able to use the auditory information contained in multimodal stimuli to compensate for difficulty processing visually conveyed emotion. PMID:24839437

  6. Construction of a multimodal CT-video chest model

    NASA Astrophysics Data System (ADS)

    Byrnes, Patrick D.; Higgins, William E.

    2014-03-01

    Bronchoscopy enables a number of minimally invasive chest procedures for diseases such as lung cancer and asthma. For example, using the bronchoscope's continuous video stream as a guide, a physician can navigate through the lung airways to examine general airway health, collect tissue samples, or administer a disease treatment. In addition, physicians can now use new image-guided intervention (IGI) systems, which draw upon both three-dimensional (3D) multi-detector computed tomography (MDCT) chest scans and bronchoscopic video, to assist with bronchoscope navigation. Unfortunately, little use is made of the acquired video stream, a potentially invaluable source of information. In addition, little effort has been made to link the bronchoscopic video stream to the detailed anatomical information given by a patient's 3D MDCT chest scan. We propose a method for constructing a multimodal CT-video model of the chest. After automatically computing a patient's 3D MDCT-based airway-tree model, the method next parses the available video data to generate a positional linkage between a sparse set of key video frames and airway path locations. Next, a fusion/mapping of the video's color mucosal information and MDCT-based endoluminal surfaces is performed. This results in the final multimodal CT-video chest model. The data structure constituting the model provides a history of those airway locations visited during bronchoscopy. It also provides for quick visual access to relevant sections of the airway wall by condensing large portions of endoscopic video into representative frames containing important structural and textural information. When examined with a set of interactive visualization tools, the resulting fused data structure provides a rich multimodal data source. We demonstrate the potential of the multimodal model with both phantom and human data.

  7. [Implementation of interdisciplinary multimodal pain therapy according to OPS 8‑918 : Recommendations of the ad hoc commission for interdisciplinary multimodal pain therapy of the German Pain Association].

    PubMed

    Arnold, B; Böger, A; Brinkschmidt, T; Casser, H-R; Irnich, D; Kaiser, U; Klimczyk, K; Lutz, J; Pfingsten, M; Sabatowski, R; Schiltenwolf, M; Söllner, W

    2018-02-01

    With the implementation of the German diagnosis-related groups (DRG) reimbursement system in hospitals, interdisciplinary multimodal pain therapy was incorporated into the associated catalogue of procedures (OPS 8‑918). Yet, the presented criteria describing the procedure of interdisciplinary multimodal pain therapy are neither precise nor unambiguous. This has led to discrepancies in the interpretation regarding the handling of the procedure-making it difficult for medical services of health insurance companies to evaluate the accordance between the delivered therapy and the required criteria. Since the number of pain units has increased in recent years, the number of examinations by the medical service of health insurance companies has increased. This article, published by the ad hoc commission for interdisciplinary multimodal pain therapy of the German Pain Association, provides specific recommendations for correct implementation of interdisciplinary multimodal pain therapy in routine care. The aim is to achieve a maximum level of accordance between health care providers and the requirements of the medical examiners from health insurance companies. More extensive criteria regarding interdisciplinary multimodal pain treatment in an in-patient setting, especially for patients with chronic and complex pain, are obviously needed. Thus, the authors further discuss specific aspects towards further development of the OPS-code. However, the application of the OPS-code still leaves room regarding treatment intensity and process quality. Therefore, the delivery of pain management in sufficient quantity and quality still remains the responsibility of each health care provider.

  8. The Impact Of Multimode Fiber Chromatic Dispersion On Data Communications

    NASA Astrophysics Data System (ADS)

    Hackert, Michael J.

    1990-01-01

    Capability for the lowest cost is the goal of contemporary communications managers. With all of the competitive pressures that modern businesses are experiencing these days, communications needs must be met with the most information carrying capacity for the lowest cost. Optical fiber communication systems meet these requirements while providing reliability, system integrity, and potential future upgradability. Consequently, optical fiber is finding numerous applications in addition to its traditional telephony plant. Fiber based systems are meeting these requirements in building networks and computer interconnects at a lower cost than copper based systems. A fiber type being chosen by industry to meet these needs in standard systems such as FDDI, is multimode fiber. Multimode fiber systems offer cost advantages over single-mode fiber through lower fiber connection costs. Also, system designers can gain savings by using low cost, high reliability, wide spectral width sources such as LEDs instead of lasers and by operating at higher bit rates than used for multimode systems in the past. However, in order to maximize the cost savings while ensuring the system will operate as intended, the chromatic dispersion of the fiber must be taken into account. This paper explains how to do that and shows how to calculate multimode chromatic dispersion for each of the standard fiber sizes (50 μm, 62.5 μm, 85 μm, and 100μm core diameter).

  9. Stent-induced coronary artery stenosis characterized by multimodal nonlinear optical microscopy

    NASA Astrophysics Data System (ADS)

    Wang, Han-Wei; Simianu, Vlad; Locker, Mattew J.; Cheng, Ji-Xin; Sturek, Michael

    2011-02-01

    We demonstrate for the first time the applicability of multimodal nonlinear optical (NLO) microscopy to the interrogation of stented coronary arteries under different diet and stent deployment conditions. Bare metal stents and Taxus drug-eluting stents (DES) were placed in coronary arteries of Ossabaw pigs of control and atherogenic diet groups. Multimodal NLO imaging was performed to inspect changes in arterial structures and compositions after stenting. Sum frequency generation, one of the multimodalities, was used for the quantitative analysis of collagen content in the peristent and in-stent artery segments of both pig groups. Atherogenic diet increased lipid and collagen in peristent segments. In-stent segments showed decreased collagen expression in neointima compared to media. Deployment of DES in atheromatous arteries inhibited collagen expression in the arterial media.

  10. Multimodality and interactivity: connecting properties of serious games with educational outcomes.

    PubMed

    Ritterfeld, Ute; Shen, Cuihua; Wang, Hua; Nocera, Luciano; Wong, Wee Ling

    2009-12-01

    Serious games have become an important genre of digital media and are often acclaimed for their potential to enhance deeper learning because of their unique technological properties. Yet the discourse has largely remained at a conceptual level. For an empirical evaluation of educational games, extra effort is needed to separate intertwined and confounding factors in order to manipulate and thus attribute the outcome to one property independent of another. This study represents one of the first attempts to empirically test the educational impact of two important properties of serious games, multimodality and interactivity, through a partial 2 x 3 (interactive, noninteractive by high, moderate, low in multimodality) factorial between-participants follow-up experiment. Results indicate that both multimodality and interactivity contribute to educational outcomes individually. Implications for educational strategies and future research directions are discussed.

  11. Multimodal fusion of brain imaging data: A key to finding the missing link(s) in complex mental illness

    PubMed Central

    Calhoun, Vince D; Sui, Jing

    2016-01-01

    It is becoming increasingly clear that combining multi-modal brain imaging data is able to provide more information for individual subjects by exploiting the rich multimodal information that exists. However, the number of studies that do true multimodal fusion (i.e. capitalizing on joint information among modalities) is still remarkably small given the known benefits. In part, this is because multi-modal studies require broader expertise in collecting, analyzing, and interpreting the results than do unimodal studies. In this paper, we start by introducing the basic reasons why multimodal data fusion is important and what it can do, and importantly how it can help us avoid wrong conclusions and help compensate for imperfect brain imaging studies. We also discuss the challenges that need to be confronted for such approaches to be more widely applied by the community. We then provide a review of the diverse studies that have used multimodal data fusion (primarily focused on psychosis) as well as provide an introduction to some of the existing analytic approaches. Finally, we discuss some up-and-coming approaches to multi-modal fusion including deep learning and multimodal classification which show considerable promise. Our conclusion is that multimodal data fusion is rapidly growing, but it is still underutilized. The complexity of the human brain coupled with the incomplete measurement provided by existing imaging technology makes multimodal fusion essential in order to mitigate against misdirection and hopefully provide a key to finding the missing link(s) in complex mental illness. PMID:27347565

  12. Multi-focus beam shaping of high power multimode lasers

    NASA Astrophysics Data System (ADS)

    Laskin, Alexander; Volpp, Joerg; Laskin, Vadim; Ostrun, Aleksei

    2017-08-01

    Beam shaping of powerful multimode fiber lasers, fiber-coupled solid-state and diode lasers is of great importance for improvements of industrial laser applications. Welding, cladding with millimetre scale working spots benefit from "inverseGauss" intensity profiles; performance of thick metal sheet cutting, deep penetration welding can be enhanced when distributing the laser energy along the optical axis as more efficient usage of laser energy, higher edge quality and reduction of the heat affected zone can be achieved. Building of beam shaping optics for multimode lasers encounters physical limitations due to the low beam spatial coherence of multimode fiber-coupled lasers resulting in big Beam Parameter Products (BPP) or M² values. The laser radiation emerging from a multimode fiber presents a mixture of wavefronts. The fiber end can be considered as a light source which optical properties are intermediate between a Lambertian source and a single mode laser beam. Imaging of the fiber end, using a collimator and a focusing objective, is a robust and widely used beam delivery approach. Beam shaping solutions are suggested in form of optics combining fiber end imaging and geometrical separation of focused spots either perpendicular to or along the optical axis. Thus, energy of high power lasers is distributed among multiple foci. In order to provide reliable operation with multi-kW lasers and avoid damages the optics are designed as refractive elements with smooth optical surfaces. The paper presents descriptions of multi-focus optics as well as examples of intensity profile measurements of beam caustics and application results.

  13. Marveling at "The Man Called Nova": Comics as Sponsors of Multimodal Literacy

    ERIC Educational Resources Information Center

    Jacobs, Dale

    2007-01-01

    This essay theorizes the ways in which comics, and Marvel Comics in particular, acted as sponsors of multimodal literacy for the author. In doing so, the essay demonstrates the possibilities that exist in examining comics more closely and in thinking about how literacy sponsorship happens in multimodal texts. (Contains 1 figure and 13 notes.)

  14. Melanoma detection using smartphone and multimode hyperspectral imaging

    NASA Astrophysics Data System (ADS)

    MacKinnon, Nicholas; Vasefi, Fartash; Booth, Nicholas; Farkas, Daniel L.

    2016-04-01

    This project's goal is to determine how to effectively implement a technology continuum from a low cost, remotely deployable imaging device to a more sophisticated multimode imaging system within a standard clinical practice. In this work a smartphone is used in conjunction with an optical attachment to capture cross-polarized and collinear color images of a nevus that are analyzed to quantify chromophore distribution. The nevus is also imaged by a multimode hyperspectral system, our proprietary SkinSpect™ device. Relative accuracy and biological plausibility of the two systems algorithms are compared to assess aspects of feasibility of in-home or primary care practitioner smartphone screening prior to rigorous clinical analysis via the SkinSpect.

  15. Tunable multiwavelength Tm-doped fiber laser based on the multimode interference effect.

    PubMed

    Zhang, Peng; Wang, Tianshu; Ma, Wanzhuo; Dong, Keyan; Jiang, Huilin

    2015-05-20

    A simple multiwavelength Tm-doped fiber laser at the 2 μm band based on multimode interference (MMI) is proposed and experimentally demonstrated. In this scheme, a 4 m Tm-doped single-mode fiber is pumped by a 1568 nm laser, and a single-mode-multimode-single-mode (SMS) fiber structure is used as an MMI filter in which the multimode fiber is used to tune the laser. Laser operation of up to three wavelengths is obtained based on the MMI filter. The wavelengths can be tuned by adjusting the polarization controller and rotating the multimode fiber in the SMS structure, and the tuning region is about 24 nm, i.e., 1892-1916 nm. The side-mode suppression ratio of the laser is about 54 dB. The 3 dB linewidth is less than 0.04 nm. Peak fluctuation at each wavelength is analyzed, and the results show that the power fluctuation is less than 3 dB around the average power.

  16. Empowering Prospective Teachers to Become Active Sense-Makers: Multimodal Modeling of the Seasons

    ERIC Educational Resources Information Center

    Kim, Mi Song

    2015-01-01

    Situating science concepts in concrete and authentic contexts, using information and communications technologies, including multimodal modeling tools, is important for promoting the development of higher-order thinking skills in learners. However, teachers often struggle to integrate emergent multimodal models into a technology-rich informal…

  17. Multimodal Imaging of Human Brain Activity: Rational, Biophysical Aspects and Modes of Integration

    PubMed Central

    Blinowska, Katarzyna; Müller-Putz, Gernot; Kaiser, Vera; Astolfi, Laura; Vanderperren, Katrien; Van Huffel, Sabine; Lemieux, Louis

    2009-01-01

    Until relatively recently the vast majority of imaging and electrophysiological studies of human brain activity have relied on single-modality measurements usually correlated with readily observable or experimentally modified behavioural or brain state patterns. Multi-modal imaging is the concept of bringing together observations or measurements from different instruments. We discuss the aims of multi-modal imaging and the ways in which it can be accomplished using representative applications. Given the importance of haemodynamic and electrophysiological signals in current multi-modal imaging applications, we also review some of the basic physiology relevant to understanding their relationship. PMID:19547657

  18. Interventions for Detrusor Overactivity: The Case for Multimodal Therapy

    PubMed Central

    Dmochowski, Roger

    2002-01-01

    Viable therapeutic alternatives for the management of overactive bladder (OAB) have recently evolved that provide satisfactory symptomatic control for the majority of patients. However, the presupposition that interventions exist as stand-alone entities is not representative of experience in unique populations with the therapeutic benefit of combination therapy, using components drawn from behavioral, physiotherapeutic, neuromodulatory, and, if necessary, surgical alternatives. Even in populations relatively refractory to therapy, the use of multimodal therapy yields additive benefits for patients with OAB symptoms. Herein is detailed the evidence supporting the concept that multimodal therapy provides optimal benefit to patients suffering from this symptom complex. PMID:16986017

  19. Empowering Prospective Teachers to Become Active Sense-Makers: Multimodal Modeling of the Seasons

    NASA Astrophysics Data System (ADS)

    Kim, Mi Song

    2015-10-01

    Situating science concepts in concrete and authentic contexts, using information and communications technologies, including multimodal modeling tools, is important for promoting the development of higher-order thinking skills in learners. However, teachers often struggle to integrate emergent multimodal models into a technology-rich informal learning environment. Our design-based research co-designs and develops engaging, immersive, and interactive informal learning activities called "Embodied Modeling-Mediated Activities" (EMMA) to support not only Singaporean learners' deep learning of astronomy but also the capacity of teachers. As part of the research on EMMA, this case study describes two prospective teachers' co-design processes involving multimodal models for teaching and learning the concept of the seasons in a technology-rich informal learning setting. Our study uncovers four prominent themes emerging from our data concerning the contextualized nature of learning and teaching involving multimodal models in informal learning contexts: (1) promoting communication and emerging questions, (2) offering affordances through limitations, (3) explaining one concept involving multiple concepts, and (4) integrating teaching and learning experiences. This study has an implication for the development of a pedagogical framework for teaching and learning in technology-enhanced learning environments—that is empowering teachers to become active sense-makers using multimodal models.

  20. Digital Multimodal Texts and Their Role in Project Work: Opportunities and Dilemmas

    ERIC Educational Resources Information Center

    Wikan, Gerd; Molster, Terje; Faugli, Bjorn; Hope, Rafael

    2010-01-01

    This paper explores how and to what extent digital multimodal text production can play a role in project work. The focus is upon describing and understanding how teachers and learners view multimodal text production as part of a learning process. Group-based project work has been used extensively in Norwegian schools since the 1970s. One criticism…

  1. Nanoengineered multimodal contrast agent for medical image guidance

    NASA Astrophysics Data System (ADS)

    Perkins, Gregory J.; Zheng, Jinzi; Brock, Kristy; Allen, Christine; Jaffray, David A.

    2005-04-01

    Multimodality imaging has gained momentum in radiation therapy planning and image-guided treatment delivery. Specifically, computed tomography (CT) and magnetic resonance (MR) imaging are two complementary imaging modalities often utilized in radiation therapy for visualization of anatomical structures for tumour delineation and accurate registration of image data sets for volumetric dose calculation. The development of a multimodal contrast agent for CT and MR with prolonged in vivo residence time would provide long-lasting spatial and temporal correspondence of the anatomical features of interest, and therefore facilitate multimodal image registration, treatment planning and delivery. The multimodal contrast agent investigated consists of nano-sized stealth liposomes encapsulating conventional iodine and gadolinium-based contrast agents. The average loading achieved was 33.5 +/- 7.1 mg/mL of iodine for iohexol and 9.8 +/- 2.0 mg/mL of gadolinium for gadoteridol. The average liposome diameter was 46.2 +/- 13.5 nm. The system was found to be stable in physiological buffer over a 15-day period, releasing 11.9 +/- 1.1% and 11.2 +/- 0.9% of the total amounts of iohexol and gadoteridol loaded, respectively. 200 minutes following in vivo administration, the contrast agent maintained a relative contrast enhancement of 81.4 +/- 13.05 differential Hounsfield units (ΔHU) in CT (40% decrease from the peak signal value achieved 3 minutes post-injection) and 731.9 +/- 144.2 differential signal intensity (ΔSI) in MR (46% decrease from the peak signal value achieved 3 minutes post-injection) in the blood (aorta), a relative contrast enhancement of 38.0 +/- 5.1 ΔHU (42% decrease from the peak signal value achieved 3 minutes post-injection) and 178.6 +/- 41.4 ΔSI (62% decrease from the peak signal value achieved 3 minutes post-injection) in the liver (parenchyma), a relative contrast enhancement of 9.1 +/- 1.7 ΔHU (94% decrease from the peak signal value achieved 3 minutes

  2. New developments in multimodal clinical multiphoton tomography

    NASA Astrophysics Data System (ADS)

    König, Karsten

    2011-03-01

    80 years ago, the PhD student Maria Goeppert predicted in her thesis in Goettingen, Germany, two-photon effects. It took 30 years to prove her theory, and another three decades to realize the first two-photon microscope. With the beginning of this millennium, first clinical multiphoton tomographs started operation in research institutions, hospitals, and in the cosmetic industry. The multiphoton tomograph MPTflexTM with its miniaturized flexible scan head became the Prism-Award 2010 winner in the category Life Sciences. Multiphoton tomographs with its superior submicron spatial resolution can be upgraded to 5D imaging tools by adding spectral time-correlated single photon counting units. Furthermore, multimodal hybrid tomographs provide chemical fingerprinting and fast wide-field imaging. The world's first clinical CARS studies have been performed with a hybrid multimodal multiphoton tomograph in spring 2010. In particular, nonfluorescent lipids and water as well as mitochondrial fluorescent NAD(P)H, fluorescent elastin, keratin, and melanin as well as SHG-active collagen have been imaged in patients with dermatological disorders. Further multimodal approaches include the combination of multiphoton tomographs with low-resolution imaging tools such as ultrasound, optoacoustic, OCT, and dermoscopy systems. Multiphoton tomographs are currently employed in Australia, Japan, the US, and in several European countries for early diagnosis of skin cancer (malignant melanoma), optimization of treatment strategies (wound healing, dermatitis), and cosmetic research including long-term biosafety tests of ZnO sunscreen nanoparticles and the measurement of the stimulated biosynthesis of collagen by anti-ageing products.

  3. A Multimodal Approach to Elimination of Stuttering.

    ERIC Educational Resources Information Center

    Beaty, David T.

    1980-01-01

    The case of a 15-year-old stutterer is presented to illustrate A. Lazarus's multimodal behavior therapy model, proposed to integrate various procedures. A combination of role playing, metronome use, biofeedback training, and assertion training was used. (CL)

  4. Multimode optomechanical system in the quantum regime

    NASA Astrophysics Data System (ADS)

    Hvidtfelt Padkær Nielsen, William; Tsaturyan, Yeghishe; Møller, Christoffer Bo; Polzik, Eugene S.; Schliesser, Albert

    2017-01-01

    We realize a simple and robust optomechanical system with a multitude of long-lived (Q > 107) mechanical modes in a phononic-bandgap shielded membrane resonator. An optical mode of a compact Fabry-Perot resonator detects these modes’ motion with a measurement rate (96 kHz) that exceeds the mechanical decoherence rates already at moderate cryogenic temperatures (10 K). Reaching this quantum regime entails, inter alia, quantum measurement backaction exceeding thermal forces and thus strong optomechanical quantum correlations. In particular, we observe ponderomotive squeezing of the output light mediated by a multitude of mechanical resonator modes, with quantum noise suppression up to -2.4 dB (-3.6 dB if corrected for detection losses) and bandwidths ≲90 kHz. The multimode nature of the membrane and Fabry-Perot resonators will allow multimode entanglement involving electromagnetic, mechanical, and spin degrees of freedom.

  5. Naming Block Structures: A Multimodal Approach

    ERIC Educational Resources Information Center

    Cohen, Lynn; Uhry, Joanna

    2011-01-01

    This study describes symbolic representation in block play in a culturally diverse suburban preschool classroom. Block play is "multimodal" and can allow children to experiment with materials to represent the world in many forms of literacy. Combined qualitative and quantitative data from seventy-seven block structures were collected and analyzed.…

  6. Deep Multimodal Distance Metric Learning Using Click Constraints for Image Ranking.

    PubMed

    Yu, Jun; Yang, Xiaokang; Gao, Fei; Tao, Dacheng

    2017-12-01

    How do we retrieve images accurately? Also, how do we rank a group of images precisely and efficiently for specific queries? These problems are critical for researchers and engineers to generate a novel image searching engine. First, it is important to obtain an appropriate description that effectively represent the images. In this paper, multimodal features are considered for describing images. The images unique properties are reflected by visual features, which are correlated to each other. However, semantic gaps always exist between images visual features and semantics. Therefore, we utilize click feature to reduce the semantic gap. The second key issue is learning an appropriate distance metric to combine these multimodal features. This paper develops a novel deep multimodal distance metric learning (Deep-MDML) method. A structured ranking model is adopted to utilize both visual and click features in distance metric learning (DML). Specifically, images and their related ranking results are first collected to form the training set. Multimodal features, including click and visual features, are collected with these images. Next, a group of autoencoders is applied to obtain initially a distance metric in different visual spaces, and an MDML method is used to assign optimal weights for different modalities. Next, we conduct alternating optimization to train the ranking model, which is used for the ranking of new queries with click features. Compared with existing image ranking methods, the proposed method adopts a new ranking model to use multimodal features, including click features and visual features in DML. We operated experiments to analyze the proposed Deep-MDML in two benchmark data sets, and the results validate the effects of the method.

  7. Multimode cavity-assisted quantum storage via continuous phase-matching control

    NASA Astrophysics Data System (ADS)

    Kalachev, Alexey; Kocharovskaya, Olga

    2013-09-01

    A scheme for spatial multimode quantum memory is developed such that spatial-temporal structure of a weak signal pulse can be stored and recalled via cavity-assisted off-resonant Raman interaction with a strong angular-modulated control field in an extended Λ-type atomic ensemble. It is shown that effective multimode storage is possible when the Raman coherence spatial grating involves wave vectors with different longitudinal components relative to the paraxial signal field. The possibilities of implementing the scheme in the solid-state materials are discussed.

  8. Ridge-branch-based blood vessel detection algorithm for multimodal retinal images

    NASA Astrophysics Data System (ADS)

    Li, Y.; Hutchings, N.; Knighton, R. W.; Gregori, G.; Lujan, B. J.; Flanagan, J. G.

    2009-02-01

    Automatic detection of retinal blood vessels is important to medical diagnoses and imaging. With the development of imaging technologies, various modals of retinal images are available. Few of currently published algorithms are applied to multimodal retinal images. Besides, the performance of algorithms with pathologies is expected to be improved. The purpose of this paper is to propose an automatic Ridge-Branch-Based (RBB) detection algorithm of blood vessel centerlines and blood vessels for multimodal retinal images (color fundus photographs, fluorescein angiograms, fundus autofluorescence images, SLO fundus images and OCT fundus images, for example). Ridges, which can be considered as centerlines of vessel-like patterns, are first extracted. The method uses the connective branching information of image ridges: if ridge pixels are connected, they are more likely to be in the same class, vessel ridge pixels or non-vessel ridge pixels. Thanks to the good distinguishing ability of the designed "Segment-Based Ridge Features", the classifier and its parameters can be easily adapted to multimodal retinal images without ground truth training. We present thorough experimental results on SLO images, color fundus photograph database and other multimodal retinal images, as well as comparison between other published algorithms. Results showed that the RBB algorithm achieved a good performance.

  9. Multimode Surface Plasmon Excitations on Organic Thin Film/Metallic Diffraction Grating

    NASA Astrophysics Data System (ADS)

    Baba, Akira; Kanda, Kenji; Ohno, Tsutomu; Ohdaira, Yasuo; Shinbo, Kazunari; Kato, Keizo; Kaneko, Futao

    2010-01-01

    In this work, we demonstrate multimode surface plasmon (SP) excitations by white light irradiation on metallic diffraction grating/plastic substrates. Recordable compact discs were used as the diffraction grating substrates on which silver films were deposited by vacuum evaporation. Since the grating pitch (1.6 µm) was larger than that of diffraction gratings commonly used for the excitation of SPs, multimode SP excitations due to several diffraction orders were observed simultaneously in the wavelength region from 400 to 800 nm. The obtained SP excitations were then compared with the calculated SP dispersion on the grating. The multimode SP excitations were further studied on spin-coated poly[2-methoxy-5-(2'-ethyl-hexyloxy)-1,4-phenylene vinylene] (MEH-PPV) thin film/silver grating substrates. An increased photoluminescence intensity due to SP excitations was observed on MEH-PPV/silver grating surfaces.

  10. Contemporary Multi-Modal Historical Representations and the Teaching of Disciplinary Understandings in History

    ERIC Educational Resources Information Center

    Donnelly, Debra J.

    2018-01-01

    Traditional privileging of the printed text has been considerably eroded by rapid technological advancement and in Australia, as elsewhere, many History teaching programs feature an array of multi-modal historical representations. Research suggests that engagement with the visual and multi-modal constructs has the potential to enrich the pedagogy…

  11. Exploring the Multimodality of EFL Textbooks for Chinese College Students: A Comparative Study

    ERIC Educational Resources Information Center

    Liu, Xiqin; Qu, Dianning

    2014-01-01

    To explore the multimodality of two representative EFL textbook series for Chinese college students, their visual and verbal semiotic modes were compared. The target textbooks are "Experiencing English" and "New Century College English". Through multimodal discourse analysis, the study aims to shed some light on how to develop…

  12. Teaching Poetry through Collaborative Art: An Analysis of Multimodal Ensembles for Transformative Learning

    ERIC Educational Resources Information Center

    Wandera, David B.

    2016-01-01

    This study is anchored on two positions: that every communication is multimodal and that different modalities within multimodal communication have particular affordances. Written and oral language and other modalities, such as body language and audio/visual media, are interwoven in classroom communication. What might it look like to strategically…

  13. Multimodal retrieval of autobiographical memories: sensory information contributes differently to the recollection of events.

    PubMed

    Willander, Johan; Sikström, Sverker; Karlsson, Kristina

    2015-01-01

    Previous studies on autobiographical memory have focused on unimodal retrieval cues (i.e., cues pertaining to one modality). However, from an ecological perspective multimodal cues (i.e., cues pertaining to several modalities) are highly important to investigate. In the present study we investigated age distributions and experiential ratings of autobiographical memories retrieved with unimodal and multimodal cues. Sixty-two participants were randomized to one of four cue-conditions: visual, olfactory, auditory, or multimodal. The results showed that the peak of the distributions depends on the modality of the retrieval cue. The results indicated that multimodal retrieval seemed to be driven by visual and auditory information to a larger extent and to a lesser extent by olfactory information. Finally, no differences were observed in the number of retrieved memories or experiential ratings across the four cue-conditions.

  14. Adiabatically tapered splice for selective excitation of the fundamental mode in a multimode fiber.

    PubMed

    Jung, Yongmin; Jeong, Yoonchan; Brambilla, Gilberto; Richardson, David J

    2009-08-01

    We propose a simple and effective method to selectively excite the fundamental mode of a multimode fiber by adiabatically tapering a fusion splice to a single-mode fiber. We experimentally demonstrate the method by adiabatically tapering splice (taper waist=15 microm, uniform length=40 mm) between single-mode and multimode fiber and show that it provides a successful mode conversion/connection and allows for almost perfect fundamental mode excitation in the multimode fiber. Excellent beam quality (M(2) approximately 1.08) was achieved with low loss and high environmental stability.

  15. Multimodal Discriminative Binary Embedding for Large-Scale Cross-Modal Retrieval.

    PubMed

    Wang, Di; Gao, Xinbo; Wang, Xiumei; He, Lihuo; Yuan, Bo

    2016-10-01

    Multimodal hashing, which conducts effective and efficient nearest neighbor search across heterogeneous data on large-scale multimedia databases, has been attracting increasing interest, given the explosive growth of multimedia content on the Internet. Recent multimodal hashing research mainly aims at learning the compact binary codes to preserve semantic information given by labels. The overwhelming majority of these methods are similarity preserving approaches which approximate pairwise similarity matrix with Hamming distances between the to-be-learnt binary hash codes. However, these methods ignore the discriminative property in hash learning process, which results in hash codes from different classes undistinguished, and therefore reduces the accuracy and robustness for the nearest neighbor search. To this end, we present a novel multimodal hashing method, named multimodal discriminative binary embedding (MDBE), which focuses on learning discriminative hash codes. First, the proposed method formulates the hash function learning in terms of classification, where the binary codes generated by the learned hash functions are expected to be discriminative. And then, it exploits the label information to discover the shared structures inside heterogeneous data. Finally, the learned structures are preserved for hash codes to produce similar binary codes in the same class. Hence, the proposed MDBE can preserve both discriminability and similarity for hash codes, and will enhance retrieval accuracy. Thorough experiments on benchmark data sets demonstrate that the proposed method achieves excellent accuracy and competitive computational efficiency compared with the state-of-the-art methods for large-scale cross-modal retrieval task.

  16. Multimodal imaging of lung cancer and its microenvironment (Conference Presentation)

    NASA Astrophysics Data System (ADS)

    Hariri, Lida P.; Niederst, Matthew J.; Mulvey, Hillary; Adams, David C.; Hu, Haichuan; Chico Calero, Isabel; Szabari, Margit V.; Vakoc, Benjamin J.; Hasan, Tayyaba; Bouma, Brett E.; Engelman, Jeffrey A.; Suter, Melissa J.

    2016-03-01

    Despite significant advances in targeted therapies for lung cancer, nearly all patients develop drug resistance within 6-12 months and prognosis remains poor. Developing drug resistance is a progressive process that involves tumor cells and their microenvironment. We hypothesize that microenvironment factors alter tumor growth and response to targeted therapy. We conducted in vitro studies in human EGFR-mutant lung carcinoma cells, and demonstrated that factors secreted from lung fibroblasts results in increased tumor cell survival during targeted therapy with EGFR inhibitor, gefitinib. We also demonstrated that increased environment stiffness results in increased tumor survival during gefitinib therapy. In order to test our hypothesis in vivo, we developed a multimodal optical imaging protocol for preclinical intravital imaging in mouse models to assess tumor and its microenvironment over time. We have successfully conducted multimodal imaging of dorsal skinfold chamber (DSC) window mice implanted with GFP-labeled human EGFR mutant lung carcinoma cells and visualized changes in tumor development and microenvironment facets over time. Multimodal imaging included structural OCT to assess tumor viability and necrosis, polarization-sensitive OCT to measure tissue birefringence for collagen/fibroblast detection, and Doppler OCT to assess tumor vasculature. Confocal imaging was also performed for high-resolution visualization of EGFR-mutant lung cancer cells labeled with GFP, and was coregistered with OCT. Our results demonstrated that stromal support and vascular growth are essential to tumor progression. Multimodal imaging is a useful tool to assess tumor and its microenvironment over time.

  17. Numerical modelling of multimode fibre-optic communication lines

    DOE Office of Scientific and Technical Information (OSTI.GOV)

    Sidelnikov, O S; Fedoruk, M P; Sygletos, S

    The results of numerical modelling of nonlinear propagation of an optical signal in multimode fibres with a small differential group delay are presented. It is found that the dependence of the error vector magnitude (EVM) on the differential group delay can be reduced by increasing the number of ADC samples per symbol in the numerical implementation of the differential group delay compensation algorithm in the receiver. The possibility of using multimode fibres with a small differential group delay for data transmission in modern digital communication systems is demonstrated. It is shown that with increasing number of modes the strong couplingmore » regime provides a lower EVM level than the weak coupling one. (fibre-optic communication lines)« less

  18. ROBOTIC SURGERY: BIOETHICAL ASPECTS.

    PubMed

    Siqueira-Batista, Rodrigo; Souza, Camila Ribeiro; Maia, Polyana Mendes; Siqueira, Sávio Lana

    2016-01-01

    The use of robots in surgery has been increasingly common today, allowing the emergence of numerous bioethical issues in this area. To present review of the ethical aspects of robot use in surgery. Search in Pubmed, SciELO and Lilacs crossing the headings "bioethics", "surgery", "ethics", "laparoscopy" and "robotic". Of the citations obtained, were selected 17 articles, which were used for the preparation of the article. It contains brief presentation on robotics, its inclusion in health and bioethical aspects, and the use of robots in surgery. Robotic surgery is a reality today in many hospitals, which makes essential bioethical reflection on the relationship between health professionals, automata and patients. A utilização de robôs em procedimentos cirúrgicos tem sido cada vez mais frequente na atualidade, o que permite a emergência de inúmeras questões bioéticas nesse âmbito. Apresentar revisão sobre os aspectos éticos dos usos de robôs em cirurgia. Realizou-se revisão nas bases de dados Pubmed, SciELO e Lilacs cruzando-se os descritores "bioética", "cirurgia", "ética", "laparoscopia" e "robótica". Do total de citações obtidas, selecionou-se 17 artigos, os quais foram utilizados para a elaboração do artigo. Ele contém breve apresentação sobre a robótica, sua inserção na saúde e os aspectos bioéticos da utilização dos robôs em procedimentos cirúrgicos. A cirurgia robótica é uma realidade, hoje, em muitas unidades hospitalares, o que torna essencial a reflexão bioética sobre as relações entre profissionais da saúde, autômatos e pacientes.

  19. Multimodal system for the planning and guidance of bronchoscopy

    NASA Astrophysics Data System (ADS)

    Higgins, William E.; Cheirsilp, Ronnarit; Zang, Xiaonan; Byrnes, Patrick

    2015-03-01

    Many technical innovations in multimodal radiologic imaging and bronchoscopy have emerged recently in the effort against lung cancer. Modern X-ray computed-tomography (CT) scanners provide three-dimensional (3D) high-resolution chest images, positron emission tomography (PET) scanners give complementary molecular imaging data, and new integrated PET/CT scanners combine the strengths of both modalities. State-of-the-art bronchoscopes permit minimally invasive tissue sampling, with vivid endobronchial video enabling navigation deep into the airway-tree periphery, while complementary endobronchial ultrasound (EBUS) reveals local views of anatomical structures outside the airways. In addition, image-guided intervention (IGI) systems have proven their utility for CT-based planning and guidance of bronchoscopy. Unfortunately, no IGI system exists that integrates all sources effectively through the complete lung-cancer staging work flow. This paper presents a prototype of a computer-based multimodal IGI system that strives to fill this need. The system combines a wide range of automatic and semi-automatic image-processing tools for multimodal data fusion and procedure planning. It also provides a flexible graphical user interface for follow-on guidance of bronchoscopy/EBUS. Human-study results demonstrate the system's potential.

  20. Single and low order mode interrogation of a multimode sapphire fiber Bragg grating sensor with tapered fibers

    NASA Astrophysics Data System (ADS)

    Grobnic, Dan; Mihailov, Stephen J.; Ding, H.; Bilodeau, F.; Smelser, Christopher W.

    2005-05-01

    Multimode sapphire fiber Bragg gratings (SFBG) made with an IR femtosecond laser and a phase mask were probed using tapered single mode fibers of different taper diameters producing single and low order mode reflection/transmission responses. A configuration made of an input single mode tapered fiber and multimode silica fiber used for output coupling was also tested and has delivered a filtered multimode transmission spectrum. The tapered coupling improved the spectral resolution of the SFBG as compared to its multimode responses previously reported. Such improvements facilitate the utilization of the SFBG as a high temperature sensor. Wavelength shifts of the single mode response were monitored as a function of temperature up to 1500 °C and were consistent with the measurement obtained from the multimode response published previously.

  1. OpenLMD, multimodal monitoring and control of LMD processing

    NASA Astrophysics Data System (ADS)

    Rodríguez-Araújo, Jorge; García-Díaz, Antón

    2017-02-01

    This paper presents OpenLMD, a novel open-source solution for on-line multimodal monitoring of Laser Metal Deposition (LMD). The solution is also applicable to a wider range of laser-based applications that require on-line control (e.g. laser welding). OpenLMD is a middleware that enables the orchestration and virtualization of a LMD robot cell, using several open-source frameworks (e.g. ROS, OpenCV, PCL). The solution also allows reconfiguration by easy integration of multiple sensors and processing equipment. As a result, OpenLMD delivers significant advantages over existing monitoring and control approaches, such as improved scalability, and multimodal monitoring and data sharing capabilities.

  2. Multimodal far-field acoustic radiation pattern: An approximate equation

    NASA Technical Reports Server (NTRS)

    Rice, E. J.

    1977-01-01

    The far-field sound radiation theory for a circular duct was studied for both single mode and multimodal inputs. The investigation was intended to develop a method to determine the acoustic power produced by turbofans as a function of mode cut-off ratio. With reasonable simplifying assumptions the single mode radiation pattern was shown to be reducible to a function of mode cut-off ratio only. With modal cut-off ratio as the dominant variable, multimodal radiation patterns can be reduced to a simple explicit expression. This approximate expression provides excellent agreement with an exact calculation of the sound radiation pattern using equal acoustic power per mode.

  3. 3D hierarchical spatial representation and memory of multimodal sensory data

    NASA Astrophysics Data System (ADS)

    Khosla, Deepak; Dow, Paul A.; Huber, David J.

    2009-04-01

    This paper describes an efficient method and system for representing, processing and understanding multi-modal sensory data. More specifically, it describes a computational method and system for how to process and remember multiple locations in multimodal sensory space (e.g., visual, auditory, somatosensory, etc.). The multimodal representation and memory is based on a biologically-inspired hierarchy of spatial representations implemented with novel analogues of real representations used in the human brain. The novelty of the work is in the computationally efficient and robust spatial representation of 3D locations in multimodal sensory space as well as an associated working memory for storage and recall of these representations at the desired level for goal-oriented action. We describe (1) A simple and efficient method for human-like hierarchical spatial representations of sensory data and how to associate, integrate and convert between these representations (head-centered coordinate system, body-centered coordinate, etc.); (2) a robust method for training and learning a mapping of points in multimodal sensory space (e.g., camera-visible object positions, location of auditory sources, etc.) to the above hierarchical spatial representations; and (3) a specification and implementation of a hierarchical spatial working memory based on the above for storage and recall at the desired level for goal-oriented action(s). This work is most useful for any machine or human-machine application that requires processing of multimodal sensory inputs, making sense of it from a spatial perspective (e.g., where is the sensory information coming from with respect to the machine and its parts) and then taking some goal-oriented action based on this spatial understanding. A multi-level spatial representation hierarchy means that heterogeneous sensory inputs (e.g., visual, auditory, somatosensory, etc.) can map onto the hierarchy at different levels. When controlling various machine

  4. Multi-Modality Cascaded Convolutional Neural Networks for Alzheimer's Disease Diagnosis.

    PubMed

    Liu, Manhua; Cheng, Danni; Wang, Kundong; Wang, Yaping

    2018-03-23

    Accurate and early diagnosis of Alzheimer's disease (AD) plays important role for patient care and development of future treatment. Structural and functional neuroimages, such as magnetic resonance images (MRI) and positron emission tomography (PET), are providing powerful imaging modalities to help understand the anatomical and functional neural changes related to AD. In recent years, machine learning methods have been widely studied on analysis of multi-modality neuroimages for quantitative evaluation and computer-aided-diagnosis (CAD) of AD. Most existing methods extract the hand-craft imaging features after image preprocessing such as registration and segmentation, and then train a classifier to distinguish AD subjects from other groups. This paper proposes to construct cascaded convolutional neural networks (CNNs) to learn the multi-level and multimodal features of MRI and PET brain images for AD classification. First, multiple deep 3D-CNNs are constructed on different local image patches to transform the local brain image into more compact high-level features. Then, an upper high-level 2D-CNN followed by softmax layer is cascaded to ensemble the high-level features learned from the multi-modality and generate the latent multimodal correlation features of the corresponding image patches for classification task. Finally, these learned features are combined by a fully connected layer followed by softmax layer for AD classification. The proposed method can automatically learn the generic multi-level and multimodal features from multiple imaging modalities for classification, which are robust to the scale and rotation variations to some extent. No image segmentation and rigid registration are required in pre-processing the brain images. Our method is evaluated on the baseline MRI and PET images of 397 subjects including 93 AD patients, 204 mild cognitive impairment (MCI, 76 pMCI +128 sMCI) and 100 normal controls (NC) from Alzheimer's Disease Neuroimaging

  5. Fostering Students' Science Inquiry through App Affordances of Multimodality, Collaboration, Interactivity, and Connectivity

    ERIC Educational Resources Information Center

    Beach, Richard; O'Brien, David

    2015-01-01

    This study examined 6th graders' use of the VoiceThread app as part of a science inquiry project on photosynthesis and carbon dioxide emissions in terms of their ability to engage in causal reasoning and their use of the affordances of multimodality, collaboration, interactivity, and connectivity. Students employed multimodal production using…

  6. Riding the Lines and Overwriting in the Margins: Affect and Multimodal Literacy Practices

    ERIC Educational Resources Information Center

    Lenters, Kimberly

    2016-01-01

    This case study examines the multimodal literacy practices of 11-year-old Nigel as he plays with assemblages of people, objects, and practices in his storywriting. The study asks "How does following the seemingly off-task multimodal literacy practices of one pre-adolescent youth across his home-community-school terrain provide insight into…

  7. The Multimodalities of Globalization: Teaching a YouTube Video in an EAP Classroom

    ERIC Educational Resources Information Center

    Chun, Christian W.

    2012-01-01

    This article examines the ways in which a multimodal text--a YouTube video on globalization and business--was mediated in two English for Academic Purposes (EAP) classrooms, and how these mediations shaped the instructor's and her students' meaning-making in specific ways. I first explore the complex multimodal discourses involved with this…

  8. "Seeing It from a Different Light": Adolescents' Video Reflections about Their Multimodal Compositions

    ERIC Educational Resources Information Center

    Smith, Blaine E.; Dalton, Bridget

    2016-01-01

    Although research emphasizes the importance of reflection for productive learning, much of this work has focused on writing as the preferred mode. The goal of this study was to examine how two adolescent composers reflected on their multimodal visions and processes through multimodal means--in particular, how the students remixed research-provided…

  9. Multimode optomechanical system in the quantum regime

    PubMed Central

    Nielsen, William Hvidtfelt Padkær; Tsaturyan, Yeghishe; Møller, Christoffer Bo; Polzik, Eugene S.; Schliesser, Albert

    2017-01-01

    We realize a simple and robust optomechanical system with a multitude of long-lived (Q > 107) mechanical modes in a phononic-bandgap shielded membrane resonator. An optical mode of a compact Fabry–Perot resonator detects these modes’ motion with a measurement rate (96 kHz) that exceeds the mechanical decoherence rates already at moderate cryogenic temperatures (10 K). Reaching this quantum regime entails, inter alia, quantum measurement backaction exceeding thermal forces and thus strong optomechanical quantum correlations. In particular, we observe ponderomotive squeezing of the output light mediated by a multitude of mechanical resonator modes, with quantum noise suppression up to −2.4 dB (−3.6 dB if corrected for detection losses) and bandwidths ≲90 kHz. The multimode nature of the membrane and Fabry–Perot resonators will allow multimode entanglement involving electromagnetic, mechanical, and spin degrees of freedom. PMID:27999182

  10. Multimode optomechanical system in the quantum regime.

    PubMed

    Nielsen, William Hvidtfelt Padkær; Tsaturyan, Yeghishe; Møller, Christoffer Bo; Polzik, Eugene S; Schliesser, Albert

    2017-01-03

    We realize a simple and robust optomechanical system with a multitude of long-lived (Q > 10 7 ) mechanical modes in a phononic-bandgap shielded membrane resonator. An optical mode of a compact Fabry-Perot resonator detects these modes' motion with a measurement rate (96 kHz) that exceeds the mechanical decoherence rates already at moderate cryogenic temperatures (10 K). Reaching this quantum regime entails, inter alia, quantum measurement backaction exceeding thermal forces and thus strong optomechanical quantum correlations. In particular, we observe ponderomotive squeezing of the output light mediated by a multitude of mechanical resonator modes, with quantum noise suppression up to -2.4 dB (-3.6 dB if corrected for detection losses) and bandwidths ≲90 kHz. The multimode nature of the membrane and Fabry-Perot resonators will allow multimode entanglement involving electromagnetic, mechanical, and spin degrees of freedom.

  11. Multimodal approach to seismic pavement testing

    USGS Publications Warehouse

    Ryden, N.; Park, C.B.; Ulriksen, P.; Miller, R.D.

    2004-01-01

    A multimodal approach to nondestructive seismic pavement testing is described. The presented approach is based on multichannel analysis of all types of seismic waves propagating along the surface of the pavement. The multichannel data acquisition method is replaced by multichannel simulation with one receiver. This method uses only one accelerometer-receiver and a light hammer-source, to generate a synthetic receiver array. This data acquisition technique is made possible through careful triggering of the source and results in such simplification of the technique that it is made generally available. Multiple dispersion curves are automatically and objectively extracted using the multichannel analysis of surface waves processing scheme, which is described. Resulting dispersion curves in the high frequency range match with theoretical Lamb waves in a free plate. At lower frequencies there are several branches of dispersion curves corresponding to the lower layers of different stiffness in the pavement system. The observed behavior of multimodal dispersion curves is in agreement with theory, which has been validated through both numerical modeling and the transfer matrix method, by solving for complex wave numbers. ?? ASCE / JUNE 2004.

  12. Photonic lantern with multimode fibers embedded

    NASA Astrophysics Data System (ADS)

    Yu, Hai-Jiao; Yan, Qi; Huang, Zong-Jun; Tian, He; Jiang, Yu; Liu, Yong-Jun; Zhang, Jian-Zhong; Sun, Wei-Min

    2014-08-01

    A photonic lantern is studied which is formed by seven multimode fibers inserted into a pure silica capillary tube. The core of the tapered end has a uniform refractive index because the polymer claddings are removed before the fibers are inserted. Consequently, the light distribution is also uniform. Two theories describing a slowly varying waveguide and multimode coupling are used to analyze the photonic lantern. The transmission loss decreases as the length of the tapered part increases. For a device with a taper length of 3.4 cm, the loss is about 1.06 dB on average for light propagating through the taper from an inserted fiber to the tapered end and 0.99 dB in the reverse direction. For a device with a taper length of 0.7 cm, the two loss values are 2.63 dB and 2.53 dB, respectively. The results show that it is possible to achieve a uniform light distribution with the tapered end and a low-loss transmission in the device if parameters related to the lantern are reasonably defined.

  13. Entanglement enhancement in multimode integrated circuits

    NASA Astrophysics Data System (ADS)

    Léger, Zacharie M.; Brodutch, Aharon; Helmy, Amr S.

    2018-06-01

    The faithful distribution of entanglement in continuous-variable systems is essential to many quantum information protocols. As such, entanglement distillation and enhancement schemes are a cornerstone of many applications. The photon subtraction scheme offers enhancement with a relatively simple setup and has been studied in various scenarios. Motivated by recent advances in integrated optics, particularly the ability to build stable multimode interferometers with squeezed input states, a multimodal extension to the enhancement via photon subtraction protocol is studied. States generated with multiple squeezed input states, rather than a single input source, are shown to be more sensitive to the enhancement protocol, leading to increased entanglement at the output. Numerical results show the gain in entanglement is not monotonic with the number of modes or the degree of squeezing in the additional modes. Consequently, the advantage due to having multiple squeezed input states can be maximized when the number of modes is still relatively small (e.g., four). The requirement for additional squeezing is within the current realm of implementation, making this scheme achievable with present technologies.

  14. Optimizing multimodality treatment for head and neck cancer in rural India.

    PubMed

    Trivedi, N P; Trivedi, P; Trivedi, H; Trivedi, S; Trivedi, N

    2012-01-01

    Multimodality treatment of head and neck cancer in rural India is not always feasible due to lack of infrastructure and logistics. To demonstrate the feasibility of multimodality treatment for head and neck cancer in a community setting in rural India. Community cancer center, retrospective review. This article focuses on practice environment in a cancer clinic in rural India. We evaluated patient profile, treatment protocols, infrastructure availability, factors impacting treatment decisions, cost estimations, completion of treatment, and major treatment-related complications for the patient population treated in our clinic for a 2-year period. A total of 230 head and neck cancer patients were treated with curative intent. Infrastructure support included basic operating room facility (cautery machine, suction, drill system, microscope, and anesthesia machine without ventilator support), blood bank, histopathology laboratory, and computerized tomography machine. Radiation therapy (RT) facility was available in a nearby city, about 75 km away. One hundred and fifty-four (67%) patients presented at an advanced stage, with 138 (60%) receiving multimodality treatment. One hundred and eighty-four (80%) patients underwent primary surgery and 167 (73%) received radiotherapy. Two hundred and twelve (92%) patients completed the treatment, 60 (26%) were lost to follow-up at 18-month median follow-up (range 12-26 months), with 112 patients (66%) being alive, disease free. Totally 142 were major head neck surgeries with 25 free flap reconstructions and 41 regional flaps. There were 15 (6%) major post-op complications and two perioperative mortalities. Average cost of treatment for single modality treatment was approximately 40,000 INR and for multimodality treatment was 80,000 INR. This study demonstrates that it is feasible to provide basic multimodality treatment to head and neck cancer patients in the community.

  15. Multimodal compared to pharmacologic treatments for chronic tension-type headache in adolescents.

    PubMed

    Przekop, Peter; Przekop, Allison; Haviland, Mark G

    2016-10-01

    Chronic tension-type headache (CTTH) in children and adolescents is a serious medical condition, with considerable morbidity and few effective, evidence-based treatments. We performed a chart review of 83 adolescents (age range = 13-18 years; 67 girls and 16 boys) diagnosed with CTTH. Two treatment protocols were compared: multimodal (osteopathic manipulative treatments, mindfulness, and qi gong) and pharmacologic (amitriptyline or gabapentin). Four outcomes (headache frequency, pain intensity, general health, and health interference) were assessed at three time points (baseline, 3 months, and 6 months). A fifth outcome, number of bilateral tender points, was recorded at baseline and 6 months. All five were evaluated statistically with a linear mixed model. Although both multimodal and pharmacologic treatments were effective for CTTH (time effects for all measures were significant at p < .001), results from each analysis favored multimodal treatment (the five group by time interaction effects were significant at or below the p < .001 level). Headache frequency in the pharmacologic group, for example, reduced from a monthly average (95% Confidence Interval shown in parentheses) of 23.9 (21.8, 26.0) to 16.4 (14.3, 18.6) and in the multimodal group from 22.3 (20.1, 24.5) to 4.9 (2.6, 7.2) (a substantial group difference). Pain intensity (worst in the last 24 hours, 0-10 scale) was reduced in the pharmacologic group from 6.2 (5.6, 6.9) to 3.4 (2.7, 4.1) and from 6.1 (5.4, 6.8) to 2.0 (1.2, 2.7) in the multimodal group (a less substantial difference). Across the other three assessments, group differences were larger for general health and number of tender points and less so for pain restriction. Multimodal treatment for adolescent CTTH appears to be effective. Randomized controlled trials are needed to confirm these promising results. Copyright © 2015 Elsevier Ltd. All rights reserved.

  16. Remote sensing of multimodal transportation systems : research brief.

    DOT National Transportation Integrated Search

    2016-09-01

    Remote Sensing of Multimodal Transportation Systems : Rapid condition monitoring and performance evaluations of the vast and vulnerable transportation infrastructure has been elusive. The framework and models developed in this research will enable th...

  17. Multimodal Teaching and Learning with the Use of Technology: Meanings, Practices and Discourses

    ERIC Educational Resources Information Center

    Papageorgiou, Vasiliki; Lameras, Petros

    2017-01-01

    The aim of this paper is to report on teachers' experiences of, and approaches to, multimodality in teaching and learning. A small-scale online survey with closed and semi-structured questions has been deployed to school and university teachers (n = 68) for eliciting their experiences in multimodal teaching and learning. Thematic analysis has been…

  18. Multiplexed single-mode wavelength-to-time mapping of multimode light

    PubMed Central

    Chandrasekharan, Harikumar K; Izdebski, Frauke; Gris-Sánchez, Itandehui; Krstajić, Nikola; Walker, Richard; Bridle, Helen L.; Dalgarno, Paul A.; MacPherson, William N.; Henderson, Robert K.; Birks, Tim A.; Thomson, Robert R.

    2017-01-01

    When an optical pulse propagates along an optical fibre, different wavelengths travel at different group velocities. As a result, wavelength information is converted into arrival-time information, a process known as wavelength-to-time mapping. This phenomenon is most cleanly observed using a single-mode fibre transmission line, where spatial mode dispersion is not present, but the use of such fibres restricts possible applications. Here we demonstrate that photonic lanterns based on tapered single-mode multicore fibres provide an efficient way to couple multimode light to an array of single-photon avalanche detectors, each of which has its own time-to-digital converter for time-correlated single-photon counting. Exploiting this capability, we demonstrate the multiplexed single-mode wavelength-to-time mapping of multimode light using a multicore fibre photonic lantern with 121 single-mode cores, coupled to 121 detectors on a 32 × 32 detector array. This work paves the way to efficient multimode wavelength-to-time mapping systems with the spectral performance of single-mode systems. PMID:28120822

  19. The integration of emotional and symbolic components in multimodal communication

    PubMed Central

    Mehu, Marc

    2015-01-01

    Human multimodal communication can be said to serve two main purposes: information transfer and social influence. In this paper, I argue that different components of multimodal signals play different roles in the processes of information transfer and social influence. Although the symbolic components of communication (e.g., verbal and denotative signals) are well suited to transfer conceptual information, emotional components (e.g., non-verbal signals that are difficult to manipulate voluntarily) likely take a function that is closer to social influence. I suggest that emotion should be considered a property of communicative signals, rather than an entity that is transferred as content by non-verbal signals. In this view, the effect of emotional processes on communication serve to change the quality of social signals to make them more efficient at producing responses in perceivers, whereas symbolic components increase the signals’ efficiency at interacting with the cognitive processes dedicated to the assessment of relevance. The interaction between symbolic and emotional components will be discussed in relation to the need for perceivers to evaluate the reliability of multimodal signals. PMID:26217280

  20. Rapid Screening of Cancer Margins in Tissue with Multimodal Confocal Microscopy

    PubMed Central

    Gareau, Daniel S.; Jeon, Hana; Nehal, Kishwer S.; Rajadhyaksha, Milind

    2012-01-01

    Background Complete and accurate excision of cancer is guided by the examination of histopathology. However, preparation of histopathology is labor intensive and slow, leading to insufficient sampling of tissue and incomplete and/or inaccurate excision of margins. We demonstrate the potential utility of multimodal confocal mosaicing microscopy for rapid screening of cancer margins, directly in fresh surgical excisions, without the need for conventional embedding, sectioning or processing. Materials/Methods A multimodal confocal mosaicing microscope was developed to image basal cell carcinoma margins in surgical skin excisions, with resolution that shows nuclear detail. Multimodal contrast is with fluorescence for imaging nuclei and reflectance for cellular cytoplasm and dermal collagen. Thirtyfive excisions of basal cell carcinomas from Mohs surgery were imaged, and the mosaics analyzed by comparison to the corresponding frozen pathology. Results Confocal mosaics are produced in about 9 minutes, displaying tissue in fields-of-view of 12 mm with 2X magnification. A digital staining algorithm transforms black and white contrast to purple and pink, which simulates the appearance of standard histopathology. Mosaicing enables rapid digital screening, which mimics the examination of histopathology. Conclusions Multimodal confocal mosaicing microscopy offers a technology platform to potentially enable real-time pathology at the bedside. The imaging may serve as an adjunct to conventional histopathology, to expedite screening of margins and guide surgery toward more complete and accurate excision of cancer. PMID:22721570

  1. Exploring Opioid-Sparing Multimodal Analgesia Options in Trauma: A Nursing Perspective.

    PubMed

    Sullivan, Denise; Lyons, Mary; Montgomery, Robert; Quinlan-Colwell, Ann

    Challenges with opioids (e.g., adverse events, misuse and abuse with long-term administration) have led to a renewed emphasis on opioid-sparing multimodal management of trauma pain. To assess the extent to which currently available evidence supports the efficacy and safety of various nonopioid analgesics and techniques to manage trauma pain, a literature search of recently published references was performed. Additional citations were included on the basis of authors' knowledge of the literature. Effective options for opioid-sparing analgesics include oral and intravenous (IV) acetaminophen; nonsteroidal anti-inflammatory drugs available via multiple routes; and anticonvulsants, which are especially effective for neuropathic pain associated with trauma. Intravenous routes (e.g., IV acetaminophen, IV ketorolac) may be associated with a faster onset of action than oral routes. Additional adjuvants for the treatment of trauma pain are muscle relaxants and alpha-2 adrenergic agonists. Ketamine and regional techniques play an important role in multimodal therapy but require medical and nursing support. Nonpharmacologic treatments (e.g., cryotherapy, distraction techniques, breathing and relaxation, acupuncture) supplement pharmacologic analgesics and can be safe and easy to implement. In conclusion, opioid-sparing multimodal analgesia addresses concerns associated with high doses of opioids, and many pharmacologic and nonpharmacologic options are available to implement this strategy. Nurses play key roles in comprehensive patient assessment; administration of patient-focused, opioid-sparing, multimodal analgesia in trauma; and monitoring for safety concerns.

  2. The effect of multimodal and enriched feedback on SMR-BCI performance.

    PubMed

    Sollfrank, T; Ramsay, A; Perdikis, S; Williamson, J; Murray-Smith, R; Leeb, R; Millán, J D R; Kübler, A

    2016-01-01

    This study investigated the effect of multimodal (visual and auditory) continuous feedback with information about the uncertainty of the input signal on motor imagery based BCI performance. A liquid floating through a visualization of a funnel (funnel feedback) provided enriched visual or enriched multimodal feedback. In a between subject design 30 healthy SMR-BCI naive participants were provided with either conventional bar feedback (CB), or visual funnel feedback (UF), or multimodal (visual and auditory) funnel feedback (MF). Subjects were required to imagine left and right hand movement and were trained to control the SMR based BCI for five sessions on separate days. Feedback accuracy varied largely between participants. The MF feedback lead to a significantly better performance in session 1 as compared to the CB feedback and could significantly enhance motivation and minimize frustration in BCI use across the five training sessions. The present study demonstrates that the BCI funnel feedback allows participants to modulate sensorimotor EEG rhythms. Participants were able to control the BCI with the funnel feedback with better performance during the initial session and less frustration compared to the CB feedback. The multimodal funnel feedback provides an alternative to the conventional cursorbar feedback for training subjects to modulate their sensorimotor rhythms. Copyright © 2015 International Federation of Clinical Neurophysiology. Published by Elsevier Ireland Ltd. All rights reserved.

  3. Academic Knowledge Construction and Multimodal Curriculum Development

    ERIC Educational Resources Information Center

    Loveless, Douglas J., Ed.; Griffith, Bryant, Ed.; Bérci, Margaret E., Ed.; Ortlieb, Evan, Ed.; Sullivan, Pamela, Ed.

    2014-01-01

    While incorporating digital technologies into the classroom has offered new ways of teaching and learning into educational processes, it is essential to take a look at how the digital shift impacts teachers, school administration, and curriculum development. "Academic Knowledge Construction and Multimodal Curriculum Development" presents…

  4. Outcome of transarterial chemoembolization-based multi-modal treatment in patients with unresectable hepatocellular carcinoma.

    PubMed

    Song, Do Seon; Nam, Soon Woo; Bae, Si Hyun; Kim, Jin Dong; Jang, Jeong Won; Song, Myeong Jun; Lee, Sung Won; Kim, Hee Yeon; Lee, Young Joon; Chun, Ho Jong; You, Young Kyoung; Choi, Jong Young; Yoon, Seung Kew

    2015-02-28

    To investigate the efficacy and safety of transarterial chemoembolization (TACE)-based multimodal treatment in patients with large hepatocellular carcinoma (HCC). A total of 146 consecutive patients were included in the analysis, and their medical records and radiological data were reviewed retrospectively. In total, 119 patients received TACE-based multi-modal treatments, and the remaining 27 received conservative management. Overall survival (P<0.001) and objective tumor response (P=0.003) were significantly better in the treatment group than in the conservative group. After subgroup analysis, survival benefits were observed not only in the multi-modal treatment group compared with the TACE-only group (P=0.002) but also in the surgical treatment group compared with the loco-regional treatment-only group (P<0.001). Multivariate analysis identified tumor stage (P<0.001) and tumor type (P=0.009) as two independent pre-treatment factors for survival. After adjusting for significant pre-treatment prognostic factors, objective response (P<0.001), surgical treatment (P=0.009), and multi-modal treatment (P=0.002) were identified as independent post-treatment prognostic factors. TACE-based multi-modal treatments were safe and more beneficial than conservative management. Salvage surgery after successful downstaging resulted in long-term survival in patients with large, unresectable HCC.

  5. Outcome of transarterial chemoembolization-based multi-modal treatment in patients with unresectable hepatocellular carcinoma

    PubMed Central

    Song, Do Seon; Nam, Soon Woo; Bae, Si Hyun; Kim, Jin Dong; Jang, Jeong Won; Song, Myeong Jun; Lee, Sung Won; Kim, Hee Yeon; Lee, Young Joon; Chun, Ho Jong; You, Young Kyoung; Choi, Jong Young; Yoon, Seung Kew

    2015-01-01

    AIM: To investigate the efficacy and safety of transarterial chemoembolization (TACE)-based multimodal treatment in patients with large hepatocellular carcinoma (HCC). METHODS: A total of 146 consecutive patients were included in the analysis, and their medical records and radiological data were reviewed retrospectively. RESULTS: In total, 119 patients received TACE-based multi-modal treatments, and the remaining 27 received conservative management. Overall survival (P < 0.001) and objective tumor response (P = 0.003) were significantly better in the treatment group than in the conservative group. After subgroup analysis, survival benefits were observed not only in the multi-modal treatment group compared with the TACE-only group (P = 0.002) but also in the surgical treatment group compared with the loco-regional treatment-only group (P < 0.001). Multivariate analysis identified tumor stage (P < 0.001) and tumor type (P = 0.009) as two independent pre-treatment factors for survival. After adjusting for significant pre-treatment prognostic factors, objective response (P < 0.001), surgical treatment (P = 0.009), and multi-modal treatment (P = 0.002) were identified as independent post-treatment prognostic factors. CONCLUSION: TACE-based multi-modal treatments were safe and more beneficial than conservative management. Salvage surgery after successful downstaging resulted in long-term survival in patients with large, unresectable HCC. PMID:25741147

  6. Automatic Rejection Of Multimode Laser Pulses

    NASA Technical Reports Server (NTRS)

    Tratt, David M.; Menzies, Robert T.; Esproles, Carlos

    1991-01-01

    Characteristic modulation detected, enabling rejection of multimode signals. Monitoring circuit senses multiple longitudinal mode oscillation of transversely excited, atmospheric-pressure (TEA) CO2 laser. Facility developed for inclusion into coherent detection laser radar (LIDAR) system. However, circuit described of use in any experiment where desireable to record data only when laser operates in single longitudinal mode.

  7. Multimodality localization of epileptic foci

    NASA Astrophysics Data System (ADS)

    Desco, Manuel; Pascau, Javier; Pozo, M. A.; Santos, Andres; Reig, Santiago; Gispert, Juan D.; Garcia-Barreno, Pedro

    2001-05-01

    This paper presents a multimodality approach for the localization of epileptic foci using PET, MRI and EEG combined without the need of external markers. Mutual Information algorithm is used for MRI-PET registration. Dipole coordinates (provided by BESA software) are projected onto the MRI using a specifically developed algorithm. The four anatomical references used for electrode positioning (nasion, inion and two preauricular points) are located on the MRI using a triplanar viewer combined with a surface-rendering tool. Geometric transformation using deformation of the ideal sphere used for dipole calculations is then applied to match the patient's brain size and shape. Eight treatment-refractory epileptic patients have been studied. The combination of the anatomical information from the MRI, hipoperfusion areas in PET and dipole position and orientation helped the physician in the diagnosis of epileptic focus location. Neurosurgery was not indicated for patients where PET and dipole results were inconsistent; in two cases it was clinically indicated despite the mismatch, showing a negative follow up. The multimodality approach presented does not require external markers for dipole projection onto the MRI, this being the main difference with previous methods. The proposed method may play an important role in the indication of surgery for treatment- refractory epileptic patients.

  8. Calibration of microsimulation models for multimodal freight networks.

    DOT National Transportation Integrated Search

    2012-06-01

    This research presents a framework for incorporating the unique operating characteristics of multi-modal freight networks : into the calibration process for microscopic traffic simulation models. Because of the nature of heavy freight movements : in ...

  9. Multimodal transport and TransLoad facilities in Arkansas.

    DOT National Transportation Integrated Search

    2015-01-01

    National Priorities consist of building a clean and ecient 21st century : transportation sector, and Multimodal Transportation is one of ve : Transportation System Eciency strategies at the US Department of Energy. Six : locomotives co...

  10. Towards a Compact Fiber Laser for Multimodal Imaging

    NASA Astrophysics Data System (ADS)

    Nie, Bai; Saytashev, Ilyas; Dantus, Marcos

    We report on multimodal depth-resolved imaging of unstained living Drosophila Melanogaster larva using sub-50 fs pulses centered at 1060 nm wavelength. Both second harmonic and third harmonic generation imaging modalities are demonstrated.

  11. Towards a compact fiber laser for multimodal imaging

    NASA Astrophysics Data System (ADS)

    Nie, Bai; Saytashev, Ilyas; Dantus, Marcos

    2014-03-01

    We report on multimodal depth-resolved imaging of unstained living Drosophila Melanogaster larva using sub-50 fs pulses centered at 1060 nm wavelength. Both second harmonic and third harmonic generation imaging modalities are demonstrated.

  12. Alcohol sensor based on single-mode-multimode-single-mode fiber structure

    NASA Astrophysics Data System (ADS)

    Mefina Yulias, R.; Hatta, A. M.; Sekartedjo, Sekartedjo

    2016-11-01

    Alcohol sensor based on Single-mode -Multimode-Single-mode (SMS) fiber structure is being proposed to sense alcohol concentration in alcohol-water mixtures. This proposed sensor uses refractive index sensing as its sensing principle. Fabricated SMS fiber structure had 40 m of multimode length. With power input -6 dBm and wavelength 1550 nm, the proposed sensor showed good response with sensitivity 1,983 dB per % v/v with measurement range 05 % v/v and measurement span 0,5% v/v.

  13. Reconceptualising Understandings of Texts, Readers and Contexts: One English Teacher's Response to Using Multimodal Texts and Interactive Whiteboards

    ERIC Educational Resources Information Center

    Kitson, Lisbeth

    2011-01-01

    The comprehension of multimodal texts is now a key concern with the release of the Australian National Curriculum for English (ACARA, 2010). However, the nature of multimodal texts, the diversity of readers in classrooms, and the complex technological environments through which multimodal texts are mediated, requires English teachers to reconsider…

  14. Natural Language Based Multimodal Interface for UAV Mission Planning

    NASA Technical Reports Server (NTRS)

    Chandarana, Meghan; Meszaros, Erica L.; Trujillo, Anna; Allen, B. Danette

    2017-01-01

    As the number of viable applications for unmanned aerial vehicle (UAV) systems increases at an exponential rate, interfaces that reduce the reliance on highly skilled engineers and pilots must be developed. Recent work aims to make use of common human communication modalities such as speech and gesture. This paper explores a multimodal natural language interface that uses a combination of speech and gesture input modalities to build complex UAV flight paths by defining trajectory segment primitives. Gesture inputs are used to define the general shape of a segment while speech inputs provide additional geometric information needed to fully characterize a trajectory segment. A user study is conducted in order to evaluate the efficacy of the multimodal interface.

  15. Multimodal and ubiquitous computing systems: supporting independent-living older users.

    PubMed

    Perry, Mark; Dowdall, Alan; Lines, Lorna; Hone, Kate

    2004-09-01

    We document the rationale and design of a multimodal interface to a pervasive/ubiquitous computing system that supports independent living by older people in their own homes. The Millennium Home system involves fitting a resident's home with sensors--these sensors can be used to trigger sequences of interaction with the resident to warn them about dangerous events, or to check if they need external help. We draw lessons from the design process and conclude the paper with implications for the design of multimodal interfaces to ubiquitous systems developed for the elderly and in healthcare, as well as for more general ubiquitous computing applications.

  16. Detection of elemental mercury by multimode diode laser correlation spectroscopy.

    PubMed

    Lou, Xiutao; Somesfalean, Gabriel; Svanberg, Sune; Zhang, Zhiguo; Wu, Shaohua

    2012-02-27

    We demonstrate a method for elemental mercury detection based on correlation spectroscopy employing UV laser radiation generated by sum-frequency mixing of two visible multimode diode lasers. Resonance matching of the multimode UV laser is achieved in a wide wavelength range and with good tolerance for various operating conditions. Large mode-hops provide an off-resonance baseline, eliminating interferences from other gas species with broadband absorption. A sensitivity of 1 μg/m3 is obtained for a 1-m path length and 30-s integration time. The performance of the system shows promise for mercury monitoring in industrial applications.

  17. Multimodal Deep Autoencoder for Human Pose Recovery.

    PubMed

    Hong, Chaoqun; Yu, Jun; Wan, Jian; Tao, Dacheng; Wang, Meng

    2015-12-01

    Video-based human pose recovery is usually conducted by retrieving relevant poses using image features. In the retrieving process, the mapping between 2D images and 3D poses is assumed to be linear in most of the traditional methods. However, their relationships are inherently non-linear, which limits recovery performance of these methods. In this paper, we propose a novel pose recovery method using non-linear mapping with multi-layered deep neural network. It is based on feature extraction with multimodal fusion and back-propagation deep learning. In multimodal fusion, we construct hypergraph Laplacian with low-rank representation. In this way, we obtain a unified feature description by standard eigen-decomposition of the hypergraph Laplacian matrix. In back-propagation deep learning, we learn a non-linear mapping from 2D images to 3D poses with parameter fine-tuning. The experimental results on three data sets show that the recovery error has been reduced by 20%-25%, which demonstrates the effectiveness of the proposed method.

  18. Modal noise investigation in multimode polymer waveguides

    NASA Astrophysics Data System (ADS)

    Beals, Joseph, IV; Bamiedakis, Nikos; Penty, Richard V.; White, Ian H.; DeGroot, Jon V., Jr.; Clapp, Terry V.

    2007-11-01

    In this work the recent interest in waveguides for use in short optical links has motivated a study of the modal noise dependence on launch conditions in short-reach step-index multimode polymer waveguides. Short optical links, especially those with several connection interfaces and utilising a restricted launch are likely to be subject to a modal noise power penalty. We therefore experimentally study the modal noise impact of restricted launches for a short-reach optical link employing a 50 x 50 μm polymer multimode waveguide. Lens launches resulting in small diameter input spots are investigated as are restricted launches from an 8 μm core optical fibre. For a launch spot of 10 μm diameter no impairment is observed for up to 9 dBo of mode selective loss, and for a fibre launch with a dynamic input movement of 6 μm no impairment is seen for up to 8 dBo of mode selective loss.

  19. NREL to Helm Laboratory Consortium on Vehicle Connectivity and Automation |

    Science.gov Websites

    automation, integrated multi-modal transportation systems, behavioral and decision science, <em>urban> science money, reduce emissions, save lives, and reshape the <em>urban> environment," says Gearhart. Other NREL

  20. Multi-Modal Traveler Information System - Gateway Functional Requirements

    DOT National Transportation Integrated Search

    1997-11-17

    The Multi-Modal Traveler Information System (MMTIS) project involves a large number of Intelligent Transportation System (ITS) related tasks. It involves research of all ITS initiatives in the Gary-Chicago-Milwaukee (GCM) Corridor which are currently...

  1. BER performance of multimode fiber low-frequency passbands in subcarrier multiplexing transmission

    NASA Astrophysics Data System (ADS)

    Patmanee, Jaruwat; Pinthong, Chairat; Kanprachar, Surachet

    2018-03-01

    Multimode fibers are normally known to have a channel for carrying a signal mainly by their 3-dB modal bandwidth ranging between 200 to 500 MHz-km, depending on the material and structure of the fiber. To use only this 3-dB modal bandwidth, a higher data rate signal cannot be successfully transmitted. Alternatively, it has been shown that the response of the multimode fibers at low-frequency region, defining as the frequency next to the 3-dB modal band, contains many passbands. Additionally, these low-frequency passbands have been shown to be predictable in terms of their peak frequencies; thus, suitable subcarrier frequencies can be obtained and used in SCM system. In this paper, the formula from the previous work for determining the peak frequency of all 6 low-frequency passbands is applied. These 6 passbands and the 3-dB modal band of the multimode fiber are used to convey a high data rate signal. The signal is separated into 7 subcarrier signals and transmitted over these 7 channels using SCM system. The performance of the received signal in terms of the bit-error-rate (BER) is determined and shown. Some modification and adjustment are done in order to improve the performance of the system. It is found that for a multimode fiber with a 200-MHz 3-dB modal bandwidth, a 500-Mbps data rate signal can be successfully transmitted with a BER of lower than 10-6 . The data rate transmitted over a multimode fiber can be increased 2.5 times comparing to the 3-dB modal bandwidth, without any coding technique applied.

  2. Multimodal Freight Transport Regulations in Indonesia And Its Implementation (A Case Study of Tanjung Priok Port)

    NASA Astrophysics Data System (ADS)

    Budisiswanto, N.; Miharja, M.; Kombaitan, B.; Pradono, P.

    2018-05-01

    The purpose of this paper is to present the current situation of multimodal transport in Indonesia and the various ways in which it is implemented. This paper will also examine the existing regulations and overcome barriers in implementation for providers and users of services. The paper also aims to correlate the elements of government regulation into the logistics chain, to understand the need for the application of Multimodal Transport. Indonesia has realized the benefits that can be achieved by implementing multimodal transport, an important alternative to improve logistics performance. As the government plays an important role in offering the legal and institutional framework, this paper assesses the implementation of regulatory linkages, infrastructure, and why multimodal transport is still not implemented properly.

  3. Clinical effectiveness of multimodality treatment on advanced pediatric hepatoblastoma.

    PubMed

    Zhang, Y; Zhang, W-L; Huang, D-S; Hong, L; Wang, Y-Z; Zhu, X; Hu, H-M; Zhang, P-W; Yi, Y; Han, T

    2014-01-01

    To investigate the effect of multimodality treatment of advanced paediatric hepatoblastoma and the factors affecting the prognosis. 35 childhood patients were treated with multimodality treatments consisting of chemotherapy, surgery, interventional therapy, and autologous peripheral blood stem cell transplantation. Patients were followed up every month. 33 patients completed the follow-up, of which 17 were in complete remission, 5 were in partial remission, 1 case got worse, and 10 died. The remission rate was 66.7% (22/33), and the overall survival rate was 69.7% (23/33). 1 patient with advanced hepatoblastoma got high-dose chemotherapy combined with autologous peripheral blood stem cell transplantation (APBSCT) treatment, and a primary lesion by 18 x 15 x 9 cm reduced to 10 x 8 x 4 cm. Remote metastases significantly alleviated, and partial remission reached six months. The overall survival was 9 months after transplantation. Patients with the mixed phenotype of hepatoblastoma had a worse prognosis than with the epithelial phenotype (p < 0.001), and patients in stage IV had a lower survival rate than in stage III (p < 0.001). Multimodality treatment can effectively improve remission rate and prolong the survival of children with the advanced hepatoblastoma. In addition, alpha-fetoprotein (AFP), hepatoblastoma pathological classification and staging are of great use in prediction of prognosis.

  4. Reflection Effects in Multimode Fiber Systems Utilizing Laser Transmitters

    NASA Technical Reports Server (NTRS)

    Bates, Harry E.

    1991-01-01

    A number of optical communication lines are now in use at NASA-Kennedy for the transmission of voice, computer data, and video signals. Now, all of these channels use a single carrier wavelength centered near 1300 or 1550 nm. Engineering tests in the past have given indications of the growth of systematic and random noise in the RF spectrum of a fiber network as the number of connector pairs is increased. This noise seems to occur when a laser transmitter is used instead of a LED. It has been suggested that the noise is caused by back reflections created at connector fiber interfaces. Experiments were performed to explore the effect of reflection on the transmitting laser under conditions of reflective feedback. This effort included computer integration of some of the instrumentation in the fiber optic lab using the Lab View software recently acquired by the lab group. The main goal was to interface the Anritsu Optical and RF spectrum analyzers to the MacIntosh II computer so that laser spectra and network RF spectra could be simultaneously and rapidly acquired in a form convenient for analysis. Both single and multimode fiber is installed at Kennedy. Since most are multimode, this effort concentrated on multimode systems.

  5. Reflection effects in multimode fiber systems utilizing laser transmitters

    NASA Astrophysics Data System (ADS)

    Bates, Harry E.

    1991-11-01

    A number of optical communication lines are now in use at NASA-Kennedy for the transmission of voice, computer data, and video signals. Now, all of these channels use a single carrier wavelength centered near 1300 or 1550 nm. Engineering tests in the past have given indications of the growth of systematic and random noise in the RF spectrum of a fiber network as the number of connector pairs is increased. This noise seems to occur when a laser transmitter is used instead of a LED. It has been suggested that the noise is caused by back reflections created at connector fiber interfaces. Experiments were performed to explore the effect of reflection on the transmitting laser under conditions of reflective feedback. This effort included computer integration of some of the instrumentation in the fiber optic lab using the Lab View software recently acquired by the lab group. The main goal was to interface the Anritsu Optical and RF spectrum analyzers to the MacIntosh II computer so that laser spectra and network RF spectra could be simultaneously and rapidly acquired in a form convenient for analysis. Both single and multimode fiber is installed at Kennedy. Since most are multimode, this effort concentrated on multimode systems.

  6. Validation of the Rational and Experiential Multimodal Inventory in the Italian Context.

    PubMed

    Monacis, Lucia; de Palo, Valeria; Di Nuovo, Santo; Sinatra, Maria

    2016-08-01

    The unfavorable relations of the Rational and Experiential Inventory Experiential scale with objective criterion measures and its limited content validity led Norris and Epstein to propose a more content-valid measure of the experiential thinking style, the Rational and Experiential Multimodal Inventory (REIm), in order to assess the several facets of a broader experiential system consisting of interrelated components. This study aimed to provide the Italian validation of the inventory by examining its psychometric features, its factor structure (Study 1, N = 545), and its convergent and discriminant validity (Study 2, N = 257). Study 1 supported the 2- and 4-factor solutions, and multi-group analyses confirmed the invariance measurement across age and gender for both models. Study 2 provided evidence for both the convergent validity by supporting the theoretical associations among Rational and Experiential Multimodal Inventory scores and similar and related measures, and the discriminant validity by showing associations between the two thinking styles and a different but conceptually related construct, i.e., identity formation. No associations between Rational and Experiential Multimodal Inventory scores and social desirability were found. The Italian version of the Rational and Experiential Multimodal Inventory showed satisfactory psychometric properties, thus confirming its validity. © The Author(s) 2016.

  7. Effects of Multimodal Analgesia on the Success of Mouse Embryo Transfer Surgery

    PubMed Central

    Parker, John M.; Austin, Jamie; Wilkerson, James; Carbone, Larry

    2011-01-01

    Multimodal analgesia is promoted as the best practice pain management for invasive animal research procedures. Universal acceptance and incorporation of multimodal analgesia requires assessing potential effects on study outcome. The focus of this study was to assess effects on embryo survival after multimodal analgesia comprising an opioid and nonsteroidal antiinflammatory drug (NSAID) compared with opioid-only analgesia during embryo transfer procedures in transgenic mouse production. Mice were assigned to receive either carprofen (5 mg/kg) with buprenorphine (0.1 mg/kg; CB) or vehicle with buprenorphine (0.1 mg/kg; VB) in a prospective, double-blinded placebo controlled clinical trial. Data were analyzed in surgical sets of 1 to 3 female mice receiving embryos chimeric for a shared targeted embryonic stem-cell clone and host blastocyst cells. A total of 99 surgical sets were analyzed, comprising 199 Crl:CD1 female mice and their 996 offspring. Neither yield (pups weaned per embryo implanted in the surgical set) nor birth rate (average number of pups weaned per dam in the set) differed significantly between the CB and VB conditions. Multimodal opioid–NSAID analgesia appears to have no significant positive or negative effect on the success of producing novel lines of transgenic mice by blastocyst transfer. PMID:21838973

  8. Advanced driver assistance systems: Using multimodal redundant warnings to enhance road safety.

    PubMed

    Biondi, Francesco; Strayer, David L; Rossi, Riccardo; Gastaldi, Massimiliano; Mulatti, Claudio

    2017-01-01

    This study investigated whether multimodal redundant warnings presented by advanced assistance systems reduce brake response times. Warnings presented by assistance systems are designed to assist drivers by informing them that evasive driving maneuvers are needed in order to avoid a potential accident. If these warnings are poorly designed, they may distract drivers, slow their responses, and reduce road safety. In two experiments, participants drove a simulated vehicle equipped with a forward collision avoidance system. Auditory, vibrotactile, and multimodal warnings were presented when the time to collision was shorter than five seconds. The effects of these warnings were investigated with participants performing a concurrent cell phone conversation (Exp. 1) or driving in high-density traffic (Exp. 2). Braking times and subjective workload were measured. Multimodal redundant warnings elicited faster braking reaction times. These warnings were found to be effective even when talking on a cell phone (Exp. 1) or driving in dense traffic (Exp. 2). Multimodal warnings produced higher ratings of urgency, but ratings of frustration did not increase compared to other warnings. Findings obtained in these two experiments are important given that faster braking responses may reduce the potential for a collision. Copyright © 2016 Elsevier Ltd. All rights reserved.

  9. Integration of multimodal RNA-seq data for prediction of kidney cancer survival

    PubMed Central

    Schwartzi, Matt; Parkl, Martin; Phanl, John H.; Wang., May D.

    2016-01-01

    Kidney cancer is of prominent concern in modern medicine. Predicting patient survival is critical to patient awareness and developing a proper treatment regimens. Previous prediction models built upon molecular feature analysis are limited to just gene expression data. In this study we investigate the difference in predicting five year survival between unimodal and multimodal analysis of RNA-seq data from gene, exon, junction, and isoform modalities. Our preliminary findings report higher predictive accuracy-as measured by area under the ROC curve (AUC)-for multimodal learning when compared to unimodal learning with both support vector machine (SVM) and k-nearest neighbor (KNN) methods. The results of this study justify further research on the use of multimodal RNA-seq data to predict survival for other cancer types using a larger sample size and additional machine learning methods. PMID:27532026

  10. Rethinking Resources: Multimodal Pedagogies in the ESL Classroom.

    ERIC Educational Resources Information Center

    Stein, Pippa

    2000-01-01

    Describes a process for rethinking resources in the English-as-a-Second-Language classroom. Rethinking resources is possible through multimodal pedagogies that recognize students as remakers and transformers of the representational resources available to them. (Author/VWL)

  11. Practical Aspects of Access Network Indoor Extensions Using Multimode Glass and Plastic Optical Fibers

    NASA Astrophysics Data System (ADS)

    Keiser, Gerd; Liu, Hao-Yu; Lu, Shao-Hsi; Devi Pukhrambam, Puspa

    2012-07-01

    Low-cost multimode glass and plastic optical fibers are attractive for high-capacity indoor telecom networks. Many existing buildings already have glass multimode fibers installed for local area network applications. Future indoor applications will use combinations of glass multimode fibers with plastic optical fibers that have low losses in the 850-nm-1,310-nm range. This article examines real-world link losses when randomly interconnecting glass and plastic fiber segments having factory-installed connectors. Potential interconnection issues include large variations in connector losses among randomly selected fiber segments, asymmetric link losses in bidirectional links, and variations in bandwidths among different types of fibers.

  12. Love that Book: Multimodal Response to Literature

    ERIC Educational Resources Information Center

    Dalton, Bridget; Grisham, Dana L.

    2013-01-01

    Composing with different modes--image, sound, video and the written word--to respond to and analyze literary and informational text helps students develop as readers and digital communicators. This article showcases five multimodal strategies for engaging children in rich literature-based learning using digital tools and Internet resources.

  13. Enriching and Assessing Young Children's Multimodal Storytelling

    ERIC Educational Resources Information Center

    Wessel-Powell, Christy; Kargin, Tolga; Wohlwend, Karen E.

    2016-01-01

    This article provides primary teachers with assessment tools and curricular examples to expand writers' workshop by adding a multimodal storytelling unit on drama and filmmaking, allowing students to create engaging off-the-page stories through films and play performances that enrich writing. Too often, children's literacy abilities are assessed…

  14. Meaning Making through Multiple Modalities in a Biology Classroom: A Multimodal Semiotics Discourse Analysis

    ERIC Educational Resources Information Center

    Jaipal, Kamini

    2010-01-01

    The teaching of science is a complex process, involving the use of multiple modalities. This paper illustrates the potential of a multimodal semiotics discourse analysis framework to illuminate meaning-making possibilities during the teaching of a science concept. A multimodal semiotics analytical framework is developed and used to (1) analyze the…

  15. Combining kriging, multispectral and multimodal microscopy to resolve malaria-infected erythrocyte contents.

    PubMed

    Dabo-Niang, S; Zoueu, J T

    2012-09-01

    In this communication, we demonstrate how kriging, combine with multispectral and multimodal microscopy can enhance the resolution of malaria-infected images and provide more details on their composition, for analysis and diagnosis. The results of this interpolation applied to the two principal components of multispectral and multimodal images illustrate that the examination of the content of Plasmodium falciparum infected human erythrocyte is improved. © 2012 The Authors Journal of Microscopy © 2012 Royal Microscopical Society.

  16. Multimodal biometrics for identity documents (MBioID).

    PubMed

    Dessimoz, Damien; Richiardi, Jonas; Champod, Christophe; Drygajlo, Andrzej

    2007-04-11

    The MBioID initiative has been set up to address the following germane question: What and how biometric technologies could be deployed in identity documents in the foreseeable future? This research effort proposes to look at current and future practices and systems of establishing and using biometric identity documents (IDs) and evaluate their effectiveness in large-scale developments. The first objective of the MBioID project is to present a review document establishing the current state-of-the-art related to the use of multimodal biometrics in an IDs application. This research report gives the main definitions, properties and the framework of use related to biometrics, an overview of the main standards developed in the biometric industry and standardisation organisations to ensure interoperability, as well as some of the legal framework and the issues associated to biometrics such as privacy and personal data protection. The state-of-the-art in terms of technological development is also summarised for a range of single biometric modalities (2D and 3D face, fingerprint, iris, on-line signature and speech), chosen according to ICAO recommendations and availabilities, and for various multimodal approaches. This paper gives a summary of the main elements of that report. The second objective of the MBioID project is to propose relevant acquisition and evaluation protocols for a large-scale deployment of biometric IDs. Combined with the protocols, a multimodal database will be acquired in a realistic way, in order to be as close as possible to a real biometric IDs deployment. In this paper, the issues and solutions related to the acquisition setup are briefly presented.

  17. Exploring Opioid-Sparing Multimodal Analgesia Options in Trauma: A Nursing Perspective

    PubMed Central

    Lyons, Mary; Montgomery, Robert; Quinlan-Colwell, Ann

    2016-01-01

    Challenges with opioids (e.g., adverse events, misuse and abuse with long-term administration) have led to a renewed emphasis on opioid-sparing multimodal management of trauma pain. To assess the extent to which currently available evidence supports the efficacy and safety of various nonopioid analgesics and techniques to manage trauma pain, a literature search of recently published references was performed. Additional citations were included on the basis of authors' knowledge of the literature. Effective options for opioid-sparing analgesics include oral and intravenous (IV) acetaminophen; nonsteroidal anti-inflammatory drugs available via multiple routes; and anticonvulsants, which are especially effective for neuropathic pain associated with trauma. Intravenous routes (e.g., IV acetaminophen, IV ketorolac) may be associated with a faster onset of action than oral routes. Additional adjuvants for the treatment of trauma pain are muscle relaxants and alpha-2 adrenergic agonists. Ketamine and regional techniques play an important role in multimodal therapy but require medical and nursing support. Nonpharmacologic treatments (e.g., cryotherapy, distraction techniques, breathing and relaxation, acupuncture) supplement pharmacologic analgesics and can be safe and easy to implement. In conclusion, opioid-sparing multimodal analgesia addresses concerns associated with high doses of opioids, and many pharmacologic and nonpharmacologic options are available to implement this strategy. Nurses play key roles in comprehensive patient assessment; administration of patient-focused, opioid-sparing, multimodal analgesia in trauma; and monitoring for safety concerns. PMID:27828892

  18. Multimodal corridor and capacity analysis manual. Final report

    DOE Office of Scientific and Technical Information (OSTI.GOV)

    NONE

    1998-12-31

    This report presents the results of research carried out under NCHRP Project 8-31, Long-Term Availability of Multimodal Corridor Capacity. The report is presented as a manual on multimodal corridor and capacity analysis. Because transportation-system and corridor capacity for freight and passengers is critical for meeting current and future transportation demand, this manual will provide much needed assistance to a wide range of practitioners, particularly those engaged in performance analysis, capacity management, needs studies, systems planning, and corridor development planning--including major investment studies. It provides information regarding capacity analysis approaches for highways, rail, pipelines, and waterways and presents available options formore » enhancing corridor capacity and performance through various strategies such as new capacity development, freeing up unused capacity, or control of travel demand. Evaluation methods for these options are included.« less

  19. Two-photon quantum walk in a multimode fiber

    PubMed Central

    Defienne, Hugo; Barbieri, Marco; Walmsley, Ian A.; Smith, Brian J.; Gigan, Sylvain

    2016-01-01

    Multiphoton propagation in connected structures—a quantum walk—offers the potential of simulating complex physical systems and provides a route to universal quantum computation. Increasing the complexity of quantum photonic networks where the walk occurs is essential for many applications. We implement a quantum walk of indistinguishable photon pairs in a multimode fiber supporting 380 modes. Using wavefront shaping, we control the propagation of the two-photon state through the fiber in which all modes are coupled. Excitation of arbitrary output modes of the system is realized by controlling classical and quantum interferences. This report demonstrates a highly multimode platform for multiphoton interference experiments and provides a powerful method to program a general high-dimensional multiport optical circuit. This work paves the way for the next generation of photonic devices for quantum simulation, computing, and communication. PMID:27152325

  20. Effectiveness of a Multimodal Therapy for Patients with Chronic Low Back Pain Regarding Pre-Admission Healthcare Utilization

    PubMed Central

    Borys, Constanze; Lutz, Johannes; Strauss, Bernhard; Altmann, Uwe

    2015-01-01

    Objective The aim of the study was to examine the effectiveness of an intensive inpatient three-week multimodal therapy. We focused especially on the impact on the multimodal therapy outcome of the pre-admission number of treatment types patients had received and of medical specialist groups patients had consulted. Methods 155 patients with chronic low back pain and indication for multimodal therapy were evaluated with respect to pain intensity, depression, anxiety, well-being, and pre-admission health care utilization. In our controlled clinical trial we compared N = 66 patients on the waiting list with N = 89 patients who received immediate treatment. The waiting list patients likewise attended multimodal therapy after the waiting period. Longitudinal post-treatment data for both were collected at three- and twelve-month follow-ups. The impact of pre-admission health care utilization on multimodal therapy outcome (post) was analysed by structural equation model. Results Compared to the control group, multimodal therapy patients’ pain intensity and psychological variables were significantly reduced. Longitudinal effects with respect to pre-measures were significant at three-month follow-up for pain intensity (ES = -0.48), well-being (ES = 0.78), anxiety (ES = -0.33), and depression (ES = -0.30). Effect sizes at twelve-month follow-up were small for anxiety (ES = -0.22), and moderate for general well-being (ES = 0.61). Structural equation model revealed that a higher number of pre-admission treatment types was associated with poorer post-treatment outcomes in pain intensity, well-being, and depression. Conclusion Multimodal therapy proved to be effective with regard to improvements in pain intensity, depression, anxiety, and well-being. The association between treatment effect and number of pre-admission pain treatment types suggests that patients would benefit more from attending multimodal therapy in an earlier stage of health care. PMID:26599232

  1. Cortical inter-hemispheric circuits for multimodal vocal learning in songbirds.

    PubMed

    Paterson, Amy K; Bottjer, Sarah W

    2017-10-15

    Vocal learning in songbirds and humans is strongly influenced by social interactions based on sensory inputs from several modalities. Songbird vocal learning is mediated by cortico-basal ganglia circuits that include the SHELL region of lateral magnocellular nucleus of the anterior nidopallium (LMAN), but little is known concerning neural pathways that could integrate multimodal sensory information with SHELL circuitry. In addition, cortical pathways that mediate the precise coordination between hemispheres required for song production have been little studied. In order to identify candidate mechanisms for multimodal sensory integration and bilateral coordination for vocal learning in zebra finches, we investigated the anatomical organization of two regions that receive input from SHELL: the dorsal caudolateral nidopallium (dNCL SHELL ) and a region within the ventral arcopallium (Av). Anterograde and retrograde tracing experiments revealed a topographically organized inter-hemispheric circuit: SHELL and dNCL SHELL , as well as adjacent nidopallial areas, send axonal projections to ipsilateral Av; Av in turn projects to contralateral SHELL, dNCL SHELL , and regions of nidopallium adjacent to each. Av on each side also projects directly to contralateral Av. dNCL SHELL and Av each integrate inputs from ipsilateral SHELL with inputs from sensory regions in surrounding nidopallium, suggesting that they function to integrate multimodal sensory information with song-related responses within LMAN-SHELL during vocal learning. Av projections share this integrated information from the ipsilateral hemisphere with contralateral sensory and song-learning regions. Our results suggest that the inter-hemispheric pathway through Av may function to integrate multimodal sensory feedback with vocal-learning circuitry and coordinate bilateral vocal behavior. © 2017 Wiley Periodicals, Inc.

  2. Analyzing Multimodal Interaction within a Classroom Setting

    ERIC Educational Resources Information Center

    Moura, Heloisa

    2006-01-01

    Human interactions are multimodal in nature. From simple to complex forms of transferal of information, human beings draw on a multiplicity of communicative modes, such as intonation and gaze, to make sense of everyday experiences. Likewise, the learning process, either within traditional classrooms or Virtual Learning Environments, is shaped by…

  3. Multimodal autofluorescence detection of cancer: from single cells to living organism

    NASA Astrophysics Data System (ADS)

    Horilova, J.; Cunderlikova, B.; Cagalinec, M.; Chorvat, D.; Marcek Chorvatova, A.

    2018-02-01

    Multimodal optical imaging of suspected tissues is showing to be a promising method for distinguishing suspected cancerous tissues from healthy ones. In particular, the combination of steady-state spectroscopic methods with timeresolved fluorescence provides more precise insight into native metabolism when focused on tissue autofluorescence. Cancer is linked to specific metabolic remodelation detectable spectroscopically. In this work, we evaluate possibilities and limitations of multimodal optical cancer detection in single cells, collagen-based 3D cell cultures and in living organisms (whole mice), as a representation of gradually increasing complexity of model systems.

  4. MCA-NMF: Multimodal Concept Acquisition with Non-Negative Matrix Factorization

    PubMed Central

    Mangin, Olivier; Filliat, David; ten Bosch, Louis; Oudeyer, Pierre-Yves

    2015-01-01

    In this paper we introduce MCA-NMF, a computational model of the acquisition of multimodal concepts by an agent grounded in its environment. More precisely our model finds patterns in multimodal sensor input that characterize associations across modalities (speech utterances, images and motion). We propose this computational model as an answer to the question of how some class of concepts can be learnt. In addition, the model provides a way of defining such a class of plausibly learnable concepts. We detail why the multimodal nature of perception is essential to reduce the ambiguity of learnt concepts as well as to communicate about them through speech. We then present a set of experiments that demonstrate the learning of such concepts from real non-symbolic data consisting of speech sounds, images, and motions. Finally we consider structure in perceptual signals and demonstrate that a detailed knowledge of this structure, named compositional understanding can emerge from, instead of being a prerequisite of, global understanding. An open-source implementation of the MCA-NMF learner as well as scripts and associated experimental data to reproduce the experiments are publicly available. PMID:26489021

  5. Argonne - Ring Resonators

    Science.gov Websites

    -- Link6 -- Integrated Photonic Spectrographs for Astronomy <em>Optical> Multi-Mode Interference Devices Dual Guiding, Modulating, and Emitting Light on Silicon Scope1 -- Scope 2 -- Lamp1 -- <em>optical> Ring Resonators

  6. Passive athermalization of multimode interference devices for wavelength-locking applications.

    PubMed

    Ruiz-Perez, Victor I; May-Arrioja, Daniel A; Guzman-Sepulveda, Jose R

    2017-03-06

    In this paper we demonstrate the passive, material-based athermalization of all-fiber architectures by cascading multimode interference (MMI) devices. In-line thermal compensation is achieved by including a liquid-core multimode section of variable length that allows ensuring temperature-independent operation while preserving the inherent filter-like spectral response of the MMI devices. The design of the temperature compensation unit is straightforward and its fabrication is simple. The applicability of our approach is experimentally verified by fabricating a wavelength-locked MMI laser with sensitivity of only -0.1 pm/°C, which is at least one order of magnitude lower than that achieved with other fiber optics devices.

  7. Computer-aided psychotherapy based on multimodal elicitation, estimation and regulation of emotion.

    PubMed

    Cosić, Krešimir; Popović, Siniša; Horvat, Marko; Kukolja, Davor; Dropuljić, Branimir; Kovač, Bernard; Jakovljević, Miro

    2013-09-01

    Contemporary psychiatry is looking at affective sciences to understand human behavior, cognition and the mind in health and disease. Since it has been recognized that emotions have a pivotal role for the human mind, an ever increasing number of laboratories and research centers are interested in affective sciences, affective neuroscience, affective psychology and affective psychopathology. Therefore, this paper presents multidisciplinary research results of Laboratory for Interactive Simulation System at Faculty of Electrical Engineering and Computing, University of Zagreb in the stress resilience. Patient's distortion in emotional processing of multimodal input stimuli is predominantly consequence of his/her cognitive deficit which is result of their individual mental health disorders. These emotional distortions in patient's multimodal physiological, facial, acoustic, and linguistic features related to presented stimulation can be used as indicator of patient's mental illness. Real-time processing and analysis of patient's multimodal response related to annotated input stimuli is based on appropriate machine learning methods from computer science. Comprehensive longitudinal multimodal analysis of patient's emotion, mood, feelings, attention, motivation, decision-making, and working memory in synchronization with multimodal stimuli provides extremely valuable big database for data mining, machine learning and machine reasoning. Presented multimedia stimuli sequence includes personalized images, movies and sounds, as well as semantically congruent narratives. Simultaneously, with stimuli presentation patient provides subjective emotional ratings of presented stimuli in terms of subjective units of discomfort/distress, discrete emotions, or valence and arousal. These subjective emotional ratings of input stimuli and corresponding physiological, speech, and facial output features provides enough information for evaluation of patient's cognitive appraisal deficit

  8. Multi-Modal Interaction for Robotic Mules

    DTIC Science & Technology

    2014-02-26

    Multi-Modal Interaction for Robotic Mules Glenn Taylor, Mike Quist, Matt Lanting, Cory Dunham , Patrick Theisen, Paul Muench Abstract...Taylor, Mike Quist, Matt Lanting, Cory Dunham , and Patrick Theisen are with Soar Technology, Inc. (corresponding author: 734-887- 7620; email: glenn...soartech.com; quist@soartech.com; matt.lanting@soartech.com; dunham @soartech.com; patrick.theisen@soartech.com Paul Muench is with US Army TARDEC

  9. Multimodal Sparse Coding for Event Detection

    DTIC Science & Technology

    2015-10-13

    classification tasks based on single modality. We present multimodal sparse coding for learning feature representations shared across multiple modalities...The shared representa- tions are applied to multimedia event detection (MED) and evaluated in compar- ison to unimodal counterparts, as well as other...and video tracks from the same multimedia clip, we can force the two modalities to share a similar sparse representation whose benefit includes robust

  10. Conservative multimodal management of a primitive neuroectodermal tumor of the thyroid.

    PubMed

    Natale, Romain; Thariat, Juliette; Vedrine, Pierre Olivier; Bozec, Alex; Peyrottes, Isabelle; Marcy, Pierre Yves; Haudebourg, Juliette; Pedeutour, Florence; Saâda, Esma; Thyss, Antoine

    2013-04-15

    Primitive neuroectodermal tumors (PNET) represent 1% of sarcomas. Head and neck peripheral PNETs have an intermediate prognosis between abdominopelvic disease and extremities. We here report the case of a 40-year old male who presented with primitive neuroectodermal tumor of the thyroid and was treated by multimodal treatment, including surgery, chemotherapy and intermediate dose radiotherapy. The patient is alive and fit with a functional larynx at 27 months. Multimodal treatments yield five-year survival rates of about 60%. Major drug regimens use vincristine, doxorubicin, ifosfamide or cyclophosphamide, dactinomycin and/or etoposide. Complete surgical excision is undertaken whenever possible to improve long-term survival. However, the relative radiosensitivity of tumors of the Ewing family, suggest multimodal treatment including adjuvant conformal radiotherapy in case of positive margins or poor response to chemotherapy rather than resection with 2-3 cm margins, which would imply laryngeal sacrifice for thyroid tumors. The role of expert rare tumor networks is crucial for optimal decision-making and management of such rare tumors on a case by case basis.

  11. Recommendations on nuclear and multimodality imaging in IE and CIED infections.

    PubMed

    Erba, Paola Anna; Lancellotti, Patrizio; Vilacosta, Isidre; Gaemperli, Oliver; Rouzet, Francois; Hacker, Marcus; Signore, Alberto; Slart, Riemer H J A; Habib, Gilbert

    2018-05-24

    In the latest update of the European Society of Cardiology (ESC) guidelines for the management of infective endocarditis (IE), imaging is positioned at the centre of the diagnostic work-up so that an early and accurate diagnosis can be reached. Besides echocardiography, contrast-enhanced CT (ce-CT), radiolabelled leucocyte (white blood cell, WBC) SPECT/CT and [ 18 F]FDG PET/CT are included as diagnostic tools in the diagnostic flow chart for IE. Following the clinical guidelines that provided a straightforward message on the role of multimodality imaging, we believe that it is highly relevant to produce specific recommendations on nuclear multimodality imaging in IE and cardiac implantable electronic device infections. In these procedural recommendations we therefore describe in detail the technical and practical aspects of WBC SPECT/CT and [ 18 F]FDG PET/CT, including ce-CT acquisition protocols. We also discuss the advantages and limitations of each procedure, specific pitfalls when interpreting images, and the most important results from the literature, and also provide recommendations on the appropriate use of multimodality imaging.

  12. Multimodality: a way to cope with road traffic noise? The case of European treefrog (Hyla arborea).

    PubMed

    Troïanowski, Mathieu; Melot, Geoffrey; Lengagne, Thierry

    2014-09-01

    In the last decades, traffic noise has become a new challenge for efficient animal communication and several studies suggest that it is involved in population declines. Although poorly investigated in a traffic noise context, communication is generally multimodal, which can be viewed as a way to improve communication efficiency by allowing shift from a sensory modality to another when one modality suffers from noise. In the present study, we investigated multimodal shift in the European treefrog (Hyla arborea), a species using both acoustic and visual cues during male quality assessment task performed by females. Females were used in a discrimination task in two environmental conditions: with or without traffic noise. In traffic noise conditions, we showed that females' reliance on acoustic signal embedded in noise pollution did not decrease in favour of visual signals, therefore showing that females do not shift between modalities in response to traffic noise. Although, we did not evidence multimodal shift in our study, many species facing traffic noise present multimodal communication, and should be investigated to evaluate the importance of multimodal shift as a way to cope with traffic noise pollution. Copyright © 2014 Elsevier B.V. All rights reserved.

  13. Preemptive, preventive, multimodal analgesia: what do they really mean?

    PubMed

    Rosero, Eric B; Joshi, Girish P

    2014-10-01

    To improve postoperative pain management, several concepts have been developed, including preemptive analgesia, preventive analgesia, and multimodal analgesia. This article will discuss the role of these concepts in improving perioperative pain management. Preemptive analgesia refers to the administration of an analgesic treatment before the surgical insult or tissue injury. Several randomized clinical trials have, however, provided equivocal evidence regarding the benefits of preincisional compared with postincisional analgesic administration. Current general consensus, therefore, indicates that use of preemptive analgesia does not translate into consistent clinical benefits after surgery. Preventive analgesia is a wider concept where the timing of analgesic administration in relation to the surgical incision is not critical. The aim of preventive analgesia is to minimize sensitization induced by noxious stimuli arising throughout the perioperative period. Multimodal analgesia consists of the administration of 2 or more drugs that act by different mechanisms for providing analgesia. These drugs may be administered via the same route or by different routes. Thus, the aim of multimodal analgesia is to improve pain relief while reducing opioid requirements and opioid-related adverse effects. Analgesic modalities currently available for postoperative pain control include opioids, local anesthetic techniques [local anesthetic infiltration, peripheral nerve blocks, and neuraxial blocks (epidural and paravertebral)], acetaminophen, nonsteroidal anti-inflammatory drugs, and cyclooxygenase-2-specific inhibitors as well as analgesic adjuncts such as steroids, ketamine, α-2 agonists, and anticonvulsants.

  14. Exploring the requirements for multimodal interaction for mobile devices in an end-to-end journey context.

    PubMed

    Krehl, Claudia; Sharples, Sarah

    2012-01-01

    The paper investigates the requirements for multimodal interaction on mobile devices in an end-to-end journey context. Traditional interfaces are deemed cumbersome and inefficient for exchanging information with the user. Multimodal interaction provides a different user-centred approach allowing for more natural and intuitive interaction between humans and computers. It is especially suitable for mobile interaction as it can overcome additional constraints including small screens, awkward keypads, and continuously changing settings - an inherent property of mobility. This paper is based on end-to-end journeys where users encounter several contexts during their journeys. Interviews and focus groups explore the requirements for multimodal interaction design for mobile devices by examining journey stages and identifying the users' information needs and sources. Findings suggest that multimodal communication is crucial when users multitask. Choosing suitable modalities depend on user context, characteristics and tasks.

  15. Improved multimodal biomarkers for Alzheimer's disease and mild cognitive impairment diagnosis: data from ADNI

    NASA Astrophysics Data System (ADS)

    Martinez-Torteya, Antonio; Treviño-Alvarado, Víctor; Tamez-Peña, José

    2013-02-01

    The accurate diagnosis of Alzheimer's disease (AD) and mild cognitive impairment (MCI) confers many clinical research and patient care benefits. Studies have shown that multimodal biomarkers provide better diagnosis accuracy of AD and MCI than unimodal biomarkers, but their construction has been based on traditional statistical approaches. The objective of this work was the creation of accurate AD and MCI diagnostic multimodal biomarkers using advanced bioinformatics tools. The biomarkers were created by exploring multimodal combinations of features using machine learning techniques. Data was obtained from the ADNI database. The baseline information (e.g. MRI analyses, PET analyses and laboratory essays) from AD, MCI and healthy control (HC) subjects with available diagnosis up to June 2012 was mined for case/controls candidates. The data mining yielded 47 HC, 83 MCI and 43 AD subjects for biomarker creation. Each subject was characterized by at least 980 ADNI features. A genetic algorithm feature selection strategy was used to obtain compact and accurate cross-validated nearest centroid biomarkers. The biomarkers achieved training classification accuracies of 0.983, 0.871 and 0.917 for HC vs. AD, HC vs. MCI and MCI vs. AD respectively. The constructed biomarkers were relatively compact: from 5 to 11 features. Those multimodal biomarkers included several widely accepted univariate biomarkers and novel image and biochemical features. Multimodal biomarkers constructed from previously and non-previously AD associated features showed improved diagnostic performance when compared to those based solely on previously AD associated features.

  16. Analysis of multimode fiber bundles for endoscopic spectral-domain optical coherence tomography

    PubMed Central

    Risi, Matthew D.; Makhlouf, Houssine; Rouse, Andrew R.; Gmitro, Arthur F.

    2016-01-01

    A theoretical analysis of the use of a fiber bundle in spectral-domain optical coherence tomography (OCT) systems is presented. The fiber bundle enables a flexible endoscopic design and provides fast, parallelized acquisition of the OCT data. However, the multimode characteristic of the fibers in the fiber bundle affects the depth sensitivity of the imaging system. A description of light interference in a multimode fiber is presented along with numerical simulations and experimental studies to illustrate the theoretical analysis. PMID:25967012

  17. Multimodal Interaction on English Testing Academic Assessment

    ERIC Educational Resources Information Center

    Magal-Royo, T.; Gimenez-Lopez, J. L.; Garcia Laborda, Jesus

    2012-01-01

    Multimodal interaction methods applied to learning environments of the English language will be a line for future research from the use of adapted mobile phones or PDAs. Today's mobile devices allow access and data entry in a synchronized manner through different channels. At the academic level we made the first analysis of English language…

  18. TDRSS multimode transponder program S-band modification

    NASA Technical Reports Server (NTRS)

    Mackey, J. E.

    1975-01-01

    The S-Band TDRS multimode transponder and its associated ground support equipment is described. The transponder demonstrates candidate modulation techniques to provide the required information for the design of an eventual S-band transponder suitable for installation in a user satellite, capable of operating as part of a Tracking and Data Relay Satellite (TDRS) system.

  19. Effects of Webcams on Multimodal Interactive Learning

    ERIC Educational Resources Information Center

    Codreanu, Tatiana; Celik, Christelle Combe

    2013-01-01

    This paper describes the multimodal pedagogical communication of two groups of online teachers; trainee tutors (second year students of the Master of Arts in Teaching French as a Foreign Language at the University Lumiere-Lyon 2) and experienced teachers based in different locations (France, Spain and Finland). They all taught French as a Foreign…

  20. Application of Multimodality Imaging Fusion Technology in Diagnosis and Treatment of Malignant Tumors under the Precision Medicine Plan.

    PubMed

    Wang, Shun-Yi; Chen, Xian-Xia; Li, Yi; Zhang, Yu-Ying

    2016-12-20

    The arrival of precision medicine plan brings new opportunities and challenges for patients undergoing precision diagnosis and treatment of malignant tumors. With the development of medical imaging, information on different modality imaging can be integrated and comprehensively analyzed by imaging fusion system. This review aimed to update the application of multimodality imaging fusion technology in the precise diagnosis and treatment of malignant tumors under the precision medicine plan. We introduced several multimodality imaging fusion technologies and their application to the diagnosis and treatment of malignant tumors in clinical practice. The data cited in this review were obtained mainly from the PubMed database from 1996 to 2016, using the keywords of "precision medicine", "fusion imaging", "multimodality", and "tumor diagnosis and treatment". Original articles, clinical practice, reviews, and other relevant literatures published in English were reviewed. Papers focusing on precision medicine, fusion imaging, multimodality, and tumor diagnosis and treatment were selected. Duplicated papers were excluded. Multimodality imaging fusion technology plays an important role in tumor diagnosis and treatment under the precision medicine plan, such as accurate location, qualitative diagnosis, tumor staging, treatment plan design, and real-time intraoperative monitoring. Multimodality imaging fusion systems could provide more imaging information of tumors from different dimensions and angles, thereby offing strong technical support for the implementation of precision oncology. Under the precision medicine plan, personalized treatment of tumors is a distinct possibility. We believe that multimodality imaging fusion technology will find an increasingly wide application in clinical practice.

  1. Angular and Polarization Response of Multimode Sensors with Resistive-Grid Absorbers

    NASA Technical Reports Server (NTRS)

    Kusaka, Akito; Wollack, Edward J.; Stevenson, Thomas R.

    2014-01-01

    High sensitivity receiver systems with near ideal polarization sensitivity are highly desirable for development of millimeter and sub-millimeter radio astronomy. Multimoded bolometers provide a unique solution to achieve such sensitivity, for which hundreds of single-mode sensors would otherwise be required. The primary concern in employing such multimoded sensors for polarimetery is the control of the polarization systematics. In this paper, we examine the angular- and polarization- dependent absorption pattern of a thin resistive grid or membrane, which models an absorber used for a multimoded bolometer. The result shows that a freestanding thin resistive absorber with a surface resistivity of eta/2, where eta is the impedance of free space, attains a beam pattern with equal E- and H-plane responses, leading to zero cross polarization. For a resistive-grid absorber, the condition is met when a pair of grids is positioned orthogonal to each other and both have a resistivity of eta/2. When a reflective backshort termination is employed to improve absorption efficiency, the cross-polar level can be suppressed below -30 dB if acceptance angle of the sensor is limited to < or approx. 60deg. The small cross-polar systematics have even-parity patterns and do not contaminate the measurements of odd-parity polarization patterns, for which many of recent instruments for cosmic microwave background are designed. Underlying symmetry that suppresses these cross-polar systematics is discussed in detail. The estimates and formalism provided in this paper offer key tools in the design consideration of the instruments using the multimoded polarimeters.

  2. Rats in Virtual Space: The development and implementation of a multimodal virtual reality system for small animals

    NASA Astrophysics Data System (ADS)

    Aharoni, Daniel Benjamin

    The integration of multimodal sensory information into a common neural code is a critical function of all complex nervous systems. This process is required for adaptive responding to incoming stimuli as well as the formation of a cognitive map of the external sensory environment. The underlying neural mechanisms of multimodal integration are poorly understood due, in part, to the technical difficulties of manipulating multimodal sensory information in combination with simultaneous in-vivo electrophysiological recording in awake behaving animals. We therefore developed a non-invasive multimodal virtual reality system that is conducive to wired electrophysiological recording techniques. This system allows for the dynamic presentation of highly immersive audiovisual virtual environments to rats maintained in a body fixed position on top of a quiet spherical treadmill. Notably, this allows the rats to remain at the same spatial location in the real world without the need for head fixation. This method opens the door for a wide array of future studies aimed at elucidating the underlying neural mechanisms of multimodal integration.

  3. Efficacy of Multimodal Pain Control Protocol in the Setting of Total Hip Arthroplasty

    PubMed Central

    Lee, Kyung-Jae; Bae, Ki-Cheor; Cho, Chul-Hyun; Kwon, Doo-Hyun

    2009-01-01

    Background This study evaluated the benefits and safety of a multimodal pain control protocol, which included a periarticular injection of local anesthetics, in patients undergoing total hip arthroplasty. Methods Between March 2006 and March 2007, 60 patients undergoing unilateral total hip arthroplasty were randomized to undergo either a multimodal pain control protocol or a conventional pain control protocol. The following parameters were compared: the preoperative and postoperative visual analogue scales (VAS), hospital stay, operative time, postoperative rehabilitation, additional painkiller consumption, and complication rates. Results There was no difference between the groups in terms of diagnosis, age, gender, and BMI. Although both groups had similar VAS scores in the preoperative period and on the fifth postoperative day, there was a significant difference between the groups over the four-day period after surgery. There were no differences in the hospital stay, operative time, additional painkiller consumption, or complication rate between the groups. The average time for comfortable crutch ambulation was 2.8 days in the multimodal pain control protocol group and 5.3 days in the control group. Conclusions The multimodal pain control protocol can significantly reduce the level of postoperative pain and improve patients' satisfaction, with no apparent risks, after total hip arthroplasty. PMID:19885051

  4. NaGdF4:Nd3+/Yb3+ Nanoparticles as Multimodal Imaging Agents

    NASA Astrophysics Data System (ADS)

    Pedraza, Francisco; Rightsell, Chris; Kumar, Ga; Giuliani, Jason; Monton, Car; Sardar, Dhiraj

    Medical imaging is a fundamental tool used for the diagnosis of numerous ailments. Each imaging modality has unique advantages; however, they possess intrinsic limitations. Some of which include low spatial resolution, sensitivity, penetration depth, and radiation damage. To circumvent this problem, the combination of imaging modalities, or multimodal imaging, has been proposed, such as Near Infrared Fluorescence imaging (NIRF) and Magnetic Resonance Imaging (MRI). Combining individual advantages, specificity and selectivity of NIRF with the deep penetration and high spatial resolution of MRI, it is possible to circumvent their shortcomings for a more robust imaging technique. In addition, both imaging modalities are very safe and minimally invasive. Fluorescent nanoparticles, such as NaGdF4:Nd3 +/Yb3 +, are excellent candidates for NIRF/MRI multimodal imaging. The dopants, Nd and Yb, absorb and emit within the biological window; where near infrared light is less attenuated by soft tissue. This results in less tissue damage and deeper tissue penetration making it a viable candidate in biological imaging. In addition, the inclusion of Gd results in paramagnetic properties, allowing their use as contrast agents in multimodal imaging. The work presented will include crystallographic results, as well as full optical and magnetic characterization to determine the nanoparticle's viability in multimodal imaging.

  5. Integrating Multimodal Arguments into High School Writing Instruction

    ERIC Educational Resources Information Center

    Howell, Emily; Butler, Tracy; Reinking, David

    2017-01-01

    We conducted a formative experiment investigating how an intervention that engaged students in constructing multimodal arguments could be integrated into high school English instruction to improve students' argumentative writing. The intervention entailed three essential components: (a) construction of arguments defined as claims, evidence, and…

  6. Reading Multimodal Texts: Perceptual, Structural and Ideological Perspectives

    ERIC Educational Resources Information Center

    Serafini, Frank

    2010-01-01

    This article presents a tripartite framework for analyzing multimodal texts. The three analytical perspectives presented include: (1) perceptual, (2) structural, and (3) ideological analytical processes. Using Anthony Browne's picturebook "Piggybook" as an example, assertions are made regarding what each analytical perspective brings to the…

  7. Multimodal Counseling of Childhood Encopresis: A Case Example.

    ERIC Educational Resources Information Center

    Gumaer, Jim

    1990-01-01

    Provides information regarding childhood disorder of encopresis and presents multimodal therapy techniques for school counselors who cannot successfully refer clients. Presents a case study of a teenage boy suffering from encopresis who was referred for counseling. Suggests specific treatment strategies including behavior modification, nutrition…

  8. Demonstration of analyzers for multimode photonic time-bin qubits

    NASA Astrophysics Data System (ADS)

    Jin, Jeongwan; Agne, Sascha; Bourgoin, Jean-Philippe; Zhang, Yanbao; Lütkenhaus, Norbert; Jennewein, Thomas

    2018-04-01

    We demonstrate two approaches for unbalanced interferometers as time-bin qubit analyzers for quantum communication, robust against mode distortions and polarization effects as expected from free-space quantum communication systems including wavefront deformations, path fluctuations, pointing errors, and optical elements. Despite strong spatial and temporal distortions of the optical mode of a time-bin qubit, entangled with a separate polarization qubit, we verify entanglement using the Negative Partial Transpose, with the measured visibility of up to 0.85 ±0.01 . The robustness of the analyzers is further demonstrated for various angles of incidence up to 0 .2∘ . The output of the interferometers is coupled into multimode fiber yielding a high system throughput of 0.74. Therefore, these analyzers are suitable and efficient for quantum communication over multimode optical channels.

  9. Multimodal Spatial Calibration for Accurately Registering EEG Sensor Positions

    PubMed Central

    Chen, Shengyong; Xiao, Gang; Li, Xiaoli

    2014-01-01

    This paper proposes a fast and accurate calibration method to calibrate multiple multimodal sensors using a novel photogrammetry system for fast localization of EEG sensors. The EEG sensors are placed on human head and multimodal sensors are installed around the head to simultaneously obtain all EEG sensor positions. A multiple views' calibration process is implemented to obtain the transformations of multiple views. We first develop an efficient local repair algorithm to improve the depth map, and then a special calibration body is designed. Based on them, accurate and robust calibration results can be achieved. We evaluate the proposed method by corners of a chessboard calibration plate. Experimental results demonstrate that the proposed method can achieve good performance, which can be further applied to EEG source localization applications on human brain. PMID:24803954

  10. Device design and signal processing for multiple-input multiple-output multimode fiber links

    NASA Astrophysics Data System (ADS)

    Appaiah, Kumar; Vishwanath, Sriram; Bank, Seth R.

    2012-01-01

    Multimode fibers (MMFs) are limited in data rate capabilities owing to modal dispersion. However, their large core diameter simplifies alignment and packaging, and makes them attractive for short and medium length links. Recent research has shown that the use of signal processing and techniques such as multiple-input multiple-output (MIMO) can greatly improve the data rate capabilities of multimode fibers. In this paper, we review recent experimental work using MIMO and signal processing for multimode fibers, and the improvements in data rates achievable with these techniques. We then present models to design as well as simulate the performance benefits obtainable with arrays of lasers and detectors in conjunction with MIMO, using channel capacity as the metric to optimize. We also discuss some aspects related to complexity of the algorithms needed for signal processing and discuss techniques for low complexity implementation.

  11. A hybrid multimodal non-rigid registration of MR images based on diffeomorphic demons.

    PubMed

    Lu, Huanxiang; Cattin, Philippe C; Reyes, Mauricio

    2010-01-01

    In this paper we present a novel hybrid approach for multimodal medical image registration based on diffeomorphic demons. Diffeomorphic demons have proven to be a robust and efficient way for intensity-based image registration. A very recent extension even allows to use mutual information (MI) as a similarity measure to registration multimodal images. However, due to the intensity correspondence uncertainty existing in some anatomical parts, it is difficult for a purely intensity-based algorithm to solve the registration problem. Therefore, we propose to combine the resulting transformations from both intensity-based and landmark-based methods for multimodal non-rigid registration based on diffeomorphic demons. Several experiments on different types of MR images were conducted, for which we show that a better anatomical correspondence between the images can be obtained using the hybrid approach than using either intensity information or landmarks alone.

  12. Optimization of Connector Position Offset for Bandwidth Enhancement of a Multimode Optical Fiber Link

    NASA Technical Reports Server (NTRS)

    Rawat, Banmali

    2000-01-01

    The multimode fiber bandwidth enhancement techniques to meet the Gigabit Ethernet standards for local area networks (LAN) of the Kennedy Space Center and other NASA centers have been discussed. Connector with lateral offset coupling between single mode launch fiber cable and the multimode fiber cable has been thoroughly investigated. An optimization of connector position offset for 8 km long optical fiber link at 1300 nm with 9 micrometer diameter single mode fiber (SMF) and 50 micrometer diameter multimode fiber (MMF) coupling has been obtained. The optimization is done in terms of bandwidth, eye-pattern, and bit pattern measurements. It is simpler, is a highly practical approach and is cheaper as no additional cost to manufacture the offset type of connectors is involved.

  13. Multimodality Treatment of Gastric Lymphoma.

    PubMed

    Ikoma, Naruhiko; Badgwell, Brian D; Mansfield, Paul F

    2017-04-01

    Gastric lymphoma is rare, accounting for 3% of gastric neoplasms and 10% of lymphomas. Treatment should be stratified based on histologic type, stage, Helicobacter pylori infection, and t(11;18) translocation status. Surgery is no longer a mainstay for treatment and should be reserved for rare situations such as perforation, fistula formation, and severe bleeding. Multimodal treatment, including H pylori eradication, radiation therapy, chemotherapy, and immunotherapy, should be provided as appropriate and can result in excellent outcomes. Copyright © 2016 Elsevier Inc. All rights reserved.

  14. Fiber Optic Multimode Development Study.

    DTIC Science & Technology

    1982-12-01

    techniques. These techniques include chemical vapor deposition, ion exchange and diffusion, dip coating, ion implantation, and laser heating . Three...8i63 p NCLASSIFIED F/G 2916 N S .... .... 2. m. i pa 1 1 1. 1111 0i I 11112.0 L4 2,2 MICROCOPY RESOLUTION TEST CHART NATIONAL BUREAU OF STANDARSI 963...NUMBER RADC-TR-82 -315 i, /2S- 3 W 4. TITLE (and Subtitle) LTYP OERPRT&P IOnEEFinai oTec hnica ILeportat Jul 80 - Jul 81 FIBER OPTIC MULTIMODE DEVELOPMENT

  15. Reading in the Australian Curriculum English: Describing the Effects of Structure and Organisation on Multimodal Texts

    ERIC Educational Resources Information Center

    Exley, Beryl; Cottrell, Amber

    2012-01-01

    The recently introduced "Australian Curriculum: English" (Australian Curriculum, Assessment and Reporting Authority (ACARA), 2012) requires students to "read" multimodal text and describe the effects of structure and organisation. We begin this article by tracing the variable understandings of what reading multimodal text might…

  16. Researching Multimodal Texts: Applying a Dynamic Model.

    ERIC Educational Resources Information Center

    Clancy, Susan; Lowrie, Tom

    The arrival of the digital age requires new approaches to understand the literacies used in making meanings from multimodal communications, and a rethinking of the ways in which research into these areas can be used to support learners in the 21st century. This presentation examines the range of literacies children have developed and used to make…

  17. A Multimodal Perspective on Textuality and Contexts

    ERIC Educational Resources Information Center

    Jewitt, Carey

    2007-01-01

    Textuality is often thought of in linguistic terms; for instance, the talk and writing that circulate in the classroom. In this paper I take a multimodal perspective on textuality and context. I draw on illustrative examples from school Science and English to examine how image, colour, gesture, gaze, posture and movement--as well as writing and…

  18. Analysis of the harmonic and intermodulation distortion in a multimode fiber optic link.

    PubMed

    Gasulla, I; Capmany, J

    2007-07-23

    We present an analytical evaluation of the harmonic and the intermodulation distortion effects produced in the transmission of an analog signal composed of various RF tones through a multimode fiber link. It is based on the electric field propagation model previously published by the authors. Results show the possibility of implementing subcarrier multiplexing techniques (SCM) with Composite Second Order (CSO) values below -50 dBc over short and middle reach multimode fiber links.

  19. Experimental and numerical study on refractive index sensors based on fibre Bragg gratings inscribed in multimode fibre

    NASA Astrophysics Data System (ADS)

    Filipe Kuhne, Jean; Rocha, Ana Maria; de Oliveira, Valmir; José Kalinowski, Hypolito; Canute Kamikawachi, Ricardo

    2018-02-01

    In this work is reported the experimental and numerical results of the refractive index response of etched fibre Bragg gratings written in a graded index multimode fibre. The responses of the modes coupled by the grating inscribed in a multimode fibre are compared with the mode coupled by a grating inscribed in single mode fibre. The results of this study show that the refractive index sensitivity and the dynamical range of etched fibre Bragg gratings written in multimode fibres are higher than the ones verified in single-mode fibres. The determination of oil-biodiesel blend concentrations are also compared as an example of practical applications. It is shown that a greater core diameter of the multimode fibre enables the Bragg gratings to exhibit enhanced sensitivity without requiring further fibre diameter reduction.

  20. Spontaneous generalization of abstract multimodal patterns in young domestic chicks.

    PubMed

    Versace, Elisabetta; Spierings, Michelle J; Caffini, Matteo; Ten Cate, Carel; Vallortigara, Giorgio

    2017-05-01

    From the early stages of life, learning the regularities associated with specific objects is crucial for making sense of experiences. Through filial imprinting, young precocial birds quickly learn the features of their social partners by mere exposure. It is not clear though to what extent chicks can extract abstract patterns of the visual and acoustic stimuli present in the imprinting object, and how they combine them. To investigate this issue, we exposed chicks (Gallus gallus) to three days of visual and acoustic imprinting, using either patterns with two identical items or patterns with two different items, presented visually, acoustically or in both modalities. Next, chicks were given a choice between the familiar and the unfamiliar pattern, present in either the multimodal, visual or acoustic modality. The responses to the novel stimuli were affected by their imprinting experience, and the effect was stronger for chicks imprinted with multimodal patterns than for the other groups. Interestingly, males and females adopted a different strategy, with males more attracted by unfamiliar patterns and females more attracted by familiar patterns. Our data show that chicks can generalize abstract patterns by mere exposure through filial imprinting and that multimodal stimulation is more effective than unimodal stimulation for pattern learning.

  1. Multi-Modal Traveler Information System - Gateway Interface Control Requirements

    DOT National Transportation Integrated Search

    1997-10-30

    The Multi-Modal Traveler Information System (MMTIS) project involves a large number of Intelligent Transportation System (ITS) related tasks. It involves research of all ITS initiatives in the Gary-Chicago-Milwaukee (GCM) Corridor which are currently...

  2. Multimodality image display station

    NASA Astrophysics Data System (ADS)

    Myers, H. Joseph

    1990-07-01

    The Multi-modality Image Display Station (MIDS) is designed for the use of physicians outside of the radiology department. Connected to a local area network or a host computer, it provides speedy access to digitized radiology images and written diagnostics needed by attending and consulting physicians near the patient bedside. Emphasis has been placed on low cost, high performance and ease of use. The work is being done as a joint study with the University of Texas Southwestern Medical Center at Dallas, and as part of a joint development effort with the Mayo Clinic. MIDS is a prototype, and should not be assumed to be an IBM product.

  3. Connecting, Creating and Composing: A Shared Multimodal Journey

    ERIC Educational Resources Information Center

    Krause, Margaret B.

    2015-01-01

    Given the dynamic nature of our society, literacy conceptualizations are constantly being redefined. While print literacy continues to be the primary literacy within elementary classroom, the growing nature of technological capabilities, social networking, and multimodal affordances require educators to delve into explorations of how children can…

  4. Using Multimodal Social-Skills Groups with Kindergarten Children.

    ERIC Educational Resources Information Center

    Stickel, Sue A.

    1990-01-01

    Describes a group social skills counseling strategy for kindergarten children based on Lazarus's seven modalities: behavior, affect, sensation, imagery, cognition, interpersonal relationships, and drugs/biology. Concludes multimodal approach seems suited to needs of young child whose emerging awareness is vitally engaged in each of the seven…

  5. Quantitative multi-modal NDT data analysis

    DOE Office of Scientific and Technical Information (OSTI.GOV)

    Heideklang, René; Shokouhi, Parisa

    2014-02-18

    A single NDT technique is often not adequate to provide assessments about the integrity of test objects with the required coverage or accuracy. In such situations, it is often resorted to multi-modal testing, where complementary and overlapping information from different NDT techniques are combined for a more comprehensive evaluation. Multi-modal material and defect characterization is an interesting task which involves several diverse fields of research, including signal and image processing, statistics and data mining. The fusion of different modalities may improve quantitative nondestructive evaluation by effectively exploiting the augmented set of multi-sensor information about the material. It is the redundantmore » information in particular, whose quantification is expected to lead to increased reliability and robustness of the inspection results. There are different systematic approaches to data fusion, each with its specific advantages and drawbacks. In our contribution, these will be discussed in the context of nondestructive materials testing. A practical study adopting a high-level scheme for the fusion of Eddy Current, GMR and Thermography measurements on a reference metallic specimen with built-in grooves will be presented. Results show that fusion is able to outperform the best single sensor regarding detection specificity, while retaining the same level of sensitivity.« less

  6. Research of the multimodal brain-tumor segmentation algorithm

    NASA Astrophysics Data System (ADS)

    Lu, Yisu; Chen, Wufan

    2015-12-01

    It is well-known that the number of clusters is one of the most important parameters for automatic segmentation. However, it is difficult to define owing to the high diversity in appearance of tumor tissue among different patients and the ambiguous boundaries of lesions. In this study, a nonparametric mixture of Dirichlet process (MDP) model is applied to segment the tumor images, and the MDP segmentation can be performed without the initialization of the number of clusters. A new nonparametric segmentation algorithm combined with anisotropic diffusion and a Markov random field (MRF) smooth constraint is proposed in this study. Besides the segmentation of single modal brain tumor images, we developed the algorithm to segment multimodal brain tumor images by the magnetic resonance (MR) multimodal features and obtain the active tumor and edema in the same time. The proposed algorithm is evaluated and compared with other approaches. The accuracy and computation time of our algorithm demonstrates very impressive performance.

  7. Dye-Enhanced Multimodal Confocal Imaging of Brain Cancers

    NASA Astrophysics Data System (ADS)

    Wirth, Dennis; Snuderl, Matija; Sheth, Sameer; Curry, William; Yaroslavsky, Anna

    2011-04-01

    Background and Significance: Accurate high resolution intraoperative detection of brain tumors may result in improved patient survival and better quality of life. The goal of this study was to evaluate dye enhanced multimodal confocal imaging for discriminating normal and cancerous brain tissue. Materials and Methods: Fresh thick brain specimens were obtained from the surgeries. Normal and cancer tissues were investigated. Samples were stained in methylene blue and imaged. Reflectance and fluorescence signals were excited at 658nm. Fluorescence emission and polarization were registered from 670 nm to 710 nm. The system provided lateral resolution of 0.6 μm and axial resolution of 7 μm. Normal and cancer specimens exhibited distinctively different characteristics. H&E histopathology was processed from each imaged sample. Results and Conclusions: The analysis of normal and cancerous tissues indicated clear differences in appearance in both the reflectance and fluorescence responses. These results confirm the feasibility of multimodal confocal imaging for intraoperative detection of small cancer nests and cells.

  8. Multimodal flexible cystoscopy for creating co-registered panoramas of the bladder urothelium

    NASA Astrophysics Data System (ADS)

    Seibel, Eric J.; Soper, Timothy D.; Burkhardt, Matthew R.; Porter, Michael P.; Yoon, W. Jong

    2012-02-01

    Bladder cancer is the most expensive cancer to treat due to the high rate of recurrence. Though white light cystoscopy is the gold standard for bladder cancer surveillance, the advent of fluorescence biomarkers provides an opportunity to improve sensitivity for early detection and reduced recurrence resulting from more accurate excision. Ideally, fluorescence information could be combined with standard reflectance images to provide multimodal views of the bladder wall. The scanning fiber endoscope (SFE) of 1.2mm in diameter is able to acquire wide-field multimodal video from a bladder phantom with fluorescence cancer "hot-spots". The SFE generates images by scanning red, green, and blue (RGB) laser light and detects the backscatter signal for reflectance video of 500-line resolution at 30 frames per second. We imaged a bladder phantom with painted vessels and mimicked fluorescent lesions by applying green fluorescent microspheres to the surface. By eliminating the green laser illumination, simultaneous reflectance and fluorescence images can be acquired at the same field of view, resolution, and frame rate. Moreover, the multimodal SFE is combined with a robotic steering mechanism and image stitching software as part of a fully automated bladder surveillance system. Using this system, the SFE can be reliably articulated over the entire 360° bladder surface. Acquired images can then be stitched into a multimodal 3D panorama of the bladder using software developed in our laboratory. In each panorama, the fluorescence images are exactly co-registered with RGB reflectance.

  9. Effects of Restricted Launch Conditions for the Enhancement of Bandwidth-Distance Product of Multimode Fiber Links

    NASA Technical Reports Server (NTRS)

    Andrawis, Alfred S.

    2000-01-01

    Several techniques had been proposed to enhance multimode fiber bandwidth-distance product. Single mode-to-multimode offset launch condition technique had been experimented with at Kennedy Space Center. Significant enhancement in multimode fiber link bandwidth is achieved using this technique. It is found that close to three-fold bandwidth enhancement can be achieved compared to standard zero offset launch technique. Moreover, significant reduction in modal noise has been observed as a function of offset launch displacement. However, significant reduction in the overall signal-to-noise ratio is also observed due to signal attenuation due to mode radiation from fiber core to its cladding.

  10. Cross-cultural evidence for multimodal motherese: Asian Indian mothers' adaptive use of synchronous words and gestures.

    PubMed

    Gogate, Lakshmi; Maganti, Madhavilatha; Bahrick, Lorraine E

    2015-01-01

    In a quasi-experimental study, 24 Asian Indian mothers were asked to teach novel (target) names for two objects and two actions to their children of three different levels of lexical mapping development: prelexical (5-8 months), early lexical (9-17 months), and advanced lexical (20-43 months). Target naming (n=1482) and non-target naming (other, n=2411) were coded for synchronous spoken words and object motion (multimodal motherese) and other naming styles. Indian mothers abundantly used multimodal motherese with target words to highlight novel word-referent relations, paralleling earlier findings from American mothers. They used it with target words more often for prelexical infants than for advanced lexical children and to name target actions later in children's development. Unlike American mothers, Indian mothers also abundantly used multimodal motherese to name target objects later in children's development. Finally, monolingual mothers who spoke a verb-dominant Indian language used multimodal motherese more often than bilingual mothers who also spoke noun-dominant English to their children. The findings suggest that within a dynamic and reciprocal mother-infant communication system, multimodal motherese adapts to unify novel words and referents across cultures. It adapts to children's level of lexical development and to ambient language-specific lexical dominance hierarchies. Copyright © 2014 Elsevier Inc. All rights reserved.

  11. Survey Design for a Statewide Multimodal Transportation Forecasting Model

    DOT National Transportation Integrated Search

    1992-02-01

    In 1990, the NMSHTD initiated an ambitious and long-term research project. The : project was to define the process for and undertake the development of a : statewide multimodal transportation forecasting model. The project commenced in : April, 1991....

  12. Multi-Modal Intelligent Traffic Signal Systems (MMITSS) impacts assessment.

    DOT National Transportation Integrated Search

    2015-08-01

    The study evaluates the potential network-wide impacts of the Multi-Modal Intelligent Transportation Signal System (MMITSS) based on a field data analysis utilizing data collected from a MMITSS prototype and a simulation analysis. The Intelligent Tra...

  13. MO-DE-202-04: Multimodality Image-Guided Surgery and Intervention: For the Rest of Us

    DOE Office of Scientific and Technical Information (OSTI.GOV)

    Shekhar, R.

    At least three major trends in surgical intervention have emerged over the last decade: a move toward more minimally invasive (or non-invasive) approach to the surgical target; the development of high-precision treatment delivery techniques; and the increasing role of multi-modality intraoperative imaging in support of such procedures. This symposium includes invited presentations on recent advances in each of these areas and the emerging role for medical physics research in the development and translation of high-precision interventional techniques. The four speakers are: Keyvan Farahani, “Image-guided focused ultrasound surgery and therapy” Jeffrey H. Siewerdsen, “Advances in image registration and reconstruction for image-guidedmore » neurosurgery” Tina Kapur, “Image-guided surgery and interventions in the advanced multimodality image-guided operating (AMIGO) suite” Raj Shekhar, “Multimodality image-guided interventions: Multimodality for the rest of us” Learning Objectives: Understand the principles and applications of HIFU in surgical ablation. Learn about recent advances in 3D–2D and 3D deformable image registration in support of surgical safety and precision. Learn about recent advances in model-based 3D image reconstruction in application to intraoperative 3D imaging. Understand the multi-modality imaging technologies and clinical applications investigated in the AMIGO suite. Understand the emerging need and techniques to implement multi-modality image guidance in surgical applications such as neurosurgery, orthopaedic surgery, vascular surgery, and interventional radiology. Research supported by the NIH and Siemens Healthcare.; J. Siewerdsen; Grant Support - National Institutes of Health; Grant Support - Siemens Healthcare; Grant Support - Carestream Health; Advisory Board - Carestream Health; Licensing Agreement - Carestream Health; Licensing Agreement - Elekta Oncology.; T. Kapur, P41EB015898; R. Shekhar, Funding: R42CA137886 and R41

  14. Multimodal hard x-ray imaging with resolution approaching 10 nm for studies in material science

    NASA Astrophysics Data System (ADS)

    Yan, Hanfei; Bouet, Nathalie; Zhou, Juan; Huang, Xiaojing; Nazaretski, Evgeny; Xu, Weihe; Cocco, Alex P.; Chiu, Wilson K. S.; Brinkman, Kyle S.; Chu, Yong S.

    2018-03-01

    We report multimodal scanning hard x-ray imaging with spatial resolution approaching 10 nm and its application to contemporary studies in the field of material science. The high spatial resolution is achieved by focusing hard x-rays with two crossed multilayer Laue lenses and raster-scanning a sample with respect to the nanofocusing optics. Various techniques are used to characterize and verify the achieved focus size and imaging resolution. The multimodal imaging is realized by utilizing simultaneously absorption-, phase-, and fluorescence-contrast mechanisms. The combination of high spatial resolution and multimodal imaging enables a comprehensive study of a sample on a very fine length scale. In this work, the unique multimodal imaging capability was used to investigate a mixed ionic-electronic conducting ceramic-based membrane material employed in solid oxide fuel cells and membrane separations (compound of Ce0.8Gd0.2O2‑x and CoFe2O4) which revealed the existence of an emergent material phase and quantified the chemical complexity at the nanoscale.

  15. Multimodality cardiac imaging at IRCCS Policlinico San Donato: a new interdisciplinary vision.

    PubMed

    Lombardi, Massimo; Secchi, Francesco; Pluchinotta, Francesca R; Castelvecchio, Serenella; Montericcio, Vincenzo; Camporeale, Antonia; Bandera, Francesco

    2016-04-28

    Multimodality imaging is the efficient integration of various methods of cardiovascular imaging to improve the ability to diagnose, guide therapy, or predict outcome. This approach implies both the availability of different technologies in a single unit and the presence of dedicated staff with cardiologic and radiologic background and certified competence in more than one imaging technique. Interaction with clinical practice and existence of research programmes and educational activities are pivotal for the success of this model. The aim of this paper is to describe the multimodality cardiac imaging programme recently started at San Donato Hospital.

  16. Multimode Regimes in Quantum Cascade Lasers: From Coherent Instabilities to Spatial Hole Burning

    DTIC Science & Technology

    2009-02-10

    from which absorption can take place; and although not very significant, there is always bulk n2 of the material. 1 A. E. Siegman , Lasers ...2007 4. TI11.E AND SUBTITI..E 5a. CONTRACT NUMBER Multimode regimes in quantum cascade lasers : from coherent W91INF-04-I-0253 instabilities to spatial...quantum cascade lasers (QCLs). In narrow devices it is found that above a second threshold the laser spectrwn dramatically broadens showing multimode

  17. Multimodal microscopy and the stepwise multi-photon activation fluorescence of melanin

    NASA Astrophysics Data System (ADS)

    Lai, Zhenhua

    The author's work is divided into three aspects: multimodal microscopy, stepwise multi-photon activation fluorescence (SMPAF) of melanin, and customized-profile lenses (CPL) for on-axis laser scanners, which will be introduced respectively. A multimodal microscope provides the ability to image samples with multiple modalities on the same stage, which incorporates the benefits of all modalities. The multimodal microscopes developed in this dissertation are the Keck 3D fusion multimodal microscope 2.0 (3DFM 2.0), upgraded from the old 3DFM with improved performance and flexibility, and the multimodal microscope for targeting small particles (the "Target" system). The control systems developed for both microscopes are low-cost and easy-to-build, with all components off-the-shelf. The control system have not only significantly decreased the complexity and size of the microscope, but also increased the pixel resolution and flexibility. The SMPAF of melanin, activated by a continuous-wave (CW) mode near-infrared (NIR) laser, has potential applications for a low-cost and reliable method of detecting melanin. The photophysics of melanin SMPAF has been studied by theoretical analysis of the excitation process and investigation of the spectra, activation threshold, and photon number absorption of melanin SMPAF. SMPAF images of melanin in mouse hair and skin, mouse melanoma, and human black and white hairs are compared with images taken by conventional multi-photon fluorescence microscopy (MPFM) and confocal reflectance microscopy (CRM). SMPAF images significantly increase specificity and demonstrate the potential to increase sensitivity for melanin detection compared to MPFM images and CRM images. Employing melanin SMPAF imaging to detect melanin inside human skin in vivo has been demonstrated, which proves the effectiveness of melanin detection using SMPAF for medical purposes. Selective melanin ablation with micrometer resolution has been presented using the Target system

  18. Manifold Regularized Multitask Feature Learning for Multimodality Disease Classification

    PubMed Central

    Jie, Biao; Zhang, Daoqiang; Cheng, Bo; Shen, Dinggang

    2015-01-01

    Multimodality based methods have shown great advantages in classification of Alzheimer’s disease (AD) and its prodromal stage, that is, mild cognitive impairment (MCI). Recently, multitask feature selection methods are typically used for joint selection of common features across multiple modalities. However, one disadvantage of existing multimodality based methods is that they ignore the useful data distribution information in each modality, which is essential for subsequent classification. Accordingly, in this paper we propose a manifold regularized multitask feature learning method to preserve both the intrinsic relatedness among multiple modalities of data and the data distribution information in each modality. Specifically, we denote the feature learning on each modality as a single task, and use group-sparsity regularizer to capture the intrinsic relatedness among multiple tasks (i.e., modalities) and jointly select the common features from multiple tasks. Furthermore, we introduce a new manifold-based Laplacian regularizer to preserve the data distribution information from each task. Finally, we use the multikernel support vector machine method to fuse multimodality data for eventual classification. Conversely, we also extend our method to the semisupervised setting, where only partial data are labeled. We evaluate our method using the baseline magnetic resonance imaging (MRI), fluorodeoxyglucose positron emission tomography (FDG-PET), and cerebrospinal fluid (CSF) data of subjects from AD neuroimaging initiative database. The experimental results demonstrate that our proposed method can not only achieve improved classification performance, but also help to discover the disease-related brain regions useful for disease diagnosis. PMID:25277605

  19. A multimodal interface for real-time soldier-robot teaming

    NASA Astrophysics Data System (ADS)

    Barber, Daniel J.; Howard, Thomas M.; Walter, Matthew R.

    2016-05-01

    Recent research and advances in robotics have led to the development of novel platforms leveraging new sensing capabilities for semantic navigation. As these systems becoming increasingly more robust, they support highly complex commands beyond direct teleoperation and waypoint finding facilitating a transition away from robots as tools to robots as teammates. Supporting future Soldier-Robot teaming requires communication capabilities on par with human-human teams for successful integration of robots. Therefore, as robots increase in functionality, it is equally important that the interface between the Soldier and robot advances as well. Multimodal communication (MMC) enables human-robot teaming through redundancy and levels of communications more robust than single mode interaction. Commercial-off-the-shelf (COTS) technologies released in recent years for smart-phones and gaming provide tools for the creation of portable interfaces incorporating MMC through the use of speech, gestures, and visual displays. However, for multimodal interfaces to be successfully used in the military domain, they must be able to classify speech, gestures, and process natural language in real-time with high accuracy. For the present study, a prototype multimodal interface supporting real-time interactions with an autonomous robot was developed. This device integrated COTS Automated Speech Recognition (ASR), a custom gesture recognition glove, and natural language understanding on a tablet. This paper presents performance results (e.g. response times, accuracy) of the integrated device when commanding an autonomous robot to perform reconnaissance and surveillance activities in an unknown outdoor environment.

  20. Comprehension Strategy Instruction for Multimodal Texts in Science

    ERIC Educational Resources Information Center

    Alvermann, Donna E.; Wilson, Amy Alexandra

    2011-01-01

    This article highlights examples from a middle-school science teacher's instruction using multimodal texts. Its importance lies in reconciling narrowed definitions of reading (and hence reading instruction) with the need to develop students' critical awareness as they engage with multiple sign systems, or semiotic resources, used for constructing…

  1. Utilizing Multi-Modal Literacies in Middle Grades Science

    ERIC Educational Resources Information Center

    Saurino, Dan; Ogletree, Tamra; Saurino, Penelope

    2010-01-01

    The nature of literacy is changing. Increased student use of computer-mediated, digital, and visual communication spans our understanding of adolescent multi-modal capabilities that reach beyond the traditional conventions of linear speech and written text in the science curriculum. Advancing technology opens doors to learning that involve…

  2. Border Crossings and Multimodal Composition in the Arts

    ERIC Educational Resources Information Center

    Morrison, Andrew

    2005-01-01

    Developmental and development-oriented learning with digital media are discussed in relation to the concepts border crossings and multimodal composition. The first concept refers to a transveral of disciplines and recombinations of elements from them. Local-global relations in knowledge building are covered. The second refers to the collaborative…

  3. Children Creating Multimodal Stories about a Familiar Environment

    ERIC Educational Resources Information Center

    Kervin, Lisa; Mantei, Jessica

    2017-01-01

    Storytelling is a practice that enables children to apply their literacy skills. This article shares a collaborative literacy strategy devised to enable children to create multimodal stories about their familiar school environment. The strategy uses resources, including the children's own drawings, images from Google Maps, and the Puppet Pals…

  4. Risk-Based Neuro-Grid Architecture for Multimodal Biometrics

    NASA Astrophysics Data System (ADS)

    Venkataraman, Sitalakshmi; Kulkarni, Siddhivinayak

    Recent research indicates that multimodal biometrics is the way forward for a highly reliable adoption of biometric identification systems in various applications, such as banks, businesses, government and even home environments. However, such systems would require large distributed datasets with multiple computational realms spanning organisational boundaries and individual privacies.

  5. Severe Speech Sound Disorders: An Integrated Multimodal Intervention

    ERIC Educational Resources Information Center

    King, Amie M.; Hengst, Julie A.; DeThorne, Laura S.

    2013-01-01

    Purpose: This study introduces an integrated multimodal intervention (IMI) and examines its effectiveness for the treatment of persistent and severe speech sound disorders (SSD) in young children. The IMI is an activity-based intervention that focuses simultaneously on increasing the "quantity" of a child's meaningful productions of target words…

  6. A Gradient-Based Multistart Algorithm for Multimodal Aerodynamic Shape Optimization Problems Based on Free-Form Deformation

    NASA Astrophysics Data System (ADS)

    Streuber, Gregg Mitchell

    Environmental and economic factors motivate the pursuit of more fuel-efficient aircraft designs. Aerodynamic shape optimization is a powerful tool in this effort, but is hampered by the presence of multimodality in many design spaces. Gradient-based multistart optimization uses a sampling algorithm and multiple parallel optimizations to reliably apply fast gradient-based optimization to moderately multimodal problems. Ensuring that the sampled geometries remain physically realizable requires manually developing specialized linear constraints for each class of problem. Utilizing free-form deformation geometry control allows these linear constraints to be written in a geometry-independent fashion, greatly easing the process of applying the algorithm to new problems. This algorithm was used to assess the presence of multimodality when optimizing a wing in subsonic and transonic flows, under inviscid and viscous conditions, and a blended wing-body under transonic, viscous conditions. Multimodality was present in every wing case, while the blended wing-body was found to be generally unimodal.

  7. The sensory substrate of multimodal communication in brown-headed cowbirds: are females sensory 'specialists' or 'generalists'?

    PubMed

    Ronald, Kelly L; Sesterhenn, Timothy M; Fernandez-Juricic, Esteban; Lucas, Jeffrey R

    2017-11-01

    Many animals communicate with multimodal signals. While we have an understanding of multimodal signal production, we know relatively less about receiver filtering of multimodal signals and whether filtering capacity in one modality influences filtering in a second modality. Most multimodal signals contain a temporal element, such as change in frequency over time or a dynamic visual display. We examined the relationship in temporal resolution across two modalities to test whether females are (1) sensory 'specialists', where a trade-off exists between the sensory modalities, (2) sensory 'generalists', where a positive relationship exists between the modalities, or (3) whether no relationship exists between modalities. We used female brown-headed cowbirds (Molothrus ater) to investigate this question as males court females with an audiovisual display. We found a significant positive relationship between female visual and auditory temporal resolution, suggesting that females are sensory 'generalists'. Females appear to resolve information well across multiple modalities, which may select for males that signal their quality similarly across modalities.

  8. Multimodal predictor of neurodevelopmental outcome in newborns with hypoxic-ischaemic encephalopathy.

    PubMed

    Temko, Andriy; Doyle, Orla; Murray, Deirdre; Lightbody, Gordon; Boylan, Geraldine; Marnane, William

    2015-08-01

    Automated multimodal prediction of outcome in newborns with hypoxic-ischaemic encephalopathy is investigated in this work. Routine clinical measures and 1h EEG and ECG recordings 24h after birth were obtained from 38 newborns with different grades of HIE. Each newborn was reassessed at 24 months to establish their neurodevelopmental outcome. A set of multimodal features is extracted from the clinical, heart rate and EEG measures and is fed into a support vector machine classifier. The performance is reported with the statistically most unbiased leave-one-patient-out performance assessment routine. A subset of informative features, whose rankings are consistent across all patients, is identified. The best performance is obtained using a subset of 9 EEG, 2h and 1 clinical feature, leading to an area under the ROC curve of 87% and accuracy of 84% which compares favourably to the EEG-based clinical outcome prediction, previously reported on the same data. The work presents a promising step towards the use of multimodal data in building an objective decision support tool for clinical prediction of neurodevelopmental outcome in newborns with hypoxic-ischaemic encephalopathy. Copyright © 2015 Elsevier Ltd. All rights reserved.

  9. User-oriented summary extraction for soccer video based on multimodal analysis

    NASA Astrophysics Data System (ADS)

    Liu, Huayong; Jiang, Shanshan; He, Tingting

    2011-11-01

    An advanced user-oriented summary extraction method for soccer video is proposed in this work. Firstly, an algorithm of user-oriented summary extraction for soccer video is introduced. A novel approach that integrates multimodal analysis, such as extraction and analysis of the stadium features, moving object features, audio features and text features is introduced. By these features the semantic of the soccer video and the highlight mode are obtained. Then we can find the highlight position and put them together by highlight degrees to obtain the video summary. The experimental results for sports video of world cup soccer games indicate that multimodal analysis is effective for soccer video browsing and retrieval.

  10. Carbon Tube Electrodes for Electrocardiography-Gated Cardiac Multimodality Imaging in Mice

    PubMed Central

    Choquet, Philippe; Goetz, Christian; Aubertin, Gaelle; Hubele, Fabrice; Sannié, Sébastien; Constantinesco, André

    2011-01-01

    This report describes a simple design of noninvasive carbon tube electrodes that facilitates electrocardiography (ECG) in mice during cardiac multimodality preclinical imaging. Both forepaws and the left hindpaw, covered by conductive gel, of mice were placed into the openings of small carbon tubes. Cardiac ECG-gated single-photon emission CT, X-ray CT, and MRI were tested (n = 60) in 20 mice. For all applications, electrodes were used in a warmed multimodality imaging cell. A heart rate of 563 ± 48 bpm was recorded from anesthetized mice regardless of the imaging technique used, with acquisition times ranging from 1 to 2 h. PMID:21333165

  11. Trends and determinants of multimodal travel in the USA.

    DOT National Transportation Integrated Search

    2013-08-01

    This report analyzes trends and determinants of multimodal individual traveldefined as the use of more than one mode of transportation during a given time periodin the U.S. The authors analyze U.S., South Atlantic Census Division, and Virginia ...

  12. Entanglement and Wigner Function Negativity of Multimode Non-Gaussian States

    NASA Astrophysics Data System (ADS)

    Walschaers, Mattia; Fabre, Claude; Parigi, Valentina; Treps, Nicolas

    2017-11-01

    Non-Gaussian operations are essential to exploit the quantum advantages in optical continuous variable quantum information protocols. We focus on mode-selective photon addition and subtraction as experimentally promising processes to create multimode non-Gaussian states. Our approach is based on correlation functions, as is common in quantum statistical mechanics and condensed matter physics, mixed with quantum optics tools. We formulate an analytical expression of the Wigner function after the subtraction or addition of a single photon, for arbitrarily many modes. It is used to demonstrate entanglement properties specific to non-Gaussian states and also leads to a practical and elegant condition for Wigner function negativity. Finally, we analyze the potential of photon addition and subtraction for an experimentally generated multimode Gaussian state.

  13. Entanglement and Wigner Function Negativity of Multimode Non-Gaussian States.

    PubMed

    Walschaers, Mattia; Fabre, Claude; Parigi, Valentina; Treps, Nicolas

    2017-11-03

    Non-Gaussian operations are essential to exploit the quantum advantages in optical continuous variable quantum information protocols. We focus on mode-selective photon addition and subtraction as experimentally promising processes to create multimode non-Gaussian states. Our approach is based on correlation functions, as is common in quantum statistical mechanics and condensed matter physics, mixed with quantum optics tools. We formulate an analytical expression of the Wigner function after the subtraction or addition of a single photon, for arbitrarily many modes. It is used to demonstrate entanglement properties specific to non-Gaussian states and also leads to a practical and elegant condition for Wigner function negativity. Finally, we analyze the potential of photon addition and subtraction for an experimentally generated multimode Gaussian state.

  14. A Multi-modal, Discriminative and Spatially Invariant CNN for RGB-D Object Labeling.

    PubMed

    Asif, Umar; Bennamoun, Mohammed; Sohel, Ferdous

    2017-08-30

    While deep convolutional neural networks have shown a remarkable success in image classification, the problems of inter-class similarities, intra-class variances, the effective combination of multimodal data, and the spatial variability in images of objects remain to be major challenges. To address these problems, this paper proposes a novel framework to learn a discriminative and spatially invariant classification model for object and indoor scene recognition using multimodal RGB-D imagery. This is achieved through three postulates: 1) spatial invariance - this is achieved by combining a spatial transformer network with a deep convolutional neural network to learn features which are invariant to spatial translations, rotations, and scale changes, 2) high discriminative capability - this is achieved by introducing Fisher encoding within the CNN architecture to learn features which have small inter-class similarities and large intra-class compactness, and 3) multimodal hierarchical fusion - this is achieved through the regularization of semantic segmentation to a multi-modal CNN architecture, where class probabilities are estimated at different hierarchical levels (i.e., imageand pixel-levels), and fused into a Conditional Random Field (CRF)- based inference hypothesis, the optimization of which produces consistent class labels in RGB-D images. Extensive experimental evaluations on RGB-D object and scene datasets, and live video streams (acquired from Kinect) show that our framework produces superior object and scene classification results compared to the state-of-the-art methods.

  15. Design and installation of a multimode microscopy system

    NASA Astrophysics Data System (ADS)

    Helm, Johannes P.; Haug, Finn-Mogens S.; Storm, Johan F.; Ottersen, Ole-Petter

    2001-04-01

    We describe design and installation of a multi-mode microscopy core facility in an environment of varied research activity in life-sciences. The experimentators can select any combination of a) microscopes (upright, upright fixed-stage, inverted), b) microscopy modes (widefield, DIC, IRDIC, widefield epifluorescence, transmission LSM, reflection and fluorescence CLSM, MPLSM), c) imaging techniques (direct observation, video observation, photography, quantitative camera-recording, flying spot scanning), d) auxiliary systems (equipment for live specimen imaging, electrophysiology, time-coordinated laser-scanning and electrophysiology, patch-clamp). The equipment is installed on one large vibration-isolating optical table (3m X 1.5m X 0.3m). Electronics, auxiliary equipment, and a fiber-coupled, remotely controlled Ar+-Kr+ laser are mounted in a rack system fixed to the ceiling. The design of the shelves allows the head of the CSLM to be moved to any of the microscopes without increasing critical cable lengths. At the same time easy access to all the units is preserved. The beam of a Titanium-Sapphire laser, controlled by means of an EOM and a prism GVD, is coupled directly to the microscopes. Three mirrors mounted on a single precision translation table are integrated into the beam steering system so that the beam can easily be redirected to any of the microscopes. All the available instruments can be operated by the educated and trained user. The system is popular among researchers in neuroanatomy, embryology, cell biology, molecular biology - including the study of protein interactions, e.g. by means of FRET, and electrophysiology. Its colocalization with an EM facility promises to provide considerable synergy effects.

  16. Prospective Evaluation of Multimodal Optical Imaging with Automated Image Analysis to Detect Oral Neoplasia In Vivo.

    PubMed

    Quang, Timothy; Tran, Emily Q; Schwarz, Richard A; Williams, Michelle D; Vigneswaran, Nadarajah; Gillenwater, Ann M; Richards-Kortum, Rebecca

    2017-10-01

    The 5-year survival rate for patients with oral cancer remains low, in part because diagnosis often occurs at a late stage. Early and accurate identification of oral high-grade dysplasia and cancer can help improve patient outcomes. Multimodal optical imaging is an adjunctive diagnostic technique in which autofluorescence imaging is used to identify high-risk regions within the oral cavity, followed by high-resolution microendoscopy to confirm or rule out the presence of neoplasia. Multimodal optical images were obtained from 206 sites in 100 patients. Histologic diagnosis, either from a punch biopsy or an excised surgical specimen, was used as the gold standard for all sites. Histopathologic diagnoses of moderate dysplasia or worse were considered neoplastic. Images from 92 sites in the first 30 patients were used as a training set to develop automated image analysis methods for identification of neoplasia. Diagnostic performance was evaluated prospectively using images from 114 sites in the remaining 70 patients as a test set. In the training set, multimodal optical imaging with automated image analysis correctly classified 95% of nonneoplastic sites and 94% of neoplastic sites. Among the 56 sites in the test set that were biopsied, multimodal optical imaging correctly classified 100% of nonneoplastic sites and 85% of neoplastic sites. Among the 58 sites in the test set that corresponded to a surgical specimen, multimodal imaging correctly classified 100% of nonneoplastic sites and 61% of neoplastic sites. These findings support the potential of multimodal optical imaging to aid in the early detection of oral cancer. Cancer Prev Res; 10(10); 563-70. ©2017 AACR . ©2017 American Association for Cancer Research.

  17. Mobile, Multi-modal, Label-Free Imaging Probe Analysis of Choroidal Oximetry and Retinal Hypoxia

    DTIC Science & Technology

    2015-10-01

    eyes and image choroidal vessels/capillaries using CARS intravital microscopy Subtask 3: Measure oxy-hemoglobin levels in PBI test and control eyes...AWARD NUMBER: W81XWH-14-1-0537 TITLE: Mobile, Multi-modal, Label-Free Imaging Probe Analysis of Choroidal Oximetry and Retinal Hypoxia...4. TITLE AND SUBTITLE Mobile, Multimodal, Label-Free Imaging Probe Analysis of Choroidal Oximetry and Retinal Hypoxia 5a. CONTRACT NUMBER W81XWH

  18. Challenges in Transcribing Multimodal Data: A Case Study

    ERIC Educational Resources Information Center

    Helm, Francesca; Dooly, Melinda

    2017-01-01

    Computer-mediated communication (CMC) once meant principally text-based communication mediated by computers, but rapid technological advances in recent years have heralded an era of multimodal communication with a growing emphasis on audio and video synchronous interaction. As CMC, in all its variants (text chats, video chats, forums, blogs, SMS,…

  19. "Imaginings": Reflections on Plurilingual Students' Creative Multimodal Works

    ERIC Educational Resources Information Center

    Stille, Saskia; Prasad, Gail

    2015-01-01

    The purpose of this article is to illustrate the potential contribution of a multimodal approach to English language teaching and learning in the educational context. Collaborating with English as a second language (ESL) and classroom teachers to explore ways to improve pedagogy in multilingual, multicultural schools, the authors discovered many…

  20. Multimodality and Immigrant Children (Response to Marni Binder)

    ERIC Educational Resources Information Center

    Campano, Gerald; Low, David

    2011-01-01

    This response to Marni Binder reflects upon two examples of (im)migrant children's artwork and challenges the dominant notion that (im)migration experiences--and their subsequent portrayals--can be fit into neat slots. The authors position multimodal composing opportunities as affording children a vital instrument for deploying their full semiotic…

  1. Multimode excitation-induced phase shifts in intrinsic Fabry-Perot interferometric fiber sensor spectra.

    PubMed

    Ma, Cheng; Wang, Anbo

    2010-09-01

    We report the modal analysis of optical fiber single-mode-multimode-single-mode intrinsic Fabry-Perot interferometer sensors. The multimode nature of the Fabry-Perot cavity gives rise to an additional phase term in the spectrogram due to intermodal dispersion-induced wavefront distortion, which could significantly affect the cavity length demodulation accuracy. By using an exact model to analyze the modal behavior, this phase term is explained by employing a rotating vector approach. Comparison of the theoretical analysis with experimental results is presented.

  2. An analysis of science content and representations in introductory college physics textbooks and multimodal learning resources

    NASA Astrophysics Data System (ADS)

    Donnelly, Suzanne M.

    This study features a comparative descriptive analysis of the physics content and representations surrounding the first law of thermodynamics as presented in four widely used introductory college physics textbooks representing each of four physics textbook categories (calculus-based, algebra/trigonometry-based, conceptual, and technical/applied). Introducing and employing a newly developed theoretical framework, multimodal generative learning theory (MGLT), an analysis of the multimodal characteristics of textbook and multimedia representations of physics principles was conducted. The modal affordances of textbook representations were identified, characterized, and compared across the four physics textbook categories in the context of their support of problem-solving. Keywords: college science, science textbooks, multimodal learning theory, thermodynamics, representations

  3. Linear Narratives, Arbitrary Relationships: Arbitrary Relationships: Mimesis and Direct Communication for Effectively Representing Engineering Realities Multimodally

    ERIC Educational Resources Information Center

    Jeyaraj, Joseph

    2017-01-01

    Engineers communicate multimodally using written and visual communication, but there is not much theorizing on why they do so and how. This essay, therefore, examines why engineers communicate multimodally, what, in the context of representing engineering realities, are the strengths and weaknesses of written and visual communication, and how,…

  4. Investigating the Strain, Temperature and Humidity Sensitivity of a Multimode Graded-Index Perfluorinated Polymer Optical Fiber with Bragg Grating

    PubMed Central

    Zheng, Yulong; Bremer, Kort

    2018-01-01

    In this work we investigate the strain, temperature and humidity sensitivity of a Fiber Bragg Grating (FBG) inscribed in a near infrared low-loss multimode perfluorinated polymer optical fiber based on cyclic transparent optical polymer (CYTOP). For this purpose, FBGs were inscribed into the multimode CYTOP fiber with a core diameter of 50 µm by using a krypton fluoride (KrF) excimer laser and the phase mask method. The evolution of the reflection spectrum of the FBG detected with a multimode interrogation technique revealed a single reflection peak with a full width at half maximum (FHWM) bandwidth of about 9 nm. Furthermore, the spectral envelope of the single FBG reflection peak can be optimized depending on the KrF excimer laser irradiation time. A linear shift of the Bragg wavelength due to applied strain, temperature and humidity was measured. Furthermore, depending on irradiation time of the KrF excimer laser, both the failure strain and strain sensitivity of the multimode fiber with FBG can be controlled. The inherent low light attenuation in the near infrared wavelength range (telecommunication window) of the multimode CYTOP fiber and the single FBG reflection peak when applying the multimode interrogation set-up will allow for new applications in the area of telecommunication and optical sensing. PMID:29734734

  5. Investigating the Strain, Temperature and Humidity Sensitivity of a Multimode Graded-Index Perfluorinated Polymer Optical Fiber with Bragg Grating.

    PubMed

    Zheng, Yulong; Bremer, Kort; Roth, Bernhard

    2018-05-05

    In this work we investigate the strain, temperature and humidity sensitivity of a Fiber Bragg Grating (FBG) inscribed in a near infrared low-loss multimode perfluorinated polymer optical fiber based on cyclic transparent optical polymer (CYTOP). For this purpose, FBGs were inscribed into the multimode CYTOP fiber with a core diameter of 50 µm by using a krypton fluoride (KrF) excimer laser and the phase mask method. The evolution of the reflection spectrum of the FBG detected with a multimode interrogation technique revealed a single reflection peak with a full width at half maximum (FHWM) bandwidth of about 9 nm. Furthermore, the spectral envelope of the single FBG reflection peak can be optimized depending on the KrF excimer laser irradiation time. A linear shift of the Bragg wavelength due to applied strain, temperature and humidity was measured. Furthermore, depending on irradiation time of the KrF excimer laser, both the failure strain and strain sensitivity of the multimode fiber with FBG can be controlled. The inherent low light attenuation in the near infrared wavelength range (telecommunication window) of the multimode CYTOP fiber and the single FBG reflection peak when applying the multimode interrogation set-up will allow for new applications in the area of telecommunication and optical sensing.

  6. A Multi-Modality CMOS Sensor Array for Cell-Based Assay and Drug Screening.

    PubMed

    Chi, Taiyun; Park, Jong Seok; Butts, Jessica C; Hookway, Tracy A; Su, Amy; Zhu, Chengjie; Styczynski, Mark P; McDevitt, Todd C; Wang, Hua

    2015-12-01

    In this paper, we present a fully integrated multi-modality CMOS cellular sensor array with four sensing modalities to characterize different cell physiological responses, including extracellular voltage recording, cellular impedance mapping, optical detection with shadow imaging and bioluminescence sensing, and thermal monitoring. The sensor array consists of nine parallel pixel groups and nine corresponding signal conditioning blocks. Each pixel group comprises one temperature sensor and 16 tri-modality sensor pixels, while each tri-modality sensor pixel can be independently configured for extracellular voltage recording, cellular impedance measurement (voltage excitation/current sensing), and optical detection. This sensor array supports multi-modality cellular sensing at the pixel level, which enables holistic cell characterization and joint-modality physiological monitoring on the same cellular sample with a pixel resolution of 80 μm × 100 μm. Comprehensive biological experiments with different living cell samples demonstrate the functionality and benefit of the proposed multi-modality sensing in cell-based assay and drug screening.

  7. Source signature estimation from multimode surface waves via mode-separated virtual real source method

    NASA Astrophysics Data System (ADS)

    Gao, Lingli; Pan, Yudi

    2018-05-01

    The correct estimation of the seismic source signature is crucial to exploration geophysics. Based on seismic interferometry, the virtual real source (VRS) method provides a model-independent way for source signature estimation. However, when encountering multimode surface waves, which are commonly seen in the shallow seismic survey, strong spurious events appear in seismic interferometric results. These spurious events introduce errors in the virtual-source recordings and reduce the accuracy of the source signature estimated by the VRS method. In order to estimate a correct source signature from multimode surface waves, we propose a mode-separated VRS method. In this method, multimode surface waves are mode separated before seismic interferometry. Virtual-source recordings are then obtained by applying seismic interferometry to each mode individually. Therefore, artefacts caused by cross-mode correlation are excluded in the virtual-source recordings and the estimated source signatures. A synthetic example showed that a correct source signature can be estimated with the proposed method, while strong spurious oscillation occurs in the estimated source signature if we do not apply mode separation first. We also applied the proposed method to a field example, which verified its validity and effectiveness in estimating seismic source signature from shallow seismic shot gathers containing multimode surface waves.

  8. Investigation of the bandwidth of multimode optical fibers used with 1550-nm LED and laser sources

    NASA Technical Reports Server (NTRS)

    White, Preston A., III

    1992-01-01

    Multimode optical fibers are not intended to be used with 1550-nm sources; however, it is desirable to utilize 1300/1550-nm wavelength division multiplexing (WDM) on some multimode fibers at Kennedy Space Center (KSC). No information from fiber vendors nor from the literature is available to support this use. Preliminary studies at KSC have suggested that these fibers might be usable at 1550-nm if the fibers possessed enough bandwidth when sourced by LEDs. Detailed bandwidth studies were made on 12 multimode fibers using 1300- and 1550-nm lasers and LEDs. The results showed that the modal bandwidth at 1550-nm was about 50 percent of the 1300-nm value and that the chromatic dispersion could be predicted by extrapolating the vendor's specifications for wavelengths outside the 1550-nm region. Utilizing these data, predictions of the fiber's optical bandwidth were accurately made. Problems with launch conditions and possible differential attenuation at connectors was noted at 1300-nm but was less significant at 1550-nm. It appears that the multimode fibers studied will offer adequate performance in the 1550-nm region for a number of current KSC needs. Studies of additional fibers are encouraged to gain more confidence and better understanding of the 1550-nm bandwidth of KSC's multimode optical fibers before committing to 1300/1550-nm WDM.

  9. Intra-operative periarticular multimodal injection in total knee arthroplasty: a local hospital experience in Hong Kong.

    PubMed

    Fan, J Ch

    2018-04-01

    Data from a local report revealed the superior outcome of regional anaesthesia and analgesia compared with general anaesthesia and intravenous patient-controlled analgesia in total knee arthroplasty. This retrospective study aimed to assess the efficacy of intra-operative periarticular multimodal injection in improving postoperative pain and reducing morphine consumption with patient-controlled analgesia after total knee arthroplasty in patients with knee osteoarthritis. From July 2005 to May 2009, 213 total knee arthroplasties without intra-operative periarticular multimodal injection (control group) were performed at a local hospital. From June 2009 to December 2012, 185 total knee arthroplasties were performed with intra-operative periarticular multimodal injection (cocktail group). The inclusion criteria were osteoarthritis of the knee, single method of anaesthesia (general or neuraxial), simple total knee arthroplasty without any metal augmentation or constraint, and postoperative patient-controlled analgesia. Postoperative patient-controlled morphine doses were compared. A total of 152 total knee arthroplasties were recruited to the cocktail group, and 89 to the control group. Duration of tourniquet application and preoperative knee score did not significantly correlate with morphine consumption by patient-controlled analgesia. Multimodal injection significantly decreased such consumption for 36 h. When injection was separately analysed for general and neuraxial anaesthesia, the effect lasted for 42 h and 24 h, respectively. Intra-operative periarticular multimodal injection decreased morphine consumption for up to 42 h postoperatively.

  10. Cross-Cultural Evidence for Multimodal Motherese: Asian-Indian Mothers’ Adaptive Use of Synchronous Words and Gestures

    PubMed Central

    Maganti, Madhavilatha; Bahrick, Lorraine E.

    2014-01-01

    In a quasi-experimental study, twenty-four Asian-Indian mothers were asked to teach novel (target) names for two objects and two actions to their children of three different levels of lexical-mapping development, pre-lexical (5–8 months), early-lexical (9–17 months), and advanced-lexical (20–43 months). Target (N = 1482) and non-target (other, N = 2411) naming was coded for synchronous spoken words and object motion (multimodal motherese) and other naming styles. Indian mothers abundantly used multimodal motherese with target words to highlight novel word-referent relations, paralleling earlier findings from American mothers (Gogate, Bahrick, & Watson, 2000). They used it with target words more often for pre-lexical infants than advanced-lexical children, and to name target actions later into children’s development. Unlike American mothers, Indian mothers also abundantly used multimodal motherese to name target objects later into children’s development. Finally, monolingual mothers who spoke a verb-dominant Indian language used multimodal motherese more often than bilingual mothers who also spoke noun-dominant English to their child. The findings suggest that within a dynamic and reciprocal mother-infant communication system, multimodal motherese adapts to unify novel words and referents across cultures. It adapts to children’s level of lexical development and to ambient language-specific lexical-dominance hierarchies. PMID:25285369

  11. Multi-modal gesture recognition using integrated model of motion, audio and video

    NASA Astrophysics Data System (ADS)

    Goutsu, Yusuke; Kobayashi, Takaki; Obara, Junya; Kusajima, Ikuo; Takeichi, Kazunari; Takano, Wataru; Nakamura, Yoshihiko

    2015-07-01

    Gesture recognition is used in many practical applications such as human-robot interaction, medical rehabilitation and sign language. With increasing motion sensor development, multiple data sources have become available, which leads to the rise of multi-modal gesture recognition. Since our previous approach to gesture recognition depends on a unimodal system, it is difficult to classify similar motion patterns. In order to solve this problem, a novel approach which integrates motion, audio and video models is proposed by using dataset captured by Kinect. The proposed system can recognize observed gestures by using three models. Recognition results of three models are integrated by using the proposed framework and the output becomes the final result. The motion and audio models are learned by using Hidden Markov Model. Random Forest which is the video classifier is used to learn the video model. In the experiments to test the performances of the proposed system, the motion and audio models most suitable for gesture recognition are chosen by varying feature vectors and learning methods. Additionally, the unimodal and multi-modal models are compared with respect to recognition accuracy. All the experiments are conducted on dataset provided by the competition organizer of MMGRC, which is a workshop for Multi-Modal Gesture Recognition Challenge. The comparison results show that the multi-modal model composed of three models scores the highest recognition rate. This improvement of recognition accuracy means that the complementary relationship among three models improves the accuracy of gesture recognition. The proposed system provides the application technology to understand human actions of daily life more precisely.

  12. Multimodal human communication--targeting facial expressions, speech content and prosody.

    PubMed

    Regenbogen, Christina; Schneider, Daniel A; Gur, Raquel E; Schneider, Frank; Habel, Ute; Kellermann, Thilo

    2012-05-01

    Human communication is based on a dynamic information exchange of the communication channels facial expressions, prosody, and speech content. This fMRI study elucidated the impact of multimodal emotion processing and the specific contribution of each channel on behavioral empathy and its prerequisites. Ninety-six video clips displaying actors who told self-related stories were presented to 27 healthy participants. In two conditions, all channels uniformly transported only emotional or neutral information. Three conditions selectively presented two emotional channels and one neutral channel. Subjects indicated the actors' emotional valence and their own while fMRI was recorded. Activation patterns of tri-channel emotional communication reflected multimodal processing and facilitative effects for empathy. Accordingly, subjects' behavioral empathy rates significantly deteriorated once one source was neutral. However, emotionality expressed via two of three channels yielded activation in a network associated with theory-of-mind-processes. This suggested participants' effort to infer mental states of their counterparts and was accompanied by a decline of behavioral empathy, driven by the participants' emotional responses. Channel-specific emotional contributions were present in modality-specific areas. The identification of different network-nodes associated with human interactions constitutes a prerequisite for understanding dynamics that underlie multimodal integration and explain the observed decline in empathy rates. This task might also shed light on behavioral deficits and neural changes that accompany psychiatric diseases. Copyright © 2012 Elsevier Inc. All rights reserved.

  13. Preventing the development of chronic pain after orthopaedic surgery with preventive multimodal analgesic techniques.

    PubMed

    Reuben, Scott S; Buvanendran, Asokumar

    2007-06-01

    The prevalences of complex regional pain syndrome, phantom limb pain, chronic donor-site pain, and persistent pain following total joint arthroplasty are alarmingly high. Central nervous system plasticity that occurs in response to tissue injury may contribute to the development of persistent postoperative pain. Many researchers have focused on methods to prevent central neuroplastic changes from occurring through the utilization of preemptive or preventive multimodal analgesic techniques. Multimodal analgesia allows a reduction in the doses of individual drugs for postoperative pain and thus a lower prevalence of opioid-related adverse events. The rationale for this strategy is the achievement of sufficient analgesia due to the additive effects of, or the synergistic effects between, different analgesics. Effective multimodal analgesic techniques include the use of nonsteroidal anti-inflammatory drugs, local anesthetics, alpha-2 agonists, ketamine, alpha(2)-delta ligands, and opioids.

  14. Superparamagnetic nanoparticles for enhanced magnetic resonance and multimodal imaging

    NASA Astrophysics Data System (ADS)

    Sikma, Elise Ann Schultz

    Magnetic resonance imaging (MRI) is a powerful tool for noninvasive tomographic imaging of biological systems with high spatial and temporal resolution. Superparamagnetic (SPM) nanoparticles have emerged as highly effective MR contrast agents due to their biocompatibility, ease of surface modification and magnetic properties. Conventional nanoparticle contrast agents suffer from difficult synthetic reproducibility, polydisperse sizes and weak magnetism. Numerous synthetic techniques and nanoparticle formulations have been developed to overcome these barriers. However, there are still major limitations in the development of new nanoparticle-based probes for MR and multimodal imaging including low signal amplification and absence of biochemical reporters. To address these issues, a set of multimodal (T2/optical) and dual contrast (T1/T2) nanoparticle probes has been developed. Their unique magnetic properties and imaging capabilities were thoroughly explored. An enzyme-activatable contrast agent is currently being developed as an innovative means for early in vivo detection of cancer at the cellular level. Multimodal probes function by combining the strengths of multiple imaging techniques into a single agent. Co-registration of data obtained by multiple imaging modalities validates the data, enhancing its quality and reliability. A series of T2/optical probes were successfully synthesized by attachment of a fluorescent dye to the surface of different types of nanoparticles. The multimodal nanoparticles generated sufficient MR and fluorescence signal to image transplanted islets in vivo. Dual contrast T1/T2 imaging probes were designed to overcome disadvantages inherent in the individual T1 and T2 components. A class of T1/T2 agents was developed consisting of a gadolinium (III) complex (DTPA chelate or DO3A macrocycle) conjugated to a biocompatible silica-coated metal oxide nanoparticle through a disulfide linker. The disulfide linker has the ability to be reduced

  15. Multimodal Composition and the Common Core State Standards

    ERIC Educational Resources Information Center

    Dalton, Bridget

    2013-01-01

    The Common Core State Standards call for an expanded view of literacy instruction, one where children learn to critically consume and produce text using technology and media. This article describes how a Digital Writers' Workshop can be a vehicle for integrating multimodal composition into the classroom. It offers general workshop principles and…

  16. Multi-modal trip planning system : Northeastern Illinois Regional Transportation Authority.

    DOT National Transportation Integrated Search

    2013-01-01

    This report evaluates the Multi-Modal Trip Planner System (MMTPS) implemented by the Northeastern Illinois Regional Transportation Authority (RTA) against the specific functional objectives enumerated by the Federal Transit Administration (FTA) in it...

  17. Showing or Telling a Story: A Comparative Study of Public Education Texts in Multimodality and Monomodality

    ERIC Educational Resources Information Center

    Wang, Kelu

    2013-01-01

    Multimodal texts that combine words and images produce meaning in a different way from monomodal texts that rely on words. They differ not only in representing the subject matter, but also constructing relationships between text producers and text receivers. This article uses two multimodal texts and one monomodal written text as samples, which…

  18. Introducing the Geneva Multimodal expression corpus for experimental research on emotion perception.

    PubMed

    Bänziger, Tanja; Mortillaro, Marcello; Scherer, Klaus R

    2012-10-01

    Research on the perception of emotional expressions in faces and voices is exploding in psychology, the neurosciences, and affective computing. This article provides an overview of some of the major emotion expression (EE) corpora currently available for empirical research and introduces a new, dynamic, multimodal corpus of emotion expressions, the Geneva Multimodal Emotion Portrayals Core Set (GEMEP-CS). The design features of the corpus are outlined and justified, and detailed validation data for the core set selection are presented and discussed. Finally, an associated database with microcoded facial, vocal, and body action elements, as well as observer ratings, is introduced.

  19. Raman Plus X: Biomedical Applications of Multimodal Raman Spectroscopy.

    PubMed

    Das, Nandan K; Dai, Yichuan; Liu, Peng; Hu, Chuanzhen; Tong, Lieshu; Chen, Xiaoya; Smith, Zachary J

    2017-07-07

    Raman spectroscopy is a label-free method of obtaining detailed chemical information about samples. Its compatibility with living tissue makes it an attractive choice for biomedical analysis, yet its translation from a research tool to a clinical tool has been slow, hampered by fundamental Raman scattering issues such as long integration times and limited penetration depth. In this review we detail the how combining Raman spectroscopy with other techniques yields multimodal instruments that can help to surmount the translational barriers faced by Raman alone. We review Raman combined with several optical and non-optical methods, including fluorescence, elastic scattering, OCT, phase imaging, and mass spectrometry. In each section we highlight the power of each combination along with a brief history and presentation of representative results. Finally, we conclude with a perspective detailing both benefits and challenges for multimodal Raman measurements, and give thoughts on future directions in the field.

  20. Recent Advances in Molecular, Multimodal and Theranostic Ultrasound Imaging

    PubMed Central

    Kiessling, Fabian; Fokong, Stanley; Bzyl, Jessica; Lederle, Wiltrud; Palmowski, Moritz; Lammers, Twan

    2014-01-01

    Ultrasound (US) imaging is an exquisite tool for the non-invasive and real-time diagnosis of many different diseases. In this context, US contrast agents can improve lesion delineation, characterization and therapy response evaluation. US contrast agents are usually micrometer-sized gas bubbles, stabilized with soft or hard shells. By conjugating antibodies to the microbubble (MB) surface, and by incorporating diagnostic agents, drugs or nucleic acids into or onto the MB shell, molecular, multimodal and theranostic MB can be generated. We here summarize recent advances in molecular, multimodal and theranostic US imaging, and introduce concepts how such advanced MB can be generated, applied and imaged. Examples are given for their use to image and treat oncological, cardiovascular and neurological diseases. Furthermore, we discuss for which therapeutic entities incorporation into (or conjugation to) MB is meaningful, and how US-mediated MB destruction can increase their extravasation, penetration, internalization and efficacy. PMID:24316070

  1. Raman Plus X: Biomedical Applications of Multimodal Raman Spectroscopy

    PubMed Central

    Das, Nandan K.; Dai, Yichuan; Liu, Peng; Hu, Chuanzhen; Tong, Lieshu; Chen, Xiaoya

    2017-01-01

    Raman spectroscopy is a label-free method of obtaining detailed chemical information about samples. Its compatibility with living tissue makes it an attractive choice for biomedical analysis, yet its translation from a research tool to a clinical tool has been slow, hampered by fundamental Raman scattering issues such as long integration times and limited penetration depth. In this review we detail the how combining Raman spectroscopy with other techniques yields multimodal instruments that can help to surmount the translational barriers faced by Raman alone. We review Raman combined with several optical and non-optical methods, including fluorescence, elastic scattering, OCT, phase imaging, and mass spectrometry. In each section we highlight the power of each combination along with a brief history and presentation of representative results. Finally, we conclude with a perspective detailing both benefits and challenges for multimodal Raman measurements, and give thoughts on future directions in the field. PMID:28686212

  2. Vestibular system: the many facets of a multimodal sense.

    PubMed

    Angelaki, Dora E; Cullen, Kathleen E

    2008-01-01

    Elegant sensory structures in the inner ear have evolved to measure head motion. These vestibular receptors consist of highly conserved semicircular canals and otolith organs. Unlike other senses, vestibular information in the central nervous system becomes immediately multisensory and multimodal. There is no overt, readily recognizable conscious sensation from these organs, yet vestibular signals contribute to a surprising range of brain functions, from the most automatic reflexes to spatial perception and motor coordination. Critical to these diverse, multimodal functions are multiple computationally intriguing levels of processing. For example, the need for multisensory integration necessitates vestibular representations in multiple reference frames. Proprioceptive-vestibular interactions, coupled with corollary discharge of a motor plan, allow the brain to distinguish actively generated from passive head movements. Finally, nonlinear interactions between otolith and canal signals allow the vestibular system to function as an inertial sensor and contribute critically to both navigation and spatial orientation.

  3. Integrating the Multimedia Builder Software as an Educational Tool to Deliver Fairy Tales: Promoting Multiliteracies and Multimodality

    ERIC Educational Resources Information Center

    Eteokleous, Nikleia; Pavlou, Victoria; Tsolakidis, Simos

    2015-01-01

    As a way to respond to the contemporary challenges for promoting multiliteracies and multimodality in education, the current study proposes a theoretical framework--the multiliteracies model--in identifying, developing and evaluating multimodal material. The article examines, first theoretically and then empirically, the promotion of…

  4. Parallel Information Processing (Image Transmission Via Fiber Bundle and Multimode Fiber

    NASA Technical Reports Server (NTRS)

    Kukhtarev, Nicholai

    2003-01-01

    Growing demand for visual, user-friendly representation of information inspires search for the new methods of image transmission. Currently used in-series (sequential) methods of information processing are inherently slow and are designed mainly for transmission of one or two dimensional arrays of data. Conventional transmission of data by fibers requires many fibers with array of laser diodes and photodetectors. In practice, fiber bundles are also used for transmission of images. Image is formed on the fiber-optic bundle entrance surface and each fiber transmits the incident image to the exit surface. Since the fibers do not preserve phase, only 2D intensity distribution can be transmitted in this way. Each single mode fiber transmit only one pixel of an image. Multimode fibers may be also used, so that each mode represent different pixel element. Direct transmission of image through multimode fiber is hindered by the mode scrambling and phase randomization. To overcome these obstacles wavelength and time-division multiplexing have been used, with each pixel transmitted on a separate wavelength or time interval. Phase-conjugate techniques also was tested in, but only in the unpractical scheme when reconstructed image return back to the fiber input end. Another method of three-dimensional imaging over single mode fibers was demonstrated in, using laser light of reduced spatial coherence. Coherence encoding, needed for a transmission of images by this methods, was realized with grating interferometer or with the help of an acousto-optic deflector. We suggest simple practical holographic method of image transmission over single multimode fiber or over fiber bundle with coherent light using filtering by holographic optical elements. Originally this method was successfully tested for the single multimode fiber. In this research we have modified holographic method for transmission of laser illuminated images over commercially available fiber bundle (fiber endoscope, or

  5. A novel multimode hybrid energy storage system and its energy management strategy for electric vehicles

    NASA Astrophysics Data System (ADS)

    Wang, Bin; Xu, Jun; Cao, Binggang; Zhou, Xuan

    2015-05-01

    This paper proposes a novel topology of multimode hybrid energy storage system (HESS) and its energy management strategy for electric vehicles (EVs). Compared to the conventional HESS, the proposed multimode HESS has more operating modes and thus it could in further enhance the efficiency of the system. The rule-based control strategy and the power-balancing strategy are developed for the energy management strategy to realize mode selection and power distribution. Generally, the DC-DC converter will operate at peak efficiency to convey the energy from the batteries to the UCs. Otherwise, the pure battery mode or the pure ultracapacitors (UCs) mode will be utilized without the DC-DC converter. To extend the battery life, the UCs have the highest priority to recycle the energy and the batteries are isolated from being recharged directly during regenerative braking. Simulations and experiments are established to validate the proposed multimode HESS and its energy management strategy. The results reveal that the energy losses in the DC-DC converter, the total energy consumption and the overall system efficiency of the proposed multimode HESS are improved compared to the conventional HESS.

  6. Multimodal control of sensors on multiple simulated unmanned vehicles.

    PubMed

    Baber, C; Morin, C; Parekh, M; Cahillane, M; Houghton, R J

    2011-09-01

    The use of multimodal (speech plus manual) control of the sensors on combinations of one, two, three or five simulated unmanned vehicles (UVs) is explored. Novice controllers of simulated UVs complete a series of target checking tasks. Two experiments compare speech and gamepad control for one, two, three or five UVs in a simulated environment. Increasing the number of UVs has an impact on subjective rating of workload (measured by NASA-Task Load Index), particularly when moving from one to three UVs. Objective measures of performance showed that the participants tended to issue fewer commands as the number of vehicles increased (when using the gamepad control), but, while performance with a single UV was superior to that of multiple UVs, there was little difference across two, three or five UVs. Participants with low spatial ability (measured by the Object Perspectives Test) showed an increase in time to respond to warnings when controlling five UVs. Combining speech with gamepad control of sensors on UVs leads to superior performance on a secondary (respond-to-warnings) task (implying a reduction in demand) and use of fewer commands on primary (move-sensors and classify-target) tasks (implying more efficient operation). STATEMENT OF RELEVANCE: Benefits of multimodal control for unmanned vehicles are demonstrated. When controlling sensors on multiple UVs, participants with low spatial orientation scores have problems. It is proposed that the findings of these studies have implications for selection of UV operators and suggests that future UV workstations could benefit from multimodal control.

  7. In-line optical fiber sensors based on cladded multimode tapered fibers.

    PubMed

    Villatoro, Joel; Monzón-Hernández, David; Luna-Moreno, Donato

    2004-11-10

    The use of uniform-waist cladded multimode tapered optical fibers is demonstrated for evanescent wave spectroscopy and sensors. The tapering is a simple, low-loss process and consists of stretching the fiber while it is being heated with an oscillating flame torch. As examples, a refractive-index sensor and a hydrogen sensor are demonstrated by use of a conventional graded-index multimode optical fiber. Also, absorbance spectra are measured while the tapers are immersed in an absorbing liquid. It is found experimentally that the uniform waist is the part of the taper that contributes most to the sensor sensitivity. The taper waist diameter may also be used to adjust the sensor dynamic range.

  8. Multimode optical dermoscopy (SkinSpect) analysis for skin with melanocytic nevus

    NASA Astrophysics Data System (ADS)

    Vasefi, Fartash; MacKinnon, Nicholas; Saager, Rolf; Kelly, Kristen M.; Maly, Tyler; Chave, Robert; Booth, Nicholas; Durkin, Anthony J.; Farkas, Daniel L.

    2016-04-01

    We have developed a multimode dermoscope (SkinSpect™) capable of illuminating human skin samples in-vivo with spectrally-programmable linearly-polarized light at 33 wavelengths between 468nm and 857 nm. Diffusely reflected photons are separated into collinear and cross-polarized image paths and images captured for each illumination wavelength. In vivo human skin nevi (N = 20) were evaluated with the multimode dermoscope and melanin and hemoglobin concentrations were compared with Spatially Modulated Quantitative Spectroscopy (SMoQS) measurements. Both systems show low correlation between their melanin and hemoglobin concentrations, demonstrating the ability of the SkinSpect™ to separate these molecular signatures and thus act as a biologically plausible device capable of early onset melanoma detection.

  9. Multimode four-wave mixing in an unresolved sideband optomechanical system

    NASA Astrophysics Data System (ADS)

    Li, Zongyang; You, Xiang; Li, Yongmin; Liu, Yong-Chun; Peng, Kunchi

    2018-03-01

    We have studied multimode four-wave mixing (FWM) in an unresolved sideband cavity optomechanical system. The radiation pressure coupling between the cavity fields and multiple mechanical modes results in the formation of a series of tripod-type energy-level systems, which induce the multimode FWM phenomenon. The FWM mechanism enables remarkable amplification of a weak signal field accompanied by the generation of an FWM field when only a microwatt-level pump field is applied. For proper system parameters, the amplified signal and FWM fields have equal intensity with opposite phases. The gain and frequency response bandwidth of the signal field can be dynamically tuned by varying the pump intensity, optomechanical coupling strength, and additional feedback control. Under certain conditions, the frequency response bandwidth can be very narrow and reaches the level of hertz.

  10. A robust probabilistic collaborative representation based classification for multimodal biometrics

    NASA Astrophysics Data System (ADS)

    Zhang, Jing; Liu, Huanxi; Ding, Derui; Xiao, Jianli

    2018-04-01

    Most of the traditional biometric recognition systems perform recognition with a single biometric indicator. These systems have suffered noisy data, interclass variations, unacceptable error rates, forged identity, and so on. Due to these inherent problems, it is not valid that many researchers attempt to enhance the performance of unimodal biometric systems with single features. Thus, multimodal biometrics is investigated to reduce some of these defects. This paper proposes a new multimodal biometric recognition approach by fused faces and fingerprints. For more recognizable features, the proposed method extracts block local binary pattern features for all modalities, and then combines them into a single framework. For better classification, it employs the robust probabilistic collaborative representation based classifier to recognize individuals. Experimental results indicate that the proposed method has improved the recognition accuracy compared to the unimodal biometrics.

  11. Unpacking Pandora's Box: Issues in the Assessment of English Learners' Literacy Skill Development in Multimodal Classrooms

    ERIC Educational Resources Information Center

    Pandya, Jessica Zacher

    2012-01-01

    In this commentary I unpack the Pandora's Box of issues related to the assessment of English language learners' literacy skill development in multimodal classrooms. I ask how we might quantify the benefits of multimodal composing, for k-12 as well as college students, given the existing complexity of assessing ELLs' traditional literacy skills. I…

  12. Multicore fibre technology: the road to multimode photonics

    NASA Astrophysics Data System (ADS)

    Bland-Hawthorn, J.; Min, Seong-Sik; Lindley, Emma; Leon-Saval, Sergio; Ellis, Simon; Lawrence, Jon; Beyrand, Nicolas; Roth, Martin; Löhmannsröben, Hans-Gerd; Veilleux, Sylvain

    2016-07-01

    For the past forty years, optical fibres have found widespread use in ground-based and space-based instruments. In most applications, these fibres are used in conjunction with conventional optics to transport light. But photonics offers a huge range of optical manipulations beyond light transport that were rarely exploited before 2001. The fundamental obstacle to the broader use of photonics is the difficulty of achieving photonic action in a multimode fibre. The first step towards a general solution was the invention of the photonic lantern1 in 2004 and the delivery of high-efficiency devices (< 1 dB loss) five years on2. Multicore fibres (MCF), used in conjunction with lanterns, are now enabling an even bigger leap towards multimode photonics. Until recently, the single-moded cores in MCFs were not sufficiently uniform to achieve telecom (SMF-28) performance. Now that high-quality MCFs have been realized, we turn our attention to printing complex functions (e.g. Bragg gratings for OH suppression) into their N cores. Our first work in this direction used a Mach-Zehnder interferometer (near-field phase mask) but this approach was only adequate for N=7 MCFs as measured by the grating uniformity3. We have now built a Sagnac interferometer that gives a three-fold increase in the depth of field sufficient to print across N >= 127 cores. We achieved first light this year with our 500mW Sabre FRED laser. These are sophisticated and complex interferometers. We report on our progress to date and summarize our first-year goals which include multimode OH suppression fibres for the Anglo-Australian Telescope/PRAXIS instrument and the Discovery Channel Telescope/MOHSIS instrument under development at the University of Maryland.

  13. Burnout: A Multimodal Approach to Assessment and Resolution.

    ERIC Educational Resources Information Center

    Kesler, Kathryn D.

    1990-01-01

    Claims assessment and treatment of guidance counselor burnout is not simple. A variety of causes and symptoms leads to the need for multidimensional conceptualization and action plan. The multimodal behavior mode, BASIC I.D., with the adoption of a Setting modality, has been shown to be a comprehensive approach when applied to the understanding…

  14. Learning through Story: A Collaborative, Multimodal Arts Approach

    ERIC Educational Resources Information Center

    Barton, Georgina; Baguley, Margaret

    2014-01-01

    Literate practice in the arts encompasses both aesthetics and creativity. It is also multimodal in nature and often collaborative. This article presents data collected from a small multi-age school, with children from Prep to Year 7, during their preparation for an end-of-year show. The children had studied the topics of conservation and…

  15. Multimodal browsing using VoiceXML

    NASA Astrophysics Data System (ADS)

    Caccia, Giuseppe; Lancini, Rosa C.; Peschiera, Giuseppe

    2003-06-01

    With the increasing development of devices such as personal computers, WAP and personal digital assistants connected to the World Wide Web, end users feel the need to browse the Internet through multiple modalities. We intend to investigate on how to create a user interface and a service distribution platform granting the user access to the Internet through standard I/O modalities and voice simultaneously. Different architectures are evaluated suggesting the more suitable for each client terminal (PC o WAP). In particular the design of the multimodal usermachine interface considers the synchronization issue between graphical and voice contents.

  16. An Iterative Local Updating Ensemble Smoother for Estimation and Uncertainty Assessment of Hydrologic Model Parameters With Multimodal Distributions

    NASA Astrophysics Data System (ADS)

    Zhang, Jiangjiang; Lin, Guang; Li, Weixuan; Wu, Laosheng; Zeng, Lingzao

    2018-03-01

    Ensemble smoother (ES) has been widely used in inverse modeling of hydrologic systems. However, for problems where the distribution of model parameters is multimodal, using ES directly would be problematic. One popular solution is to use a clustering algorithm to identify each mode and update the clusters with ES separately. However, this strategy may not be very efficient when the dimension of parameter space is high or the number of modes is large. Alternatively, we propose in this paper a very simple and efficient algorithm, i.e., the iterative local updating ensemble smoother (ILUES), to explore multimodal distributions of model parameters in nonlinear hydrologic systems. The ILUES algorithm works by updating local ensembles of each sample with ES to explore possible multimodal distributions. To achieve satisfactory data matches in nonlinear problems, we adopt an iterative form of ES to assimilate the measurements multiple times. Numerical cases involving nonlinearity and multimodality are tested to illustrate the performance of the proposed method. It is shown that overall the ILUES algorithm can well quantify the parametric uncertainties of complex hydrologic models, no matter whether the multimodal distribution exists.

  17. Multimodal OCT for complex assessment of tumors response to therapy

    NASA Astrophysics Data System (ADS)

    Sirotkina, Marina A.; Kiseleva, Elena B.; Gubarkova, Ekaterina V.; Matveev, Lev A.; Zaitsev, Vladimir Yu.; Matveyev, Alexander L.; Shirmanova, Marina V.; Sovetsky, Alexander A.; Moiseev, Alexander A.; Zagaynova, Elena V.; Vitkin, Alex; Gladkova, Natalia D.

    2017-07-01

    Multimodal OCT is a promising tool for monitoring of individual tumor response to antitumor therapies. The changes of tumor cells, connective tissue, microcirculation and stiffness can be estimated simultaneously in real time with high resolution.

  18. Feature-based Alignment of Volumetric Multi-modal Images

    PubMed Central

    Toews, Matthew; Zöllei, Lilla; Wells, William M.

    2014-01-01

    This paper proposes a method for aligning image volumes acquired from different imaging modalities (e.g. MR, CT) based on 3D scale-invariant image features. A novel method for encoding invariant feature geometry and appearance is developed, based on the assumption of locally linear intensity relationships, providing a solution to poor repeatability of feature detection in different image modalities. The encoding method is incorporated into a probabilistic feature-based model for multi-modal image alignment. The model parameters are estimated via a group-wise alignment algorithm, that iteratively alternates between estimating a feature-based model from feature data, then realigning feature data to the model, converging to a stable alignment solution with few pre-processing or pre-alignment requirements. The resulting model can be used to align multi-modal image data with the benefits of invariant feature correspondence: globally optimal solutions, high efficiency and low memory usage. The method is tested on the difficult RIRE data set of CT, T1, T2, PD and MP-RAGE brain images of subjects exhibiting significant inter-subject variability due to pathology. PMID:24683955

  19. Using multiple metaphors and multimodalities as a semiotic resource when teaching year 2 students computational strategies

    NASA Astrophysics Data System (ADS)

    Mildenhall, Paula; Sherriff, Barbara

    2017-06-01

    Recent research indicates that using multimodal learning experiences can be effective in teaching mathematics. Using a social semiotic lens within a participationist framework, this paper reports on a professional learning collaboration with a primary school teacher designed to explore the use of metaphors and modalities in mathematics instruction. This video case study was conducted in a year 2 classroom over two terms, with the focus on building children's understanding of computational strategies. The findings revealed that the teacher was able to successfully plan both multimodal and multiple metaphor learning experiences that acted as semiotic resources to support the children's understanding of abstract mathematics. The study also led to implications for teaching when using multiple metaphors and multimodalities.

  20. Multimode and single-mode fibers for data center and high-performance computing applications

    NASA Astrophysics Data System (ADS)

    Bickham, Scott R.

    2016-03-01

    Data center (DC) and high performance computing (HPC) applications have traditionally used a combination of copper, multimode fiber and single-mode fiber interconnects with relative percentages that depend on factors such as the line rate, reach and connectivity costs. The balance between these transmission media has increasingly shifted towards optical fiber due to the reach constraints of copper at data rates of 10 Gb/s and higher. The percentage of single-mode fiber deployed in the DC has also grown slightly since 2014, coinciding with the emergence of mega DCs with extended distance needs beyond 100 m. This trend will likely continue in the next few years as DCs expand their capacity from 100G to 400G, increase the physical size of their facilities and begin to utilize silicon-photonics transceiver technology. However there is a still a need for the low-cost and high-density connectivity, and this is sustaining the deployment of multimode fiber for links <= 100 m. In this paper, we discuss options for single-mode and multimode fibers in DCs and HPCs and introduce a reduced diameter multimode fiber concept which provides intra-and inter-rack connectivity as well as compatibility with silicon-photonic transceivers operating at 1310 nm. We also discuss the trade-offs between single-mode fiber attributes such as bend-insensitivity, attenuation and mode field diameter and their roles in capacity and connectivity in data centers.

  1. A Deep and Autoregressive Approach for Topic Modeling of Multimodal Data.

    PubMed

    Zheng, Yin; Zhang, Yu-Jin; Larochelle, Hugo

    2016-06-01

    Topic modeling based on latent Dirichlet allocation (LDA) has been a framework of choice to deal with multimodal data, such as in image annotation tasks. Another popular approach to model the multimodal data is through deep neural networks, such as the deep Boltzmann machine (DBM). Recently, a new type of topic model called the Document Neural Autoregressive Distribution Estimator (DocNADE) was proposed and demonstrated state-of-the-art performance for text document modeling. In this work, we show how to successfully apply and extend this model to multimodal data, such as simultaneous image classification and annotation. First, we propose SupDocNADE, a supervised extension of DocNADE, that increases the discriminative power of the learned hidden topic features and show how to employ it to learn a joint representation from image visual words, annotation words and class label information. We test our model on the LabelMe and UIUC-Sports data sets and show that it compares favorably to other topic models. Second, we propose a deep extension of our model and provide an efficient way of training the deep model. Experimental results show that our deep model outperforms its shallow version and reaches state-of-the-art performance on the Multimedia Information Retrieval (MIR) Flickr data set.

  2. Log-Gabor Energy Based Multimodal Medical Image Fusion in NSCT Domain

    PubMed Central

    Yang, Yong; Tong, Song; Huang, Shuying; Lin, Pan

    2014-01-01

    Multimodal medical image fusion is a powerful tool in clinical applications such as noninvasive diagnosis, image-guided radiotherapy, and treatment planning. In this paper, a novel nonsubsampled Contourlet transform (NSCT) based method for multimodal medical image fusion is presented, which is approximately shift invariant and can effectively suppress the pseudo-Gibbs phenomena. The source medical images are initially transformed by NSCT followed by fusing low- and high-frequency components. The phase congruency that can provide a contrast and brightness-invariant representation is applied to fuse low-frequency coefficients, whereas the Log-Gabor energy that can efficiently determine the frequency coefficients from the clear and detail parts is employed to fuse the high-frequency coefficients. The proposed fusion method has been compared with the discrete wavelet transform (DWT), the fast discrete curvelet transform (FDCT), and the dual tree complex wavelet transform (DTCWT) based image fusion methods and other NSCT-based methods. Visually and quantitatively experimental results indicate that the proposed fusion method can obtain more effective and accurate fusion results of multimodal medical images than other algorithms. Further, the applicability of the proposed method has been testified by carrying out a clinical example on a woman affected with recurrent tumor images. PMID:25214889

  3. Delivery of an ultrashort spatially focused pulse to the other end of a multimode fiber using digital phase conjugation

    NASA Astrophysics Data System (ADS)

    Morales Delgado, Edgar E.; Papadopoulos, Ioannis N.; Farahi, Salma; Psaltis, Demetri; Moser, Christophe

    2015-03-01

    Multimode optical fibers potentially allow the transmission of larger amounts of information than their single mode counterparts because of their high number of supported modes. However, propagation of a light pulse through a multimode fiber suffers from spatial distortions due to the superposition of the various exited modes and from time broadening due to modal dispersion. We present a method based on digital phase conjugation to selectively excite in a multimode fiber specific optical fiber modes that follow similar optical paths as they travel through the fiber. The excited modes interfere constructively at the fiber output generating an ultrashort spatially focused pulse. The excitation of a limited number of modes following similar optical paths limits modal dispersion, allowing the transmission of the ultrashort pulse. We have experimentally demonstrated the delivery of a focused spot of pulse width equal to 500 fs through a 30 cm, 200 micrometer core step-index multimode fiber. The results of this study show that two-photon imaging capability can be added to ultra-thin lensless endoscopy using commercial multimode fibers.

  4. New optical frequency domain differential mode delay measurement method for a multimode optical fiber.

    PubMed

    Ahn, T; Moon, S; Youk, Y; Jung, Y; Oh, K; Kim, D

    2005-05-30

    A novel mode analysis method and differential mode delay (DMD) measurement technique for a multimode optical fiber based on optical frequency domain reflectometry has been proposed for the first time. We have used a conventional OFDR with a tunable external cavity laser and a Michelson interferometer. A few-mode optical multimode fiber was prepared to test our proposed measurement technique. We have also compared the OFDR measurement results with those obtained using a traditional time-domain measurement method.

  5. Stepwise Connectivity of the Modal Cortex Reveals the Multimodal Organization of the Human Brain

    PubMed Central

    Sepulcre, Jorge; Sabuncu, Mert R.; Yeo, Thomas B.; Liu, Hesheng; Johnson, Keith A.

    2012-01-01

    How human beings integrate information from external sources and internal cognition to produce a coherent experience is still not well understood. During the past decades, anatomical, neurophysiological and neuroimaging research in multimodal integration have stood out in the effort to understand the perceptual binding properties of the brain. Areas in the human lateral occipito-temporal, prefrontal and posterior parietal cortices have been associated with sensory multimodal processing. Even though this, rather patchy, organization of brain regions gives us a glimpse of the perceptual convergence, the articulation of the flow of information from modality-related to the more parallel cognitive processing systems remains elusive. Using a method called Stepwise Functional Connectivity analysis, the present study analyzes the functional connectome and transitions from primary sensory cortices to higher-order brain systems. We identify the large-scale multimodal integration network and essential connectivity axes for perceptual integration in the human brain. PMID:22855814

  6. Enabling cost-effective multimodal trip planners through open transit data.

    DOT National Transportation Integrated Search

    2011-05-01

    This study examined whether multimodal trip planners can be developed using opensource software and open data sources. : OpenStreetMap (OSM), maintained by the nonprofit OpenStreetMap Foundation, is an open, freely available international : rep...

  7. Enabling cost-effective multimodal trip planners through open transit data.

    DOT National Transportation Integrated Search

    2011-05-01

    This study examined whether multimodal trip planners can be developed using opensource software and open data sources. OpenStreetMap (OSM), maintained by the nonprofit OpenStreetMap Foundation, is an open, freely available international reposit...

  8. Multi-Modal Traveler Information System - GCM Corridor Architecture Functional Requirements

    DOT National Transportation Integrated Search

    1997-11-17

    The Multi-Modal Traveler Information System (MMTIS) project involves a large number of Intelligent Transportation System (ITS) related tasks. It involves research of all ITS initiatives in the Gary-Chicago-Milwaukee (GCM) Corridor which are currently...

  9. Fast and accurate modeling of nonlinear pulse propagation in graded-index multimode fibers.

    PubMed

    Conforti, Matteo; Mas Arabi, Carlos; Mussot, Arnaud; Kudlinski, Alexandre

    2017-10-01

    We develop a model for the description of nonlinear pulse propagation in multimode optical fibers with a parabolic refractive index profile. It consists of a 1+1D generalized nonlinear Schrödinger equation with a periodic nonlinear coefficient, which can be solved in an extremely fast and efficient way. The model is able to quantitatively reproduce recently observed phenomena like geometric parametric instability and broadband dispersive wave emission. We envisage that our equation will represent a valuable tool for the study of spatiotemporal nonlinear dynamics in the growing field of multimode fiber optics.

  10. Multimodal Play and Adolescents: Notes on Noticing Laughter

    ERIC Educational Resources Information Center

    Vasudevan, Lalitha

    2015-01-01

    In this article, I explore laughter as a form of multimodal play in which adolescents' engage across contexts and in various configurations. With a few recent exceptions, a focus on unscripted play is largely missing from ongoing research and discussion about the education of adolescents. Whereas the space to play has been vitally important to the…

  11. Label-aligned Multi-task Feature Learning for Multimodal Classification of Alzheimer’s Disease and Mild Cognitive Impairment

    PubMed Central

    Zu, Chen; Jie, Biao; Liu, Mingxia; Chen, Songcan

    2015-01-01

    Multimodal classification methods using different modalities of imaging and non-imaging data have recently shown great advantages over traditional single-modality-based ones for diagnosis and prognosis of Alzheimer’s disease (AD), as well as its prodromal stage, i.e., mild cognitive impairment (MCI). However, to the best of our knowledge, most existing methods focus on mining the relationship across multiple modalities of the same subjects, while ignoring the potentially useful relationship across different subjects. Accordingly, in this paper, we propose a novel learning method for multimodal classification of AD/MCI, by fully exploring the relationships across both modalities and subjects. Specifically, our proposed method includes two subsequent components, i.e., label-aligned multi-task feature selection and multimodal classification. In the first step, the feature selection learning from multiple modalities are treated as different learning tasks and a group sparsity regularizer is imposed to jointly select a subset of relevant features. Furthermore, to utilize the discriminative information among labeled subjects, a new label-aligned regularization term is added into the objective function of standard multi-task feature selection, where label-alignment means that all multi-modality subjects with the same class labels should be closer in the new feature-reduced space. In the second step, a multi-kernel support vector machine (SVM) is adopted to fuse the selected features from multi-modality data for final classification. To validate our method, we perform experiments on the Alzheimer’s Disease Neuroimaging Initiative (ADNI) database using baseline MRI and FDG-PET imaging data. The experimental results demonstrate that our proposed method achieves better classification performance compared with several state-of-the-art methods for multimodal classification of AD/MCI. PMID:26572145

  12. Designing Is Learning: An Investigation of Designing Multimodal Texts

    ERIC Educational Resources Information Center

    Hall, Matthew

    2013-01-01

    This qualitative study analyzed the meaning-making practices of urban adolescents participating in a college preparatory program featuring philosophical inquiry into cosmopolitanism and the creation of multimodal texts. In contrast to studies of composing that focus on individual outcomes, this dissertation traced group meaning making. The study…

  13. Promoting Multilingual Communicative Competence through Multimodal Academic Learning Situations

    ERIC Educational Resources Information Center

    Kyppö, Anna; Natri, Teija

    2016-01-01

    This paper presents information on the factors affecting the development of multilingual and multicultural communicative competence in interactive multimodal learning environments in an academic context. The interdisciplinary course in multilingual interaction offered at the University of Jyväskylä aims to enhance students' competence in…

  14. Prospectus on Multi-Modal Aspects of Human Factors in Transportation

    DOT National Transportation Integrated Search

    1991-02-01

    This prospectus identifies and discusses a series of human factors : issues which are critical to transportation safety and productivity, and : examines the potential benefits that can accrue from taking a multi-modal : approach to human factors rese...

  15. Measurement of curvature and temperature using multimode interference devices

    NASA Astrophysics Data System (ADS)

    Guzman-Sepulveda, J. R.; Aguilar-Soto, J. G.; Torres-Cisneros, M.; Ibarra-Manzano, O. G.; May-Arrioja, D. A.

    2011-09-01

    In this paper we propose the fabrication, implementation, and testing of a novel fiber optic sensor based on Multimode Interference (MMI) effects for independent measurement of curvature and temperature. The development of fiber based MMI devices is relatively new and since they exhibit a band-pass filter response they can be used in different applications. The operating mechanism of our sensor is based on the self-imaging phenomena that occur in multimode fibers (MMF), which is related to the interference of the propagating modes and their accumulated phase. We demonstrate that the peak wavelength shifts with temperature variations as a result of changes in the accumulated phase through thermo-optics effects, while the intensity of the peak wavelength is reduced as the curvature increases since we start to loss higher order modes. In this way both measurements are obtained independently with a single fiber device. Compared to other fiber-optic sensors, our sensor features an extremely simple structure and fabrication process, and hence cost effectiveness.

  16. Language as a multimodal phenomenon: implications for language learning, processing and evolution.

    PubMed

    Vigliocco, Gabriella; Perniss, Pamela; Vinson, David

    2014-09-19

    Our understanding of the cognitive and neural underpinnings of language has traditionally been firmly based on spoken Indo-European languages and on language studied as speech or text. However, in face-to-face communication, language is multimodal: speech signals are invariably accompanied by visual information on the face and in manual gestures, and sign languages deploy multiple channels (hands, face and body) in utterance construction. Moreover, the narrow focus on spoken Indo-European languages has entrenched the assumption that language is comprised wholly by an arbitrary system of symbols and rules. However, iconicity (i.e. resemblance between aspects of communicative form and meaning) is also present: speakers use iconic gestures when they speak; many non-Indo-European spoken languages exhibit a substantial amount of iconicity in word forms and, finally, iconicity is the norm, rather than the exception in sign languages. This introduction provides the motivation for taking a multimodal approach to the study of language learning, processing and evolution, and discusses the broad implications of shifting our current dominant approaches and assumptions to encompass multimodal expression in both signed and spoken languages. © 2014 The Author(s) Published by the Royal Society. All rights reserved.

  17. Sequential updating of multimodal hydrogeologic parameter fields using localization and clustering techniques

    NASA Astrophysics Data System (ADS)

    Sun, Alexander Y.; Morris, Alan P.; Mohanty, Sitakanta

    2009-07-01

    Estimated parameter distributions in groundwater models may contain significant uncertainties because of data insufficiency. Therefore, adaptive uncertainty reduction strategies are needed to continuously improve model accuracy by fusing new observations. In recent years, various ensemble Kalman filters have been introduced as viable tools for updating high-dimensional model parameters. However, their usefulness is largely limited by the inherent assumption of Gaussian error statistics. Hydraulic conductivity distributions in alluvial aquifers, for example, are usually non-Gaussian as a result of complex depositional and diagenetic processes. In this study, we combine an ensemble Kalman filter with grid-based localization and a Gaussian mixture model (GMM) clustering techniques for updating high-dimensional, multimodal parameter distributions via dynamic data assimilation. We introduce innovative strategies (e.g., block updating and dimension reduction) to effectively reduce the computational costs associated with these modified ensemble Kalman filter schemes. The developed data assimilation schemes are demonstrated numerically for identifying the multimodal heterogeneous hydraulic conductivity distributions in a binary facies alluvial aquifer. Our results show that localization and GMM clustering are very promising techniques for assimilating high-dimensional, multimodal parameter distributions, and they outperform the corresponding global ensemble Kalman filter analysis scheme in all scenarios considered.

  18. Language as a multimodal phenomenon: implications for language learning, processing and evolution

    PubMed Central

    Vigliocco, Gabriella; Perniss, Pamela; Vinson, David

    2014-01-01

    Our understanding of the cognitive and neural underpinnings of language has traditionally been firmly based on spoken Indo-European languages and on language studied as speech or text. However, in face-to-face communication, language is multimodal: speech signals are invariably accompanied by visual information on the face and in manual gestures, and sign languages deploy multiple channels (hands, face and body) in utterance construction. Moreover, the narrow focus on spoken Indo-European languages has entrenched the assumption that language is comprised wholly by an arbitrary system of symbols and rules. However, iconicity (i.e. resemblance between aspects of communicative form and meaning) is also present: speakers use iconic gestures when they speak; many non-Indo-European spoken languages exhibit a substantial amount of iconicity in word forms and, finally, iconicity is the norm, rather than the exception in sign languages. This introduction provides the motivation for taking a multimodal approach to the study of language learning, processing and evolution, and discusses the broad implications of shifting our current dominant approaches and assumptions to encompass multimodal expression in both signed and spoken languages. PMID:25092660

  19. Multimode Acoustic Research

    NASA Technical Reports Server (NTRS)

    Barmatz, M.

    1985-01-01

    There is a need for high temperature containerless processing facilities that can efficiently position and manipulate molten samples in the reduced gravity environment of space. The goal of the research is to develop sophisticated high temperature manipulation capabilities such as selection of arbitrary axes rotation and rapid sample cooling. This program will investigate new classes of acoustic levitation in rectangular, cylindrical and spherical geometries. The program tasks include calculating theoretical expressions of the acoustic forces in these geometries for the excitation of up to three acoustic modes (multimodes). These calculations are used to: (1) determine those acoustic modes that produce stable levitation, (2) isolate the levitation and rotation capabilities to produce more than one axis of rotation, and (3) develop methods to translate samples down long tube cylindrical chambers. Experimental levitators will then be constructed to verify the stable levitation and rotation predictions of the models.

  20. Multimodal fiber source for nonlinear microscopy based on a dissipative soliton laser

    PubMed Central

    Lamb, Erin S.; Wise, Frank W.

    2015-01-01

    Recent developments in high energy femtosecond fiber lasers have enabled robust and lower-cost sources for multiphoton-fluorescence and harmonic-generation imaging. However, picosecond pulses are better suited for Raman scattering microscopy, so the ideal multimodal source for nonlinear microcopy needs to provide both durations. Here we present spectral compression of a high-power femtosecond fiber laser as a route to producing transform-limited picosecond pulses. These pulses pump a fiber optical parametric oscillator to yield a robust fiber source capable of providing the synchronized picosecond pulse trains needed for Raman scattering microscopy. Thus, this system can be used as a multimodal platform for nonlinear microscopy techniques. PMID:26417497

  1. A refractive index sensor based on taper Michelson interferometer in multimode fiber

    NASA Astrophysics Data System (ADS)

    Fu, Xinghu; Zhang, Jiangpeng; Wang, Siwen; Fu, Guangwei; Liu, Qiang; Jin, Wa; Bi, Weihong

    2016-11-01

    A refractive index sensor based on taper Michelson interferometer in multimode fiber is proposed. The Hydrofluoric acid corrosion processing is studied in the preparation of single cone multimode optical fiber sensor. The taper Michelson interferometer is fabricated by changing corrosion time. The relationship between fiber sensor feature and corrosion time is analyzed. The experimental results show that the interference spectrum shift in the direction of short wave with the increase of the refractive index. The refractive index sensitivity can reach 115.8008 nm/RIU. Thereby, it can be used in detecting the refractive index in different areas including the environmental protection, health care and food production.

  2. BNU-LSVED: a multimodal spontaneous expression database in educational environment

    NASA Astrophysics Data System (ADS)

    Sun, Bo; Wei, Qinglan; He, Jun; Yu, Lejun; Zhu, Xiaoming

    2016-09-01

    In the field of pedagogy or educational psychology, emotions are treated as very important factors, which are closely associated with cognitive processes. Hence, it is meaningful for teachers to analyze students' emotions in classrooms, thus adjusting their teaching activities and improving students ' individual development. To provide a benchmark for different expression recognition algorithms, a large collection of training and test data in classroom environment has become an acute problem that needs to be resolved. In this paper, we present a multimodal spontaneous database in real learning environment. To collect the data, students watched seven kinds of teaching videos and were simultaneously filmed by a camera. Trained coders made one of the five learning expression labels for each image sequence extracted from the captured videos. This subset consists of 554 multimodal spontaneous expression image sequences (22,160 frames) recorded in real classrooms. There are four main advantages in this database. 1) Due to recorded in the real classroom environment, viewer's distance from the camera and the lighting of the database varies considerably between image sequences. 2) All the data presented are natural spontaneous responses to teaching videos. 3) The multimodal database also contains nonverbal behavior including eye movement, head posture and gestures to infer a student ' s affective state during the courses. 4) In the video sequences, there are different kinds of temporal activation patterns. In addition, we have demonstrated the labels for the image sequences are in high reliability through Cronbach's alpha method.

  3. Multimode fiber optic wavelength division multiplexing

    NASA Technical Reports Server (NTRS)

    Spencer, J. L.

    1982-01-01

    Optical wavelength division multiplexing (WDM) systems, with signals transmitted on different wavelengths through a single optical fiber, can have increased bandwidth and fault isolation properties over single wavelength optical systems. Two WDM system designs that might be used with multimode fibers are considered and a general description of the components which could be used to implement the system are given. The components described are sources, multiplexers, demultiplexers, and detectors. Emphasis is given to the demultiplexer technique which is the major developmental component in the WDM system.

  4. Assessment of laparoscopic skills of Gynecology and Obstetrics residents after a training program.

    PubMed

    Fernandes, Carla Ferreira Kikuchi; Ruano, José Maria Cordeiro; Kati, Lea Mina; Noguti, Alberto Sinhiti; Girão, Manoel João Batista Castello; Sartori, Marair Gracio Ferreira

    2016-01-01

    To evaluate laparoscopic skills of third-year Gynecology and Obstetrics residents after training at a training and surgical experimentation center. Use of a prospective questionnaire analyzing demographic data, medical residency, skills, competences, and training in a box trainer and in pigs. After the training, there was significant improvement in laparoscopic skills according to the residents (before 1.3/after 2.7; p=0.000) and preceptors (before 2.1/after 4.8; p=0.000). There was also significant improvement in the feeling of competence in surgeries with level 1 and 2 of difficulty. All residents approved the training. The training was distributed into 12 hours in the box trainer and 20 hours in animals, and led to better laparoscopic skills and a feeling of more surgical competence in laparoscopic surgery levels 1 and 2. Avaliar a habilidade laparoscópica dos residentes do terceiro ano de residência médica em Ginecologia e Obstetrícia após treinamento em um centro de treinamento e experimentação cirúrgica. Aplicação de questionário de forma prospectiva analisando dados demográficos, da residência médica, da habilidade, da competência e do treinamento em caixa preta e em porcas. Após o treinamento, houve melhora da habilidade em laparoscopia de forma significativa na avaliação dos residentes (antes 1,3/depois 2,7; p=0,000) e preceptores (antes 2,1/depois 4,8; p=0,000). Houve melhora significativa na sensação de competência em cirurgias de níveis 1 e 2 de dificuldade. Todos os residentes aprovaram o treinamento. O treinamento dividido em 12 horas de caixa preta e 20 horas em animais trouxe melhora na habilidade em laparoscopia e na sensação de melhora na competência cirúrgica em cirurgias laparoscópicas de níveis 1 e 2.

  5. The integration of audio-tactile information is modulated by multimodal social interaction with physical contact in infancy.

    PubMed

    Tanaka, Yukari; Kanakogi, Yasuhiro; Kawasaki, Masahiro; Myowa, Masako

    2018-04-01

    Interaction between caregivers and infants is multimodal in nature. To react interactively and smoothly to such multimodal signals, infants must integrate all these signals. However, few empirical infant studies have investigated how multimodal social interaction with physical contact facilitates multimodal integration, especially regarding audio - tactile (A-T) information. By using electroencephalogram (EEG) and event-related potentials (ERPs), the present study investigated how neural processing involved in A-T integration is modulated by tactile interaction. Seven- to 8-months-old infants heard one pseudoword both whilst being tickled (multimodal 'A-T' condition), and not being tickled (unimodal 'A' condition). Thereafter, their EEG was measured during the perception of the same words. Compared to the A condition, the A-T condition resulted in enhanced ERPs and higher beta-band activity within the left temporal regions, indicating neural processing of A-T integration. Additionally, theta-band activity within the middle frontal region was enhanced, which may reflect enhanced attention to social information. Furthermore, differential ERPs correlated with the degree of engagement in the tickling interaction. We provide neural evidence that the integration of A-T information in infants' brains is facilitated through tactile interaction with others. Such plastic changes in neural processing may promote harmonious social interaction and effective learning in infancy. Copyright © 2017 The Authors. Published by Elsevier Ltd.. All rights reserved.

  6. Development of a methodology to coordinate and prioritize multimodal investment networks.

    DOT National Transportation Integrated Search

    2005-01-01

    Across the nation, there are opportunities to improve coordination among transportation modal agencies, including aviation, transit, ports, highway, rail, pedestrian, and bicycle modes. Virginia's statewide multimodal transportation planning effort V...

  7. Multimodal EEG Recordings, Psychometrics and Behavioural Analysis.

    PubMed

    Boeijinga, Peter H

    2015-01-01

    High spatial and temporal resolution measurements of neuronal activity are preferably combined. In an overview on how this approach can take shape, multimodal electroencephalography (EEG) is treated in 2 main parts: by experiments without a task and in the experimentally cued working brain. It concentrates first on the alpha rhythm properties and next on data-driven search for patterns such as the default mode network. The high-resolution volumic distributions of neuronal metabolic indices result in distributed cortical regions and possibly relate to numerous nuclei, observable in a non-invasive manner in the central nervous system of humans. The second part deals with paradigms in which nowadays assessment of target-related networks can align level-dependent blood oxygenation, electrical responses and behaviour, taking the temporal resolution advantages of event-related potentials. Evidence-based electrical propagation in serial tasks during performance is now to a large extent attributed to interconnected pathways, particularly chronometry-dependent ones, throughout a chain including a dorsal stream, next ventral cortical areas taking the flow of information towards inferior temporal domains. The influence of aging is documented, and results of the first multimodal studies in neuropharmacology are consistent. Finally a scope on implementation of advanced clinical applications and personalized marker strategies in neuropsychiatry is indicated. © 2016 S. Karger AG, Basel.

  8. Cavity Quantum Acoustic Device in the Multimode Strong Coupling Regime

    NASA Astrophysics Data System (ADS)

    Moores, Bradley A.; Sletten, Lucas R.; Viennot, Jeremie J.; Lehnert, K. W.

    2018-06-01

    We demonstrate an acoustical analog of a circuit quantum electrodynamics system that leverages acoustic properties to enable strong multimode coupling in the dispersive regime while suppressing spontaneous emission to unconfined modes. Specifically, we fabricate and characterize a device that comprises a flux tunable transmon coupled to a 300 μ m long surface acoustic wave resonator. For some modes, the qubit-cavity coupling reaches 6.5 MHz, exceeding the cavity loss rate (200 kHz), qubit linewidth (1.1 MHz), and the cavity free spectral range (4.8 MHz), placing the device in both the strong coupling and strong multimode regimes. With the qubit detuned from the confined modes of the cavity, we observe that the qubit linewidth strongly depends on its frequency, as expected for spontaneous emission of phonons, and we identify operating frequencies where this emission rate is suppressed.

  9. Reconfigurable optical interconnection network for multimode optical fiber sensor arrays

    NASA Technical Reports Server (NTRS)

    Chen, R. T.; Robinson, D.; Lu, H.; Wang, M. R.; Jannson, T.; Baumbick, R.

    1992-01-01

    A single-source, single-detector architecture has been developed to implement a reconfigurable optical interconnection network multimode optical fiber sensor arrays. The network was realized by integrating LiNbO3 electrooptic (EO) gratings working at the Raman Na regime and a massive fan-out waveguide hologram (WH) working at the Bragg regime onto a multimode glass waveguide. The glass waveguide utilized the whole substrate as a guiding medium. A 1-to-59 massive waveguide fan-out was demonstrated using a WH operating at 514 nm. Measured diffraction efficiency of 59 percent was experimentally confirmed. Reconfigurability of the interconnection was carried out by generating an EO grating through an externally applied electric field. Unlike conventional single-mode integrated optical devices, the guided mode demonstrated has an azimuthal symmetry in mode profile which is the same as that of a fiber mode.

  10. Structured illumination multimodal 3D-resolved quantitative phase and fluorescence sub-diffraction microscopy

    PubMed Central

    Chowdhury, Shwetadwip; Eldridge, Will J.; Wax, Adam; Izatt, Joseph A.

    2017-01-01

    Sub-diffraction resolution imaging has played a pivotal role in biological research by visualizing key, but previously unresolvable, sub-cellular structures. Unfortunately, applications of far-field sub-diffraction resolution are currently divided between fluorescent and coherent-diffraction regimes, and a multimodal sub-diffraction technique that bridges this gap has not yet been demonstrated. Here we report that structured illumination (SI) allows multimodal sub-diffraction imaging of both coherent quantitative-phase (QP) and fluorescence. Due to SI’s conventionally fluorescent applications, we first demonstrate the principle of SI-enabled three-dimensional (3D) QP sub-diffraction imaging with calibration microspheres. Image analysis confirmed enhanced lateral and axial resolutions over diffraction-limited QP imaging, and established striking parallels between coherent SI and conventional optical diffraction tomography. We next introduce an optical system utilizing SI to achieve 3D sub-diffraction, multimodal QP/fluorescent visualization of A549 biological cells fluorescently tagged for F-actin. Our results suggest that SI has a unique utility in studying biological phenomena with significant molecular, biophysical, and biochemical components. PMID:28663887

  11. Recurrent oral cavity cancer: Patterns of failure after salvage multimodality therapy.

    PubMed

    Quinlan-Davidson, Sean R; Morrison, William H; Myers, Jeffrey N; Gunn, Gary B; William, William N; Beadle, Beth M; Skinner, Heath D; Gillenwater, Ann M; Frank, Steven J; Phan, Jack; Johnson, Faye M; Fuller, Clifton D; Zafereo, Mark E; Rosenthal, David I; Garden, Adam S

    2017-04-01

    We focused on a cohort of radiation naïve patients who had recurrent oral cavity cancer (recurrent OCC) to assess their outcomes with salvage multimodal therapy. A retrospective single institutional study was performed of patients with recurrent OCC. Disease recurrence and survival outcomes were assessed. Seventy-eight patients were analyzed. All patients had salvage surgery and intensity-modulated radiotherapy (IMRT) and 74% had chemotherapy. Five-year overall survival, recurrence-free survival, and locoregional control rates were 59%, 60%, and 74%, respectively. Outcomes of radiation naïve patients with recurrent OCC are fair, and seem similar with patients with locally advanced nonrecurrent OCC treated with multimodal therapy. © 2016 Wiley Periodicals, Inc. Head Neck 39: 633-638, 2017. © 2016 Wiley Periodicals, Inc.

  12. A Mediated Discourse Analysis (MDA) Approach to Multimodal Data

    ERIC Educational Resources Information Center

    Dooly, Melinda

    2017-01-01

    Just as research in language learning is moving beyond the four walls of the classroom, there is a growing awareness that language use (and simultaneous learning) takes place in increasingly complex and interconnected ways, in particular through the use of technology. This chapter summarizes an investigation into multimodal communicative…

  13. Multiliteracies in Practice: Integrating Multimodal Production across the Curriculum

    ERIC Educational Resources Information Center

    Thibaut, Patricia; Curwood, Jen Scott

    2018-01-01

    Supported by ever-evolving digital tools and online spaces, we argue that multiliteracies can be used to close the gap between teacher-directed, individual, and assessment-driven learning, and authentic, shared, and purpose-driven learning. This is particularly evident through multimodal composition and collaboration in primary classrooms. Over…

  14. The pivotal role of multimodality reporter sensors in drug discovery: from cell based assays to real time molecular imaging.

    PubMed

    Ray, Pritha

    2011-04-01

    Development and marketing of new drugs require stringent validation that are expensive and time consuming. Non-invasive multimodality molecular imaging using reporter genes holds great potential to expedite these processes at reduced cost. New generations of smarter molecular imaging strategies such as Split reporter, Bioluminescence resonance energy transfer, Multimodality fusion reporter technologies will further assist to streamline and shorten the drug discovery and developmental process. This review illustrates the importance and potential of molecular imaging using multimodality reporter genes in drug development at preclinical phases.

  15. Dye-enhanced multimodal confocal imaging as a novel approach to intraoperative diagnosis of brain tumors.

    PubMed

    Snuderl, Matija; Wirth, Dennis; Sheth, Sameer A; Bourne, Sarah K; Kwon, Churl-Su; Ancukiewicz, Marek; Curry, William T; Frosch, Matthew P; Yaroslavsky, Anna N

    2013-01-01

    Intraoperative diagnosis plays an important role in accurate sampling of brain tumors, limiting the number of biopsies required and improving the distinction between brain and tumor. The goal of this study was to evaluate dye-enhanced multimodal confocal imaging for discriminating gliomas from nonglial brain tumors and from normal brain tissue for diagnostic use. We investigated a total of 37 samples including glioma (13), meningioma (7), metastatic tumors (9) and normal brain removed for nontumoral indications (8). Tissue was stained in 0.05 mg/mL aqueous solution of methylene blue (MB) for 2-5 minutes and multimodal confocal images were acquired using a custom-built microscope. After imaging, tissue was formalin fixed and paraffin embedded for standard neuropathologic evaluation. Thirteen pathologists provided diagnoses based on the multimodal confocal images. The investigated tumor types exhibited distinctive and complimentary characteristics in both the reflectance and fluorescence responses. Images showed distinct morphological features similar to standard histology. Pathologists were able to distinguish gliomas from normal brain tissue and nonglial brain tumors, and to render diagnoses from the images in a manner comparable to haematoxylin and eosin (H&E) slides. These results confirm the feasibility of multimodal confocal imaging for intravital intraoperative diagnosis. © 2012 The Authors; Brain Pathology © 2012 International Society of Neuropathology.

  16. Right hepatic artery aneurysm.

    PubMed

    Bernal, Astrid Del Pilar Ardila; Loures, Paulo; Calle, Juan Cristóbal Ospina; Cunha, Beatriz; Córdoba, Juan Camilo

    2016-01-01

    We report a case of an aneurysm of the right hepatic artery and its multidisciplinary management by general surgery, endoscopy and radiology services. Being a case of extremely low incidence, it is important to show its diagnostic and therapeutic approach. RESUMO Relatamos um caso de aneurisma da artéria hepática direita conduzido de forma multidisciplinar pelos Serviços de Cirurgia Geral, Endoscopia e Radiologia. Em se tratando de caso de incidência baixíssima, é importante mostrar o enfoque diagnóstico e terapêutico usado em seu manejo.

  17. Cochlear Implantation for Profound Hearing Loss After Multimodal Treatment for Neuroblastoma in Children.

    PubMed

    Ryu, Nam-Gyu; Moon, Il Joon; Chang, Young Soo; Kim, Byoung Kil; Chung, Won-Ho; Cho, Yang-Sun; Hong, Sung Hwa

    2015-12-01

    Neuroblastoma (NBL) predominantly affects children under 5 years of age. Through multimodal therapy, including chemotherapy, radiotherapy, surgery, and peripheral blood stem cell transplantation, the survival rate in patients with NBL have improved while treatment-related complications have also increased. Treatment-related ototoxicity, mainly from cisplatin, can result in profound hearing loss requiring cochlear implantation (CI). We analyzed the effectiveness and hearing preservation of CI recipients who had treated with multimodal therapy due to NBL. Patients who received multimodal therapy for NBL and subsequent CIs were enrolled. A detailed review of the perioperative hearing test, speech evaluation, and posttreatment complications was conducted. Speech performance was analyzed using the category of auditory performance (CAP) score and the postoperative hearing preservation of low frequencies was also compared. Patients who were candidates for electro-acoustic stimulation (EAS) used an EAS electrode for low frequency hearing preservation. Three patients were identified and all patients showed improvement of speech performance after CI. The average of CAP score improved from 4.3 preoperatively to 5.8 at 1 year postoperatively. Two patients who were fitted with the Flex electrode showed complete hearing preservation and the preserved hearing was maintained over 1 year. The one remaining patient was given the standard CI-512 electrode and showed partial hearing preservation. Patients with profound hearing loss resulting from NBL multimodal therapy can be good candidates for CI, especially for EAS. A soft surgical technique as well as a specifically designed electrode should be applied to this specific population during the CI operation in order to preserve residual hearing and achieve better outcomes.

  18. Radiation patterns of multimode feed-horn-coupled bolometers for FAR-IR space applications

    NASA Astrophysics Data System (ADS)

    Kalinauskaite, Eimante; Murphy, J. Anthony; McAuley, Ian; Trappe, Neal A.; McCarthy, Darragh N.; Bracken, Colm P.; Doherty, Stephen; Gradziel, Marcin L.; O'Sullivan, Créidhe; Wilson, Daniel; Peacocke, Tully; Maffei, Bruno; Lamarre, Jean-Michel; Ade, Peter A. R.; Savini, Giorgio

    2017-02-01

    A multimode horn differs from a single mode horn in that it has a larger sized waveguide feeding it. Multimode horns can therefore be utilized as high efficiency feeds for bolometric detectors, providing increased throughput and sensitivity over single mode feeds, while also ensuring good control of the beam pattern characteristics. Although a cavity mounted bolometer can be modelled as a perfect black body radiator (using reciprocity in order to calculate beam patterns), nevertheless, this is an approximation. In this paper we present how this approach can be improved to actually include the cavity coupled bolometer, now modelled as a thin absorbing film. Generally, this is a big challenge for finite element software, in that the structures are typically electrically large. However, the radiation pattern of multimode horns can be more efficiently simulated using mode matching, typically with smooth-walled waveguide modes as the basis and computing an overall scattering matrix for the horn-waveguide-cavity system. Another issue on the optical efficiency of the detectors is the presence of any free space gaps, through which power can escape. This is best dealt with treating the system as an absorber. Appropriate reflection and transmission matrices can be determined for the cavity using the natural eigenfields of the bolometer cavity system. We discuss how the approach can be applied to proposed terahertz systems, and also present results on how the approach was applied to improve beam pattern predictions on the sky for the multi-mode HFI 857GHz channel on Planck.

  19. Multi-Sensory, Multi-Modal Concepts for Information Understanding

    DTIC Science & Technology

    2004-04-01

    September 20022-2 Outline • The modern dilemma of knowledge acquisition • A vision for information access and understanding • Emerging concepts for...Multi-Sensory, Multi-Modal Concepts for Information Understanding David L. Hall, Ph.D. School of Information Sciences and Technology The... understanding . INTRODUCTION Historically, information displays for display and understanding of data fusion products have focused on the use of vision

  20. Multimodal Task-Driven Dictionary Learning for Image Classification

    DTIC Science & Technology

    2015-12-18

    1 Multimodal Task-Driven Dictionary Learning for Image Classification Soheil Bahrampour, Student Member, IEEE, Nasser M. Nasrabadi, Fellow, IEEE...Asok Ray, Fellow, IEEE, and W. Kenneth Jenkins, Life Fellow, IEEE Abstract— Dictionary learning algorithms have been suc- cessfully used for both...reconstructive and discriminative tasks, where an input signal is represented with a sparse linear combination of dictionary atoms. While these methods are

  1. Score level fusion scheme based on adaptive local Gabor features for face-iris-fingerprint multimodal biometric

    NASA Astrophysics Data System (ADS)

    He, Fei; Liu, Yuanning; Zhu, Xiaodong; Huang, Chun; Han, Ye; Chen, Ying

    2014-05-01

    A multimodal biometric system has been considered a promising technique to overcome the defects of unimodal biometric systems. We have introduced a fusion scheme to gain a better understanding and fusion method for a face-iris-fingerprint multimodal biometric system. In our case, we use particle swarm optimization to train a set of adaptive Gabor filters in order to achieve the proper Gabor basic functions for each modality. For a closer analysis of texture information, two different local Gabor features for each modality are produced by the corresponding Gabor coefficients. Next, all matching scores of the two Gabor features for each modality are projected to a single-scalar score via a trained, supported, vector regression model for a final decision. A large-scale dataset is formed to validate the proposed scheme using the Facial Recognition Technology database-fafb and CASIA-V3-Interval together with FVC2004-DB2a datasets. The experimental results demonstrate that as well as achieving further powerful local Gabor features of multimodalities and obtaining better recognition performance by their fusion strategy, our architecture also outperforms some state-of-the-art individual methods and other fusion approaches for face-iris-fingerprint multimodal biometric systems.

  2. Hearing and Seeing Tone through Color: An Efficacy Study of Web-Based, Multimodal Chinese Tone Perception Training

    ERIC Educational Resources Information Center

    Godfroid, Aline; Lin, Chin-Hsi; Ryu, Catherine

    2017-01-01

    Multimodal approaches have been shown to be effective for many learning tasks. In this study, we compared the effectiveness of five multimodal methods for second language (L2) Mandarin tone perception training: three single-cue methods (number, pitch contour, color) and two dual-cue methods (color and number, color and pitch contour). A total of…

  3. Composing for Affect, Audience, and Identity: Toward a Multidimensional Understanding of Adolescents' Multimodal Composing Goals and Designs

    ERIC Educational Resources Information Center

    Smith, Blaine E.

    2018-01-01

    This study examined adolescents' perspectives on their multimodal composing goals and designs when creating digital projects in the context of an English Language Arts class. Sociocultural and social semiotics theoretical frameworks were integrated to understand six 12th grade students' viewpoints when composing three multimodal products--a…

  4. Use of Multi-Modal Media and Tools in an Online Information Literacy Course: College Students' Attitudes and Perceptions

    ERIC Educational Resources Information Center

    Chen, Hsin-Liang; Williams, James Patrick

    2009-01-01

    This project studies the use of multi-modal media objects in an online information literacy class. One hundred sixty-two undergraduate students answered seven surveys. Significant relationships are found among computer skills, teaching materials, communication tools and learning experience. Multi-modal media objects and communication tools are…

  5. Multimodal representation contributes to the complex development of science literacy in a college biology class

    NASA Astrophysics Data System (ADS)

    Bennett, William Drew

    This study is an investigation into the science literacy of college genetics students who were given a modified curriculum to address specific teaching and learning problems from a previous class. This study arose out of an interest by the professor and researcher to determine how well students in the class Human Genetics in the 21st Century responded to a reorganized curriculum to address misconceptions that were prevalent after direct instruction in the previous year's class. One of the components to the revised curriculum was the addition of a multimodal representation requirement as part of their normal writing assignments. How well students performed in these writing assignments and the relationship they had to student learning the rest of the class formed the principle research interest of this study. Improving science literacy has been a consistent goal of science educators and policy makers for over 50 years (DeBoer, 2000). This study uses the conceptualization of Norris and Phillips (2003) in which science literacy can be organized into both the fundamental sense (reading and writing) and the derived sense (experience and knowledge) of science literacy. The fundamental sense of science literacy was investigated in the students' ability to understand and use multimodal representations as part of their homework writing assignments. The derived sense of science literacy was investigated in how well students were able to apply their previous learning to class assessments found in quizzes and exams. This study uses a mixed-methods correlational design to investigate the relationship that existed between students' writing assignment experiences connected to multimodal representations and their academic performance in classroom assessments. Multimodal representations are pervasive in science literature and communication. These are the figures, diagrams, tables, pictures, mathematical equations, and any other form of content in which scientists and science

  6. Rhesus macaques recognize unique multi-modal face-voice relations of familiar individuals and not of unfamiliar ones

    PubMed Central

    Habbershon, Holly M.; Ahmed, Sarah Z.; Cohen, Yale E.

    2013-01-01

    Communication signals in non-human primates are inherently multi-modal. However, for laboratory-housed monkeys, there is relatively little evidence in support of the use of multi-modal communication signals in individual recognition. Here, we used a preferential-looking paradigm to test whether laboratory-housed rhesus could “spontaneously” (i.e., in the absence of operant training) use multi-modal communication stimuli to discriminate between known conspecifics. The multi-modal stimulus was a silent movie of two monkeys vocalizing and an audio file of the vocalization from one of the monkeys in the movie. We found that the gaze patterns of those monkeys that knew the individuals in the movie were reliably biased toward the individual that did not produce the vocalization. In contrast, there was not a systematic gaze pattern for those monkeys that did not know the individuals in the movie. These data are consistent with the hypothesis that laboratory-housed rhesus can recognize and distinguish between conspecifics based on auditory and visual communication signals. PMID:23774779

  7. Berlin Kompass: Multimodal Gameful Empowerment for Foreign Language Learning

    ERIC Educational Resources Information Center

    Kallioniemi, Pekka; Posti, Laura-Pihkala; Hakulinen, Jaakko; Turunen, Markku; Keskinen, Tuuli; Raisamo, Roope

    2015-01-01

    This article presents an innovative, gameful, multimodal, and authentic learning environment for training of oral communication in a foreign language--a virtual adventure called Berlin Kompass. After a brief presentation of the pedagogical and technological backgrounds, the system is described. Central results of a series of pilots in autumn 2013…

  8. Transmodal Redesign in Music and Literacy: Diverse Multimodal Classrooms

    ERIC Educational Resources Information Center

    Tomlinson, Michelle M.

    2015-01-01

    Two classrooms of diverse 5-year-old children were set the task of exploring ways of realising music invention through the semiotic import of composing resources. In both a rural and an inner-urban setting in Australia, children demonstrated syncretism in bilingual practices in communication. Visual multimodal analysis demonstrated how children…

  9. Multimodal Career Development: "BASIC IDEAS" for Wholistic Career Education.

    ERIC Educational Resources Information Center

    Southern, Stephen

    This paper presents a comprehensive model for career development over the lifespan. The approach, based on the multimodal behavioral therapy of Arnold Lazarus, takes into account 10 modalities and factors that should be considered when addressing the career education needs of whole persons. These modalities and factors, represented by the acronym…

  10. [Role of surgery in multimodal treatment of oral and oropharyngeal cancer].

    PubMed

    Scheithauer, M O; Riechelmann, H

    2009-02-01

    The value of surgery in multimodal treatment concepts of oral and oropharyngeal cancer, respecting quality of life and survival rates, should be evaluated. Patients with oral or oropharyngeal cancer were grouped, if tumor-targeted surgery was part of a multimodal treatment concept or if the patients received radiotherapy with or without chemotherapy only. Surgical versus non-surgical therapy, age, disease extent, tumor site and comorbidity as measured by the American Society of Anesthesiologists (ASA) physical status score were included in a Cox proportional hazard analysis. Quality of life was assessed 3 years following treatment employing the EORTC-C30 and H&N35 questionnaires. Patients treated with radiotherapy with or without chemotherapy only (63/140) had a worse survival (hazard ratio 1.7037, 95 % CI 0.9981 to 2.9080, p = 0.0508) than patients treated with surgery (77/140) as a part of a multimodal treatment concept. Disease extent (p < 0.01) and ASA score (p < 0.01) had a significant impact on survival. Quality of life scores were remarkably similar in surgically and non-surgically treated patients. The results of this study indicate that surgery remains a core modality of oral and oropharyngeal cancer treatment. External beam radiotherapy only, also if applied in current fractionation techniques, may not be sufficient to achieve adequate results.

  11. Optical modelling of far-infrared astronomical instrumentation exploiting multimode horn antennas

    NASA Astrophysics Data System (ADS)

    O'Sullivan, Créidhe; Murphy, J. Anthony; Mc Auley, Ian; Wilson, Daniel; Gradziel, Marcin L.; Trappe, Neil; Cahill, Fiachra; Peacocke, T.; Savini, G.; Ganga, K.

    2014-07-01

    In this paper we describe the optical modelling of astronomical telescopes that exploit bolometric detectors fed by multimoded horn antennas. In cases where the horn shape is profiled rather than being a simple cone, we determine the beam at the horn aperture using an electromagnetic mode-matching technique. Bolometers, usually placed in an integrating cavity, can excite many hybrid modes in a corrugated horn; we usually assume they excite all modes equally. If the waveguide section feeding the horn is oversized these modes can propagate independently, thereby increasing the throughput of the system. We use an SVD analysis on the matrix that describes the scattering between waveguide (TE/TM) modes to recover the independent orthogonal fields (hybrid modes) and then propagate these to the sky independently where they are added in quadrature. Beam patterns at many frequencies across the band are then added with a weighting appropriate to the source spectrum. Here we describe simulations carried out on the highest-frequency (857-GHz) channel of the Planck HFI instrument. We concentrate in particular on the use of multimode feedhorns and consider the effects of possible manufacturing tolerances on the beam on the sky. We also investigate the feasibility of modelling far-out sidelobes across a wide band for electrically large structures and bolometers fed by multi-mode feedhorns. Our optical simulations are carried out using the industry-standard GRASP software package.

  12. Interactions, Intersections and Improvisations: Studying the Multimodal Texts and Classroom Talk of Six- to Seven-Year-Olds

    ERIC Educational Resources Information Center

    Pahl, Kate

    2009-01-01

    This article examines the relationship between children's talk in the classroom and their multimodal texts. The article uses an analytic framework derived from Bourdieu's concept of habitus to examine how 6-7-year-old children's regular ways of being and doing can be found in their multimodal texts together with their talk (Bourdieu, 1977, 1990).…

  13. Novel multimodality segmentation using level sets and Jensen-Rényi divergence

    DOE Office of Scientific and Technical Information (OSTI.GOV)

    Markel, Daniel, E-mail: daniel.markel@mail.mcgill.ca; Zaidi, Habib; Geneva Neuroscience Center, Geneva University, CH-1205 Geneva

    2013-12-15

    Purpose: Positron emission tomography (PET) is playing an increasing role in radiotherapy treatment planning. However, despite progress, robust algorithms for PET and multimodal image segmentation are still lacking, especially if the algorithm were extended to image-guided and adaptive radiotherapy (IGART). This work presents a novel multimodality segmentation algorithm using the Jensen-Rényi divergence (JRD) to evolve the geometric level set contour. The algorithm offers improved noise tolerance which is particularly applicable to segmentation of regions found in PET and cone-beam computed tomography. Methods: A steepest gradient ascent optimization method is used in conjunction with the JRD and a level set activemore » contour to iteratively evolve a contour to partition an image based on statistical divergence of the intensity histograms. The algorithm is evaluated using PET scans of pharyngolaryngeal squamous cell carcinoma with the corresponding histological reference. The multimodality extension of the algorithm is evaluated using 22 PET/CT scans of patients with lung carcinoma and a physical phantom scanned under varying image quality conditions. Results: The average concordance index (CI) of the JRD segmentation of the PET images was 0.56 with an average classification error of 65%. The segmentation of the lung carcinoma images had a maximum diameter relative error of 63%, 19.5%, and 14.8% when using CT, PET, and combined PET/CT images, respectively. The estimated maximal diameters of the gross tumor volume (GTV) showed a high correlation with the macroscopically determined maximal diameters, with aR{sup 2} value of 0.85 and 0.88 using the PET and PET/CT images, respectively. Results from the physical phantom show that the JRD is more robust to image noise compared to mutual information and region growing. Conclusions: The JRD has shown improved noise tolerance compared to mutual information for the purpose of PET image segmentation. Presented is a

  14. Novel multimodality segmentation using level sets and Jensen-Rényi divergence.

    PubMed

    Markel, Daniel; Zaidi, Habib; El Naqa, Issam

    2013-12-01

    Positron emission tomography (PET) is playing an increasing role in radiotherapy treatment planning. However, despite progress, robust algorithms for PET and multimodal image segmentation are still lacking, especially if the algorithm were extended to image-guided and adaptive radiotherapy (IGART). This work presents a novel multimodality segmentation algorithm using the Jensen-Rényi divergence (JRD) to evolve the geometric level set contour. The algorithm offers improved noise tolerance which is particularly applicable to segmentation of regions found in PET and cone-beam computed tomography. A steepest gradient ascent optimization method is used in conjunction with the JRD and a level set active contour to iteratively evolve a contour to partition an image based on statistical divergence of the intensity histograms. The algorithm is evaluated using PET scans of pharyngolaryngeal squamous cell carcinoma with the corresponding histological reference. The multimodality extension of the algorithm is evaluated using 22 PET/CT scans of patients with lung carcinoma and a physical phantom scanned under varying image quality conditions. The average concordance index (CI) of the JRD segmentation of the PET images was 0.56 with an average classification error of 65%. The segmentation of the lung carcinoma images had a maximum diameter relative error of 63%, 19.5%, and 14.8% when using CT, PET, and combined PET/CT images, respectively. The estimated maximal diameters of the gross tumor volume (GTV) showed a high correlation with the macroscopically determined maximal diameters, with a R(2) value of 0.85 and 0.88 using the PET and PET/CT images, respectively. Results from the physical phantom show that the JRD is more robust to image noise compared to mutual information and region growing. The JRD has shown improved noise tolerance compared to mutual information for the purpose of PET image segmentation. Presented is a flexible framework for multimodal image segmentation

  15. A multimodal spatiotemporal cardiac motion atlas from MR and ultrasound data.

    PubMed

    Puyol-Antón, Esther; Sinclair, Matthew; Gerber, Bernhard; Amzulescu, Mihaela Silvia; Langet, Hélène; Craene, Mathieu De; Aljabar, Paul; Piro, Paolo; King, Andrew P

    2017-08-01

    Cardiac motion atlases provide a space of reference in which the motions of a cohort of subjects can be directly compared. Motion atlases can be used to learn descriptors that are linked to different pathologies and which can subsequently be used for diagnosis. To date, all such atlases have been formed and applied using data from the same modality. In this work we propose a framework to build a multimodal cardiac motion atlas from 3D magnetic resonance (MR) and 3D ultrasound (US) data. Such an atlas will benefit from the complementary motion features derived from the two modalities, and furthermore, it could be applied in clinics to detect cardiovascular disease using US data alone. The processing pipeline for the formation of the multimodal motion atlas initially involves spatial and temporal normalisation of subjects' cardiac geometry and motion. This step was accomplished following a similar pipeline to that proposed for single modality atlas formation. The main novelty of this paper lies in the use of a multi-view algorithm to simultaneously reduce the dimensionality of both the MR and US derived motion data in order to find a common space between both modalities to model their variability. Three different dimensionality reduction algorithms were investigated: principal component analysis, canonical correlation analysis and partial least squares regression (PLS). A leave-one-out cross validation on a multimodal data set of 50 volunteers was employed to quantify the accuracy of the three algorithms. Results show that PLS resulted in the lowest errors, with a reconstruction error of less than 2.3 mm for MR-derived motion data, and less than 2.5  mm for US-derived motion data. In addition, 1000 subjects from the UK Biobank database were used to build a large scale monomodal data set for a systematic validation of the proposed algorithms. Our results demonstrate the feasibility of using US data alone to analyse cardiac function based on a multimodal motion atlas

  16. Fast and robust multimodal image registration using a local derivative pattern.

    PubMed

    Jiang, Dongsheng; Shi, Yonghong; Chen, Xinrong; Wang, Manning; Song, Zhijian

    2017-02-01

    Deformable multimodal image registration, which can benefit radiotherapy and image guided surgery by providing complementary information, remains a challenging task in the medical image analysis field due to the difficulty of defining a proper similarity measure. This article presents a novel, robust and fast binary descriptor, the discriminative local derivative pattern (dLDP), which is able to encode images of different modalities into similar image representations. dLDP calculates a binary string for each voxel according to the pattern of intensity derivatives in its neighborhood. The descriptor similarity is evaluated using the Hamming distance, which can be efficiently computed, instead of conventional L1 or L2 norms. For the first time, we validated the effectiveness and feasibility of the local derivative pattern for multimodal deformable image registration with several multi-modal registration applications. dLDP was compared with three state-of-the-art methods in artificial image and clinical settings. In the experiments of deformable registration between different magnetic resonance imaging (MRI) modalities from BrainWeb, between computed tomography and MRI images from patient data, and between MRI and ultrasound images from BITE database, we show our method outperforms localized mutual information and entropy images in terms of both accuracy and time efficiency. We have further validated dLDP for the deformable registration of preoperative MRI and three-dimensional intraoperative ultrasound images. Our results indicate that dLDP reduces the average mean target registration error from 4.12 mm to 2.30 mm. This accuracy is statistically equivalent to the accuracy of the state-of-the-art methods in the study; however, in terms of computational complexity, our method significantly outperforms other methods and is even comparable to the sum of the absolute difference. The results reveal that dLDP can achieve superior performance regarding both accuracy and

  17. Wide range optofluidically tunable multimode interference fiber laser

    NASA Astrophysics Data System (ADS)

    Antonio-Lopez, J. E.; Sanchez-Mondragon, J. J.; LiKamWa, P.; May-Arrioja, D. A.

    2014-08-01

    An optofluidically tunable fiber laser based on multimode interference (MMI) effects with a wide tuning range is proposed and demonstrated. The tunable mechanism is based on an MMI fiber filter fabricated using a special fiber known as no-core fiber, which is a multimode fiber (MMF) without cladding. Therefore, when the MMI filter is covered by liquid the optical properties of the no-core fiber are modified, which allow us to tune the peak wavelength response of the MMI filter. Rather than applying the liquid on the entire no-core fiber, we change the liquid level along the no-core fiber, which provides a highly linear tuning response. In addition, by selecting the adequate refractive index of the liquid we can also choose the tuning range. We demonstrate the versatility of the optofluidically tunable MMI filter by wavelength tuning two different gain media, erbium doped fiber and a semiconductor optical amplifier, achieving tuning ranges of 55 and 90 nm respectively. In both cases, we achieve side-mode suppression ratios (SMSR) better than 50 dBm with output power variations of less than 0.76 dBm over the whole tuning range.

  18. Automatic lip reading by using multimodal visual features

    NASA Astrophysics Data System (ADS)

    Takahashi, Shohei; Ohya, Jun

    2013-12-01

    Since long time ago, speech recognition has been researched, though it does not work well in noisy places such as in the car or in the train. In addition, people with hearing-impaired or difficulties in hearing cannot receive benefits from speech recognition. To recognize the speech automatically, visual information is also important. People understand speeches from not only audio information, but also visual information such as temporal changes in the lip shape. A vision based speech recognition method could work well in noisy places, and could be useful also for people with hearing disabilities. In this paper, we propose an automatic lip-reading method for recognizing the speech by using multimodal visual information without using any audio information such as speech recognition. First, the ASM (Active Shape Model) is used to track and detect the face and lip in a video sequence. Second, the shape, optical flow and spatial frequencies of the lip features are extracted from the lip detected by ASM. Next, the extracted multimodal features are ordered chronologically so that Support Vector Machine is performed in order to learn and classify the spoken words. Experiments for classifying several words show promising results of this proposed method.

  19. Enhancing image classification models with multi-modal biomarkers

    NASA Astrophysics Data System (ADS)

    Caban, Jesus J.; Liao, David; Yao, Jianhua; Mollura, Daniel J.; Gochuico, Bernadette; Yoo, Terry

    2011-03-01

    Currently, most computer-aided diagnosis (CAD) systems rely on image analysis and statistical models to diagnose, quantify, and monitor the progression of a particular disease. In general, CAD systems have proven to be effective at providing quantitative measurements and assisting physicians during the decision-making process. As the need for more flexible and effective CADs continues to grow, questions about how to enhance their accuracy have surged. In this paper, we show how statistical image models can be augmented with multi-modal physiological values to create more robust, stable, and accurate CAD systems. In particular, this paper demonstrates how highly correlated blood and EKG features can be treated as biomarkers and used to enhance image classification models designed to automatically score subjects with pulmonary fibrosis. In our results, a 3-5% improvement was observed when comparing the accuracy of CADs that use multi-modal biomarkers with those that only used image features. Our results show that lab values such as Erythrocyte Sedimentation Rate and Fibrinogen, as well as EKG measurements such as QRS and I:40, are statistically significant and can provide valuable insights about the severity of the pulmonary fibrosis disease.

  20. 40Gbit/s MDM-WDM Laguerre-Gaussian Mode with Equalization for Multimode Fiber in Access Networks

    NASA Astrophysics Data System (ADS)

    Fazea, Yousef; Amphawan, Angela

    2018-04-01

    Modal dispersion is seen as the primary impairment for multimode fiber. Mode division multiplexing (MDM) is a promising technology that has been realized as a favorable technology for considerably upsurges the capacity and distance of multimode fiber in conjunction with Wavelength Division Multiplexing (WDM) for fiber-to-the-home. This paper reveals the importance of an equalization technique in conjunction with controlling the modes spacing of mode division multiplexing-wavelength division multiplexing of Laguerre-Gaussian modes to alleviate modal dispersion for multimode fiber. The effects of channel spacing of 20 channels MDM-WDM were examined through controlling the azimuthal mode number and the radial mode number of Laguerre-Gaussian modes. A data rate of 40Gbit/s was achieved for a distance of 1,500 m for MDM-WDM.