Aberrations and adaptive optics in super-resolution microscopy

PubMed Central

Booth, Martin; Andrade, Débora; Burke, Daniel; Patton, Brian; Zurauskas, Mantas

2015-01-01

As one of the most powerful tools in the biological investigation of cellular structures and dynamic processes, fluorescence microscopy has undergone extraordinary developments in the past decades. The advent of super-resolution techniques has enabled fluorescence microscopy – or rather nanoscopy – to achieve nanoscale resolution in living specimens and unravelled the interior of cells with unprecedented detail. The methods employed in this expanding field of microscopy, however, are especially prone to the detrimental effects of optical aberrations. In this review, we discuss how super-resolution microscopy techniques based upon single-molecule switching, stimulated emission depletion and structured illumination each suffer from aberrations in different ways that are dependent upon intrinsic technical aspects. We discuss the use of adaptive optics as an effective means to overcome this problem. PMID:26124194

Microsphere-aided optical microscopy and its applications for super-resolution imaging

NASA Astrophysics Data System (ADS)

Upputuri, Paul Kumar; Pramanik, Manojit

2017-12-01

The spatial resolution of a standard optical microscope (SOM) is limited by diffraction. In visible spectrum, SOM can provide ∼ 200 nm resolution. To break the diffraction limit several approaches were developed including scanning near field microscopy, metamaterial super-lenses, nanoscale solid immersion lenses, super-oscillatory lenses, confocal fluorescence microscopy, techniques that exploit non-linear response of fluorophores like stimulated emission depletion microscopy, stochastic optical reconstruction microscopy, etc. Recently, photonic nanojet generated by a dielectric microsphere was used to break the diffraction limit. The microsphere-approach is simple, cost-effective and can be implemented under a standard microscope, hence it has gained enormous attention for super-resolution imaging. In this article, we briefly review the microsphere approach and its applications for super-resolution imaging in various optical imaging modalities.

Deep learning massively accelerates super-resolution localization microscopy.

PubMed

Ouyang, Wei; Aristov, Andrey; Lelek, Mickaël; Hao, Xian; Zimmer, Christophe

2018-06-01

The speed of super-resolution microscopy methods based on single-molecule localization, for example, PALM and STORM, is limited by the need to record many thousands of frames with a small number of observed molecules in each. Here, we present ANNA-PALM, a computational strategy that uses artificial neural networks to reconstruct super-resolution views from sparse, rapidly acquired localization images and/or widefield images. Simulations and experimental imaging of microtubules, nuclear pores, and mitochondria show that high-quality, super-resolution images can be reconstructed from up to two orders of magnitude fewer frames than usually needed, without compromising spatial resolution. Super-resolution reconstructions are even possible from widefield images alone, though adding localization data improves image quality. We demonstrate super-resolution imaging of >1,000 fields of view containing >1,000 cells in ∼3 h, yielding an image spanning spatial scales from ∼20 nm to ∼2 mm. The drastic reduction in acquisition time and sample irradiation afforded by ANNA-PALM enables faster and gentler high-throughput and live-cell super-resolution imaging.

Facile method to stain the bacterial cell surface for super-resolution fluorescence microscopy

DOE Office of Scientific and Technical Information (OSTI.GOV)

Gunsolus, Ian L.; Hu, Dehong; Mihai, Cosmin

A method to fluorescently stain the surfaces of both Gram-negative and Gram-positive bacterial cells compatible with super-resolution fluorescence microscopy is presented. This method utilizes a commercially-available fluorescent probe to label primary amines at the surface of the cell. We demonstrate efficient staining of two bacterial strains, the Gram-negative Shewanella oneidensis MR-1 and the Gram-positive Bacillus subtilis 168. Using structured illumination microscopy and stochastic optical reconstruction microscopy, which require high quantum yield or specialized dyes, we show that this staining method may be used to resolve the bacterial cell surface with sub-diffraction-limited resolution. We further use this method to identify localizationmore » patterns of nanomaterials, specifically cadmium selenide quantum dots, following interaction with bacterial cells.« less

Repurposing a photosynthetic antenna protein as a super-resolution microscopy label.

PubMed

Barnett, Samuel F H; Hitchcock, Andrew; Mandal, Amit K; Vasilev, Cvetelin; Yuen, Jonathan M; Morby, James; Brindley, Amanda A; Niedzwiedzki, Dariusz M; Bryant, Donald A; Cadby, Ashley J; Holten, Dewey; Hunter, C Neil

2017-12-01

Techniques such as Stochastic Optical Reconstruction Microscopy (STORM) and Structured Illumination Microscopy (SIM) have increased the achievable resolution of optical imaging, but few fluorescent proteins are suitable for super-resolution microscopy, particularly in the far-red and near-infrared emission range. Here we demonstrate the applicability of CpcA, a subunit of the photosynthetic antenna complex in cyanobacteria, for STORM and SIM imaging. The periodicity and width of fabricated nanoarrays of CpcA, with a covalently attached phycoerythrobilin (PEB) or phycocyanobilin (PCB) chromophore, matched the lines in reconstructed STORM images. SIM and STORM reconstructions of Escherichia coli cells harbouring CpcA-labelled cytochrome bd 1 ubiquinol oxidase in the cytoplasmic membrane show that CpcA-PEB and CpcA-PCB are suitable for super-resolution imaging in vivo. The stability, ease of production, small size and brightness of CpcA-PEB and CpcA-PCB demonstrate the potential of this largely unexplored protein family as novel probes for super-resolution microscopy.

STED super-resolution microscopy of clinical paraffin-embedded human rectal cancer tissue.

PubMed

Ilgen, Peter; Stoldt, Stefan; Conradi, Lena-Christin; Wurm, Christian Andreas; Rüschoff, Josef; Ghadimi, B Michael; Liersch, Torsten; Jakobs, Stefan

2014-01-01

Formalin fixed and paraffin-embedded human tissue resected during cancer surgery is indispensable for diagnostic and therapeutic purposes and represents a vast and largely unexploited resource for research. Optical microscopy of such specimen is curtailed by the diffraction-limited resolution of conventional optical microscopy. To overcome this limitation, we used STED super-resolution microscopy enabling optical resolution well below the diffraction barrier. We visualized nanoscale protein distributions in sections of well-annotated paraffin-embedded human rectal cancer tissue stored in a clinical repository. Using antisera against several mitochondrial proteins, STED microscopy revealed distinct sub-mitochondrial protein distributions, suggesting a high level of structural preservation. Analysis of human tissues stored for up to 17 years demonstrated that these samples were still amenable for super-resolution microscopy. STED microscopy of sections of HER2 positive rectal adenocarcinoma revealed details in the surface and intracellular HER2 distribution that were blurred in the corresponding conventional images, demonstrating the potential of super-resolution microscopy to explore the thus far largely untapped nanoscale regime in tissues stored in biorepositories.

STED Super-Resolution Microscopy of Clinical Paraffin-Embedded Human Rectal Cancer Tissue

PubMed Central

Wurm, Christian Andreas; Rüschoff, Josef; Ghadimi, B. Michael; Liersch, Torsten; Jakobs, Stefan

2014-01-01

Formalin fixed and paraffin-embedded human tissue resected during cancer surgery is indispensable for diagnostic and therapeutic purposes and represents a vast and largely unexploited resource for research. Optical microscopy of such specimen is curtailed by the diffraction-limited resolution of conventional optical microscopy. To overcome this limitation, we used STED super-resolution microscopy enabling optical resolution well below the diffraction barrier. We visualized nanoscale protein distributions in sections of well-annotated paraffin-embedded human rectal cancer tissue stored in a clinical repository. Using antisera against several mitochondrial proteins, STED microscopy revealed distinct sub-mitochondrial protein distributions, suggesting a high level of structural preservation. Analysis of human tissues stored for up to 17 years demonstrated that these samples were still amenable for super-resolution microscopy. STED microscopy of sections of HER2 positive rectal adenocarcinoma revealed details in the surface and intracellular HER2 distribution that were blurred in the corresponding conventional images, demonstrating the potential of super-resolution microscopy to explore the thus far largely untapped nanoscale regime in tissues stored in biorepositories. PMID:25025184

A Microfluidic Platform for Correlative Live-Cell and Super-Resolution Microscopy

PubMed Central

Tam, Johnny; Cordier, Guillaume Alan; Bálint, Štefan; Sandoval Álvarez, Ángel; Borbely, Joseph Steven; Lakadamyali, Melike

2014-01-01

Recently, super-resolution microscopy methods such as stochastic optical reconstruction microscopy (STORM) have enabled visualization of subcellular structures below the optical resolution limit. Due to the poor temporal resolution, however, these methods have mostly been used to image fixed cells or dynamic processes that evolve on slow time-scales. In particular, fast dynamic processes and their relationship to the underlying ultrastructure or nanoscale protein organization cannot be discerned. To overcome this limitation, we have recently developed a correlative and sequential imaging method that combines live-cell and super-resolution microscopy. This approach adds dynamic background to ultrastructural images providing a new dimension to the interpretation of super-resolution data. However, currently, it suffers from the need to carry out tedious steps of sample preparation manually. To alleviate this problem, we implemented a simple and versatile microfluidic platform that streamlines the sample preparation steps in between live-cell and super-resolution imaging. The platform is based on a microfluidic chip with parallel, miniaturized imaging chambers and an automated fluid-injection device, which delivers a precise amount of a specified reagent to the selected imaging chamber at a specific time within the experiment. We demonstrate that this system can be used for live-cell imaging, automated fixation, and immunostaining of adherent mammalian cells in situ followed by STORM imaging. We further demonstrate an application by correlating mitochondrial dynamics, morphology, and nanoscale mitochondrial protein distribution in live and super-resolution images. PMID:25545548

Fast, label-free super-resolution live-cell imaging using rotating coherent scattering (ROCS) microscopy

NASA Astrophysics Data System (ADS)

Jünger, Felix; Olshausen, Philipp V.; Rohrbach, Alexander

2016-07-01

Living cells are highly dynamic systems with cellular structures being often below the optical resolution limit. Super-resolution microscopes, usually based on fluorescence cell labelling, are usually too slow to resolve small, dynamic structures. We present a label-free microscopy technique, which can generate thousands of super-resolved, high contrast images at a frame rate of 100 Hertz and without any post-processing. The technique is based on oblique sample illumination with coherent light, an approach believed to be not applicable in life sciences because of too many interference artefacts. However, by circulating an incident laser beam by 360° during one image acquisition, relevant image information is amplified. By combining total internal reflection illumination with dark-field detection, structures as small as 150 nm become separable through local destructive interferences. The technique images local changes in refractive index through scattered laser light and is applied to living mouse macrophages and helical bacteria revealing unexpected dynamic processes.

Fast, label-free super-resolution live-cell imaging using rotating coherent scattering (ROCS) microscopy

PubMed Central

Jünger, Felix; Olshausen, Philipp v.; Rohrbach, Alexander

2016-01-01

Living cells are highly dynamic systems with cellular structures being often below the optical resolution limit. Super-resolution microscopes, usually based on fluorescence cell labelling, are usually too slow to resolve small, dynamic structures. We present a label-free microscopy technique, which can generate thousands of super-resolved, high contrast images at a frame rate of 100 Hertz and without any post-processing. The technique is based on oblique sample illumination with coherent light, an approach believed to be not applicable in life sciences because of too many interference artefacts. However, by circulating an incident laser beam by 360° during one image acquisition, relevant image information is amplified. By combining total internal reflection illumination with dark-field detection, structures as small as 150 nm become separable through local destructive interferences. The technique images local changes in refractive index through scattered laser light and is applied to living mouse macrophages and helical bacteria revealing unexpected dynamic processes. PMID:27465033

DMD-based LED-illumination super-resolution and optical sectioning microscopy.

PubMed

Dan, Dan; Lei, Ming; Yao, Baoli; Wang, Wen; Winterhalder, Martin; Zumbusch, Andreas; Qi, Yujiao; Xia, Liang; Yan, Shaohui; Yang, Yanlong; Gao, Peng; Ye, Tong; Zhao, Wei

2013-01-01

Super-resolution three-dimensional (3D) optical microscopy has incomparable advantages over other high-resolution microscopic technologies, such as electron microscopy and atomic force microscopy, in the study of biological molecules, pathways and events in live cells and tissues. We present a novel approach of structured illumination microscopy (SIM) by using a digital micromirror device (DMD) for fringe projection and a low-coherence LED light for illumination. The lateral resolution of 90 nm and the optical sectioning depth of 120 μm were achieved. The maximum acquisition speed for 3D imaging in the optical sectioning mode was 1.6×10(7) pixels/second, which was mainly limited by the sensitivity and speed of the CCD camera. In contrast to other SIM techniques, the DMD-based LED-illumination SIM is cost-effective, ease of multi-wavelength switchable and speckle-noise-free. The 2D super-resolution and 3D optical sectioning modalities can be easily switched and applied to either fluorescent or non-fluorescent specimens.

Single-exposure super-resolved interferometric microscopy by RGB multiplexing in lensless configuration

NASA Astrophysics Data System (ADS)

Granero, Luis; Ferreira, Carlos; Zalevsky, Zeev; García, Javier; Micó, Vicente

2016-07-01

Single-Exposure Super-Resolved Interferometric Microscopy (SESRIM) reports on a way to achieve one-dimensional (1-D) superresolved imaging in digital holographic microscopy (DHM) by a single illumination shot and digital recording. SESRIM provides color-coded angular multiplexing of the accessible sample's range of spatial frequencies and it allows their recording in a single CCD (color or monochrome) snapshot by adding 3 RGB coherent reference beams at the output plane. In this manuscript, we extend the applicability of SESRIM to the field of digital in-line holographic microscopy (DIHM), that is, working without lenses. As consequence of the in-line configuration, an additional restriction concerning the object field of view (FOV) must be imposed to the technique. Experimental results are reported for both a synthetic object (USAF resolution test target) and a biological sample (swine sperm sample) validating this new kind of superresolution imaging method named as lensless SESRIM (L-SESRIM).

Super-resolution optical microscopy for studying membrane structure and dynamics.

PubMed

Sezgin, Erdinc

2017-07-12

Investigation of cell membrane structure and dynamics requires high spatial and temporal resolution. The spatial resolution of conventional light microscopy is limited due to the diffraction of light. However, recent developments in microscopy enabled us to access the nano-scale regime spatially, thus to elucidate the nanoscopic structures in the cellular membranes. In this review, we will explain the resolution limit, address the working principles of the most commonly used super-resolution microscopy techniques and summarise their recent applications in the biomembrane field.

DMD-based LED-illumination Super-resolution and optical sectioning microscopy

PubMed Central

Dan, Dan; Lei, Ming; Yao, Baoli; Wang, Wen; Winterhalder, Martin; Zumbusch, Andreas; Qi, Yujiao; Xia, Liang; Yan, Shaohui; Yang, Yanlong; Gao, Peng; Ye, Tong; Zhao, Wei

2013-01-01

Super-resolution three-dimensional (3D) optical microscopy has incomparable advantages over other high-resolution microscopic technologies, such as electron microscopy and atomic force microscopy, in the study of biological molecules, pathways and events in live cells and tissues. We present a novel approach of structured illumination microscopy (SIM) by using a digital micromirror device (DMD) for fringe projection and a low-coherence LED light for illumination. The lateral resolution of 90 nm and the optical sectioning depth of 120 μm were achieved. The maximum acquisition speed for 3D imaging in the optical sectioning mode was 1.6×107 pixels/second, which was mainly limited by the sensitivity and speed of the CCD camera. In contrast to other SIM techniques, the DMD-based LED-illumination SIM is cost-effective, ease of multi-wavelength switchable and speckle-noise-free. The 2D super-resolution and 3D optical sectioning modalities can be easily switched and applied to either fluorescent or non-fluorescent specimens. PMID:23346373

Improved localization accuracy in stochastic super-resolution fluorescence microscopy by K-factor image deshadowing

PubMed Central

Ilovitsh, Tali; Meiri, Amihai; Ebeling, Carl G.; Menon, Rajesh; Gerton, Jordan M.; Jorgensen, Erik M.; Zalevsky, Zeev

2013-01-01

Localization of a single fluorescent particle with sub-diffraction-limit accuracy is a key merit in localization microscopy. Existing methods such as photoactivated localization microscopy (PALM) and stochastic optical reconstruction microscopy (STORM) achieve localization accuracies of single emitters that can reach an order of magnitude lower than the conventional resolving capabilities of optical microscopy. However, these techniques require a sparse distribution of simultaneously activated fluorophores in the field of view, resulting in larger time needed for the construction of the full image. In this paper we present the use of a nonlinear image decomposition algorithm termed K-factor, which reduces an image into a nonlinear set of contrast-ordered decompositions whose joint product reassembles the original image. The K-factor technique, when implemented on raw data prior to localization, can improve the localization accuracy of standard existing methods, and also enable the localization of overlapping particles, allowing the use of increased fluorophore activation density, and thereby increased data collection speed. Numerical simulations of fluorescence data with random probe positions, and especially at high densities of activated fluorophores, demonstrate an improvement of up to 85% in the localization precision compared to single fitting techniques. Implementing the proposed concept on experimental data of cellular structures yielded a 37% improvement in resolution for the same super-resolution image acquisition time, and a decrease of 42% in the collection time of super-resolution data with the same resolution. PMID:24466491

An introduction to optical super-resolution microscopy for the adventurous biologist

NASA Astrophysics Data System (ADS)

Vangindertael, J.; Camacho, R.; Sempels, W.; Mizuno, H.; Dedecker, P.; Janssen, K. P. F.

2018-04-01

Ever since the inception of light microscopy, the laws of physics have seemingly thwarted every attempt to visualize the processes of life at its most fundamental, sub-cellular, level. The diffraction limit has restricted our view to length scales well above 250 nm and in doing so, severely compromised our ability to gain true insights into many biological systems. Fortunately, continuous advancements in optics, electronics and mathematics have since provided the means to once again make physics work to our advantage. Even though some of the fundamental concepts enabling super-resolution light microscopy have been known for quite some time, practically feasible implementations have long remained elusive. It should therefore not come as a surprise that the 2014 Nobel Prize in Chemistry was awarded to the scientists who, each in their own way, contributed to transforming super-resolution microscopy from a technological tour de force to a staple of the biologist’s toolkit. By overcoming the diffraction barrier, light microscopy could once again be established as an indispensable tool in an age where the importance of understanding life at the molecular level cannot be overstated. This review strives to provide the aspiring life science researcher with an introduction to optical microscopy, starting from the fundamental concepts governing compound and fluorescent confocal microscopy to the current state-of-the-art of super-resolution microscopy techniques and their applications.

Techniques for super-resolution microscopy using NV-diamond

NASA Astrophysics Data System (ADS)

Trifonov, Alexei; Glenn, David; Bar-Gill, Nir; Le Sage, David; Walsworth, Ronald

2011-05-01

We discuss the development and application of techniques for super-resolution microscopy using NV centers in diamond: stimulated emission depletion (STED), metastable ground state depletion (GSD), and stochastic optical reconstruction microscopy (STORM). NV centers do not bleach under optical excitation, are not biotoxic, and have long-lived electronic spin coherence and spin-state-dependent fluorescence. Thus NV-diamond has great potential as a fluorescent biomarker and as a magnetic biosensor.

Quantitative super-resolution single molecule microscopy dataset of YFP-tagged growth factor receptors.

PubMed

Lukeš, Tomáš; Pospíšil, Jakub; Fliegel, Karel; Lasser, Theo; Hagen, Guy M

2018-03-01

Super-resolution single molecule localization microscopy (SMLM) is a method for achieving resolution beyond the classical limit in optical microscopes (approx. 200 nm laterally). Yellow fluorescent protein (YFP) has been used for super-resolution single molecule localization microscopy, but less frequently than other fluorescent probes. Working with YFP in SMLM is a challenge because a lower number of photons are emitted per molecule compared with organic dyes, which are more commonly used. Publically available experimental data can facilitate development of new data analysis algorithms. Four complete, freely available single molecule super-resolution microscopy datasets on YFP-tagged growth factor receptors expressed in a human cell line are presented, including both raw and analyzed data. We report methods for sample preparation, for data acquisition, and for data analysis, as well as examples of the acquired images. We also analyzed the SMLM datasets using a different method: super-resolution optical fluctuation imaging (SOFI). The 2 modes of analysis offer complementary information about the sample. A fifth single molecule super-resolution microscopy dataset acquired with the dye Alexa 532 is included for comparison purposes. This dataset has potential for extensive reuse. Complete raw data from SMLM experiments have typically not been published. The YFP data exhibit low signal-to-noise ratios, making data analysis a challenge. These datasets will be useful to investigators developing their own algorithms for SMLM, SOFI, and related methods. The data will also be useful for researchers investigating growth factor receptors such as ErbB3.

Multiple signal classification algorithm for super-resolution fluorescence microscopy

PubMed Central

Agarwal, Krishna; Macháň, Radek

2016-01-01

Single-molecule localization techniques are restricted by long acquisition and computational times, or the need of special fluorophores or biologically toxic photochemical environments. Here we propose a statistical super-resolution technique of wide-field fluorescence microscopy we call the multiple signal classification algorithm which has several advantages. It provides resolution down to at least 50 nm, requires fewer frames and lower excitation power and works even at high fluorophore concentrations. Further, it works with any fluorophore that exhibits blinking on the timescale of the recording. The multiple signal classification algorithm shows comparable or better performance in comparison with single-molecule localization techniques and four contemporary statistical super-resolution methods for experiments of in vitro actin filaments and other independently acquired experimental data sets. We also demonstrate super-resolution at timescales of 245 ms (using 49 frames acquired at 200 frames per second) in samples of live-cell microtubules and live-cell actin filaments imaged without imaging buffers. PMID:27934858

Lateral resolution improvement in scanning nonlinear dielectric microscopy by measuring super-higher-order nonlinear dielectric constants

NASA Astrophysics Data System (ADS)

Chinone, N.; Yamasue, K.; Hiranaga, Y.; Honda, K.; Cho, Y.

2012-11-01

Scanning nonlinear dielectric microscopy (SNDM) can be used to visualize polarization distributions in ferroelectric materials and dopant profiles in semiconductor devices. Without using a special sharp tip, we achieved an improved lateral resolution in SNDM through the measurement of super-higher-order nonlinearity up to the fourth order. We observed a multidomain single crystal congruent LiTaO3 (CLT) sample, and a cross section of a metal-oxide-semiconductor (MOS) field-effect-transistor (FET). The imaged domain boundaries of the CLT were narrower in the super-higher-order images than in the conventional image. Compared to the conventional method, the super-higher-order method resolved the more detailed structure of the MOSFET.

Correlative super-resolution fluorescence microscopy combined with optical coherence microscopy

NASA Astrophysics Data System (ADS)

Kim, Sungho; Kim, Gyeong Tae; Jang, Soohyun; Shim, Sang-Hee; Bae, Sung Chul

2015-03-01

Recent development of super-resolution fluorescence imaging technique such as stochastic optical reconstruction microscopy (STORM) and photoactived localization microscope (PALM) has brought us beyond the diffraction limits. It allows numerous opportunities in biology because vast amount of formerly obscured molecular structures, due to lack of spatial resolution, now can be directly observed. A drawback of fluorescence imaging, however, is that it lacks complete structural information. For this reason, we have developed a super-resolution multimodal imaging system based on STORM and full-field optical coherence microscopy (FF-OCM). FF-OCM is a type of interferometry systems based on a broadband light source and a bulk Michelson interferometer, which provides label-free and non-invasive visualization of biological samples. The integration between the two systems is simple because both systems use a wide-field illumination scheme and a conventional microscope. This combined imaging system gives us both functional information at a molecular level (~20nm) and structural information at the sub-cellular level (~1μm). For thick samples such as tissue slices, while FF-OCM is readily capable of imaging the 3D architecture, STORM suffer from aberrations and high background fluorescence that substantially degrade the resolution. In order to correct the aberrations in thick tissues, we employed an adaptive optics system in the detection path of the STORM microscope. We used our multimodal system to obtain images on brain tissue samples with structural and functional information.

Light-sheet Bayesian microscopy enables deep-cell super-resolution imaging of heterochromatin in live human embryonic stem cells.

PubMed

Hu, Ying S; Zhu, Quan; Elkins, Keri; Tse, Kevin; Li, Yu; Fitzpatrick, James A J; Verma, Inder M; Cang, Hu

2013-01-01

Heterochromatin in the nucleus of human embryonic cells plays an important role in the epigenetic regulation of gene expression. The architecture of heterochromatin and its dynamic organization remain elusive because of the lack of fast and high-resolution deep-cell imaging tools. We enable this task by advancing instrumental and algorithmic implementation of the localization-based super-resolution technique. We present light-sheet Bayesian super-resolution microscopy (LSBM). We adapt light-sheet illumination for super-resolution imaging by using a novel prism-coupled condenser design to illuminate a thin slice of the nucleus with high signal-to-noise ratio. Coupled with a Bayesian algorithm that resolves overlapping fluorophores from high-density areas, we show, for the first time, nanoscopic features of the heterochromatin structure in both fixed and live human embryonic stem cells. The enhanced temporal resolution allows capturing the dynamic change of heterochromatin with a lateral resolution of 50-60 nm on a time scale of 2.3 s. Light-sheet Bayesian microscopy opens up broad new possibilities of probing nanometer-scale nuclear structures and real-time sub-cellular processes and other previously difficult-to-access intracellular regions of living cells at the single-molecule, and single cell level.

Light-sheet Bayesian microscopy enables deep-cell super-resolution imaging of heterochromatin in live human embryonic stem cells

PubMed Central

Hu, Ying S; Zhu, Quan; Elkins, Keri; Tse, Kevin; Li, Yu; Fitzpatrick, James A J; Verma, Inder M; Cang, Hu

2016-01-01

Background Heterochromatin in the nucleus of human embryonic cells plays an important role in the epigenetic regulation of gene expression. The architecture of heterochromatin and its dynamic organization remain elusive because of the lack of fast and high-resolution deep-cell imaging tools. We enable this task by advancing instrumental and algorithmic implementation of the localization-based super-resolution technique. Results We present light-sheet Bayesian super-resolution microscopy (LSBM). We adapt light-sheet illumination for super-resolution imaging by using a novel prism-coupled condenser design to illuminate a thin slice of the nucleus with high signal-to-noise ratio. Coupled with a Bayesian algorithm that resolves overlapping fluorophores from high-density areas, we show, for the first time, nanoscopic features of the heterochromatin structure in both fixed and live human embryonic stem cells. The enhanced temporal resolution allows capturing the dynamic change of heterochromatin with a lateral resolution of 50–60 nm on a time scale of 2.3 s. Conclusion Light-sheet Bayesian microscopy opens up broad new possibilities of probing nanometer-scale nuclear structures and real-time sub-cellular processes and other previously difficult-to-access intracellular regions of living cells at the single-molecule, and single cell level. PMID:27795878

Correlative Super-Resolution Microscopy: New Dimensions and New Opportunities.

PubMed

Hauser, Meghan; Wojcik, Michal; Kim, Doory; Mahmoudi, Morteza; Li, Wan; Xu, Ke

2017-06-14

Correlative microscopy, the integration of two or more microscopy techniques performed on the same sample, produces results that emphasize the strengths of each technique while offsetting their individual weaknesses. Light microscopy has historically been a central method in correlative microscopy due to its widespread availability, compatibility with hydrated and live biological samples, and excellent molecular specificity through fluorescence labeling. However, conventional light microscopy can only achieve a resolution of ∼300 nm, undercutting its advantages in correlations with higher-resolution methods. The rise of super-resolution microscopy (SRM) over the past decade has drastically improved the resolution of light microscopy to ∼10 nm, thus creating exciting new opportunities and challenges for correlative microscopy. Here we review how these challenges are addressed to effectively correlate SRM with other microscopy techniques, including light microscopy, electron microscopy, cryomicroscopy, atomic force microscopy, and various forms of spectroscopy. Though we emphasize biological studies, we also discuss the application of correlative SRM to materials characterization and single-molecule reactions. Finally, we point out current limitations and discuss possible future improvements and advances. We thus demonstrate how a correlative approach adds new dimensions of information and provides new opportunities in the fast-growing field of SRM.

Super-resolution and super-localization microscopy: A novel tool for imaging chemical and biological processes

DOE Office of Scientific and Technical Information (OSTI.GOV)

Dong, Bin

2015-01-01

Optical microscopy imaging of single molecules and single particles is an essential method for studying fundamental biological and chemical processes at the molecular and nanometer scale. The best spatial resolution (~ λ/2) achievable in traditional optical microscopy is governed by the diffraction of light. However, single molecule-based super-localization and super-resolution microscopy imaging techniques have emerged in the past decade. Individual molecules can be localized with nanometer scale accuracy and precision for studying of biological and chemical processes.This work uncovered the heterogeneous properties of the pore structures. In this dissertation, the coupling of molecular transport and catalytic reaction at the singlemore » molecule and single particle level in multilayer mesoporous nanocatalysts was elucidated. Most previous studies dealt with these two important phenomena separately. A fluorogenic oxidation reaction of non-fluorescent amplex red to highly fluorescent resorufin was tested. The diffusion behavior of single resorufin molecules in aligned nanopores was studied using total internal reflection fluorescence microscopy (TIRFM).« less

Super-Resolution Microscopy Techniques and Their Potential for Applications in Radiation Biophysics.

PubMed

Eberle, Jan Philipp; Rapp, Alexander; Krufczik, Matthias; Eryilmaz, Marion; Gunkel, Manuel; Erfle, Holger; Hausmann, Michael

2017-01-01

Fluorescence microscopy is an essential tool for imaging tagged biological structures. Due to the wave nature of light, the resolution of a conventional fluorescence microscope is limited laterally to about 200 nm and axially to about 600 nm, which is often referred to as the Abbe limit. This hampers the observation of important biological structures and dynamics in the nano-scaled range ~10 nm to ~100 nm. Consequentially, various methods have been developed circumventing this limit of resolution. Super-resolution microscopy comprises several of those methods employing physical and/or chemical properties, such as optical/instrumental modifications and specific labeling of samples. In this article, we will give a brief insight into a variety of selected optical microscopy methods reaching super-resolution beyond the Abbe limit. We will survey three different concepts in connection to biological applications in radiation research without making a claim to be complete.

Super-resolved refocusing with a plenoptic camera

NASA Astrophysics Data System (ADS)

Zhou, Zhiliang; Yuan, Yan; Bin, Xiangli; Qian, Lulu

2011-03-01

This paper presents an approach to enhance the resolution of refocused images by super resolution methods. In plenoptic imaging, we demonstrate that the raw sensor image can be divided to a number of low-resolution angular images with sub-pixel shifts between each other. The sub-pixel shift, which defines the super-resolving ability, is mathematically derived by considering the plenoptic camera as equivalent camera arrays. We implement simulation to demonstrate the imaging process of a plenoptic camera. A high-resolution image is then reconstructed using maximum a posteriori (MAP) super resolution algorithms. Without other degradation effects in simulation, the super resolved image achieves a resolution as high as predicted by the proposed model. We also build an experimental setup to acquire light fields. With traditional refocusing methods, the image is rendered at a rather low resolution. In contrast, we implement the super-resolved refocusing methods and recover an image with more spatial details. To evaluate the performance of the proposed method, we finally compare the reconstructed images using image quality metrics like peak signal to noise ratio (PSNR).

Super-resolution binding activated localization microscopy through reversible change of DNA conformation.

PubMed

Szczurek, Aleksander; Birk, Udo; Knecht, Hans; Dobrucki, Jurek; Mai, Sabine; Cremer, Christoph

2018-01-01

Methods of super-resolving light microscopy (SRM) have found an exponentially growing range of applications in cell biology, including nuclear structure analyses. Recent developments have proven that Single Molecule Localization Microscopy (SMLM), a type of SRM, is particularly useful for enhanced spatial analysis of the cell nucleus due to its highest resolving capability combined with very specific fluorescent labeling. In this commentary we offer a brief review of the latest methodological development in the field of SMLM of chromatin designated DNA Structure Fluctuation Assisted Binding Activated Localization Microscopy (abbreviated as fBALM) as well as its potential future applications in biology and medicine.

Three-dimensional nanometre localization of nanoparticles to enhance super-resolution microscopy

NASA Astrophysics Data System (ADS)

Bon, Pierre; Bourg, Nicolas; Lécart, Sandrine; Monneret, Serge; Fort, Emmanuel; Wenger, Jérôme; Lévêque-Fort, Sandrine

2015-07-01

Meeting the nanometre resolution promised by super-resolution microscopy techniques (pointillist: PALM, STORM, scanning: STED) requires stabilizing the sample drifts in real time during the whole acquisition process. Metal nanoparticles are excellent probes to track the lateral drifts as they provide crisp and photostable information. However, achieving nanometre axial super-localization is still a major challenge, as diffraction imposes large depths-of-fields. Here we demonstrate fast full three-dimensional nanometre super-localization of gold nanoparticles through simultaneous intensity and phase imaging with a wavefront-sensing camera based on quadriwave lateral shearing interferometry. We show how to combine the intensity and phase information to provide the key to the third axial dimension. Presently, we demonstrate even in the occurrence of large three-dimensional fluctuations of several microns, unprecedented sub-nanometre localization accuracies down to 0.7 nm in lateral and 2.7 nm in axial directions at 50 frames per second. We demonstrate that nanoscale stabilization greatly enhances the image quality and resolution in direct stochastic optical reconstruction microscopy imaging.

Wavelength scanning achieves pixel super-resolution in holographic on-chip microscopy

NASA Astrophysics Data System (ADS)

Luo, Wei; Göröcs, Zoltan; Zhang, Yibo; Feizi, Alborz; Greenbaum, Alon; Ozcan, Aydogan

2016-03-01

Lensfree holographic on-chip imaging is a potent solution for high-resolution and field-portable bright-field imaging over a wide field-of-view. Previous lensfree imaging approaches utilize a pixel super-resolution technique, which relies on sub-pixel lateral displacements between the lensfree diffraction patterns and the image sensor's pixel-array, to achieve sub-micron resolution under unit magnification using state-of-the-art CMOS imager chips, commonly used in e.g., mobile-phones. Here we report, for the first time, a wavelength scanning based pixel super-resolution technique in lensfree holographic imaging. We developed an iterative super-resolution algorithm, which generates high-resolution reconstructions of the specimen from low-resolution (i.e., under-sampled) diffraction patterns recorded at multiple wavelengths within a narrow spectral range (e.g., 10-30 nm). Compared with lateral shift-based pixel super-resolution, this wavelength scanning approach does not require any physical shifts in the imaging setup, and the resolution improvement is uniform in all directions across the sensor-array. Our wavelength scanning super-resolution approach can also be integrated with multi-height and/or multi-angle on-chip imaging techniques to obtain even higher resolution reconstructions. For example, using wavelength scanning together with multi-angle illumination, we achieved a halfpitch resolution of 250 nm, corresponding to a numerical aperture of 1. In addition to pixel super-resolution, the small scanning steps in wavelength also enable us to robustly unwrap phase, revealing the specimen's optical path length in our reconstructed images. We believe that this new wavelength scanning based pixel super-resolution approach can provide competitive microscopy solutions for high-resolution and field-portable imaging needs, potentially impacting tele-pathology applications in resource-limited-settings.

Label-free super-resolution with coherent nonlinear structured-illumination microscopy

NASA Astrophysics Data System (ADS)

Huttunen, Mikko J.; Abbas, Aazad; Upham, Jeremy; Boyd, Robert W.

2017-08-01

Structured-illumination microscopy enables up to a two-fold lateral resolution improvement by spatially modulating the intensity profile of the illumination beam. We propose a novel way to generalize the concept of structured illumination to nonlinear widefield modalities by spatially modulating, instead of field intensities, the phase of the incident field while interferometrically measuring the complex-valued scattered field. We numerically demonstrate that for second-order and third-order processes an almost four- and six-fold increase in lateral resolution is achievable, respectively. This procedure overcomes the conventional Abbe diffraction limit and provides new possibilities for label-free super-resolution microscopy.

Combined multi-plane phase retrieval and super-resolution optical fluctuation imaging for 4D cell microscopy

NASA Astrophysics Data System (ADS)

Descloux, A.; Grußmayer, K. S.; Bostan, E.; Lukes, T.; Bouwens, A.; Sharipov, A.; Geissbuehler, S.; Mahul-Mellier, A.-L.; Lashuel, H. A.; Leutenegger, M.; Lasser, T.

2018-03-01

Super-resolution fluorescence microscopy provides unprecedented insight into cellular and subcellular structures. However, going `beyond the diffraction barrier' comes at a price, since most far-field super-resolution imaging techniques trade temporal for spatial super-resolution. We propose the combination of a novel label-free white light quantitative phase imaging with fluorescence to provide high-speed imaging and spatial super-resolution. The non-iterative phase retrieval relies on the acquisition of single images at each z-location and thus enables straightforward 3D phase imaging using a classical microscope. We realized multi-plane imaging using a customized prism for the simultaneous acquisition of eight planes. This allowed us to not only image live cells in 3D at up to 200 Hz, but also to integrate fluorescence super-resolution optical fluctuation imaging within the same optical instrument. The 4D microscope platform unifies the sensitivity and high temporal resolution of phase imaging with the specificity and high spatial resolution of fluorescence microscopy.

Three-Dimensional Orientation of Anisotropic Plasmonic Aggregates at Intracellular Nuclear Indentation Sites by Integrated Light Sheet Super-Resolution Microscopy.

PubMed

Chakkarapani, Suresh Kumar; Sun, Yucheng; Lee, Seungah; Fang, Ning; Kang, Seong Ho

2018-05-22

Three-dimensional (3D) orientations of individual anisotropic plasmonic nanoparticles in aggregates were observed in real time by integrated light sheet super-resolution microscopy ( iLSRM). Asymmetric light scattering of a gold nanorod (AuNR) was used to trigger signals based on the polarizer angle. Controlled photoswitching was achieved by turning the polarizer and obtaining a series of images at different polarization directions. 3D subdiffraction-limited super-resolution images were obtained by superlocalization of scattering signals as a function of the anisotropic optical properties of AuNRs. Varying the polarizer angle allowed resolution of the orientation of individual AuNRs. 3D images of individual nanoparticles were resolved in aggregated regions, resulting in as low as 64 nm axial resolution and 28 nm spatial resolution. The proposed imaging setup and localization approach demonstrates a convenient method for imaging under a noisy environment where the majority of scattering noise comes from cellular components. This integrated 3D iLSRM and localization technique was shown to be reliable and useful in the field of 3D nonfluorescence super-resolution imaging.

Super-resolution binding activated localization microscopy through reversible change of DNA conformation

PubMed Central

Knecht, Hans; Dobrucki, Jurek; Mai, Sabine

2018-01-01

ABSTRACT Methods of super-resolving light microscopy (SRM) have found an exponentially growing range of applications in cell biology, including nuclear structure analyses. Recent developments have proven that Single Molecule Localization Microscopy (SMLM), a type of SRM, is particularly useful for enhanced spatial analysis of the cell nucleus due to its highest resolving capability combined with very specific fluorescent labeling. In this commentary we offer a brief review of the latest methodological development in the field of SMLM of chromatin designated DNA Structure Fluctuation Assisted Binding Activated Localization Microscopy (abbreviated as fBALM) as well as its potential future applications in biology and medicine. PMID:29297245

FALCON: fast and unbiased reconstruction of high-density super-resolution microscopy data

NASA Astrophysics Data System (ADS)

Min, Junhong; Vonesch, Cédric; Kirshner, Hagai; Carlini, Lina; Olivier, Nicolas; Holden, Seamus; Manley, Suliana; Ye, Jong Chul; Unser, Michael

2014-04-01

Super resolution microscopy such as STORM and (F)PALM is now a well known method for biological studies at the nanometer scale. However, conventional imaging schemes based on sparse activation of photo-switchable fluorescent probes have inherently slow temporal resolution which is a serious limitation when investigating live-cell dynamics. Here, we present an algorithm for high-density super-resolution microscopy which combines a sparsity-promoting formulation with a Taylor series approximation of the PSF. Our algorithm is designed to provide unbiased localization on continuous space and high recall rates for high-density imaging, and to have orders-of-magnitude shorter run times compared to previous high-density algorithms. We validated our algorithm on both simulated and experimental data, and demonstrated live-cell imaging with temporal resolution of 2.5 seconds by recovering fast ER dynamics.

FALCON: fast and unbiased reconstruction of high-density super-resolution microscopy data

PubMed Central

Min, Junhong; Vonesch, Cédric; Kirshner, Hagai; Carlini, Lina; Olivier, Nicolas; Holden, Seamus; Manley, Suliana; Ye, Jong Chul; Unser, Michael

2014-01-01

Super resolution microscopy such as STORM and (F)PALM is now a well known method for biological studies at the nanometer scale. However, conventional imaging schemes based on sparse activation of photo-switchable fluorescent probes have inherently slow temporal resolution which is a serious limitation when investigating live-cell dynamics. Here, we present an algorithm for high-density super-resolution microscopy which combines a sparsity-promoting formulation with a Taylor series approximation of the PSF. Our algorithm is designed to provide unbiased localization on continuous space and high recall rates for high-density imaging, and to have orders-of-magnitude shorter run times compared to previous high-density algorithms. We validated our algorithm on both simulated and experimental data, and demonstrated live-cell imaging with temporal resolution of 2.5 seconds by recovering fast ER dynamics. PMID:24694686

CINCH (confocal incoherent correlation holography) super resolution fluorescence microscopy based upon FINCH (Fresnel incoherent correlation holography).

PubMed

Siegel, Nisan; Storrie, Brian; Bruce, Marc; Brooker, Gary

2015-02-07

FINCH holographic fluorescence microscopy creates high resolution super-resolved images with enhanced depth of focus. The simple addition of a real-time Nipkow disk confocal image scanner in a conjugate plane of this incoherent holographic system is shown to reduce the depth of focus, and the combination of both techniques provides a simple way to enhance the axial resolution of FINCH in a combined method called "CINCH". An important feature of the combined system allows for the simultaneous real-time image capture of widefield and holographic images or confocal and confocal holographic images for ready comparison of each method on the exact same field of view. Additional GPU based complex deconvolution processing of the images further enhances resolution.

Under the Microscope: Single-Domain Antibodies for Live-Cell Imaging and Super-Resolution Microscopy.

PubMed

Traenkle, Bjoern; Rothbauer, Ulrich

2017-01-01

Single-domain antibodies (sdAbs) have substantially expanded the possibilities of advanced cellular imaging such as live-cell or super-resolution microscopy to visualize cellular antigens and their dynamics. In addition to their unique properties including small size, high stability, and solubility in many environments, sdAbs can be efficiently functionalized according to the needs of the respective imaging approach. Genetically encoded intrabodies fused to fluorescent proteins (chromobodies) have become versatile tools to study dynamics of endogenous proteins in living cells. Additionally, sdAbs conjugated to organic dyes were shown to label cellular structures with high density and minimal fluorophore displacement making them highly attractive probes for super-resolution microscopy. Here, we review recent advances of the chromobody technology to visualize localization and dynamics of cellular targets and the application of chromobody-based cell models for compound screening. Acknowledging the emerging importance of super-resolution microscopy in cell biology, we further discuss advantages and challenges of sdAbs for this technology.

Super-resolution microscopy as a potential approach to diagnosis of platelet granule disorders.

PubMed

Westmoreland, D; Shaw, M; Grimes, W; Metcalf, D J; Burden, J J; Gomez, K; Knight, A E; Cutler, D F

2016-04-01

Many platelet functions are dependent on bioactive molecules released from their granules. Deficiencies of these granules in number, shape or content are associated with bleeding. The small size of these granules is such that imaging them for diagnosis has traditionally required electron microscopy. However, recently developed super-resolution microscopes provide sufficient spatial resolution to effectively image platelet granules. When combined with automated image analysis, these methods provide a quantitative, unbiased, rapidly acquired dataset that can readily and reliably reveal differences in platelet granules between individuals. To demonstrate the ability of structured illumination microscopy (SIM) to efficiently differentiate between healthy volunteers and three patients with Hermansky-Pudlak syndrome. Blood samples were taken from three patients with Hermansky-Pudlak syndrome and seven controls. Patients 1-3 have gene defects in HPS1, HPS6 and HPS5, respectively; all controls were healthy volunteers. Platelet-rich plasma was isolated from blood and the platelets fixed, stained for CD63 and processed for analysis by immunofluorescence microscopy, using a custom-built SIM microscope. SIM can successfully resolve CD63-positive structures in fixed platelets. A determination of the number of CD63-positive structures per platelet allowed us to conclude that each patient was significantly different from all of the controls with 99% confidence. A super-resolution imaging approach is effective and rapid in objectively differentiating between patients with a platelet bleeding disorder and healthy volunteers. CD63 is a useful marker for predicting Hermansky-Pudlak syndrome and could be used in the diagnosis of patients suspected of other platelet granule disorders. © 2016 The Authors. Journal of Thrombosis and Haemostasis published by Wiley Periodicals, Inc. on behalf of International Society on Thrombosis and Haemostasis.

Live-cell super-resolution imaging of intrinsically fast moving flagellates

NASA Astrophysics Data System (ADS)

Glogger, M.; Stichler, S.; Subota, I.; Bertlein, S.; Spindler, M.-C.; Teßmar, J.; Groll, J.; Engstler, M.; Fenz, S. F.

2017-02-01

Recent developments in super-resolution microscopy make it possible to resolve structures in biological cells at a spatial resolution of a few nm and observe dynamical processes with a temporal resolution of ms to μs. However, the optimal structural resolution requires repeated illumination cycles and is thus limited to chemically fixed cells. For live cell applications substantial improvement over classical Abbe-limited imaging can already be obtained in adherent or slow moving cells. Nonetheless, a large group of cells are fast moving and thus could not yet be addressed with live cell super-resolution microscopy. These include flagellate pathogens like African trypanosomes, the causative agents of sleeping sickness in humans and nagana in livestock. Here, we present an embedding method based on a in situ forming cytocompatible UV-crosslinked hydrogel. The fast cross-linking hydrogel immobilizes trypanosomes efficiently to allow microscopy on the nanoscale. We characterized both the trypanosomes and the hydrogel with respect to their autofluorescence properties and found them suitable for single-molecule fluorescence microscopy (SMFM). As a proof of principle, SMFM was applied to super-resolve a structure inside the living trypanosome. We present an image of a flagellar axoneme component recorded by using the intrinsic blinking behavior of eYFP. , which features invited work from the best early-career researchers working within the scope of J Phys D. This project is part of the Journal of Physics series’ 50th anniversary celebrations in 2017. Susanne Fenz was selected by the Editorial Board of J Phys D as an Emerging Talent/Leader.

Quantum dot immunocytochemical localization of somatostatin in somatostatinoma by Widefield Epifluorescence, super-resolution light, and immunoelectron microscopy.

PubMed

Killingsworth, Murray C; Lai, Ken; Wu, Xiaojuan; Yong, Jim L C; Lee, C Soon

2012-11-01

Quantum dot nanocrystal probes (QDs) have been used for detection of somatostatin hormone in secretory granules of somatostatinoma tumor cells by immunofluorescence light microscopy, super-resolution light microscopy, and immunoelectron microscopy. Immunostaining for all modalities was done using sections taken from an epoxy resin-embedded tissue specimen and a similar labeling protocol. This approach allowed assessment of labeling at light microscopy level before examination at super-resolution and electron microscopy level and was a significant aid in interpretation. Etching of ultrathin sections with saturated sodium metaperiodate was a critical step presumably able to retrieve some tissue antigenicity masked by processing in epoxy resin. Immunofluorescence microscopy of QD-immunolabeled sections showed somatostatin hormone localization in cytoplasmic granules. Some variable staining of tumor gland-like structures appeared related to granule maturity and dispersal of granule contents within the tumor cell cytoplasm. Super-resolution light microscopy demonstrated localization of somatostatin within individual secretory granules to be heterogeneous, and this staining pattern was confirmed by immunoelectron microscopy.

Quantum Dot Immunocytochemical Localization of Somatostatin in Somatostatinoma by Widefield Epifluorescence, Super-resolution Light, and Immunoelectron Microscopy

PubMed Central

Lai, Ken; Wu, Xiaojuan; Yong, Jim L. C.; Lee, C. Soon

2012-01-01

Quantum dot nanocrystal probes (QDs) have been used for detection of somatostatin hormone in secretory granules of somatostatinoma tumor cells by immunofluorescence light microscopy, super-resolution light microscopy, and immunoelectron microscopy. Immunostaining for all modalities was done using sections taken from an epoxy resin-embedded tissue specimen and a similar labeling protocol. This approach allowed assessment of labeling at light microscopy level before examination at super-resolution and electron microscopy level and was a significant aid in interpretation. Etching of ultrathin sections with saturated sodium metaperiodate was a critical step presumably able to retrieve some tissue antigenicity masked by processing in epoxy resin. Immunofluorescence microscopy of QD-immunolabeled sections showed somatostatin hormone localization in cytoplasmic granules. Some variable staining of tumor gland-like structures appeared related to granule maturity and dispersal of granule contents within the tumor cell cytoplasm. Super-resolution light microscopy demonstrated localization of somatostatin within individual secretory granules to be heterogeneous, and this staining pattern was confirmed by immunoelectron microscopy. PMID:22899862

Interrogating Surface Functional Group Heterogeneity of Activated Thermoplastics Using Super-Resolution Fluorescence Microscopy.

PubMed

ONeil, Colleen E; Jackson, Joshua M; Shim, Sang-Hee; Soper, Steven A

2016-04-05

We present a novel approach for characterizing surfaces utilizing super-resolution fluorescence microscopy with subdiffraction limit spatial resolution. Thermoplastic surfaces were activated by UV/O3 or O2 plasma treatment under various conditions to generate pendant surface-confined carboxylic acids (-COOH). These surface functional groups were then labeled with a photoswitchable dye and interrogated using single-molecule, localization-based, super-resolution fluorescence microscopy to elucidate the surface heterogeneity of these functional groups across the activated surface. Data indicated nonuniform distributions of these functional groups for both COC and PMMA thermoplastics with the degree of heterogeneity being dose dependent. In addition, COC demonstrated relative higher surface density of functional groups compared to PMMA for both UV/O3 and O2 plasma treatment. The spatial distribution of -COOH groups secured from super-resolution imaging were used to simulate nonuniform patterns of electroosmotic flow in thermoplastic nanochannels. Simulations were compared to single-particle tracking of fluorescent nanoparticles within thermoplastic nanoslits to demonstrate the effects of surface functional group heterogeneity on the electrokinetic transport process.

CINCH (confocal incoherent correlation holography) super resolution fluorescence microscopy based upon FINCH (Fresnel incoherent correlation holography)

PubMed Central

Siegel, Nisan; Storrie, Brian; Bruce, Marc

2016-01-01

FINCH holographic fluorescence microscopy creates high resolution super-resolved images with enhanced depth of focus. The simple addition of a real-time Nipkow disk confocal image scanner in a conjugate plane of this incoherent holographic system is shown to reduce the depth of focus, and the combination of both techniques provides a simple way to enhance the axial resolution of FINCH in a combined method called “CINCH”. An important feature of the combined system allows for the simultaneous real-time image capture of widefield and holographic images or confocal and confocal holographic images for ready comparison of each method on the exact same field of view. Additional GPU based complex deconvolution processing of the images further enhances resolution. PMID:26839443

Understanding Super-Resolution Nanoscopy and Its Biological Applications in Cell Imaging

DOE Office of Scientific and Technical Information (OSTI.GOV)

Hu, Dehong; Zhao, Baoming; Xie, Yumei

2013-01-01

Optical microscopy has been an ideal tool to study phenomena in live cells because visible light at reasonable intensity does not perturb much of the normal biological functions. However, optical resolution using visible light is significantly limited by the wavelength. Overcoming this diffraction-limit barrier will reveal biological mechanisms, cellular structures, and physiological processes at nanometer scale, orders of magnitude lower than current optical microscopy. Although this appears to be a daunting task, recently developed photoswitchable probes enable reconstruction of individual images into a super-resolution image, thus the emergence of nanoscopy. Harnessing the resolution power of nanoscopy, we report here nano-resolutionmore » fluorescence imaging of microtubules and their network structures in biological cells. The super-resolution nanoscopy successfully resolved nanostructures of microtubule network—a daunting task that cannot be completed using conventional wide-field microscopy.« less

Improved axial resolution of FINCH fluorescence microscopy when combined with spinning disk confocal microscopy.

PubMed

Siegel, Nisan; Brooker, Gary

2014-09-22

FINCH holographic fluorescence microscopy creates super-resolved images with enhanced depth of focus. Addition of a Nipkow disk real-time confocal image scanner is shown to reduce the FINCH depth of focus while improving transverse confocal resolution in a combined method called "CINCH".

Brain Slice Staining and Preparation for Three-Dimensional Super-Resolution Microscopy

PubMed Central

German, Christopher L.; Gudheti, Manasa V.; Fleckenstein, Annette E.; Jorgensen, Erik M.

2018-01-01

Localization microscopy techniques – such as photoactivation localization microscopy (PALM), fluorescent PALM (FPALM), ground state depletion (GSD), and stochastic optical reconstruction microscopy (STORM) – provide the highest precision for single molecule localization currently available. However, localization microscopy has been largely limited to cell cultures due to the difficulties that arise in imaging thicker tissue sections. Sample fixation and antibody staining, background fluorescence, fluorophore photoinstability, light scattering in thick sections, and sample movement create significant challenges for imaging intact tissue. We have developed a sample preparation and image acquisition protocol to address these challenges in rat brain slices. The sample preparation combined multiple fixation steps, saponin permeabilization, and tissue clarification. Together, these preserve intracellular structures, promote antibody penetration, reduce background fluorescence and light scattering, and allow acquisition of images deep in a 30 μm thick slice. Image acquisition challenges were resolved by overlaying samples with a permeable agarose pad and custom-built stainless steel imaging adapter, and sealing the imaging chamber. This approach kept slices flat, immobile, bathed in imaging buffer, and prevented buffer oxidation during imaging. Using this protocol, we consistently obtained single molecule localizations of synaptic vesicle and active zone proteins in three-dimensions within individual synaptic terminals of the striatum in rat brain slices. These techniques may be easily adapted to the preparation and imaging of other tissues, substantially broadening the application of super-resolution imaging. PMID:28924666

Next-generation endomyocardial biopsy: the potential of confocal and super-resolution microscopy.

PubMed

Crossman, David J; Ruygrok, Peter N; Hou, Yu Feng; Soeller, Christian

2015-03-01

Confocal laser scanning microscopy and super-resolution microscopy provide high-contrast and high-resolution fluorescent imaging, which has great potential to increase the diagnostic yield of endomyocardial biopsy (EMB). EMB is currently the gold standard for identification of cardiac allograft rejection, myocarditis, and infiltrative and storage diseases. However, standard analysis is dominated by low-contrast bright-field light and electron microscopy (EM); this lack of contrast makes quantification of pathological features difficult. For example, assessment of cardiac allograft rejection relies on subjective grading of H&E histology, which may lead to diagnostic variability between pathologists. This issue could be solved by utilising the high contrast provided by fluorescence methods such as confocal to quantitatively assess the degree of lymphocytic infiltrate. For infiltrative diseases such as amyloidosis, the nanometre resolution provided by EM can be diagnostic in identifying disease-causing fibrils. The recent advent of super-resolution imaging, particularly direct stochastic optical reconstruction microscopy (dSTORM), provides high-contrast imaging at resolution approaching that of EM. Moreover, dSTORM utilises conventional fluorescence dyes allowing for the same structures to be routinely imaged at the cellular scale and then at the nanoscale. The key benefit of these technologies is that the high contrast facilitates quantitative digital analysis and thereby provides a means to robustly assess critical pathological features. Ultimately, this technology has the ability to provide greater accuracy and precision to EMB assessment, which could result in better outcomes for patients.

Stimulated emission depletion microscopy resolves individual nitrogen vacancy centers in diamond nanocrystals.

PubMed

Arroyo-Camejo, Silvia; Adam, Marie-Pierre; Besbes, Mondher; Hugonin, Jean-Paul; Jacques, Vincent; Greffet, Jean-Jacques; Roch, Jean-François; Hell, Stefan W; Treussart, François

2013-12-23

Nitrogen-vacancy (NV) color centers in nanodiamonds are highly promising for bioimaging and sensing. However, resolving individual NV centers within nanodiamond particles and the controlled addressing and readout of their spin state has remained a major challenge. Spatially stochastic super-resolution techniques cannot provide this capability in principle, whereas coordinate-controlled super-resolution imaging methods, like stimulated emission depletion (STED) microscopy, have been predicted to fail in nanodiamonds. Here we show that, contrary to these predictions, STED can resolve single NV centers in 40-250 nm sized nanodiamonds with a resolution of ≈10 nm. Even multiple adjacent NVs located in single nanodiamonds can be imaged individually down to relative distances of ≈15 nm. Far-field optical super-resolution of NVs inside nanodiamonds is highly relevant for bioimaging applications of these fluorescent nanolabels. The targeted addressing and readout of individual NV(-) spins inside nanodiamonds by STED should also be of high significance for quantum sensing and information applications.

Improved axial resolution of FINCH fluorescence microscopy when combined with spinning disk confocal microscopy

PubMed Central

Siegel, Nisan; Brooker, Gary

2014-01-01

FINCH holographic fluorescence microscopy creates super-resolved images with enhanced depth of focus. Addition of a Nipkow disk real-time confocal image scanner is shown to reduce the FINCH depth of focus while improving transverse confocal resolution in a combined method called “CINCH”. PMID:25321701

3D single-molecule super-resolution microscopy with a tilted light sheet.

PubMed

Gustavsson, Anna-Karin; Petrov, Petar N; Lee, Maurice Y; Shechtman, Yoav; Moerner, W E

2018-01-09

Tilted light sheet microscopy with 3D point spread functions (TILT3D) combines a novel, tilted light sheet illumination strategy with long axial range point spread functions (PSFs) for low-background, 3D super-localization of single molecules as well as 3D super-resolution imaging in thick cells. Because the axial positions of the single emitters are encoded in the shape of each single-molecule image rather than in the position or thickness of the light sheet, the light sheet need not be extremely thin. TILT3D is built upon a standard inverted microscope and has minimal custom parts. The result is simple and flexible 3D super-resolution imaging with tens of nm localization precision throughout thick mammalian cells. We validate TILT3D for 3D super-resolution imaging in mammalian cells by imaging mitochondria and the full nuclear lamina using the double-helix PSF for single-molecule detection and the recently developed tetrapod PSFs for fiducial bead tracking and live axial drift correction.

Super-resolution optical microscopy study of telomere structure.

PubMed

Phipps, Mary Lisa; Goodwin, Peter M; Martinez, Jennifer S; Goodwin, Edwin H

2016-09-01

Chromosome ends are shielded from exonucleolytic attack and inappropriate end-joining by terminal structures called telomeres; these structures are potential targets for anticancer drugs. Telomeres are composed of a simple DNA sequence (5?-TTAGGG-3? in humans) repeated more than a thousand times, a short 3? single-stranded overhang, and numerous proteins. Electron microscopy has shown that the 3? overhang pairs with the complementary strand at an internal site creating a small displacement loop and a large double-stranded “t-loop.” Our goal is to determine whether all telomeres adopt the t-loop configuration, or whether there are two or more distinct configurations. Progress in optimizing super-resolution (SR) microscopy for this ongoing investigation is reported here. Results suggest that under certain conditions sample preparation procedures may disrupt chromatin by causing loss of nucleosomes. This finding may limit the use of SR microscopy in telomere studies.

Super-resolution optical microscopy study of telomere structure

NASA Astrophysics Data System (ADS)

Phipps, Mary Lisa; Goodwin, Peter M.; Martinez, Jennifer S.; Goodwin, Edwin H.

2016-09-01

Chromosome ends are shielded from exonucleolytic attack and inappropriate end-joining by terminal structures called telomeres; these structures are potential targets for anticancer drugs. Telomeres are composed of a simple DNA sequence (5‧-TTAGGG-3‧ in humans) repeated more than a thousand times, a short 3‧ single-stranded overhang, and numerous proteins. Electron microscopy has shown that the 3‧ overhang pairs with the complementary strand at an internal site creating a small displacement loop and a large double-stranded "t-loop." Our goal is to determine whether all telomeres adopt the t-loop configuration, or whether there are two or more distinct configurations. Progress in optimizing super-resolution (SR) microscopy for this ongoing investigation is reported here. Results suggest that under certain conditions sample preparation procedures may disrupt chromatin by causing loss of nucleosomes. This finding may limit the use of SR microscopy in telomere studies.

STED super-resolution microscopy reveals an array of MINOS clusters along human mitochondria

PubMed Central

Jans, Daniel C.; Wurm, Christian A.; Riedel, Dietmar; Wenzel, Dirk; Stagge, Franziska; Deckers, Markus; Rehling, Peter; Jakobs, Stefan

2013-01-01

The mitochondrial inner membrane organizing system (MINOS) is a conserved large hetero-oligomeric protein complex in the mitochondrial inner membrane, crucial for the maintenance of cristae morphology. MINOS has been suggested to represent the core of an extended protein network that controls mitochondrial function and structure, and has been linked to several human diseases. The spatial arrangement of MINOS within mitochondria is ill-defined, however. Using super-resolution stimulated emission depletion (STED) microscopy and immunogold electron microscopy, we determined the distribution of three known human MINOS subunits (mitofilin, MINOS1, and CHCHD3) in mammalian cells. Super-resolution microscopy revealed that all three subunits form similar clusters within mitochondria, and that MINOS is more abundant in mitochondria around the nucleus than in peripheral mitochondria. At the submitochondrial level, mitofilin, a core MINOS subunit, is preferentially localized at cristae junctions. In primary human fibroblasts, mitofilin labeling uncovered a regularly spaced pattern of clusters arranged in parallel to the cell growth surfaces. We suggest that this array of MINOS complexes might explain the observed phenomenon of largely horizontally arranged cristae junctions that connect the inner boundary membrane to lamellar cristae. The super-resolution images demonstrate an unexpectedly high level of regularity in the nanoscale distribution of the MINOS complex in human mitochondria, supporting an integrating role of MINOS in the structural organization of the organelle. PMID:23676277

Multi-dimensional super-resolution imaging enables surface hydrophobicity mapping

NASA Astrophysics Data System (ADS)

Bongiovanni, Marie N.; Godet, Julien; Horrocks, Mathew H.; Tosatto, Laura; Carr, Alexander R.; Wirthensohn, David C.; Ranasinghe, Rohan T.; Lee, Ji-Eun; Ponjavic, Aleks; Fritz, Joelle V.; Dobson, Christopher M.; Klenerman, David; Lee, Steven F.

2016-12-01

Super-resolution microscopy allows biological systems to be studied at the nanoscale, but has been restricted to providing only positional information. Here, we show that it is possible to perform multi-dimensional super-resolution imaging to determine both the position and the environmental properties of single-molecule fluorescent emitters. The method presented here exploits the solvatochromic and fluorogenic properties of nile red to extract both the emission spectrum and the position of each dye molecule simultaneously enabling mapping of the hydrophobicity of biological structures. We validated this by studying synthetic lipid vesicles of known composition. We then applied both to super-resolve the hydrophobicity of amyloid aggregates implicated in neurodegenerative diseases, and the hydrophobic changes in mammalian cell membranes. Our technique is easily implemented by inserting a transmission diffraction grating into the optical path of a localization-based super-resolution microscope, enabling all the information to be extracted simultaneously from a single image plane.

Multi-dimensional super-resolution imaging enables surface hydrophobicity mapping

PubMed Central

Bongiovanni, Marie N.; Godet, Julien; Horrocks, Mathew H.; Tosatto, Laura; Carr, Alexander R.; Wirthensohn, David C.; Ranasinghe, Rohan T.; Lee, Ji-Eun; Ponjavic, Aleks; Fritz, Joelle V.; Dobson, Christopher M.; Klenerman, David; Lee, Steven F.

2016-01-01

Super-resolution microscopy allows biological systems to be studied at the nanoscale, but has been restricted to providing only positional information. Here, we show that it is possible to perform multi-dimensional super-resolution imaging to determine both the position and the environmental properties of single-molecule fluorescent emitters. The method presented here exploits the solvatochromic and fluorogenic properties of nile red to extract both the emission spectrum and the position of each dye molecule simultaneously enabling mapping of the hydrophobicity of biological structures. We validated this by studying synthetic lipid vesicles of known composition. We then applied both to super-resolve the hydrophobicity of amyloid aggregates implicated in neurodegenerative diseases, and the hydrophobic changes in mammalian cell membranes. Our technique is easily implemented by inserting a transmission diffraction grating into the optical path of a localization-based super-resolution microscope, enabling all the information to be extracted simultaneously from a single image plane. PMID:27929085

Super-resolution microscopy reveals cell wall dynamics and peptidoglycan architecture in ovococcal bacteria.

PubMed

Wheeler, Richard; Mesnage, Stéphane; Boneca, Ivo G; Hobbs, Jamie K; Foster, Simon J

2011-12-01

Cell morphology and viability in Eubacteria is dictated by the architecture of peptidoglycan, the major and essential structural component of the cell wall. Although the biochemical composition of peptidoglycan is well understood, how the peptidoglycan architecture can accommodate the dynamics of growth and division while maintaining cell shape remains largely unknown. Here, we elucidate the peptidoglycan architecture and dynamics of bacteria with ovoid cell shape (ovococci), which includes a number of important pathogens, by combining biochemical analyses with atomic force and super-resolution microscopies. Atomic force microscopy analysis showed preferential orientation of the peptidoglycan network parallel to the short axis of the cell, with distinct architectural features associated with septal and peripheral wall synthesis. Super-resolution three-dimensional structured illumination fluorescence microscopy was applied for the first time in bacteria to unravel the dynamics of peptidoglycan assembly in ovococci. The ovococci have a unique peptidoglycan architecture and growth mode not observed in other model organisms. © 2011 Blackwell Publishing Ltd.

Multicolor Super-Resolution Fluorescence Imaging via Multi-Parameter Fluorophore Detection

PubMed Central

Bates, Mark; Dempsey, Graham T; Chen, Kok Hao; Zhuang, Xiaowei

2012-01-01

Understanding the complexity of the cellular environment will benefit from the ability to unambiguously resolve multiple cellular components, simultaneously and with nanometer-scale spatial resolution. Multicolor super-resolution fluorescence microscopy techniques have been developed to achieve this goal, yet challenges remain in terms of the number of targets that can be simultaneously imaged and the crosstalk between color channels. Herein, we demonstrate multicolor stochastic optical reconstruction microscopy (STORM) based on a multi-parameter detection strategy, which uses both the fluorescence activation wavelength and the emission color to discriminate between photo-activatable fluorescent probes. First, we obtained two-color super-resolution images using the near-infrared cyanine dye Alexa 750 in conjunction with a red cyanine dye Alexa 647, and quantified color crosstalk levels and image registration accuracy. Combinatorial pairing of these two switchable dyes with fluorophores which enhance photo-activation enabled multi-parameter detection of six different probes. Using this approach, we obtained six-color super-resolution fluorescence images of a model sample. The combination of multiple fluorescence detection parameters for improved fluorophore discrimination promises to substantially enhance our ability to visualize multiple cellular targets with sub-diffraction-limit resolution. PMID:22213647

Annular solid-immersion lenslet array super-resolution optical microscopy

NASA Astrophysics Data System (ADS)

Liau, Z. L.

2012-10-01

We describe a novel solid-immersion lenslet array, micro-fabricated in a chip form in the high-index (3.45) gallium phosphide. The innovatively designed lenslet features an annular aperture with appropriately patterned light absorbers and antireflection coatings. The array chip is easy to handle and enables the direct deposition of the specimen of interest onto its back-plane for tight adhesion and good optical coupling. The ensuing diffraction from the near field can yield supercritical rays inside the high-index lenslet and can, therefore, overcome the refraction and critical-angle limitations. This model showed agreement with the experimental observation of the solid-immersion fluorescence microscopy imaging, in which the refracted rays were completely blocked by the annular aperture. A large longitudinal (depth) magnification effect was also predicted and showed agreement with experiment. The annular lenslet's additional advantages of improved resolution and contrast were also discussed. Resolution of nested-L patterns with grating pitch as small as 100 nm was experimentally demonstrated. The demonstrated annular solid-immersion lenslet array concept is promising for a wider use in super-resolution optical microscopy.

Super-resolution atomic force photoactivated microscopy of biological samples (Conference Presentation)

NASA Astrophysics Data System (ADS)

Lee, Seunghyun; Kim, Hyemin; Shin, Seungjun; Doh, Junsang; Kim, Chulhong

2017-03-01

Optical microscopy (OM) and photoacoustic microscopy (PAM) have previously been used to image the optical absorption of intercellular features of biological cells. However, the optical diffraction limit ( 200 nm) makes it difficult for these modalities to image nanoscale inner cell structures and the distribution of internal cell components. Although super-resolution fluorescence microscopy, such as stimulated emission depletion microscopy (STED) and stochastic optical reconstruction microscopy (STORM), has successfully performed nanoscale biological imaging, these modalities require the use of exogenous fluorescence agents, which are unfavorable for biological samples. Our newly developed atomic force photoactivated microscopy (AFPM) can provide optical absorption images with nanoscale lateral resolution without any exogenous contrast agents. AFPM combines conventional atomic force microscopy (AFM) and an optical excitation system, and simultaneously provides multiple contrasts, such as the topography and magnitude of optical absorption. AFPM can detect the intrinsic optical absorption of samples with 8 nm lateral resolution, easily overcoming the diffraction limit. Using the label-free AFPM system, we have successfully imaged the optical absorption properties of a single melanoma cell (B16F10) and a rosette leaf epidermal cell of Arabidopsis (ecotype Columbia (Col-0)) with nanoscale lateral resolution. The remarkable images show the melanosome distribution of a melanoma cell and the biological structures of a plant cell. AFPM provides superior imaging of optical absorption with a nanoscale lateral resolution, and it promises to become widely used in biological and chemical research.

Diverse protocols for correlative super-resolution fluorescence imaging and electron microscopy of chemically fixed samples

PubMed Central

Kopek, Benjamin G.; Paez-Segala, Maria G.; Shtengel, Gleb; Sochacki, Kem A.; Sun, Mei G.; Wang, Yalin; Xu, C. Shan; van Engelenburg, Schuyler B.; Taraska, Justin W.; Looger, Loren L.; Hess, Harald F.

2017-01-01

Our groups have recently developed related approaches for sample preparation for super-resolution imaging within endogenous cellular environments using correlative light and electron microscopy (CLEM). Four distinct techniques for preparing and acquiring super-resolution CLEM datasets on aldehyde-fixed specimens are provided, including Tokuyasu cryosectioning, whole-cell mount, cell unroofing and platinum replication, and resin embedding and sectioning. Choice of the best protocol for a given application depends on a number of criteria that are discussed in detail. Tokuyasu cryosectioning is relatively rapid but is limited to small, delicate specimens. Whole-cell mount has the simplest sample preparation but is restricted to surface structures. Cell unroofing and platinum replica creates high-contrast, 3-dimensional images of the cytoplasmic surface of the plasma membrane, but is more challenging than whole-cell mount. Resin embedding permits serial sectioning of large samples, but is limited to osmium-resistant probes, and is technically difficult. Expected results from these protocols include super-resolution localization (~10–50 nm) of fluorescent targets within the context of electron microscopy ultrastructure, which can help address cell biological questions. These protocols can be completed in 2–7 days, are compatible with a number of super-resolution imaging protocols, and are broadly applicable across biology. PMID:28384138

Operating organic light-emitting diodes imaged by super-resolution spectroscopy

DOE Office of Scientific and Technical Information (OSTI.GOV)

King, John T.; Granick, Steve

Super-resolution stimulated emission depletion (STED) microscopy is adapted here for materials characterization that would not otherwise be possible. With the example of organic light-emitting diodes (OLEDs), spectral imaging with pixel-by-pixel wavelength discrimination allows us to resolve local-chain environment encoded in the spectral response of the semi-conducting polymer, and correlate chain packing with local electroluminescence by using externally applied current as the excitation source. We observe nanoscopic defects that would be unresolvable by traditional microscopy. They are revealed in electroluminescence maps in operating OLEDs with 50 nm spatial resolution. We find that brightest emission comes from regions with more densely packedmore » chains. Conventional microscopy of an operating OLED would lack the resolution needed to discriminate these features, while traditional methods to resolve nanoscale features generally cannot be performed when the device is operating. As a result, this points the way towards real-time analysis of materials design principles in devices as they actually operate.« less

Operating organic light-emitting diodes imaged by super-resolution spectroscopy

DOE PAGES

King, John T.; Granick, Steve

2016-06-21

Super-resolution stimulated emission depletion (STED) microscopy is adapted here for materials characterization that would not otherwise be possible. With the example of organic light-emitting diodes (OLEDs), spectral imaging with pixel-by-pixel wavelength discrimination allows us to resolve local-chain environment encoded in the spectral response of the semi-conducting polymer, and correlate chain packing with local electroluminescence by using externally applied current as the excitation source. We observe nanoscopic defects that would be unresolvable by traditional microscopy. They are revealed in electroluminescence maps in operating OLEDs with 50 nm spatial resolution. We find that brightest emission comes from regions with more densely packedmore » chains. Conventional microscopy of an operating OLED would lack the resolution needed to discriminate these features, while traditional methods to resolve nanoscale features generally cannot be performed when the device is operating. As a result, this points the way towards real-time analysis of materials design principles in devices as they actually operate.« less

Compact three-dimensional super-resolution system based on fluorescence emission difference microscopy

NASA Astrophysics Data System (ADS)

Zhu, Dazhao; Chen, Youhua; Fang, Yue; Hussain, Anwar; Kuang, Cuifang; Zhou, Xiaoxu; Xu, Yingke; Liu, Xu

2017-12-01

A compact microscope system for three-dimensional (3-D) super-resolution imaging is presented. The super-resolution capability of the system is based on a size-reduced effective 3-D point spread function generated through the fluorescence emission difference (FED) method. The appropriate polarization direction distribution and manipulation allows the panel active area of the spatial light modulator to be fully utilized. This allows simultaneous modulation of the incident light by two kinds of phase masks to be performed with a single spatial light modulator in order to generate a 3-D negative spot. The system is more compact than standard 3-D FED systems while maintaining all the advantages of 3-D FED microscopy. The experimental results demonstrated the improvement in 3-D resolution by nearly 1.7 times and 1.6 times compared to the classic confocal resolution in the lateral and axial directions, respectively.

Super-resolution photoacoustic microscopy using joint sparsity

NASA Astrophysics Data System (ADS)

Burgholzer, P.; Haltmeier, M.; Berer, T.; Leiss-Holzinger, E.; Murray, T. W.

2017-07-01

We present an imaging method that uses the random optical speckle patterns that naturally emerge as light propagates through strongly scattering media as a structured illumination source for photoacoustic imaging. Our approach, termed blind structured illumination photoacoustic microscopy (BSIPAM), was inspired by recent work in fluorescence microscopy where super-resolution imaging was demonstrated using multiple unknown speckle illumination patterns. We extend this concept to the multiple scattering domain using photoacoustics (PA), with the speckle pattern serving to generate ultrasound. The optical speckle pattern that emerges as light propagates through diffuse media provides structured illumination to an object placed behind a scattering wall. The photoacoustic signal produced by such illumination is detected using a focused ultrasound transducer. We demonstrate through both simulation and experiment, that by acquiring multiple photoacoustic images, each produced by a different random and unknown speckle pattern, an image of an absorbing object can be reconstructed with a spatial resolution far exceeding that of the ultrasound transducer. We experimentally and numerically demonstrate a gain in resolution of more than a factor of two by using multiple speckle illuminations. The variations in the photoacoustic signals generated with random speckle patterns are utilized in BSIPAM using a novel reconstruction algorithm. Exploiting joint sparsity, this algorithm is capable of reconstructing the absorbing structure from measured PA signals with a resolution close to the speckle size. Another way to excite random excitation for photoacoustic imaging are small absorbing particles, including contrast agents, which flow through small vessels. For such a set-up, the joint-sparsity is generated by the fact that all the particles move in the same vessels. Structured illumination in that case is not necessary.

Single cell systems biology by super-resolution imaging and combinatorial labeling

PubMed Central

Lubeck, Eric; Cai, Long

2012-01-01

Fluorescence microscopy is a powerful quantitative tool for exploring regulatory networks in single cells. However, the number of molecular species that can be measured simultaneously is limited by the spectral separability of fluorophores. Here we demonstrate a simple but general strategy to drastically increase the capacity for multiplex detection of molecules in single cells by using optical super-resolution microscopy (SRM) and combinatorial labeling. As a proof of principle, we labeled mRNAs with unique combinations of fluorophores using Fluorescence in situ Hybridization (FISH), and resolved the sequences and combinations of fluorophores with SRM. We measured the mRNA levels of 32 genes simultaneously in single S. cerevisiae cells. These experiments demonstrate that combinatorial labeling and super-resolution imaging of single cells provides a natural approach to bring systems biology into single cells. PMID:22660740

Differential localization of SAP102 and PSD-95 is revealed in hippocampal spines using super-resolution light microscopy.

PubMed

Zheng, Chan-Ying; Wang, Ya-Xia; Kachar, Bechara; Petralia, Ronald S

2011-01-01

Synapse-associated protein 102 (SAP102) and postsynaptic density 95 (PSD-95) are two major cytoskeleton proteins in the postsynaptic density (PSD). Both of them belong to the membrane-associated guanylate kinase (MAGUK) family, which clusters and anchors glutamate receptors and other proteins at synapses. In our previous study, we found that SAP102 and PSD-95 have different distributions, using combined light/electron microscopy (LM/EM) methods.1 Here, we double labeled endogenous SAP102 and PSD-95 in mature hippocampal neurons, and then took images by two different kinds of super resolution microscopy-Stimulated Emission Depletion microscopy (STED) and DeltaVision OMX 3D super resolution microscopy. We found that our 2D and 3D super resolution data were consistent with our previous LM/EM data, showing significant differences in the localization of SAP102 and PSD-95 in spines: SAP102 is distributed in both the PSD and cytoplasm of spines, while PSD-95 is concentrated only in the PSD area. These results indicate functional differences between SAP102 and PSD-95 in synaptic organization and plasticity.

SNSMIL, a real-time single molecule identification and localization algorithm for super-resolution fluorescence microscopy

PubMed Central

Tang, Yunqing; Dai, Luru; Zhang, Xiaoming; Li, Junbai; Hendriks, Johnny; Fan, Xiaoming; Gruteser, Nadine; Meisenberg, Annika; Baumann, Arnd; Katranidis, Alexandros; Gensch, Thomas

2015-01-01

Single molecule localization based super-resolution fluorescence microscopy offers significantly higher spatial resolution than predicted by Abbe’s resolution limit for far field optical microscopy. Such super-resolution images are reconstructed from wide-field or total internal reflection single molecule fluorescence recordings. Discrimination between emission of single fluorescent molecules and background noise fluctuations remains a great challenge in current data analysis. Here we present a real-time, and robust single molecule identification and localization algorithm, SNSMIL (Shot Noise based Single Molecule Identification and Localization). This algorithm is based on the intrinsic nature of noise, i.e., its Poisson or shot noise characteristics and a new identification criterion, QSNSMIL, is defined. SNSMIL improves the identification accuracy of single fluorescent molecules in experimental or simulated datasets with high and inhomogeneous background. The implementation of SNSMIL relies on a graphics processing unit (GPU), making real-time analysis feasible as shown for real experimental and simulated datasets. PMID:26098742

Super-resolved Mirau digital holography by structured illumination

NASA Astrophysics Data System (ADS)

Ganjkhani, Yasaman; Charsooghi, Mohammad A.; Akhlaghi, Ehsan A.; Moradi, Ali-Reza

2017-12-01

In this paper, we apply structured illumination toward super-resolved 3D imaging in a common-path digital holography arrangement. Digital holographic microscopy (DHM) provides non-invasive 3D images of transparent samples as well as 3D profiles of reflective surfaces. A compact and vibration-immune arrangement for DHM may be obtained through the use of a Mirau microscope objective. However, high-magnification Mirau objectives have a low working distance and are expensive. Low-magnification ones, on the other hand, suffer from low lateral resolution. Structured illumination has been widely used for resolution improvement of intensity images, but the technique can also be readily applied to DHM. We apply structured illumination to Mirau DHM by implementing successive sinusoidal gratings with different orientations onto a spatial light modulator (SLM) and forming its image on the specimen. Moreover, we show that, instead of different orientations of 1D gratings, alternative single 2D gratings, e.g. checkerboard or hexagonal patterns, can provide resolution enhancement in multiple directions. Our results show a 35% improvement in the resolution power of the DHM. The presented arrangement has the potential to serve as a table-top device for high resolution holographic microscopy.

Fast, long-term, super-resolution imaging with Hessian structured illumination microscopy.

PubMed

Huang, Xiaoshuai; Fan, Junchao; Li, Liuju; Liu, Haosen; Wu, Runlong; Wu, Yi; Wei, Lisi; Mao, Heng; Lal, Amit; Xi, Peng; Tang, Liqiang; Zhang, Yunfeng; Liu, Yanmei; Tan, Shan; Chen, Liangyi

2018-06-01

To increase the temporal resolution and maximal imaging time of super-resolution (SR) microscopy, we have developed a deconvolution algorithm for structured illumination microscopy based on Hessian matrixes (Hessian-SIM). It uses the continuity of biological structures in multiple dimensions as a priori knowledge to guide image reconstruction and attains artifact-minimized SR images with less than 10% of the photon dose used by conventional SIM while substantially outperforming current algorithms at low signal intensities. Hessian-SIM enables rapid imaging of moving vesicles or loops in the endoplasmic reticulum without motion artifacts and with a spatiotemporal resolution of 88 nm and 188 Hz. Its high sensitivity allows the use of sub-millisecond excitation pulses followed by dark recovery times to reduce photobleaching of fluorescent proteins, enabling hour-long time-lapse SR imaging of actin filaments in live cells. Finally, we observed the structural dynamics of mitochondrial cristae and structures that, to our knowledge, have not been observed previously, such as enlarged fusion pores during vesicle exocytosis.

Fast myopic 2D-SIM super resolution microscopy with joint modulation pattern estimation

NASA Astrophysics Data System (ADS)

Orieux, François; Loriette, Vincent; Olivo-Marin, Jean-Christophe; Sepulveda, Eduardo; Fragola, Alexandra

2017-12-01

Super-resolution in structured illumination microscopy (SIM) is obtained through de-aliasing of modulated raw images, in which high frequencies are measured indirectly inside the optical transfer function. Usual approaches that use 9 or 15 images are often too slow for dynamic studies. Moreover, as experimental conditions change with time, modulation parameters must be estimated within the images. This paper tackles the problem of image reconstruction for fast super resolution in SIM, where the number of available raw images is reduced to four instead of nine or fifteen. Within an optimization framework, the solution is inferred via a joint myopic criterion for image and modulation (or acquisition) parameters, leading to what is frequently called a myopic or semi-blind inversion problem. The estimate is chosen as the minimizer of the nonlinear criterion, numerically calculated by means of a block coordinate optimization algorithm. The effectiveness of the proposed method is demonstrated for simulated and experimental examples. The results show precise estimation of the modulation parameters jointly with the reconstruction of the super resolution image. The method also shows its effectiveness for thick biological samples.

High-magnification super-resolution FINCH microscopy using birefringent crystal lens interferometers

NASA Astrophysics Data System (ADS)

Siegel, Nisan; Lupashin, Vladimir; Storrie, Brian; Brooker, Gary

2016-12-01

Fresnel incoherent correlation holography (FINCH) microscopy is a promising approach for high-resolution biological imaging but has so far been limited to use with low-magnification, low-numerical-aperture configurations. We report the use of in-line incoherent interferometers made from uniaxial birefringent α-barium borate (α-BBO) or calcite crystals that overcome the aberrations and distortions present with previous implementations that employed spatial light modulators or gradient refractive index lenses. FINCH microscopy incorporating these birefringent elements and high-numerical-aperture oil immersion objectives could outperform standard wide-field fluorescence microscopy, with, for example, a 149 nm lateral point spread function at a wavelength of 590 nm. Enhanced resolution was confirmed with sub-resolution fluorescent beads. Taking the Golgi apparatus as a biological example, three different proteins labelled with GFP and two other fluorescent dyes in HeLa cells were resolved with an image quality that is comparable to similar samples captured by structured illumination microscopy.

Imaging cellular structures in super-resolution with SIM, STED and Localisation Microscopy: A practical comparison.

PubMed

Wegel, Eva; Göhler, Antonia; Lagerholm, B Christoffer; Wainman, Alan; Uphoff, Stephan; Kaufmann, Rainer; Dobbie, Ian M

2016-06-06

Many biological questions require fluorescence microscopy with a resolution beyond the diffraction limit of light. Super-resolution methods such as Structured Illumination Microscopy (SIM), STimulated Emission Depletion (STED) microscopy and Single Molecule Localisation Microscopy (SMLM) enable an increase in image resolution beyond the classical diffraction-limit. Here, we compare the individual strengths and weaknesses of each technique by imaging a variety of different subcellular structures in fixed cells. We chose examples ranging from well separated vesicles to densely packed three dimensional filaments. We used quantitative and correlative analyses to assess the performance of SIM, STED and SMLM with the aim of establishing a rough guideline regarding the suitability for typical applications and to highlight pitfalls associated with the different techniques.

Analyzing Protein Clusters on the Plasma Membrane: Application of Spatial Statistical Analysis Methods on Super-Resolution Microscopy Images.

PubMed

Paparelli, Laura; Corthout, Nikky; Pavie, Benjamin; Annaert, Wim; Munck, Sebastian

2016-01-01

The spatial distribution of proteins within the cell affects their capability to interact with other molecules and directly influences cellular processes and signaling. At the plasma membrane, multiple factors drive protein compartmentalization into specialized functional domains, leading to the formation of clusters in which intermolecule interactions are facilitated. Therefore, quantifying protein distributions is a necessity for understanding their regulation and function. The recent advent of super-resolution microscopy has opened up the possibility of imaging protein distributions at the nanometer scale. In parallel, new spatial analysis methods have been developed to quantify distribution patterns in super-resolution images. In this chapter, we provide an overview of super-resolution microscopy and summarize the factors influencing protein arrangements on the plasma membrane. Finally, we highlight methods for analyzing clusterization of plasma membrane proteins, including examples of their applications.

Lensfree on-chip microscopy over a wide field-of-view using pixel super-resolution

PubMed Central

Bishara, Waheb; Su, Ting-Wei; Coskun, Ahmet F.; Ozcan, Aydogan

2010-01-01

We demonstrate lensfree holographic microscopy on a chip to achieve ~0.6 µm spatial resolution corresponding to a numerical aperture of ~0.5 over a large field-of-view of ~24 mm2. By using partially coherent illumination from a large aperture (~50 µm), we acquire lower resolution lensfree in-line holograms of the objects with unit fringe magnification. For each lensfree hologram, the pixel size at the sensor chip limits the spatial resolution of the reconstructed image. To circumvent this limitation, we implement a sub-pixel shifting based super-resolution algorithm to effectively recover much higher resolution digital holograms of the objects, permitting sub-micron spatial resolution to be achieved across the entire sensor chip active area, which is also equivalent to the imaging field-of-view (24 mm2) due to unit magnification. We demonstrate the success of this pixel super-resolution approach by imaging patterned transparent substrates, blood smear samples, as well as Caenoharbditis Elegans. PMID:20588977

Painting Supramolecular Polymers in Organic Solvents by Super-resolution Microscopy

PubMed Central

2018-01-01

Despite the rapid development of complex functional supramolecular systems, visualization of these architectures under native conditions at high resolution has remained a challenging endeavor. Super-resolution microscopy was recently proposed as an effective tool to unveil one-dimensional nanoscale structures in aqueous media upon chemical functionalization with suitable fluorescent probes. Building upon our previous work, which enabled photoactivation localization microscopy in organic solvents, herein, we present the imaging of one-dimensional supramolecular polymers in their native environment by interface point accumulation for imaging in nanoscale topography (iPAINT). The noncovalent staining, typical of iPAINT, allows the investigation of supramolecular polymers’ structure in situ without any chemical modification. The quasi-permanent adsorption of the dye to the polymer is exploited to identify block-like arrangements within supramolecular fibers, which were obtained upon mixing homopolymers that were prestained with different colors. The staining of the blocks, maintained by the lack of exchange of the dyes, permits the imaging of complex structures for multiple days. This study showcases the potential of PAINT-like strategies such as iPAINT to visualize multicomponent dynamic systems in their native environment with an easy, synthesis-free approach and high spatial resolution. PMID:29697958

Fluorescent Nano-Probes to Image Plant Cell Walls by Super-Resolution STED Microscopy

PubMed Central

Paës, Gabriel; Habrant, Anouck; Terryn, Christine

2018-01-01

Lignocellulosic biomass is a complex network of polymers making up the cell walls of plants. It represents a feedstock of sustainable resources to be converted into fuels, chemicals, and materials. Because of its complex architecture, lignocellulose is a recalcitrant material that requires some pretreatments and several types of catalysts to be transformed efficiently. Gaining more knowledge in the architecture of plant cell walls is therefore important to understand and optimize transformation processes. For the first time, super-resolution imaging of poplar wood samples has been performed using the Stimulated Emission Depletion (STED) technique. In comparison to standard confocal images, STED reveals new details in cell wall structure, allowing the identification of secondary walls and middle lamella with fine details, while keeping open the possibility to perform topochemistry by the use of relevant fluorescent nano-probes. In particular, the deconvolution of STED images increases the signal-to-noise ratio so that images become very well defined. The obtained results show that the STED super-resolution technique can be easily implemented by using cheap commercial fluorescent rhodamine-PEG nano-probes which outline the architecture of plant cell walls due to their interaction with lignin. Moreover, the sample preparation only requires easily-prepared plant sections of a few tens of micrometers, in addition to an easily-implemented post-treatment of images. Overall, the STED super-resolution technique in combination with a variety of nano-probes can provide a new vision of plant cell wall imaging by filling in the gap between classical photon microscopy and electron microscopy. PMID:29415498

Fluorescent Nano-Probes to Image Plant Cell Walls by Super-Resolution STED Microscopy.

PubMed

Paës, Gabriel; Habrant, Anouck; Terryn, Christine

2018-02-06

Lignocellulosic biomass is a complex network of polymers making up the cell walls of plants. It represents a feedstock of sustainable resources to be converted into fuels, chemicals, and materials. Because of its complex architecture, lignocellulose is a recalcitrant material that requires some pretreatments and several types of catalysts to be transformed efficiently. Gaining more knowledge in the architecture of plant cell walls is therefore important to understand and optimize transformation processes. For the first time, super-resolution imaging of poplar wood samples has been performed using the Stimulated Emission Depletion (STED) technique. In comparison to standard confocal images, STED reveals new details in cell wall structure, allowing the identification of secondary walls and middle lamella with fine details, while keeping open the possibility to perform topochemistry by the use of relevant fluorescent nano-probes. In particular, the deconvolution of STED images increases the signal-to-noise ratio so that images become very well defined. The obtained results show that the STED super-resolution technique can be easily implemented by using cheap commercial fluorescent rhodamine-PEG nano-probes which outline the architecture of plant cell walls due to their interaction with lignin. Moreover, the sample preparation only requires easily-prepared plant sections of a few tens of micrometers, in addition to an easily-implemented post-treatment of images. Overall, the STED super-resolution technique in combination with a variety of nano-probes can provide a new vision of plant cell wall imaging by filling in the gap between classical photon microscopy and electron microscopy.

Polarization sensitive localization based super-resolution microscopy with a birefringent wedge

NASA Astrophysics Data System (ADS)

Sinkó, József; Gajdos, Tamás; Czvik, Elvira; Szabó, Gábor; Erdélyi, Miklós

2017-03-01

A practical method has been presented for polarization sensitive localization based super-resolution microscopy using a birefringent dual wedge. The measurement of the polarization degree at the single molecule level can reveal the chemical and physical properties of the local environment of the fluorescent dye molecule and can hence provide information about the sub-diffraction sized structure of biological samples. Polarization sensitive STORM imaging of the F-Actins proved correlation between the orientation of fluorescent dipoles and the axis of the fibril.

Identification and super-resolution imaging of ligand-activated receptor dimers in live cells

NASA Astrophysics Data System (ADS)

Winckler, Pascale; Lartigue, Lydia; Giannone, Gregory; de Giorgi, Francesca; Ichas, François; Sibarita, Jean-Baptiste; Lounis, Brahim; Cognet, Laurent

2013-08-01

Molecular interactions are key to many chemical and biological processes like protein function. In many signaling processes they occur in sub-cellular areas displaying nanoscale organizations and involving molecular assemblies. The nanometric dimensions and the dynamic nature of the interactions make their investigations complex in live cells. While super-resolution fluorescence microscopies offer live-cell molecular imaging with sub-wavelength resolutions, they lack specificity for distinguishing interacting molecule populations. Here we combine super-resolution microscopy and single-molecule Förster Resonance Energy Transfer (FRET) to identify dimers of receptors induced by ligand binding and provide super-resolved images of their membrane distribution in live cells. By developing a two-color universal-Point-Accumulation-In-the-Nanoscale-Topography (uPAINT) method, dimers of epidermal growth factor receptors (EGFR) activated by EGF are studied at ultra-high densities, revealing preferential cell-edge sub-localization. This methodology which is specifically devoted to the study of molecules in interaction, may find other applications in biological systems where understanding of molecular organization is crucial.

Fast and efficient molecule detection in localization-based super-resolution microscopy by parallel adaptive histogram equalization.

PubMed

Li, Yiming; Ishitsuka, Yuji; Hedde, Per Niklas; Nienhaus, G Ulrich

2013-06-25

In localization-based super-resolution microscopy, individual fluorescent markers are stochastically photoactivated and subsequently localized within a series of camera frames, yielding a final image with a resolution far beyond the diffraction limit. Yet, before localization can be performed, the subregions within the frames where the individual molecules are present have to be identified-oftentimes in the presence of high background. In this work, we address the importance of reliable molecule identification for the quality of the final reconstructed super-resolution image. We present a fast and robust algorithm (a-livePALM) that vastly improves the molecule detection efficiency while minimizing false assignments that can lead to image artifacts.

Dances with Membranes: Breakthroughs from Super-resolution Imaging

PubMed Central

Curthoys, Nikki M.; Parent, Matthew; Mlodzianoski, Michael; Nelson, Andrew J.; Lilieholm, Jennifer; Butler, Michael B.; Valles, Matthew; Hess, Samuel T.

2017-01-01

Biological membrane organization mediates numerous cellular functions and has also been connected with an immense number of human diseases. However, until recently, experimental methodologies have been unable to directly visualize the nanoscale details of biological membranes, particularly in intact living cells. Numerous models explaining membrane organization have been proposed, but testing those models has required indirect methods; the desire to directly image proteins and lipids in living cell membranes is a strong motivation for the advancement of technology. The development of super-resolution microscopy has provided powerful tools for quantification of membrane organization at the level of individual proteins and lipids, and many of these tools are compatible with living cells. Previously inaccessible questions are now being addressed, and the field of membrane biology is developing rapidly. This chapter discusses how the development of super-resolution microscopy has led to fundamental advances in the field of biological membrane organization. We summarize the history and some models explaining how proteins are organized in cell membranes, and give an overview of various super-resolution techniques and methods of quantifying super-resolution data. We discuss the application of super-resolution techniques to membrane biology in general, and also with specific reference to the fields of actin and actin-binding proteins, virus infection, mitochondria, immune cell biology, and phosphoinositide signaling. Finally, we present our hopes and expectations for the future of super-resolution microscopy in the field of membrane biology. PMID:26015281

Lensfree super-resolution holographic microscopy using wetting films on a chip

NASA Astrophysics Data System (ADS)

Mudanyali, Onur; Bishara, Waheb; Ozcan, Aydogan

2011-08-01

We investigate the use of wetting films to significantly improve the imaging performance of lensfree pixel super-resolution on-chip microscopy, achieving < 1 μm spatial resolution over a large imaging area of ~24 mm2. Formation of an ultra-thin wetting film over the specimen effectively creates a micro-lens effect over each object, which significantly improves the signal-to-noise-ratio and therefore the resolution of our lensfree images. We validate the performance of this approach through lensfree on-chip imaging of various objects having fine morphological features (with dimensions of e.g., ≤0.5 μm) such as Escherichia coli (E. coli), human sperm, Giardia lamblia trophozoites, polystyrene micro beads as well as red blood cells. These results are especially important for the development of highly sensitive field-portable microscopic analysis tools for resource limited settings.

Super resolution imaging of HER2 gene amplification

NASA Astrophysics Data System (ADS)

Okada, Masaya; Kubo, Takuya; Masumoto, Kanako; Iwanaga, Shigeki

2016-02-01

HER2 positive breast cancer is currently examined by counting HER2 genes using fluorescence in situ hybridization (FISH)-stained breast carcinoma samples. In this research, two-dimensional super resolution fluorescence microscopy based on stochastic optical reconstruction microscopy (STORM), with a spatial resolution of approximately 20 nm in the lateral direction, was used to more precisely distinguish and count HER2 genes in a FISH-stained tissue section. Furthermore, by introducing double-helix point spread function (DH-PSF), an optical phase modulation technique, to super resolution microscopy, three-dimensional images were obtained of HER2 in a breast carcinoma sample approximately 4 μm thick.

Quantitative Super-Resolution Microscopy of Nanopipette-Deposited Fluorescent Patterns.

PubMed

Hennig, Simon; van de Linde, Sebastian; Bergmann, Stephan; Huser, Thomas; Sauer, Markus

2015-08-25

We describe a method for the deposition of minute amounts of fluorophore-labeled oligonucleotides with high local precision in conductive and transparent solid layers of poly(vinyl alcohol) (PVA) doped with glycerin and cysteamine (PVA-G-C layers). Deposition of negatively charged fluorescent molecules was accomplished with a setup based on a scanning ion conductance microscope (SICM) using nanopipettes with tip diameters of ∼100 nm by using the ion flux flowing between two electrodes through the nanopipette. To investigate the precision of the local deposition process, we performed in situ super-resolution microscopy by direct stochastic optical reconstruction microscopy (dSTORM). Exploiting the single-molecule sensitivity and reliability of dSTORM, we determine the number of fluorescent molecules deposited in single spots. The correlation of applied charge and number of deposited molecules enables the quantification of delivered molecules by measuring the charge during the delivery process. We demonstrate the reproducible deposition of 3-168 fluorescent molecules in single spots and the creation of fluorescent structures. The fluorescent structures are highly stable and can be reused several times.

Localization-based super-resolution imaging of cellular structures.

PubMed

Kanchanawong, Pakorn; Waterman, Clare M

2013-01-01

Fluorescence microscopy allows direct visualization of fluorescently tagged proteins within cells. However, the spatial resolution of conventional fluorescence microscopes is limited by diffraction to ~250 nm, prompting the development of super-resolution microscopy which offers resolution approaching the scale of single proteins, i.e., ~20 nm. Here, we describe protocols for single molecule localization-based super-resolution imaging, using focal adhesion proteins as an example and employing either photoswitchable fluorophores or photoactivatable fluorescent proteins. These protocols should also be easily adaptable to imaging a broad array of macromolecular assemblies in cells whose components can be fluorescently tagged and assemble into high density structures.

Measurement of replication structures at the nanometer scale using super-resolution light microscopy

PubMed Central

Baddeley, D.; Chagin, V. O.; Schermelleh, L.; Martin, S.; Pombo, A.; Carlton, P. M.; Gahl, A.; Domaing, P.; Birk, U.; Leonhardt, H.; Cremer, C.; Cardoso, M. C.

2010-01-01

DNA replication, similar to other cellular processes, occurs within dynamic macromolecular structures. Any comprehensive understanding ultimately requires quantitative data to establish and test models of genome duplication. We used two different super-resolution light microscopy techniques to directly measure and compare the size and numbers of replication foci in mammalian cells. This analysis showed that replication foci vary in size from 210 nm down to 40 nm. Remarkably, spatially modulated illumination (SMI) and 3D-structured illumination microscopy (3D-SIM) both showed an average size of 125 nm that was conserved throughout S-phase and independent of the labeling method, suggesting a basic unit of genome duplication. Interestingly, the improved optical 3D resolution identified 3- to 5-fold more distinct replication foci than previously reported. These results show that optical nanoscopy techniques enable accurate measurements of cellular structures at a level previously achieved only by electron microscopy and highlight the possibility of high-throughput, multispectral 3D analyses. PMID:19864256

Super-resolved all-refocused image with a plenoptic camera

NASA Astrophysics Data System (ADS)

Wang, Xiang; Li, Lin; Hou, Guangqi

2015-12-01

This paper proposes an approach to produce the super-resolution all-refocused images with the plenoptic camera. The plenoptic camera can be produced by putting a micro-lens array between the lens and the sensor in a conventional camera. This kind of camera captures both the angular and spatial information of the scene in one single shot. A sequence of digital refocused images, which are refocused at different depth, can be produced after processing the 4D light field captured by the plenoptic camera. The number of the pixels in the refocused image is the same as that of the micro-lens in the micro-lens array. Limited number of the micro-lens will result in poor low resolution refocused images. Therefore, not enough details will exist in these images. Such lost details, which are often high frequency information, are important for the in-focus part in the refocused image. We decide to super-resolve these in-focus parts. The result of image segmentation method based on random walks, which works on the depth map produced from the 4D light field data, is used to separate the foreground and background in the refocused image. And focusing evaluation function is employed to determine which refocused image owns the clearest foreground part and which one owns the clearest background part. Subsequently, we employ single image super-resolution method based on sparse signal representation to process the focusing parts in these selected refocused images. Eventually, we can obtain the super-resolved all-focus image through merging the focusing background part and the focusing foreground part in the way of digital signal processing. And more spatial details will be kept in these output images. Our method will enhance the resolution of the refocused image, and just the refocused images owning the clearest foreground and background need to be super-resolved.

Single objective light-sheet microscopy for high-speed whole-cell 3D super-resolution

DOE PAGES

Meddens, Marjolein B. M.; Liu, Sheng; Finnegan, Patrick S.; ...

2016-01-01

Here, we have developed a method for performing light-sheet microscopy with a single high numerical aperture lens by integrating reflective side walls into a microfluidic chip. These 45° side walls generate light-sheet illumination by reflecting a vertical light-sheet into the focal plane of the objective. Light-sheet illumination of cells loaded in the channels increases image quality in diffraction limited imaging via reduction of out-of-focus background light. Single molecule super-resolution is also improved by the decreased background resulting in better localization precision and decreased photo-bleaching, leading to more accepted localizations overall and higher quality images. Moreover, 2D and 3D single moleculemore » super-resolution data can be acquired faster by taking advantage of the increased illumination intensities as compared to wide field, in the focused light-sheet.« less

Single objective light-sheet microscopy for high-speed whole-cell 3D super-resolution

PubMed Central

Meddens, Marjolein B. M.; Liu, Sheng; Finnegan, Patrick S.; Edwards, Thayne L.; James, Conrad D.; Lidke, Keith A.

2016-01-01

We have developed a method for performing light-sheet microscopy with a single high numerical aperture lens by integrating reflective side walls into a microfluidic chip. These 45° side walls generate light-sheet illumination by reflecting a vertical light-sheet into the focal plane of the objective. Light-sheet illumination of cells loaded in the channels increases image quality in diffraction limited imaging via reduction of out-of-focus background light. Single molecule super-resolution is also improved by the decreased background resulting in better localization precision and decreased photo-bleaching, leading to more accepted localizations overall and higher quality images. Moreover, 2D and 3D single molecule super-resolution data can be acquired faster by taking advantage of the increased illumination intensities as compared to wide field, in the focused light-sheet. PMID:27375939

Super-resolution from single photon emission: toward biological application

NASA Astrophysics Data System (ADS)

Moreva, E.; Traina, P.; Forneris, J.; Ditalia Tchernij, S.; Guarina, L.; Franchino, C.; Picollo, F.; Ruo Berchera, I.; Brida, G.; Degiovanni, I. P.; Carabelli, V.; Olivero, P.; Genovese, M.

2017-08-01

Properties of quantum light represent a tool for overcoming limits of classical optics. Several experiments have demonstrated this advantage ranging from quantum enhanced imaging to quantum illumination. In this work, experimental demonstration of quantum-enhanced resolution in confocal fluorescence microscopy will be presented. This is achieved by exploiting the non-classical photon statistics of fluorescence emission of single nitrogen-vacancy (NV) color centers in diamond. By developing a general model of super-resolution based on the direct sampling of the kth-order autocorrelation function of the photoluminescence signal, we show the possibility to resolve, in principle, arbitrarily close emitting centers. Finally, possible applications of NV-based fluorescent nanodiamonds in biosensing and future developments will be presented.

Portable lensless wide-field microscopy imaging platform based on digital inline holography and multi-frame pixel super-resolution

PubMed Central

Sobieranski, Antonio C; Inci, Fatih; Tekin, H Cumhur; Yuksekkaya, Mehmet; Comunello, Eros; Cobra, Daniel; von Wangenheim, Aldo; Demirci, Utkan

2017-01-01

In this paper, an irregular displacement-based lensless wide-field microscopy imaging platform is presented by combining digital in-line holography and computational pixel super-resolution using multi-frame processing. The samples are illuminated by a nearly coherent illumination system, where the hologram shadows are projected into a complementary metal-oxide semiconductor-based imaging sensor. To increase the resolution, a multi-frame pixel resolution approach is employed to produce a single holographic image from multiple frame observations of the scene, with small planar displacements. Displacements are resolved by a hybrid approach: (i) alignment of the LR images by a fast feature-based registration method, and (ii) fine adjustment of the sub-pixel information using a continuous optimization approach designed to find the global optimum solution. Numerical method for phase-retrieval is applied to decode the signal and reconstruct the morphological details of the analyzed sample. The presented approach was evaluated with various biological samples including sperm and platelets, whose dimensions are in the order of a few microns. The obtained results demonstrate a spatial resolution of 1.55 µm on a field-of-view of ≈30 mm2. PMID:29657866

Oblique reconstructions in tomosynthesis. II. Super-resolution

PubMed Central

Acciavatti, Raymond J.; Maidment, Andrew D. A.

2013-01-01

Purpose: In tomosynthesis, super-resolution has been demonstrated using reconstruction planes parallel to the detector. Super-resolution allows for subpixel resolution relative to the detector. The purpose of this work is to develop an analytical model that generalizes super-resolution to oblique reconstruction planes. Methods: In a digital tomosynthesis system, a sinusoidal test object is modeled along oblique angles (i.e., “pitches”) relative to the plane of the detector in a 3D divergent-beam acquisition geometry. To investigate the potential for super-resolution, the input frequency is specified to be greater than the alias frequency of the detector. Reconstructions are evaluated in an oblique plane along the extent of the object using simple backprojection (SBP) and filtered backprojection (FBP). By comparing the amplitude of the reconstruction against the attenuation coefficient of the object at various frequencies, the modulation transfer function (MTF) is calculated to determine whether modulation is within detectable limits for super-resolution. For experimental validation of super-resolution, a goniometry stand was used to orient a bar pattern phantom along various pitches relative to the breast support in a commercial digital breast tomosynthesis system. Results: Using theoretical modeling, it is shown that a single projection image cannot resolve a sine input whose frequency exceeds the detector alias frequency. The high frequency input is correctly visualized in SBP or FBP reconstruction using a slice along the pitch of the object. The Fourier transform of this reconstructed slice is maximized at the input frequency as proof that the object is resolved. Consistent with the theoretical results, experimental images of a bar pattern phantom showed super-resolution in oblique reconstructions. At various pitches, the highest frequency with detectable modulation was determined by visual inspection of the bar patterns. The dependency of the highest

Facile method to stain the bacterial cell surface for super-resolution fluorescence microscopy†

PubMed Central

Gunsolus, Ian L.; Hu, Dehong; Mihai, Cosmin; Lohse, Samuel E.; Lee, Chang-soo; Torelli, Marco D.; Hamers, Robert J.; Murhpy, Catherine J.; Orr, Galya

2015-01-01

A method to fluorescently stain the surfaces of both Gram-negative and Gram-positive bacterial cells compatible with super-resolution fluorescence microscopy is presented. This method utilizes a commercially-available fluorescent probe to label primary amines at the surface of the cell. We demonstrate eficient staining of two bacterial strains, the Gram-negative Shewanella oneidensis MR-1 and the Gram-positive Bacillus subtilis 168. Using structured illumination microscopy and stochastic optical reconstruction microscopy, which require high quantum yield or specialized dyes, we show that this staining method may be used to resolve the bacterial cell surface with sub-diffraction-limited resolution. We further use this method to identify localization patterns of nanomaterials, specifically cadmium selenide quantum dots, following interaction with bacterial cells. PMID:24816810

Super-resolution photoacoustic microscopy using a localized near-field of a plasmonic nanoaperture: a three-dimensional simulation study

NASA Astrophysics Data System (ADS)

Park, Byullee; Lee, Hongki; Upputuri, Paul Kumar; Pramanik, Manojit; Kim, Donghyun; Kim, Chulhong

2018-02-01

Super-resolution microscopy has been increasingly important to delineate nanoscale biological structures or nanoparticles. With these increasing demands, several imaging modalities, including super-resolution fluorescence microscope (SRFM) and electron microscope (EM), have been developed and commercialized. These modalities achieve nanoscale resolution, however, SRFM cannot image without fluorescence, and sample preparation of EM is not suitable for biological specimens. To overcome those disadvantages, we have numerically studied the possibility of superresolution photoacoustic microscopy (SR-PAM) based on near-field localization of light. Photoacoustic (PA) signal is generally acquired based on optical absorption contrast; thus it requires no agents or pre-processing for the samples. The lateral resolution of the conventional photoacoustic microscopy is limited to 200 nm by diffraction limit, therefore reducing the lateral resolution is a major research impetus. Our approach to breaking resolution limit is to use laser pulses of extremely small spot size as a light source. In this research, we simulated the PA signal by constructing the three dimensional SR-PAM system environment using the k-Wave toolbox. As the light source, we simulated ultrashort light pulses using geometrical nanoaperture with near-field localization of surface plasmons. Through the PA simulation, we have successfully distinguish cuboids spaced 3 nm apart. In the near future, we will develop the SR-PAM and it will contribute to biomedical and material sciences.

Super-resolved microsphere-assisted Mirau digital holography by oblique illumination

NASA Astrophysics Data System (ADS)

Abbasian, Vahid; Ganjkhani, Yasaman; Akhlaghi, Ehsan A.; Anand, Arun; Javidi, Bahram; Moradi, Ali-Reza

2018-06-01

In this paper, oblique illumination is used to improve the lateral resolution and edge sharpness in microsphere (MS)-assisted Mirau digital holographic microscopy (Mirau-DHM). Abbe showed that tilting the illumination light allows entrance of higher spatial frequencies into the imaging system thus increasing the resolution power. We extended the idea to common-path DHM, based on Mirau objective, toward super-resolved 3D imaging. High magnification Mirau objectives are very expensive and low-magnification ones suffer from low resolution, therefore, any attempt to increase the effective resolution of the system may be of a great interest. We have already demonstrated the effective resolution increasing of a Mirau-DHM system by incorporating a transparent MS within the working distance of the objective. Here, we show that by integrating a MS-assisted Mirau-DHM with the oblique illumination even higher resolutions can be achieved. We have applied the technique for various samples and have shown the increase in the lateral resolution for the both cases of Mirau-DHM with and without the MS.

Reconstitution radicicol containing apolipoprotein B lipoparticle and tracing its cell uptake process by super resolution fluorescent microscopy.

NASA Astrophysics Data System (ADS)

Lin, Chung Ching; Lin, Po-Yen; Chang, Chia-Ching

Apolipoprotein B (apoB) is the only protein of LDL. LDL delivers cholesterol, triacylglycerides and lipids to the target cells. Reconstitute apoB lipoparticle (rABL) will be an idea drug delivery vehicle for hydrophobic and amphiphilic materials delivery. It is challenged to renature ApoB into its functional state from denatured state. By using modified bile salt and radicicol (Rad) added over-critical refolding process, apoB can be restored into its native like state. The intrinsic fluorescence of apoB increased during the refolding process. Moreover, radicicol (Rad) molecules have been encapsulated into reconstitute rABL (Rad@rABL). To investigate the cell uptake mechanism of Rad@rABL, a super resolution ground state depletion (GSD) microscopy is used in this research. Fluorescence labeled Rad@rABL can be traced within the tumor cell. Key words: LDL, radicicol, protein refolding, super resolution microscopy.

Super-Resolution Microscopy of Cerebrospinal Fluid Biomarkers as a Tool for Alzheimer's Disease Diagnostics.

PubMed

Zhang, William I; Antonios, Gregory; Rabano, Alberto; Bayer, Thomas A; Schneider, Anja; Rizzoli, Silvio O

2015-01-01

Alzheimer's disease (AD) is neuropathologically characterized by aggregates of amyloid-β peptides (Aβ) and tau proteins. The consensus in the AD field is that Aβ and tau should serve as diagnostic biomarkers for AD. However, their aggregates have been difficult to investigate by conventional fluorescence microscopy, since their size is below the diffraction limit (∼200 nm). To solve this, we turned to a super-resolution imaging technique, stimulated emission depletion (STED) microscopy, which has a high enough precision to allow the discrimination of low- and high-molecular weight aggregates prepared in vitro. We used STED to analyze the structural organization of Aβ and tau in cerebrospinal fluid (CSF) from 36 AD patients, 11 patients with mild cognitive impairment (MCI), and 21 controls. We measured the numbers of aggregates in the CSF samples, and the aggregate sizes and intensities. These parameters enabled us to distinguish AD patients from controls with a specificity of ∼87% and a sensitivity of ∼79% . In addition, the aggregate parameters determined with STED microscopy correlated with the severity of cognitive impairment in AD patients. Finally, these parameters may be useful as predictive tools for MCI cases. The STED parameters of two MCI patients who developed AD during the course of the study, as well as of MCI patients whose Aβ ELISA values fall within the accepted range for AD, placed them close to the AD averages. We suggest that super-resolution imaging is a promising tool for AD diagnostics.

TH-EF-BRA-11: Feasibility of Super-Resolution Time-Resolved 4DMRI for Multi-Breath Volumetric Motion Simulation in Radiotherapy Planning

DOE Office of Scientific and Technical Information (OSTI.GOV)

Li, G; Zakian, K; Deasy, J

Purpose: To develop a novel super-resolution time-resolved 4DMRI technique to evaluate multi-breath, irregular and complex organ motion without respiratory surrogate for radiotherapy planning. Methods: The super-resolution time-resolved (TR) 4DMRI approach combines a series of low-resolution 3D cine MRI images acquired during free breathing (FB) with a high-resolution breath-hold (BH) 3DMRI via deformable image registration (DIR). Five volunteers participated in the study under an IRB-approved protocol. The 3D cine images with voxel size of 5×5×5 mm{sup 3} at two volumes per second (2Hz) were acquired coronally using a T1 fast field echo sequence, half-scan (0.8) acceleration, and SENSE (3) parallel imaging.more » Phase-encoding was set in the lateral direction to minimize motion artifacts. The BH image with voxel size of 2×2×2 mm{sup 3} was acquired using the same sequence within 10 seconds. A demons-based DIR program was employed to produce super-resolution 2Hz 4DMRI. Registration quality was visually assessed using difference images between TR 4DMRI and 3D cine and quantitatively assessed using average voxel correlation. The fidelity of the 3D cine images was assessed using a gel phantom and a 1D motion platform by comparing mobile and static images. Results: Owing to voxel intensity similarity using the same MRI scanning sequence, accurate DIR between FB and BH images is achieved. The voxel correlations between 3D cine and TR 4DMRI are greater than 0.92 in all cases and the difference images illustrate minimal residual error with little systematic patterns. The 3D cine images of the mobile gel phantom preserve object geometry with minimal scanning artifacts. Conclusion: The super-resolution time-resolved 4DMRI technique has been achieved via DIR, providing a potential solution for multi-breath motion assessment. Accurate DIR mapping has been achieved to map high-resolution BH images to low-resolution FB images, producing 2Hz volumetric high-resolution 4

Super-resolution optical telescopes with local light diffraction shrinkage

PubMed Central

Wang, Changtao; Tang, Dongliang; Wang, Yanqin; Zhao, Zeyu; Wang, Jiong; Pu, Mingbo; Zhang, Yudong; Yan, Wei; Gao, Ping; Luo, Xiangang

2015-01-01

Suffering from giant size of objective lenses and infeasible manipulations of distant targets, telescopes could not seek helps from present super-resolution imaging, such as scanning near-field optical microscopy, perfect lens and stimulated emission depletion microscopy. In this paper, local light diffraction shrinkage associated with optical super-oscillatory phenomenon is proposed for real-time and optically restoring super-resolution imaging information in a telescope system. It is found that fine target features concealed in diffraction-limited optical images of a telescope could be observed in a small local field of view, benefiting from a relayed metasurface-based super-oscillatory imaging optics in which some local Fourier components beyond the cut-off frequency of telescope could be restored. As experimental examples, a minimal resolution to 0.55 of Rayleigh criterion is obtained, and imaging complex targets and large targets by superimposing multiple local fields of views are demonstrated as well. This investigation provides an access for real-time, incoherent and super-resolution telescopes without the manipulation of distant targets. More importantly, it gives counterintuitive evidence to the common knowledge that relayed optics could not deliver more imaging details than objective systems. PMID:26677820

Two-photon speckle illumination for super-resolution microscopy.

PubMed

Negash, Awoke; Labouesse, Simon; Chaumet, Patrick C; Belkebir, Kamal; Giovannini, Hugues; Allain, Marc; Idier, Jérôme; Sentenac, Anne

2018-06-01

We present a numerical study of a microscopy setup in which the sample is illuminated with uncontrolled speckle patterns and the two-photon excitation fluorescence is collected on a camera. We show that, using a simple deconvolution algorithm for processing the speckle low-resolution images, this wide-field imaging technique exhibits resolution significantly better than that of two-photon excitation scanning microscopy or one-photon excitation bright-field microscopy.

Tilted Light Sheet Microscopy with 3D Point Spread Functions for Single-Molecule Super-Resolution Imaging in Mammalian Cells.

PubMed

Gustavsson, Anna-Karin; Petrov, Petar N; Lee, Maurice Y; Shechtman, Yoav; Moerner, W E

2018-02-01

To obtain a complete picture of subcellular nanostructures, cells must be imaged with high resolution in all three dimensions (3D). Here, we present tilted light sheet microscopy with 3D point spread functions (TILT3D), an imaging platform that combines a novel, tilted light sheet illumination strategy with engineered long axial range point spread functions (PSFs) for low-background, 3D super localization of single molecules as well as 3D super-resolution imaging in thick cells. TILT3D is built upon a standard inverted microscope and has minimal custom parts. The axial positions of the single molecules are encoded in the shape of the PSF rather than in the position or thickness of the light sheet, and the light sheet can therefore be formed using simple optics. The result is flexible and user-friendly 3D super-resolution imaging with tens of nm localization precision throughout thick mammalian cells. We validated TILT3D for 3D super-resolution imaging in mammalian cells by imaging mitochondria and the full nuclear lamina using the double-helix PSF for single-molecule detection and the recently developed Tetrapod PSF for fiducial bead tracking and live axial drift correction. We envision TILT3D to become an important tool not only for 3D super-resolution imaging, but also for live whole-cell single-particle and single-molecule tracking.

Efficient super-resolution image reconstruction applied to surveillance video captured by small unmanned aircraft systems

NASA Astrophysics Data System (ADS)

He, Qiang; Schultz, Richard R.; Chu, Chee-Hung Henry

2008-04-01

The concept surrounding super-resolution image reconstruction is to recover a highly-resolved image from a series of low-resolution images via between-frame subpixel image registration. In this paper, we propose a novel and efficient super-resolution algorithm, and then apply it to the reconstruction of real video data captured by a small Unmanned Aircraft System (UAS). Small UAS aircraft generally have a wingspan of less than four meters, so that these vehicles and their payloads can be buffeted by even light winds, resulting in potentially unstable video. This algorithm is based on a coarse-to-fine strategy, in which a coarsely super-resolved image sequence is first built from the original video data by image registration and bi-cubic interpolation between a fixed reference frame and every additional frame. It is well known that the median filter is robust to outliers. If we calculate pixel-wise medians in the coarsely super-resolved image sequence, we can restore a refined super-resolved image. The primary advantage is that this is a noniterative algorithm, unlike traditional approaches based on highly-computational iterative algorithms. Experimental results show that our coarse-to-fine super-resolution algorithm is not only robust, but also very efficient. In comparison with five well-known super-resolution algorithms, namely the robust super-resolution algorithm, bi-cubic interpolation, projection onto convex sets (POCS), the Papoulis-Gerchberg algorithm, and the iterated back projection algorithm, our proposed algorithm gives both strong efficiency and robustness, as well as good visual performance. This is particularly useful for the application of super-resolution to UAS surveillance video, where real-time processing is highly desired.

Super-resolution differential interference contrast microscopy by structured illumination.

PubMed

Chen, Jianling; Xu, Yan; Lv, Xiaohua; Lai, Xiaomin; Zeng, Shaoqun

2013-01-14

We propose a structured illumination differential interference contrast (SI-DIC) microscopy, breaking the diffraction resolution limit of differential interference contrast (DIC) microscopy. SI-DIC extends the bandwidth of coherent transfer function of the DIC imaging system, thus the resolution is improved. With 0.8 numerical aperture condenser and objective, the reconstructed SI-DIC image of 53 nm polystyrene beads reveals lateral resolution of approximately 190 nm, doubling that of the conventional DIC image. We also demonstrate biological observations of label-free cells with improved spatial resolution. The SI-DIC microscopy can provide sub-diffraction resolution and high contrast images with marker-free specimens, and has the potential for achieving sub-diffraction resolution quantitative phase imaging.

Experimental assessment and analysis of super-resolution in fluorescence microscopy based on multiple-point spread function fitting of spectrally demultiplexed images

NASA Astrophysics Data System (ADS)

Nishimura, Takahiro; Kimura, Hitoshi; Ogura, Yusuke; Tanida, Jun

2018-06-01

This paper presents an experimental assessment and analysis of super-resolution microscopy based on multiple-point spread function fitting of spectrally demultiplexed images using a designed DNA structure as a test target. For the purpose, a DNA structure was designed to have binding sites at a certain interval that is smaller than the diffraction limit. The structure was labeled with several types of quantum dots (QDs) to acquire their spatial information as spectrally encoded images. The obtained images are analyzed with a point spread function multifitting algorithm to determine the QD locations that indicate the binding site positions. The experimental results show that the labeled locations can be observed beyond the diffraction-limited resolution using three-colored fluorescence images that were obtained with a confocal fluorescence microscope. Numerical simulations show that labeling with eight types of QDs enables the positions aligned at 27.2-nm pitches on the DNA structure to be resolved with high accuracy.

Fast time-resolved electrostatic force microscopy: Achieving sub-cycle time resolution

DOE Office of Scientific and Technical Information (OSTI.GOV)

Karatay, Durmus U.; Harrison, Jeffrey S.; Glaz, Micah S.

The ability to measure microsecond- and nanosecond-scale local dynamics below the diffraction limit with widely available atomic force microscopy hardware would enable new scientific studies in fields ranging from biology to semiconductor physics. However, commercially available scanning-probe instruments typically offer the ability to measure dynamics only on time scales of milliseconds to seconds. Here, we describe in detail the implementation of fast time-resolved electrostatic force microscopy using an oscillating cantilever as a means to measure fast local dynamics following a perturbation to a sample. We show how the phase of the oscillating cantilever relative to the perturbation event is criticalmore » to achieving reliable sub-cycle time resolution. We explore how noise affects the achievable time resolution and present empirical guidelines for reducing noise and optimizing experimental parameters. Specifically, we show that reducing the noise on the cantilever by using photothermal excitation instead of piezoacoustic excitation further improves time resolution. We demonstrate the discrimination of signal rise times with time constants as fast as 10 ns, and simultaneous data acquisition and analysis for dramatically improved image acquisition times.« less

Quantitative analyses of the 3D nuclear landscape recorded with super-resolved fluorescence microscopy.

PubMed

Schmid, Volker J; Cremer, Marion; Cremer, Thomas

2017-07-01

Recent advancements of super-resolved fluorescence microscopy have revolutionized microscopic studies of cells, including the exceedingly complex structural organization of cell nuclei in space and time. In this paper we describe and discuss tools for (semi-) automated, quantitative 3D analyses of the spatial nuclear organization. These tools allow the quantitative assessment of highly resolved different chromatin compaction levels in individual cell nuclei, which reflect functionally different regions or sub-compartments of the 3D nuclear landscape, and measurements of absolute distances between sites of different chromatin compaction. In addition, these tools allow 3D mapping of specific DNA/RNA sequences and nuclear proteins relative to the 3D chromatin compaction maps and comparisons of multiple cell nuclei. The tools are available in the free and open source R packages nucim and bioimagetools. We discuss the use of masks for the segmentation of nuclei and the use of DNA stains, such as DAPI, as a proxy for local differences in chromatin compaction. We further discuss the limitations of 3D maps of the nuclear landscape as well as problems of the biological interpretation of such data. Copyright © 2017 Elsevier Inc. All rights reserved.

Plasmonics and metamaterials based super-resolution imaging (Conference Presentation)

NASA Astrophysics Data System (ADS)

Liu, Zhaowei

2017-05-01

In recent years, surface imaging of various biological dynamics and biomechanical phenomena has seen a surge of interest. Imaging of processes such as exocytosis and kinesin motion are most effective when depth is limited to a very thin region of interest at the edge of the cell or specimen. However, many objects and processes of interest are of size scales below the diffraction limit for safe, visible wavelength illumination. Super-resolution imaging methods such as structured illumination microscopy and others have offered various compromises between resolution, imaging speed, and bio-compatibility. In this talk, I will present our most recent progress in plasmonic structured illumination microscopy (PSIM) and localized plasmonic structured illumination microscopy (LPSIM), and their applications in bio-imaging. We have achieved wide-field surface imaging with resolution down to 75 nm while maintaining reasonable speed and compatibility with biological specimens. These plasmonic enhanced super resolution techniques offer unique solutions to obtain 50nm spatial resolution and 50 frames per second wide imaging speed at the same time.

Super-Resolution Microscopy Unveils Dynamic Heterogeneities in Nanoparticle Protein Corona.

PubMed

Feiner-Gracia, Natalia; Beck, Michaela; Pujals, Sílvia; Tosi, Sébastien; Mandal, Tamoghna; Buske, Christian; Linden, Mika; Albertazzi, Lorenzo

2017-11-01

The adsorption of serum proteins, leading to the formation of a biomolecular corona, is a key determinant of the biological identity of nanoparticles in vivo. Therefore, gaining knowledge on the formation, composition, and temporal evolution of the corona is of utmost importance for the development of nanoparticle-based therapies. Here, it is shown that the use of super-resolution optical microscopy enables the imaging of the protein corona on mesoporous silica nanoparticles with single protein sensitivity. Particle-by-particle quantification reveals a significant heterogeneity in protein absorption under native conditions. Moreover, the diversity of the corona evolves over time depending on the surface chemistry and degradability of the particles. This paper investigates the consequences of protein adsorption for specific cell targeting by antibody-functionalized nanoparticles providing a detailed understanding of corona-activity relations. The methodology is widely applicable to a variety of nanostructures and complements the existing ensemble approaches for protein corona study. © 2017 WILEY-VCH Verlag GmbH & Co. KGaA, Weinheim.

Maximizing the Biochemical Resolving Power of Fluorescence Microscopy

PubMed Central

Esposito, Alessandro; Popleteeva, Marina; Venkitaraman, Ashok R.

2013-01-01

Most recent advances in fluorescence microscopy have focused on achieving spatial resolutions below the diffraction limit. However, the inherent capability of fluorescence microscopy to non-invasively resolve different biochemical or physical environments in biological samples has not yet been formally described, because an adequate and general theoretical framework is lacking. Here, we develop a mathematical characterization of the biochemical resolution in fluorescence detection with Fisher information analysis. To improve the precision and the resolution of quantitative imaging methods, we demonstrate strategies for the optimization of fluorescence lifetime, fluorescence anisotropy and hyperspectral detection, as well as different multi-dimensional techniques. We describe optimized imaging protocols, provide optimization algorithms and describe precision and resolving power in biochemical imaging thanks to the analysis of the general properties of Fisher information in fluorescence detection. These strategies enable the optimal use of the information content available within the limited photon-budget typically available in fluorescence microscopy. This theoretical foundation leads to a generalized strategy for the optimization of multi-dimensional optical detection, and demonstrates how the parallel detection of all properties of fluorescence can maximize the biochemical resolving power of fluorescence microscopy, an approach we term Hyper Dimensional Imaging Microscopy (HDIM). Our work provides a theoretical framework for the description of the biochemical resolution in fluorescence microscopy, irrespective of spatial resolution, and for the development of a new class of microscopes that exploit multi-parametric detection systems. PMID:24204821

Measuring true localization accuracy in super resolution microscopy with DNA-origami nanostructures

NASA Astrophysics Data System (ADS)

Reuss, Matthias; Fördős, Ferenc; Blom, Hans; Öktem, Ozan; Högberg, Björn; Brismar, Hjalmar

2017-02-01

A common method to assess the performance of (super resolution) microscopes is to use the localization precision of emitters as an estimate for the achieved resolution. Naturally, this is widely used in super resolution methods based on single molecule stochastic switching. This concept suffers from the fact that it is hard to calibrate measures against a real sample (a phantom), because true absolute positions of emitters are almost always unknown. For this reason, resolution estimates are potentially biased in an image since one is blind to true position accuracy, i.e. deviation in position measurement from true positions. We have solved this issue by imaging nanorods fabricated with DNA-origami. The nanorods used are designed to have emitters attached at each end in a well-defined and highly conserved distance. These structures are widely used to gauge localization precision. Here, we additionally determined the true achievable localization accuracy and compared this figure of merit to localization precision values for two common super resolution microscope methods STED and STORM.

Super Resolution Imaging of Genetically Labeled Synapses in Drosophila Brain Tissue.

PubMed

Spühler, Isabelle A; Conley, Gaurasundar M; Scheffold, Frank; Sprecher, Simon G

2016-01-01

Understanding synaptic connectivity and plasticity within brain circuits and their relationship to learning and behavior is a fundamental quest in neuroscience. Visualizing the fine details of synapses using optical microscopy remains however a major technical challenge. Super resolution microscopy opens the possibility to reveal molecular features of synapses beyond the diffraction limit. With direct stochastic optical reconstruction microscopy, dSTORM, we image synaptic proteins in the brain tissue of the fruit fly, Drosophila melanogaster. Super resolution imaging of brain tissue harbors difficulties due to light scattering and the density of signals. In order to reduce out of focus signal, we take advantage of the genetic tools available in the Drosophila and have fluorescently tagged synaptic proteins expressed in only a small number of neurons. These neurons form synapses within the calyx of the mushroom body, a distinct brain region involved in associative memory formation. Our results show that super resolution microscopy, in combination with genetically labeled synaptic proteins, is a powerful tool to investigate synapses in a quantitative fashion providing an entry point for studies on synaptic plasticity during learning and memory formation.

North Twin Peak in super resolution

NASA Technical Reports Server (NTRS)

1997-01-01

This pair of images shows the result of taking a sequence of 25 identical exposures from the Imager for Mars Pathfinder (IMP) of the northern Twin Peak, with small camera motions, and processing them with the Super-Resolution algorithm developed at NASA's Ames Research Center.

The upper image is a representative input image, scaled up by a factor of five, with the pixel edges smoothed out for a fair comparison. The lower image allows significantly finer detail to be resolved.

Mars Pathfinder is the second in NASA's Discovery program of low-cost spacecraft with highly focused science goals. The Jet Propulsion Laboratory, Pasadena, CA, developed and manages the Mars Pathfinder mission for NASA's Office of Space Science, Washington, D.C. JPL is an operating division of the California Institute of Technology (Caltech). The Imager for Mars Pathfinder (IMP) was developed by the University of Arizona Lunar and Planetary Laboratory under contract to JPL. Peter Smith is the Principal Investigator.

The super-resolution research was conducted by Peter Cheeseman, Bob Kanefsky, Robin Hanson, and John Stutz of NASA's Ames Research Center, Mountain View, CA. More information on this technology is available on the Ames Super Resolution home page at

http://ic-www.arc.nasa.gov/ic/projects/bayes-group/ group/super-res/

Super-Resolution Imaging Strategies for Cell Biologists Using a Spinning Disk Microscope

PubMed Central

Hosny, Neveen A.; Song, Mingying; Connelly, John T.; Ameer-Beg, Simon; Knight, Martin M.; Wheeler, Ann P.

2013-01-01

In this study we use a spinning disk confocal microscope (SD) to generate super-resolution images of multiple cellular features from any plane in the cell. We obtain super-resolution images by using stochastic intensity fluctuations of biological probes, combining Photoactivation Light-Microscopy (PALM)/Stochastic Optical Reconstruction Microscopy (STORM) methodologies. We compared different image analysis algorithms for processing super-resolution data to identify the most suitable for analysis of particular cell structures. SOFI was chosen for X and Y and was able to achieve a resolution of ca. 80 nm; however higher resolution was possible >30 nm, dependant on the super-resolution image analysis algorithm used. Our method uses low laser power and fluorescent probes which are available either commercially or through the scientific community, and therefore it is gentle enough for biological imaging. Through comparative studies with structured illumination microscopy (SIM) and widefield epifluorescence imaging we identified that our methodology was advantageous for imaging cellular structures which are not immediately at the cell-substrate interface, which include the nuclear architecture and mitochondria. We have shown that it was possible to obtain two coloured images, which highlights the potential this technique has for high-content screening, imaging of multiple epitopes and live cell imaging. PMID:24130668

Multi-pulse pumping for far-field super-resolution imaging

NASA Astrophysics Data System (ADS)

Requena, Sebastian; Raut, Sangram; Doan, Hung; Kimball, Joe; Fudala, Rafal; Borejdo, Julian; Gryczynski, Ignacy; Strzhemechny, Yuri; Gryczynski, Zygmunt

2016-02-01

Recently, far-field optical imaging with a resolution significantly beyond diffraction limit has attracted tremendous attention allowing for high resolution imaging in living objects. Various methods have been proposed that are divided in to two basic approaches; deterministic super-resolution like STED or RESOLFT and stochastic super-resolution like PALM or STORM. We propose to achieve super-resolution in far-field fluorescence imaging by the use of controllable (on-demand) bursts of pulses that can change the fluorescence signal of long-lived component over one order of magnitude. We demonstrate that two beads, one labeled with a long-lived dye and another with a short-lived dye, separated by a distance lower than 100 nm can be easily resolved in a single experiment. The proposed method can be used to separate two biological structures in a cell by targeting them with two antibodies labeled with long-lived and short-lived fluorophores.

Tilted light sheet microscopy with 3D point spread functions for single-molecule super-resolution imaging in mammalian cells

NASA Astrophysics Data System (ADS)

Gustavsson, Anna-Karin; Petrov, Petar N.; Lee, Maurice Y.; Shechtman, Yoav; Moerner, W. E.

2018-02-01

To obtain a complete picture of subcellular nanostructures, cells must be imaged with high resolution in all three dimensions (3D). Here, we present tilted light sheet microscopy with 3D point spread functions (TILT3D), an imaging platform that combines a novel, tilted light sheet illumination strategy with engineered long axial range point spread functions (PSFs) for low-background, 3D super localization of single molecules as well as 3D super-resolution imaging in thick cells. TILT3D is built upon a standard inverted microscope and has minimal custom parts. The axial positions of the single molecules are encoded in the shape of the PSF rather than in the position or thickness of the light sheet, and the light sheet can therefore be formed using simple optics. The result is flexible and user-friendly 3D super-resolution imaging with tens of nm localization precision throughout thick mammalian cells. We validated TILT3D for 3D superresolution imaging in mammalian cells by imaging mitochondria and the full nuclear lamina using the double-helix PSF for single-molecule detection and the recently developed Tetrapod PSF for fiducial bead tracking and live axial drift correction. We envision TILT3D to become an important tool not only for 3D super-resolution imaging, but also for live whole-cell single-particle and single-molecule tracking.

Adaptive pixel-super-resolved lensfree in-line digital holography for wide-field on-chip microscopy.

PubMed

Zhang, Jialin; Sun, Jiasong; Chen, Qian; Li, Jiaji; Zuo, Chao

2017-09-18

High-resolution wide field-of-view (FOV) microscopic imaging plays an essential role in various fields of biomedicine, engineering, and physical sciences. As an alternative to conventional lens-based scanning techniques, lensfree holography provides a new way to effectively bypass the intrinsical trade-off between the spatial resolution and FOV of conventional microscopes. Unfortunately, due to the limited sensor pixel-size, unpredictable disturbance during image acquisition, and sub-optimum solution to the phase retrieval problem, typical lensfree microscopes only produce compromised imaging quality in terms of lateral resolution and signal-to-noise ratio (SNR). Here, we propose an adaptive pixel-super-resolved lensfree imaging (APLI) method which can solve, or at least partially alleviate these limitations. Our approach addresses the pixel aliasing problem by Z-scanning only, without resorting to subpixel shifting or beam-angle manipulation. Automatic positional error correction algorithm and adaptive relaxation strategy are introduced to enhance the robustness and SNR of reconstruction significantly. Based on APLI, we perform full-FOV reconstruction of a USAF resolution target (~29.85 mm 2 ) and achieve half-pitch lateral resolution of 770 nm, surpassing 2.17 times of the theoretical Nyquist-Shannon sampling resolution limit imposed by the sensor pixel-size (1.67µm). Full-FOV imaging result of a typical dicot root is also provided to demonstrate its promising potential applications in biologic imaging.

An Example-Based Super-Resolution Algorithm for Selfie Images

PubMed Central

William, Jino Hans; Venkateswaran, N.; Narayanan, Srinath; Ramachandran, Sandeep

2016-01-01

A selfie is typically a self-portrait captured using the front camera of a smartphone. Most state-of-the-art smartphones are equipped with a high-resolution (HR) rear camera and a low-resolution (LR) front camera. As selfies are captured by front camera with limited pixel resolution, the fine details in it are explicitly missed. This paper aims to improve the resolution of selfies by exploiting the fine details in HR images captured by rear camera using an example-based super-resolution (SR) algorithm. HR images captured by rear camera carry significant fine details and are used as an exemplar to train an optimal matrix-value regression (MVR) operator. The MVR operator serves as an image-pair priori which learns the correspondence between the LR-HR patch-pairs and is effectively used to super-resolve LR selfie images. The proposed MVR algorithm avoids vectorization of image patch-pairs and preserves image-level information during both learning and recovering process. The proposed algorithm is evaluated for its efficiency and effectiveness both qualitatively and quantitatively with other state-of-the-art SR algorithms. The results validate that the proposed algorithm is efficient as it requires less than 3 seconds to super-resolve LR selfie and is effective as it preserves sharp details without introducing any counterfeit fine details. PMID:27064500

Super-resolution for scanning light stimulation systems

DOE Office of Scientific and Technical Information (OSTI.GOV)

Bitzer, L. A.; Neumann, K.; Benson, N., E-mail: niels.benson@uni-due.de

Super-resolution (SR) is a technique used in digital image processing to overcome the resolution limitation of imaging systems. In this process, a single high resolution image is reconstructed from multiple low resolution images. SR is commonly used for CCD and CMOS (Complementary Metal-Oxide-Semiconductor) sensor images, as well as for medical applications, e.g., magnetic resonance imaging. Here, we demonstrate that super-resolution can be applied with scanning light stimulation (LS) systems, which are common to obtain space-resolved electro-optical parameters of a sample. For our purposes, the Projection Onto Convex Sets (POCS) was chosen and modified to suit the needs of LS systems.more » To demonstrate the SR adaption, an Optical Beam Induced Current (OBIC) LS system was used. The POCS algorithm was optimized by means of OBIC short circuit current measurements on a multicrystalline solar cell, resulting in a mean square error reduction of up to 61% and improved image quality.« less

A general strategy for developing cell-permeable photo-modulatable organic fluorescent probes for live-cell super-resolution imaging.

PubMed

Pan, Deng; Hu, Zhe; Qiu, Fengwu; Huang, Zhen-Li; Ma, Yilong; Wang, Yina; Qin, Lingsong; Zhang, Zhihong; Zeng, Shaoqun; Zhang, Yu-Hui

2014-11-20

Single-molecule localization microscopy (SMLM) achieves super-resolution imaging beyond the diffraction limit but critically relies on the use of photo-modulatable fluorescent probes. Here we report a general strategy for constructing cell-permeable photo-modulatable organic fluorescent probes for live-cell SMLM by exploiting the remarkable cytosolic delivery ability of a cell-penetrating peptide (rR)3R2. We develop photo-modulatable organic fluorescent probes consisting of a (rR)3R2 peptide coupled to a cell-impermeable organic fluorophore and a recognition unit. Our results indicate that these organic probes are not only cell permeable but can also specifically and directly label endogenous targeted proteins. Using the probes, we obtain super-resolution images of lysosomes and endogenous F-actin under physiological conditions. We resolve the dynamics of F-actin with 10 s temporal resolution in live cells and discern fine F-actin structures with diameters of ~80 nm. These results open up new avenues in the design of fluorescent probes for live-cell super-resolution imaging.

Super Resolution Imaging of Genetically Labeled Synapses in Drosophila Brain Tissue

PubMed Central

Spühler, Isabelle A.; Conley, Gaurasundar M.; Scheffold, Frank; Sprecher, Simon G.

2016-01-01

Understanding synaptic connectivity and plasticity within brain circuits and their relationship to learning and behavior is a fundamental quest in neuroscience. Visualizing the fine details of synapses using optical microscopy remains however a major technical challenge. Super resolution microscopy opens the possibility to reveal molecular features of synapses beyond the diffraction limit. With direct stochastic optical reconstruction microscopy, dSTORM, we image synaptic proteins in the brain tissue of the fruit fly, Drosophila melanogaster. Super resolution imaging of brain tissue harbors difficulties due to light scattering and the density of signals. In order to reduce out of focus signal, we take advantage of the genetic tools available in the Drosophila and have fluorescently tagged synaptic proteins expressed in only a small number of neurons. These neurons form synapses within the calyx of the mushroom body, a distinct brain region involved in associative memory formation. Our results show that super resolution microscopy, in combination with genetically labeled synaptic proteins, is a powerful tool to investigate synapses in a quantitative fashion providing an entry point for studies on synaptic plasticity during learning and memory formation. PMID:27303270

Supporting lander and rover operation: a novel super-resolution restoration technique

NASA Astrophysics Data System (ADS)

Tao, Yu; Muller, Jan-Peter

2015-04-01

Higher resolution imaging data is always desirable to critical rover engineering operations, such as landing site selection, path planning, and optical localisation. For current Mars missions, 25cm HiRISE images have been widely used by the MER & MSL engineering team for rover path planning and location registration/adjustment. However, 25cm is not high enough resolution to be able to view individual rocks (≤2m in size) or visualise the types of sedimentary features that rover onboard cameras might observe. Nevertheless, due to various physical constraints (e.g. telescope size and mass) from the imaging instruments themselves, one needs to be able to tradeoff spatial resolution and bandwidth. This means that future imaging systems are likely to be limited to resolve features larger than 25cm. We have developed a novel super-resolution algorithm/pipeline to be able to restore higher resolution image from the non-redundant sub-pixel information contained in multiple lower resolution raw images [Tao & Muller 2015]. We will demonstrate with experiments performed using 5-10 overlapped 25cm HiRISE images for MER-A, MER-B & MSL to resolve 5-10cm super resolution images that can be directly compared to rover imagery at a range of 5 metres from the rover cameras but in our case can be used to visualise features many kilometres away from the actual rover traverse. We will demonstrate how these super-resolution images together with image understanding software can be used to quantify rock size-frequency distributions as well as measure sedimentary rock layers for several critical sites for comparison with rover orthorectified image mosaic to demonstrate optimality of using our super-resolution resolved image to better support future lander and rover operation in future. We present the potential of super-resolution for virtual exploration to the ˜400 HiRISE areas which have been viewed 5 or more times and the potential application of this technique to all of the ESA Exo

Novel Super-Resolution Approach to Time-Resolved Volumetric 4-Dimensional Magnetic Resonance Imaging With High Spatiotemporal Resolution for Multi-Breathing Cycle Motion Assessment

DOE Office of Scientific and Technical Information (OSTI.GOV)

Li, Guang, E-mail: lig2@mskcc.org; Wei, Jie; Kadbi, Mo

Purpose: To develop and evaluate a super-resolution approach to reconstruct time-resolved 4-dimensional magnetic resonance imaging (TR-4DMRI) with a high spatiotemporal resolution for multi-breathing cycle motion assessment. Methods and Materials: A super-resolution approach was developed to combine fast 3-dimensional (3D) cine MRI with low resolution during free breathing (FB) and high-resolution 3D static MRI during breath hold (BH) using deformable image registration. A T1-weighted, turbo field echo sequence, coronal 3D cine acquisition, partial Fourier approximation, and SENSitivity Encoding parallel acceleration were used. The same MRI pulse sequence, field of view, and acceleration techniques were applied in both FB and BH acquisitions;more » the intensity-based Demons deformable image registration method was used. Under an institutional review board–approved protocol, 7 volunteers were studied with 3D cine FB scan (voxel size: 5 × 5 × 5 mm{sup 3}) at 2 Hz for 40 seconds and a 3D static BH scan (2 × 2 × 2 mm{sup 3}). To examine the image fidelity of 3D cine and super-resolution TR-4DMRI, a mobile gel phantom with multi-internal targets was scanned at 3 speeds and compared with the 3D static image. Image similarity among 3D cine, 4DMRI, and 3D static was evaluated visually using difference image and quantitatively using voxel intensity correlation and Dice index (phantom only). Multi-breathing-cycle waveforms were extracted and compared in both phantom and volunteer images using the 3D cine as the references. Results: Mild imaging artifacts were found in the 3D cine and TR-4DMRI of the mobile gel phantom with a Dice index of >0.95. Among 7 volunteers, the super-resolution TR-4DMRI yielded high voxel-intensity correlation (0.92 ± 0.05) and low voxel-intensity difference (<0.05). The detected motion differences between TR-4DMRI and 3D cine were −0.2 ± 0.5 mm (phantom) and −0.2 ± 1.9 mm (diaphragms). Conclusion: Super-resolution

SIL-STED microscopy technique enhancing super-resolution of fluorescence microscopy

NASA Astrophysics Data System (ADS)

Park, No-Cheol; Lim, Geon; Lee, Won-sup; Moon, Hyungbae; Choi, Guk-Jong; Park, Young-Pil

2017-08-01

We have characterized a new type STED microscope which combines a high numerical aperture (NA) optical head with a solid immersion lens (SIL), and we call it as SIL-STED microscope. The advantage of a SIL-STED microscope is that its high NA of the SIL makes it superior to a general STED microscope in lateral resolution, thus overcoming the optical diffraction limit at the macromolecular level and enabling advanced super-resolution imaging of cell surface or cell membrane structure and function Do. This study presents the first implementation of higher NA illumination in a STED microscope limiting the fluorescence lateral resolution to about 40 nm. The refractive index of the SIL which is made of material KTaO3 is about 2.23 and 2.20 at a wavelength of 633 nm and 780 nm which are used for excitation and depletion in STED imaging, respectively. Based on the vector diffraction theory, the electric field focused by the SILSTED microscope is numerically calculated so that the numerical results of the point dispersion function of the microscope and the expected resolution could be analyzed. For further investigation, fluorescence imaging of nano size fluorescent beads is fulfilled to show improved performance of the technique.

Super-resolution Imaging of Chemical Synapses in the Brain

PubMed Central

Dani, Adish; Huang, Bo; Bergan, Joseph; Dulac, Catherine; Zhuang, Xiaowei

2010-01-01

Determination of the molecular architecture of synapses requires nanoscopic image resolution and specific molecular recognition, a task that has so far defied many conventional imaging approaches. Here we present a super-resolution fluorescence imaging method to visualize the molecular architecture of synapses in the brain. Using multicolor, three-dimensional stochastic optical reconstruction microscopy, the distributions of synaptic proteins can be measured with nanometer precision. Furthermore, the wide-field, volumetric imaging method enables high-throughput, quantitative analysis of a large number of synapses from different brain regions. To demonstrate the capabilities of this approach, we have determined the organization of ten protein components of the presynaptic active zone and the postsynaptic density. Variations in synapse morphology, neurotransmitter receptor composition, and receptor distribution were observed both among synapses and across different brain regions. Combination with optogenetics further allowed molecular events associated with synaptic plasticity to be resolved at the single-synapse level. PMID:21144999

The internal architecture of dendritic spines revealed by super-resolution imaging: What did we learn so far?

DOE Office of Scientific and Technical Information (OSTI.GOV)

MacGillavry, Harold D., E-mail: h.d.macgillavry@uu.nl; Hoogenraad, Casper C., E-mail: c.hoogenraad@uu.nl

2015-07-15

The molecular architecture of dendritic spines defines the efficiency of signal transmission across excitatory synapses. It is therefore critical to understand the mechanisms that control the dynamic localization of the molecular constituents within spines. However, because of the small scale at which most processes within spines take place, conventional light microscopy techniques are not adequate to provide the necessary level of resolution. Recently, super-resolution imaging techniques have overcome the classical barrier imposed by the diffraction of light, and can now resolve the localization and dynamic behavior of proteins within small compartments with nanometer precision, revolutionizing the study of dendritic spinemore » architecture. Here, we highlight exciting new findings from recent super-resolution studies on neuronal spines, and discuss how these studies revealed important new insights into how protein complexes are assembled and how their dynamic behavior shapes the efficiency of synaptic transmission.« less

Qualitative and quantitative analysis of PMN/T-cell interactions by InFlow and super-resolution microscopy.

PubMed

Balta, Emre; Stopp, Julian; Castelletti, Laura; Kirchgessner, Henning; Samstag, Yvonne; Wabnitz, Guido H

2017-01-01

Neutrophils or polymorphonuclear cells (PMN) eliminate bacteria via phagocytosis and/or NETosis. Apart from these conventional roles, PMN also have immune-regulatory functions. They can transdifferentiate and upregulate MHCII as well as ligands for costimulatory receptors which enables them to behave as antigen presenting cells (APC). The initial step for activating T-cells is the formation of an immune synapse between T-cells and antigen-presenting cells. However, the immune synapse that develops at the PMN/T-cell contact zone is as yet hardly investigated due to the non-availability of methods for analysis of large number of PMN interactions. In order to overcome these obstacles, we introduce here a workflow to analyse the immune synapse of primary human PMN and T-cells using multispectral imaging flow cytometry (InFlow microscopy) and super-resolution microscopy. For that purpose, we used CD3 and CD66b as the lineage markers for T-cells and PMN, respectively. Thereafter, we applied and critically discussed various "masks" for identification of T-cell PMN interactions. Using this approach, we found that a small fraction of transdifferentiated PMN (CD66b + CD86 high ) formed stable PMN/T-cell conjugates. Interestingly, while both CD3 and CD66b accumulation in the immune synapse was dependent on the maturation state of the PMN, only CD3 accumulation was greatly enhanced by the presence of superantigen. The actin cytoskeleton was weakly rearranged at the PMN side on the immune synapse upon contact with a T-cell in the presence of superantigen. A more detailed analysis using super-resolution microscopy (structured-illumination microscopy, SIM) confirmed this finding. Together, we present an InFlow microscopy based approach for the large scale analysis of PMN/T-cell interactions and - combined with SIM - a possibility for an in-depth analysis of protein translocation at the site of interactions. Copyright © 2016 Elsevier Inc. All rights reserved.

Super-resolution microscopy reveals LINC complex recruitment at nuclear indentation sites.

PubMed

Versaevel, Marie; Braquenier, Jean-Baptiste; Riaz, Maryam; Grevesse, Thomas; Lantoine, Joséphine; Gabriele, Sylvain

2014-12-08

Increasing evidences show that the actin cytoskeleton is a key parameter of the nuclear remodeling process in response to the modifications of cellular morphology. However, detailed information on the interaction between the actin cytoskeleton and the nuclear lamina was still lacking. We addressed this question by constraining endothelial cells on rectangular fibronectin-coated micropatterns and then using Structured Illumination Microscopy (SIM) to observe the interactions between actin stress fibers, nuclear lamina and LINC complexes at a super-resolution scale. Our results show that tension in apical actin stress fibers leads to deep nuclear indentations that significantly deform the nuclear lamina. Interestingly, indented nuclear zones are characterized by a local enrichment of LINC complexes, which anchor apical actin fibers to the nuclear lamina. Moreover, our findings indicate that nuclear indentations induce the formation of segregated domains of condensed chromatin. However, nuclear indentations and condensed chromatin domains are not irreversible processes and both can relax in absence of tension in apical actin stress fibers.

Adaptive optics improves multiphoton super-resolution imaging

NASA Astrophysics Data System (ADS)

Zheng, Wei; Wu, Yicong; Winter, Peter; Shroff, Hari

2018-02-01

Three dimensional (3D) fluorescence microscopy has been essential for biological studies. It allows interrogation of structure and function at spatial scales spanning the macromolecular, cellular, and tissue levels. Critical factors to consider in 3D microscopy include spatial resolution, signal-to-noise (SNR), signal-to-background (SBR), and temporal resolution. Maintaining high quality imaging becomes progressively more difficult at increasing depth (where optical aberrations, induced by inhomogeneities of refractive index in the sample, degrade resolution and SNR), and in thick or densely labeled samples (where out-of-focus background can swamp the valuable, in-focus-signal from each plane). In this report, we introduce our new instrumentation to address these problems. A multiphoton structured illumination microscope was simply modified to integrate an adpative optics system for optical aberrations correction. Firstly, the optical aberrations are determined using direct wavefront sensing with a nonlinear guide star and subsequently corrected using a deformable mirror, restoring super-resolution information. We demonstrate the flexibility of our adaptive optics approach on a variety of semi-transparent samples, including bead phantoms, cultured cells in collagen gels and biological tissues. The performance of our super-resolution microscope is improved in all of these samples, as peak intensity is increased (up to 40-fold) and resolution recovered (up to 176+/-10 nm laterally and 729+/-39 nm axially) at depths up to 250 μm from the coverslip surface.

Nanoscale Spatial Organization of Prokaryotic Cells Studied by Super-Resolution Optical Microscopy

NASA Astrophysics Data System (ADS)

McEvoy, Andrea Lynn

All cells spatially organize their interiors, and this arrangement is necessary for cell viability. Until recently, it was believed that only eukaryotic cells spatially segregate their components. However, it is becoming increasingly clear that bacteria also assemble their proteins into complex patterns. In eukaryotic cells, spatial organization arises from membrane bound organelles as well as motor transport proteins which can move cargos within the cell. To date, there are no known motor transport proteins in bacteria and most microbes lack membrane bound organelles, so it remains a mystery how bacterial spatial organization emerges. In hind-sight it is not surprising that bacteria also exhibit complex spatial organization considering much of what we have learned about the basic processes that take place in all cells, such as transcription and translation was first discovered in prokaryotic cells. Perhaps the fundamental principles that govern spatial organization in prokaryotic cells may be applicable in eukaryotic cells as well. In addition, bacteria are attractive model organism for spatial organization studies because they are genetically tractable, grow quickly and much biochemical and structural data is known about them. A powerful tool for observing spatial organization in cells is the fluorescence microscope. By specifically tagging a protein of interest with a fluorescent probe, it is possible to examine how proteins organize and dynamically assemble inside cells. A significant disadvantage of this technology is its spatial resolution (approximately 250 nm laterally and 500 nm axially). This limitation on resolution causes closely spaced proteins to look blurred making it difficult to observe the fine structure within the complexes. This resolution limit is especially problematic within small cells such as bacteria. With the recent invention of new optical microscopies, we now can surpass the existing limits of fluorescence imaging. In some cases, we can

Localization-based super-resolution imaging meets high-content screening.

PubMed

Beghin, Anne; Kechkar, Adel; Butler, Corey; Levet, Florian; Cabillic, Marine; Rossier, Olivier; Giannone, Gregory; Galland, Rémi; Choquet, Daniel; Sibarita, Jean-Baptiste

2017-12-01

Single-molecule localization microscopy techniques have proven to be essential tools for quantitatively monitoring biological processes at unprecedented spatial resolution. However, these techniques are very low throughput and are not yet compatible with fully automated, multiparametric cellular assays. This shortcoming is primarily due to the huge amount of data generated during imaging and the lack of software for automation and dedicated data mining. We describe an automated quantitative single-molecule-based super-resolution methodology that operates in standard multiwell plates and uses analysis based on high-content screening and data-mining software. The workflow is compatible with fixed- and live-cell imaging and allows extraction of quantitative data like fluorophore photophysics, protein clustering or dynamic behavior of biomolecules. We demonstrate that the method is compatible with high-content screening using 3D dSTORM and DNA-PAINT based super-resolution microscopy as well as single-particle tracking.

Multiplane and Spectrally-Resolved Single Molecule Localization Microscopy with Industrial Grade CMOS cameras.

PubMed

Babcock, Hazen P

2018-01-29

This work explores the use of industrial grade CMOS cameras for single molecule localization microscopy (SMLM). We show that industrial grade CMOS cameras approach the performance of scientific grade CMOS cameras at a fraction of the cost. This makes it more economically feasible to construct high-performance imaging systems with multiple cameras that are capable of a diversity of applications. In particular we demonstrate the use of industrial CMOS cameras for biplane, multiplane and spectrally resolved SMLM. We also provide open-source software for simultaneous control of multiple CMOS cameras and for the reduction of the movies that are acquired to super-resolution images.

New learning based super-resolution: use of DWT and IGMRF prior.

PubMed

Gajjar, Prakash P; Joshi, Manjunath V

2010-05-01

In this paper, we propose a new learning-based approach for super-resolving an image captured at low spatial resolution. Given the low spatial resolution test image and a database consisting of low and high spatial resolution images, we obtain super-resolution for the test image. We first obtain an initial high-resolution (HR) estimate by learning the high-frequency details from the available database. A new discrete wavelet transform (DWT) based approach is proposed for learning that uses a set of low-resolution (LR) images and their corresponding HR versions. Since the super-resolution is an ill-posed problem, we obtain the final solution using a regularization framework. The LR image is modeled as the aliased and noisy version of the corresponding HR image, and the aliasing matrix entries are estimated using the test image and the initial HR estimate. The prior model for the super-resolved image is chosen as an Inhomogeneous Gaussian Markov random field (IGMRF) and the model parameters are estimated using the same initial HR estimate. A maximum a posteriori (MAP) estimation is used to arrive at the cost function which is minimized using a simple gradient descent approach. We demonstrate the effectiveness of the proposed approach by conducting the experiments on gray scale as well as on color images. The method is compared with the standard interpolation technique and also with existing learning-based approaches. The proposed approach can be used in applications such as wildlife sensor networks, remote surveillance where the memory, the transmission bandwidth, and the camera cost are the main constraints.

Super-resolution of fluorescence-free plasmonic nanoparticles using enhanced dark-field illumination based on wavelength-modulation

DOE PAGES

Zhang, Peng; Lee, Seungah; Yu, Hyunung; ...

2015-06-15

Super-resolution imaging of fluorescence-free plasmonic nanoparticles (NPs) was achieved using enhanced dark-field (EDF) illumination based on wavelength-modulation. Indistinguishable adjacent EDF images of 103-nm gold nanoparticles (GNPs), 40-nm gold nanorods (GNRs), and 80-nm silver nanoparticles (SNPs) were modulated at their wavelengths of specific localized surface plasmon scattering. The coordinates (x, y) of each NP were resolved by fitting their point spread functions with a two-dimensional Gaussian. The measured localization precisions of GNPs, GNRs, and SNPs were 2.5 nm, 5.0 nm, and 2.9 nm, respectively. From the resolved coordinates of NPs and the corresponding localization precisions, super-resolution images were reconstructed. Depending onmore » the spontaneous polarization of GNR scattering, the orientation angle of GNRs in two-dimensions was resolved and provided more elaborate localization information. This novel fluorescence-free super-resolution method was applied to live HeLa cells to resolve NPs and provided remarkable subdiffraction limit images.« less

Re-scan confocal microscopy: scanning twice for better resolution

PubMed Central

De Luca, Giulia M.R.; Breedijk, Ronald M.P.; Brandt, Rick A.J.; Zeelenberg, Christiaan H.C.; de Jong, Babette E.; Timmermans, Wendy; Azar, Leila Nahidi; Hoebe, Ron A.; Stallinga, Sjoerd; Manders, Erik M.M.

2013-01-01

We present a new super-resolution technique, Re-scan Confocal Microscopy (RCM), based on standard confocal microscopy extended with an optical (re-scanning) unit that projects the image directly on a CCD-camera. This new microscope has improved lateral resolution and strongly improved sensitivity while maintaining the sectioning capability of a standard confocal microscope. This simple technology is typically useful for biological applications where the combination high-resolution and high-sensitivity is required. PMID:24298422

Re-scan confocal microscopy: scanning twice for better resolution.

PubMed

De Luca, Giulia M R; Breedijk, Ronald M P; Brandt, Rick A J; Zeelenberg, Christiaan H C; de Jong, Babette E; Timmermans, Wendy; Azar, Leila Nahidi; Hoebe, Ron A; Stallinga, Sjoerd; Manders, Erik M M

2013-01-01

We present a new super-resolution technique, Re-scan Confocal Microscopy (RCM), based on standard confocal microscopy extended with an optical (re-scanning) unit that projects the image directly on a CCD-camera. This new microscope has improved lateral resolution and strongly improved sensitivity while maintaining the sectioning capability of a standard confocal microscope. This simple technology is typically useful for biological applications where the combination high-resolution and high-sensitivity is required.

New developments in super-resolution for GaoFen-4

NASA Astrophysics Data System (ADS)

Li, Feng; Fu, Jie; Xin, Lei; Liu, Yuhong; Liu, Zhijia

2017-10-01

In this paper, the application of super resolution (SR, restoring a high spatial resolution image from a series of low resolution images of the same scene) techniques to GaoFen(GF)-4, which is the most advanced geostationaryorbit earth observing satellite in China, remote sensing images is investigated and tested. SR has been a hot research area for decades, but one of the barriers of applying SR in remote sensing community is the time slot between those low resolution (LR) images acquisition. In general, the longer the time slot, the less reliable the reconstruction. GF-4 has the unique advantage of capturing a sequence of LR of the same region in minutes, i.e. working as a staring camera from the point view of SR. This is the first experiment of applying super resolution to a sequence of low resolution images captured by GF-4 within a short time period. In this paper, we use Maximum a Posteriori (MAP) to solve the ill-conditioned problem of SR. Both the wavelet transform and the curvelet transform are used to setup a sparse prior for remote sensing images. By combining several images of both the BeiJing and DunHuang regions captured by GF-4 our method can improve spatial resolution both visually and numerically. Experimental tests show that lots of detail cannot be observed in the captured LR images, but can be seen in the super resolved high resolution (HR) images. To help the evaluation, Google Earth image can also be referenced. Moreover, our experimental tests also show that the higher the temporal resolution, the better the HR images can be resolved. The study illustrates that the application for SR to geostationary-orbit based earth observation data is very feasible and worthwhile, and it holds the potential application for all other geostationary-orbit based earth observing systems.

Nano-scale measurement of biomolecules by optical microscopy and semiconductor nanoparticles

PubMed Central

Ichimura, Taro; Jin, Takashi; Fujita, Hideaki; Higuchi, Hideo; Watanabe, Tomonobu M.

2014-01-01

Over the past decade, great developments in optical microscopy have made this technology increasingly compatible with biological studies. Fluorescence microscopy has especially contributed to investigating the dynamic behaviors of live specimens and can now resolve objects with nanometer precision and resolution due to super-resolution imaging. Additionally, single particle tracking provides information on the dynamics of individual proteins at the nanometer scale both in vitro and in cells. Complementing advances in microscopy technologies has been the development of fluorescent probes. The quantum dot, a semi-conductor fluorescent nanoparticle, is particularly suitable for single particle tracking and super-resolution imaging. This article overviews the principles of single particle tracking and super resolution along with describing their application to the nanometer measurement/observation of biological systems when combined with quantum dot technologies. PMID:25120488

Assessing resolution in live cell structured illumination microscopy

NASA Astrophysics Data System (ADS)

Pospíšil, Jakub; Fliegel, Karel; Klíma, Miloš

2017-12-01

Structured Illumination Microscopy (SIM) is a powerful super-resolution technique, which is able to enhance the resolution of optical microscope beyond the Abbe diffraction limit. In the last decade, numerous SIM methods that achieve the resolution of 100 nm in the lateral dimension have been developed. The SIM setups with new high-speed cameras and illumination pattern generators allow rapid acquisition of the live specimen. Therefore, SIM is widely used for investigation of the live structures in molecular and live cell biology. Quantitative evaluation of resolution enhancement in a real sample is essential to describe the efficiency of super-resolution microscopy technique. However, measuring the resolution of a live cell sample is a challenging task. Based on our experimental findings, the widely used Fourier ring correlation (FRC) method does not seem to be well suited for measuring the resolution of SIM live cell video sequences. Therefore, the resolution assessing methods based on Fourier spectrum analysis are often used. We introduce a measure based on circular average power spectral density (PSDca) estimated from a single SIM image (one video frame). PSDca describes the distribution of the power of a signal with respect to its spatial frequency. Spatial resolution corresponds to the cut-off frequency in Fourier space. In order to estimate the cut-off frequency from a noisy signal, we use a spectral subtraction method for noise suppression. In the future, this resolution assessment approach might prove useful also for single-molecule localization microscopy (SMLM) live cell imaging.

Plasmon-Assisted Selective and Super-Resolving Excitation of Individual Quantum Emitters on a Metal Nanowire.

PubMed

Li, Qiang; Pan, Deng; Wei, Hong; Xu, Hongxing

2018-03-14

Hybrid systems composed of multiple quantum emitters coupled with plasmonic waveguides are promising building blocks for future integrated quantum nanophotonic circuits. The techniques that can super-resolve and selectively excite contiguous quantum emitters in a diffraction-limited area are of great importance for studying the plasmon-mediated interaction between quantum emitters and manipulating the single plasmon generation and propagation in plasmonic circuits. Here we show that multiple quantum dots coupled with a silver nanowire can be controllably excited by tuning the interference field of surface plasmons on the nanowire. Because of the period of the interference pattern is much smaller than the diffraction limit, we demonstrate the selective excitation of two quantum dots separated by a distance as short as 100 nm. We also numerically demonstrate a new kind of super-resolution imaging method that combines the tunable surface plasmon interference pattern on the NW with the structured illumination microscopy technique. Our work provides a novel high-resolution optical excitation and imaging method for the coupled systems of multiple quantum emitters and plasmonic waveguides, which adds a new tool for studying and manipulating single quantum emitters and single plasmons for quantum plasmonic circuitry applications.

The super-resolution debate

NASA Astrophysics Data System (ADS)

Won, Rachel

2018-05-01

In the quest for nanoscopy with super-resolution, consensus from the imaging community is that super-resolution is not always needed and that scientists should choose an imaging technique based on their specific application.

Probing nano-organization of astroglia with multi-color super-resolution microscopy.

PubMed

Heller, Janosch P; Michaluk, Piotr; Sugao, Kohtaroh; Rusakov, Dmitri A

2017-11-01

Astroglia are essential for brain development, homeostasis, and metabolic support. They also contribute actively to the formation and regulation of synaptic circuits, by successfully handling, integrating, and propagating physiological signals of neural networks. The latter occurs mainly by engaging a versatile mechanism of internal Ca 2+ fluctuations and regenerative waves prompting targeted release of signaling molecules into the extracellular space. Astroglia also show substantial structural plasticity associated with age- and use-dependent changes in neural circuitry. However, the underlying cellular mechanisms are poorly understood, mainly because of the extraordinary complex morphology of astroglial compartments on the nanoscopic scale. This complexity largely prevents direct experimental access to astroglial processes, most of which are beyond the diffraction limit of optical microscopy. Here we employed super-resolution microscopy (direct stochastic optical reconstruction microscopy; dSTORM), to visualize astroglial organization on the nanoscale, in culture and in thin brain slices, as an initial step to understand the structural basis of astrocytic nano-physiology. We were able to follow nanoscopic morphology of GFAP-enriched astrocytes, which adapt a flattened shape in culture and a sponge-like structure in situ, with GFAP fibers of varied diameters. We also visualized nanoscopic astrocytic processes using the ubiquitous cytosolic astrocyte marker proteins S100β and glutamine synthetase. Finally, we overexpressed and imaged membrane-targeted pHluorin and lymphocyte-specific protein tyrosine kinase (N-terminal domain) -green fluorescent protein (lck-GFP), to better understand the molecular cascades underlying some common astroglia-targeted fluorescence imaging techniques. The results provide novel, albeit initial, insights into the cellular organization of astroglia on the nanoscale, paving the way for function-specific studies. © 2017 Wiley Periodicals

Quantum correlation enhanced super-resolution localization microscopy enabled by a fibre bundle camera

PubMed Central

Israel, Yonatan; Tenne, Ron; Oron, Dan; Silberberg, Yaron

2017-01-01

Despite advances in low-light-level detection, single-photon methods such as photon correlation have rarely been used in the context of imaging. The few demonstrations, for example of subdiffraction-limited imaging utilizing quantum statistics of photons, have remained in the realm of proof-of-principle demonstrations. This is primarily due to a combination of low values of fill factors, quantum efficiencies, frame rates and signal-to-noise characteristic of most available single-photon sensitive imaging detectors. Here we describe an imaging device based on a fibre bundle coupled to single-photon avalanche detectors that combines a large fill factor, a high quantum efficiency, a low noise and scalable architecture. Our device enables localization-based super-resolution microscopy in a non-sparse non-stationary scene, utilizing information on the number of active emitters, as gathered from non-classical photon statistics. PMID:28287167

Cygnus A super-resolved via convex optimization from VLA data

NASA Astrophysics Data System (ADS)

Dabbech, A.; Onose, A.; Abdulaziz, A.; Perley, R. A.; Smirnov, O. M.; Wiaux, Y.

2018-05-01

We leverage the Sparsity Averaging Re-weighted Analysis approach for interferometric imaging, that is based on convex optimization, for the super-resolution of Cyg A from observations at the frequencies 8.422 and 6.678 GHz with the Karl G. Jansky Very Large Array (VLA). The associated average sparsity and positivity priors enable image reconstruction beyond instrumental resolution. An adaptive Preconditioned primal-dual algorithmic structure is developed for imaging in the presence of unknown noise levels and calibration errors. We demonstrate the superior performance of the algorithm with respect to the conventional CLEAN-based methods, reflected in super-resolved images with high fidelity. The high-resolution features of the recovered images are validated by referring to maps of Cyg A at higher frequencies, more precisely 17.324 and 14.252 GHz. We also confirm the recent discovery of a radio transient in Cyg A, revealed in the recovered images of the investigated data sets. Our MATLAB code is available online on GitHub.

Super-resolution with an SLM and two intensity images

NASA Astrophysics Data System (ADS)

Alcalá Ochoa, Noé; de León, Y. Ponce

2018-06-01

It is reported a method which may simplify the optical setups used to achieve super-resolution through the amplitude multiplication of two waves. For this end we decompose a super-resolving pupil into two complex masks and with the aid of a Spatial Light Modulator (LCoS) we obtain two intensity images that are subtracted. With this proposal, the traditional experimental optical setups are considerably simplified, with the additional benefit that different masks can be utilized without needing to perform the setup alignment each time.

Particle tracking and extended object imaging by interferometric super resolution microscopy

NASA Astrophysics Data System (ADS)

Gdor, Itay; Yoo, Seunghwan; Wang, Xiaolei; Daddysman, Matthew; Wilton, Rosemarie; Ferrier, Nicola; Hereld, Mark; Cossairt, Oliver (Ollie); Katsaggelos, Aggelos; Scherer, Norbert F.

2018-02-01

An interferometric fluorescent microscope and a novel theoretic image reconstruction approach were developed and used to obtain super-resolution images of live biological samples and to enable dynamic real time tracking. The tracking utilizes the information stored in the interference pattern of both the illuminating incoherent light and the emitted light. By periodically shifting the interferometer phase and a phase retrieval algorithm we obtain information that allow localization with sub-2 nm axial resolution at 5 Hz.

Superresolution microscopy for microbiology

PubMed Central

Coltharp, Carla; Xiao, Jie

2014-01-01

Summary This review provides a practical introduction to superresolution microscopy from the perspective of microbiological research. Because of the small sizes of bacterial cells, superresolution methods are particularly powerful and suitable for revealing details of cellular structures that are not resolvable under conventional fluorescence light microscopy. Here we describe the methodological concepts behind three major categories of super-resolution light microscopy: photoactivated localization microscopy (PALM) and stochastic optical reconstruction microscopy (STORM), structured illumination microscopy (SIM) and stimulated emission-depletion (STED) microscopy. We then present recent applications of each of these techniques to microbial systems, which have revealed novel conformations of cellular structures and described new properties of in vivo protein function and interactions. Finally, we discuss the unique issues related to implementing each of these superresolution techniques with bacterial specimens and suggest avenues for future development. The goal of this review is to provide the necessary technical background for interested microbiologists to choose the appropriate super-resolution method for their biological systems, and to introduce the practical considerations required for designing and analysing superresolution imaging experiments. PMID:22947061

Development of bimolecular fluorescence complementation using rsEGFP2 for detection and super-resolution imaging of protein-protein interactions in live cells

PubMed Central

Wang, Sheng; Ding, Miao; Chen, Xuanze; Chang, Lei; Sun, Yujie

2017-01-01

Direct visualization of protein-protein interactions (PPIs) at high spatial and temporal resolution in live cells is crucial for understanding the intricate and dynamic behaviors of signaling protein complexes. Recently, bimolecular fluorescence complementation (BiFC) assays have been combined with super-resolution imaging techniques including PALM and SOFI to visualize PPIs at the nanometer spatial resolution. RESOLFT nanoscopy has been proven as a powerful live-cell super-resolution imaging technique. With regard to the detection and visualization of PPIs in live cells with high temporal and spatial resolution, here we developed a BiFC assay using split rsEGFP2, a highly photostable and reversibly photoswitchable fluorescent protein previously developed for RESOLFT nanoscopy. Combined with parallelized RESOLFT microscopy, we demonstrated the high spatiotemporal resolving capability of a rsEGFP2-based BiFC assay by detecting and visualizing specifically the heterodimerization interactions between Bcl-xL and Bak as well as the dynamics of the complex on mitochondria membrane in live cells. PMID:28663931

Optimizing Imaging Conditions for Demanding Multi-Color Super Resolution Localization Microscopy

PubMed Central

Nahidiazar, Leila; Agronskaia, Alexandra V.; Broertjes, Jorrit; van den Broek, Bram; Jalink, Kees

2016-01-01

Single Molecule Localization super-resolution Microscopy (SMLM) has become a powerful tool to study cellular architecture at the nanometer scale. In SMLM, single fluorophore labels are made to repeatedly switch on and off (“blink”), and their exact locations are determined by mathematically finding the centers of individual blinks. The image quality obtainable by SMLM critically depends on efficacy of blinking (brightness, fraction of molecules in the on-state) and on preparation longevity and labeling density. Recent work has identified several combinations of bright dyes and imaging buffers that work well together. Unfortunately, different dyes blink optimally in different imaging buffers, and acquisition of good quality 2- and 3-color images has therefore remained challenging. In this study we describe a new imaging buffer, OxEA, that supports 3-color imaging of the popular Alexa dyes. We also describe incremental improvements in preparation technique that significantly decrease lateral- and axial drift, as well as increase preparation longevity. We show that these improvements allow us to collect very large series of images from the same cell, enabling image stitching, extended 3D imaging as well as multi-color recording. PMID:27391487

Super-nonlinear fluorescence microscopy for high-contrast deep tissue imaging

NASA Astrophysics Data System (ADS)

Wei, Lu; Zhu, Xinxin; Chen, Zhixing; Min, Wei

2014-02-01

Two-photon excited fluorescence microscopy (TPFM) offers the highest penetration depth with subcellular resolution in light microscopy, due to its unique advantage of nonlinear excitation. However, a fundamental imaging-depth limit, accompanied by a vanishing signal-to-background contrast, still exists for TPFM when imaging deep into scattering samples. Formally, the focusing depth, at which the in-focus signal and the out-of-focus background are equal to each other, is defined as the fundamental imaging-depth limit. To go beyond this imaging-depth limit of TPFM, we report a new class of super-nonlinear fluorescence microscopy for high-contrast deep tissue imaging, including multiphoton activation and imaging (MPAI) harnessing novel photo-activatable fluorophores, stimulated emission reduced fluorescence (SERF) microscopy by adding a weak laser beam for stimulated emission, and two-photon induced focal saturation imaging with preferential depletion of ground-state fluorophores at focus. The resulting image contrasts all exhibit a higher-order (third- or fourth- order) nonlinear signal dependence on laser intensity than that in the standard TPFM. Both the physical principles and the imaging demonstrations will be provided for each super-nonlinear microscopy. In all these techniques, the created super-nonlinearity significantly enhances the imaging contrast and concurrently extends the imaging depth-limit of TPFM. Conceptually different from conventional multiphoton processes mediated by virtual states, our strategy constitutes a new class of fluorescence microscopy where high-order nonlinearity is mediated by real population transfer.

Super-resolution method for face recognition using nonlinear mappings on coherent features.

PubMed

Huang, Hua; He, Huiting

2011-01-01

Low-resolution (LR) of face images significantly decreases the performance of face recognition. To address this problem, we present a super-resolution method that uses nonlinear mappings to infer coherent features that favor higher recognition of the nearest neighbor (NN) classifiers for recognition of single LR face image. Canonical correlation analysis is applied to establish the coherent subspaces between the principal component analysis (PCA) based features of high-resolution (HR) and LR face images. Then, a nonlinear mapping between HR/LR features can be built by radial basis functions (RBFs) with lower regression errors in the coherent feature space than in the PCA feature space. Thus, we can compute super-resolved coherent features corresponding to an input LR image according to the trained RBF model efficiently and accurately. And, face identity can be obtained by feeding these super-resolved features to a simple NN classifier. Extensive experiments on the Facial Recognition Technology, University of Manchester Institute of Science and Technology, and Olivetti Research Laboratory databases show that the proposed method outperforms the state-of-the-art face recognition algorithms for single LR image in terms of both recognition rate and robustness to facial variations of pose and expression.

Controlled power delivery for super-resolution imaging of biological samples using digital micromirror device

NASA Astrophysics Data System (ADS)

Valiya Peedikakkal, Liyana; Cadby, Ashley

2017-02-01

Localization based super resolution images of a biological sample is generally achieved by using high power laser illumination with long exposure time which unfortunately increases photo-toxicity of a sample, making super resolution microscopy, in general, incompatible with live cell imaging. Furthermore, the limitation of photobleaching reduces the ability to acquire time lapse images of live biological cells using fluorescence microscopy. Digital Light Processing (DLP) technology can deliver light at grey scale levels by flickering digital micromirrors at around 290 Hz enabling highly controlled power delivery to samples. In this work, Digital Micromirror Device (DMD) is implemented in an inverse Schiefspiegler telescope setup to control the power and pattern of illumination for super resolution microscopy. We can achieve spatial and temporal patterning of illumination by controlling the DMD pixel by pixel. The DMD allows us to control the power and spatial extent of the laser illumination. We have used this to show that we can reduce the power delivered to the sample to allow for longer time imaging in one area while achieving sub-diffraction STORM imaging in another using higher power densities.

Sequential Super-Resolution Imaging of Bacterial Regulatory Proteins: The Nucleoid and the Cell Membrane in Single, Fixed E. coli Cells.

PubMed

Spahn, Christoph; Glaesmann, Mathilda; Gao, Yunfeng; Foo, Yong Hwee; Lampe, Marko; Kenney, Linda J; Heilemann, Mike

2017-01-01

Despite their small size and the lack of compartmentalization, bacteria exhibit a striking degree of cellular organization, both in time and space. During the last decade, a group of new microscopy techniques emerged, termed super-resolution microscopy or nanoscopy, which facilitate visualizing the organization of proteins in bacteria at the nanoscale. Single-molecule localization microscopy (SMLM) is especially well suited to reveal a wide range of new information regarding protein organization, interaction, and dynamics in single bacterial cells. Recent developments in click chemistry facilitate the visualization of bacterial chromatin with a resolution of ~20 nm, providing valuable information about the ultrastructure of bacterial nucleoids, especially at short generation times. In this chapter, we describe a simple-to-realize protocol that allows determining precise structural information of bacterial nucleoids in fixed cells, using direct stochastic optical reconstruction microscopy (dSTORM). In combination with quantitative photoactivated localization microscopy (PALM), the spatial relationship of proteins with the bacterial chromosome can be studied. The position of a protein of interest with respect to the nucleoids and the cell cylinder can be visualized by super-resolving the membrane using point accumulation for imaging in nanoscale topography (PAINT). The combination of the different SMLM techniques in a sequential workflow maximizes the information that can be extracted from single cells, while maintaining optimal imaging conditions for each technique.

Video Super-Resolution via Bidirectional Recurrent Convolutional Networks.

PubMed

Huang, Yan; Wang, Wei; Wang, Liang

2018-04-01

Super resolving a low-resolution video, namely video super-resolution (SR), is usually handled by either single-image SR or multi-frame SR. Single-Image SR deals with each video frame independently, and ignores intrinsic temporal dependency of video frames which actually plays a very important role in video SR. Multi-Frame SR generally extracts motion information, e.g., optical flow, to model the temporal dependency, but often shows high computational cost. Considering that recurrent neural networks (RNNs) can model long-term temporal dependency of video sequences well, we propose a fully convolutional RNN named bidirectional recurrent convolutional network for efficient multi-frame SR. Different from vanilla RNNs, 1) the commonly-used full feedforward and recurrent connections are replaced with weight-sharing convolutional connections. So they can greatly reduce the large number of network parameters and well model the temporal dependency in a finer level, i.e., patch-based rather than frame-based, and 2) connections from input layers at previous timesteps to the current hidden layer are added by 3D feedforward convolutions, which aim to capture discriminate spatio-temporal patterns for short-term fast-varying motions in local adjacent frames. Due to the cheap convolutional operations, our model has a low computational complexity and runs orders of magnitude faster than other multi-frame SR methods. With the powerful temporal dependency modeling, our model can super resolve videos with complex motions and achieve well performance.

A novel super-resolution camera model

NASA Astrophysics Data System (ADS)

Shao, Xiaopeng; Wang, Yi; Xu, Jie; Wang, Lin; Liu, Fei; Luo, Qiuhua; Chen, Xiaodong; Bi, Xiangli

2015-05-01

Aiming to realize super resolution(SR) to single image and video reconstruction, a super resolution camera model is proposed for the problem that the resolution of the images obtained by traditional cameras behave comparatively low. To achieve this function we put a certain driving device such as piezoelectric ceramics in the camera. By controlling the driving device, a set of continuous low resolution(LR) images can be obtained and stored instantaneity, which reflect the randomness of the displacements and the real-time performance of the storage very well. The low resolution image sequences have different redundant information and some particular priori information, thus it is possible to restore super resolution image factually and effectively. The sample method is used to derive the reconstruction principle of super resolution, which analyzes the possible improvement degree of the resolution in theory. The super resolution algorithm based on learning is used to reconstruct single image and the variational Bayesian algorithm is simulated to reconstruct the low resolution images with random displacements, which models the unknown high resolution image, motion parameters and unknown model parameters in one hierarchical Bayesian framework. Utilizing sub-pixel registration method, a super resolution image of the scene can be reconstructed. The results of 16 images reconstruction show that this camera model can increase the image resolution to 2 times, obtaining images with higher resolution in currently available hardware levels.

Super-resolution study of polymer mobility fluctuations near c*.

PubMed

King, John T; Yu, Changqian; Wilson, William L; Granick, Steve

2014-09-23

Nanoscale dynamic heterogeneities in synthetic polymer solutions are detected using super-resolution optical microscopy. To this end, we map concentration fluctuations in polystyrene-toluene solutions with spatial resolution below the diffraction limit, focusing on critical fluctuations near the polymer overlap concentration, c*. Two-photon super-resolution microscopy was adapted to be applicable in an organic solvent, and a home-built STED-FCS system with stimulated emission depletion (STED) was used to perform fluorescence correlation spectroscopy (FCS). The polystyrene serving as the tracer probe (670 kg mol(-1), radius of gyration RG ≈ 35 nm, end-labeled with a bodipy derivative chromophore) was dissolved in toluene at room temperature (good solvent) and mixed with matrix polystyrene (3,840 kg mol(-1), RG ≈ 97 nm, Mw/Mn = 1.04) whose concentration was varied from dilute to more than 10c*. Whereas for dilute solutions the intensity-intensity correlation function follows a single diffusion process, it splits starting at c* to imply an additional relaxation process provided that the experimental focal area does not greatly exceed the polymer blob size. We identify the slower mode as self-diffusion and the increasingly rapid mode as correlated segment fluctuations that reflect the cooperative diffusion coefficient, Dcoop. These real-space measurements find quantitative agreement between correlation lengths inferred from dynamic measurements and those from determining the limit below which diffusion coefficients are independent of spot size. This study is considered to illustrate the potential of importing into polymer science the techniques of super-resolution imaging.

Large scale superres 3D imaging: light-sheet single-molecule localization microscopy (Conference Presentation)

NASA Astrophysics Data System (ADS)

Lu, Chieh Han; Chen, Peilin; Chen, Bi-Chang

2017-02-01

Optical imaging techniques provide much important information in understanding life science especially cellular structure and morphology because "seeing is believing". However, the resolution of optical imaging is limited by the diffraction limit, which is discovered by Ernst Abbe, i.e. λ/2(NA) (NA is the numerical aperture of the objective lens). Fluorescence super-resolution microscopic techniques such as Stimulated emission depletion microscopy (STED), Photoactivated localization microscopy (PALM), and Stochastic optical reconstruction microscopy (STORM) are invented to have the capability of seeing biological entities down to molecular level that are smaller than the diffraction limit (around 200-nm in lateral resolution). These techniques do not physically violate the Abbe limit of resolution but exploit the photoluminescence properties and labelling specificity of fluorescence molecules to achieve super-resolution imaging. However, these super-resolution techniques limit most of their applications to the 2D imaging of fixed or dead samples due to the high laser power needed or slow speed for the localization process. Extended from 2D imaging, light sheet microscopy has been proven to have a lot of applications on 3D imaging at much better spatiotemporal resolutions due to its intrinsic optical sectioning and high imaging speed. Herein, we combine the advantage of localization microscopy and light-sheet microscopy to have super-resolved cellular imaging in 3D across large field of view. With high-density labeled spontaneous blinking fluorophore and wide-field detection of light-sheet microscopy, these allow us to construct 3D super-resolution multi-cellular imaging at high speed ( minutes) by light-sheet single-molecule localization microscopy.

Aptamer-recognized carbohydrates on the cell membrane revealed by super-resolution microscopy.

PubMed

Jing, Yingying; Cai, Mingjun; Xu, Haijiao; Zhou, Lulu; Yan, Qiuyan; Gao, Jing; Wang, Hongda

2018-04-26

Carbohydrates are one of the most important components on the cell membrane, which participate in various physiological activities, and their aberrant expression is a consequence of pathological changes. In previous studies, carbohydrate analysis basically relied on lectins. However, discrimination between lectins still exists due to their multivalent character. Furthermore, the structures obtained by carbohydrate-lectin crosslinking confuse our direct observation to some extent. Fortunately, the emergence of aptamers, which are smaller and more flexible, has provided us an unprecedented choice. Herein, an aptamer recognition method with high precise localization was developed for imaging membrane-bound N-acetylgalactosamine (GalNAc). By using direct stochastic optical reconstruction microscopy (dSTORM), we compared this aptamer recognition method with the lectin recognition method for visualizing the detailed structure of GalNAc at the nanometer scale. The results indicated that GalNAc forms irregular clusters on the cell membrane with a resolution of 23 ± 7 nm by aptamer recognition. Additionally, when treated with N-acetylgalactosidase, the aptamer-recognized GalNAc shows a more significant decrease in cluster size and localization density, thus verifying better specificity of aptamers than lectins. Collectively, our study suggests that aptamers can act as perfect substitutes for lectins in carbohydrate labeling, which will be of great potential value in the field of super-resolution fluorescence imaging.

Synthesis of a Far-Red Photoactivatable Silicon-Containing Rhodamine for Super-Resolution Microscopy.

PubMed

Grimm, Jonathan B; Klein, Teresa; Kopek, Benjamin G; Shtengel, Gleb; Hess, Harald F; Sauer, Markus; Lavis, Luke D

2016-01-26

The rhodamine system is a flexible framework for building small-molecule fluorescent probes. Changing N-substitution patterns and replacing the xanthene oxygen with a dimethylsilicon moiety can shift the absorption and fluorescence emission maxima of rhodamine dyes to longer wavelengths. Acylation of the rhodamine nitrogen atoms forces the molecule to adopt a nonfluorescent lactone form, providing a convenient method to make fluorogenic compounds. Herein, we take advantage of all of these structural manipulations and describe a novel photoactivatable fluorophore based on a Si-containing analogue of Q-rhodamine. This probe is the first example of a "caged" Si-rhodamine, exhibits higher photon counts compared to established localization microscopy dyes, and is sufficiently red-shifted to allow multicolor imaging. The dye is a useful label for super-resolution imaging and constitutes a new scaffold for far-red fluorogenic molecules. © 2015 The Authors. Published by Wiley-VCH Verlag GmbH & Co. KGaA.

Super-Resolution Optical Fluctuation Bio-Imaging with Dual-Color Carbon Nanodots.

PubMed

Chizhik, Anna M; Stein, Simon; Dekaliuk, Mariia O; Battle, Christopher; Li, Weixing; Huss, Anja; Platen, Mitja; Schaap, Iwan A T; Gregor, Ingo; Demchenko, Alexander P; Schmidt, Christoph F; Enderlein, Jörg; Chizhik, Alexey I

2016-01-13

Success in super-resolution imaging relies on a proper choice of fluorescent probes. Here, we suggest novel easily produced and biocompatible nanoparticles-carbon nanodots-for super-resolution optical fluctuation bioimaging (SOFI). The particles revealed an intrinsic dual-color fluorescence, which corresponds to two subpopulations of particles of different electric charges. The neutral nanoparticles localize to cellular nuclei suggesting their potential use as an inexpensive, easily produced nucleus-specific label. The single particle study revealed that the carbon nanodots possess a unique hybrid combination of fluorescence properties exhibiting characteristics of both dye molecules and semiconductor nanocrystals. The results suggest that charge trapping and redistribution on the surface of the particles triggers their transitions between emissive and dark states. These findings open up new possibilities for the utilization of carbon nanodots in the various super-resolution microscopy methods based on stochastic optical switching.

TestSTORM: Simulator for optimizing sample labeling and image acquisition in localization based super-resolution microscopy

PubMed Central

Sinkó, József; Kákonyi, Róbert; Rees, Eric; Metcalf, Daniel; Knight, Alex E.; Kaminski, Clemens F.; Szabó, Gábor; Erdélyi, Miklós

2014-01-01

Localization-based super-resolution microscopy image quality depends on several factors such as dye choice and labeling strategy, microscope quality and user-defined parameters such as frame rate and number as well as the image processing algorithm. Experimental optimization of these parameters can be time-consuming and expensive so we present TestSTORM, a simulator that can be used to optimize these steps. TestSTORM users can select from among four different structures with specific patterns, dye and acquisition parameters. Example results are shown and the results of the vesicle pattern are compared with experimental data. Moreover, image stacks can be generated for further evaluation using localization algorithms, offering a tool for further software developments. PMID:24688813

Correlative Stochastic Optical Reconstruction Microscopy and Electron Microscopy

PubMed Central

Kim, Doory; Deerinck, Thomas J.; Sigal, Yaron M.; Babcock, Hazen P.; Ellisman, Mark H.; Zhuang, Xiaowei

2015-01-01

Correlative fluorescence light microscopy and electron microscopy allows the imaging of spatial distributions of specific biomolecules in the context of cellular ultrastructure. Recent development of super-resolution fluorescence microscopy allows the location of molecules to be determined with nanometer-scale spatial resolution. However, correlative super-resolution fluorescence microscopy and electron microscopy (EM) still remains challenging because the optimal specimen preparation and imaging conditions for super-resolution fluorescence microscopy and EM are often not compatible. Here, we have developed several experiment protocols for correlative stochastic optical reconstruction microscopy (STORM) and EM methods, both for un-embedded samples by applying EM-specific sample preparations after STORM imaging and for embedded and sectioned samples by optimizing the fluorescence under EM fixation, staining and embedding conditions. We demonstrated these methods using a variety of cellular targets. PMID:25874453

Advances in pancreatic islet monolayer culture on glass surfaces enable super-resolution microscopy and insights into beta cell ciliogenesis and proliferation

PubMed Central

Phelps, Edward A.; Cianciaruso, Chiara; Santo-Domingo, Jaime; Pasquier, Miriella; Galliverti, Gabriele; Piemonti, Lorenzo; Berishvili, Ekaterine; Burri, Olivier; Wiederkehr, Andreas; Hubbell, Jeffrey A.; Baekkeskov, Steinunn

2017-01-01

A robust and reproducible method for culturing monolayers of adherent and well-spread primary islet cells on glass coverslips is required for detailed imaging studies by super-resolution and live-cell microscopy. Guided by an observation that dispersed islet cells spread and adhere well on glass surfaces in neuronal co-culture and form a monolayer of connected cells, we demonstrate that in the absence of neurons, well-defined surface coatings combined with components of neuronal culture media collectively support robust attachment and growth of primary human or rat islet cells as monolayers on glass surfaces. The islet cell monolayer cultures on glass stably maintain distinct mono-hormonal insulin+, glucagon+, somatostatin+ and PP+ cells and glucose-responsive synchronized calcium signaling as well as expression of the transcription factors Pdx-1 and NKX-6.1 in beta cells. This technical advance enabled detailed observation of sub-cellular processes in primary human and rat beta cells by super-resolution microscopy. The protocol is envisaged to have broad applicability to sophisticated analyses of pancreatic islet cells that reveal new biological insights, as demonstrated by the identification of an in vitro protocol that markedly increases proliferation of primary beta cells and is associated with a reduction in ciliated, ostensibly proliferation-suppressed beta cells. PMID:28401888

Super-resolved linear fluorescence localization microscopy using photostable fluorophores: A virtual microscopy study

NASA Astrophysics Data System (ADS)

Birk, Udo; Szczurek, Aleksander; Cremer, Christoph

2017-12-01

Current approaches to overcome the conventional limit of the resolution potential of light microscopy (of about 200 nm for visible light), often suffer from non-linear effects, which render the quantification of the image intensities in the reconstructions difficult, and also affect the quantification of the biological structure under investigation. As an attempt to face these difficulties, we discuss a particular method of localization microscopy which is based on photostable fluorescent dyes. The proposed method can potentially be implemented as a fast alternative for quantitative localization microscopy, circumventing the need for the acquisition of thousands of image frames and complex, highly dye-specific imaging buffers. Although the need for calibration remains in order to extract quantitative data (such as the number of emitters), multispectral approaches are largely facilitated due to the much less stringent requirements on imaging buffers. Furthermore, multispectral acquisitions can be readily obtained using commercial instrumentation such as e.g. the conventional confocal laser scanning microscope.

A Super-Resolution Algorithm for Enhancement of FLASH LIDAR Data: Flight Test Results

NASA Technical Reports Server (NTRS)

Bulyshev, Alexander; Amzajerdian, Farzin; Roback, Eric; Reisse Robert

2014-01-01

This paper describes the results of a 3D super-resolution algorithm applied to the range data obtained from a recent Flash Lidar helicopter flight test. The flight test was conducted by the NASA's Autonomous Landing and Hazard Avoidance Technology (ALHAT) project over a simulated lunar terrain facility at NASA Kennedy Space Center. ALHAT is developing the technology for safe autonomous landing on the surface of celestial bodies: Moon, Mars, asteroids. One of the test objectives was to verify the ability of 3D super-resolution technique to generate high resolution digital elevation models (DEMs) and to determine time resolved relative positions and orientations of the vehicle. 3D super-resolution algorithm was developed earlier and tested in computational modeling, and laboratory experiments, and in a few dynamic experiments using a moving truck. Prior to the helicopter flight test campaign, a 100mX100m hazard field was constructed having most of the relevant extraterrestrial hazard: slopes, rocks, and craters with different sizes. Data were collected during the flight and then processed by the super-resolution code. The detailed DEM of the hazard field was constructed using independent measurement to be used for comparison. ALHAT navigation system data were used to verify abilities of super-resolution method to provide accurate relative navigation information. Namely, the 6 degree of freedom state vector of the instrument as a function of time was restored from super-resolution data. The results of comparisons show that the super-resolution method can construct high quality DEMs and allows for identifying hazards like rocks and craters within the accordance of ALHAT requirements.

A super-resolution algorithm for enhancement of flash lidar data: flight test results

NASA Astrophysics Data System (ADS)

Bulyshev, Alexander; Amzajerdian, Farzin; Roback, Eric; Reisse, Robert

2013-03-01

This paper describes the results of a 3D super-resolution algorithm applied to the range data obtained from a recent Flash Lidar helicopter flight test. The flight test was conducted by the NASA's Autonomous Landing and Hazard Avoidance Technology (ALHAT) project over a simulated lunar terrain facility at NASA Kennedy Space Center. ALHAT is developing the technology for safe autonomous landing on the surface of celestial bodies: Moon, Mars, asteroids. One of the test objectives was to verify the ability of 3D super-resolution technique to generate high resolution digital elevation models (DEMs) and to determine time resolved relative positions and orientations of the vehicle. 3D super-resolution algorithm was developed earlier and tested in computational modeling, and laboratory experiments, and in a few dynamic experiments using a moving truck. Prior to the helicopter flight test campaign, a 100mX100m hazard field was constructed having most of the relevant extraterrestrial hazard: slopes, rocks, and craters with different sizes. Data were collected during the flight and then processed by the super-resolution code. The detailed DEM of the hazard field was constructed using independent measurement to be used for comparison. ALHAT navigation system data were used to verify abilities of super-resolution method to provide accurate relative navigation information. Namely, the 6 degree of freedom state vector of the instrument as a function of time was restored from super-resolution data. The results of comparisons show that the super-resolution method can construct high quality DEMs and allows for identifying hazards like rocks and craters within the accordance of ALHAT requirements.

Complementarity of PALM and SOFI for super-resolution live-cell imaging of focal adhesions

PubMed Central

Deschout, Hendrik; Lukes, Tomas; Sharipov, Azat; Szlag, Daniel; Feletti, Lely; Vandenberg, Wim; Dedecker, Peter; Hofkens, Johan; Leutenegger, Marcel; Lasser, Theo; Radenovic, Aleksandra

2016-01-01

Live-cell imaging of focal adhesions requires a sufficiently high temporal resolution, which remains a challenge for super-resolution microscopy. Here we address this important issue by combining photoactivated localization microscopy (PALM) with super-resolution optical fluctuation imaging (SOFI). Using simulations and fixed-cell focal adhesion images, we investigate the complementarity between PALM and SOFI in terms of spatial and temporal resolution. This PALM-SOFI framework is used to image focal adhesions in living cells, while obtaining a temporal resolution below 10 s. We visualize the dynamics of focal adhesions, and reveal local mean velocities around 190 nm min−1. The complementarity of PALM and SOFI is assessed in detail with a methodology that integrates a resolution and signal-to-noise metric. This PALM and SOFI concept provides an enlarged quantitative imaging framework, allowing unprecedented functional exploration of focal adhesions through the estimation of molecular parameters such as fluorophore densities and photoactivation or photoswitching kinetics. PMID:27991512

Complementarity of PALM and SOFI for super-resolution live-cell imaging of focal adhesions

NASA Astrophysics Data System (ADS)

Deschout, Hendrik; Lukes, Tomas; Sharipov, Azat; Szlag, Daniel; Feletti, Lely; Vandenberg, Wim; Dedecker, Peter; Hofkens, Johan; Leutenegger, Marcel; Lasser, Theo; Radenovic, Aleksandra

2016-12-01

Live-cell imaging of focal adhesions requires a sufficiently high temporal resolution, which remains a challenge for super-resolution microscopy. Here we address this important issue by combining photoactivated localization microscopy (PALM) with super-resolution optical fluctuation imaging (SOFI). Using simulations and fixed-cell focal adhesion images, we investigate the complementarity between PALM and SOFI in terms of spatial and temporal resolution. This PALM-SOFI framework is used to image focal adhesions in living cells, while obtaining a temporal resolution below 10 s. We visualize the dynamics of focal adhesions, and reveal local mean velocities around 190 nm min-1. The complementarity of PALM and SOFI is assessed in detail with a methodology that integrates a resolution and signal-to-noise metric. This PALM and SOFI concept provides an enlarged quantitative imaging framework, allowing unprecedented functional exploration of focal adhesions through the estimation of molecular parameters such as fluorophore densities and photoactivation or photoswitching kinetics.

Complementarity of PALM and SOFI for super-resolution live-cell imaging of focal adhesions.

PubMed

Deschout, Hendrik; Lukes, Tomas; Sharipov, Azat; Szlag, Daniel; Feletti, Lely; Vandenberg, Wim; Dedecker, Peter; Hofkens, Johan; Leutenegger, Marcel; Lasser, Theo; Radenovic, Aleksandra

2016-12-19

Live-cell imaging of focal adhesions requires a sufficiently high temporal resolution, which remains a challenge for super-resolution microscopy. Here we address this important issue by combining photoactivated localization microscopy (PALM) with super-resolution optical fluctuation imaging (SOFI). Using simulations and fixed-cell focal adhesion images, we investigate the complementarity between PALM and SOFI in terms of spatial and temporal resolution. This PALM-SOFI framework is used to image focal adhesions in living cells, while obtaining a temporal resolution below 10 s. We visualize the dynamics of focal adhesions, and reveal local mean velocities around 190 nm min -1 . The complementarity of PALM and SOFI is assessed in detail with a methodology that integrates a resolution and signal-to-noise metric. This PALM and SOFI concept provides an enlarged quantitative imaging framework, allowing unprecedented functional exploration of focal adhesions through the estimation of molecular parameters such as fluorophore densities and photoactivation or photoswitching kinetics.

Alpha particle spectroscopy using FNTD and SIM super-resolution microscopy.

PubMed

Kouwenberg, J J M; Kremers, G J; Slotman, J A; Wolterbeek, H T; Houtsmuller, A B; Denkova, A G; Bos, A J J

2018-06-01

Structured illumination microscopy (SIM) for the imaging of alpha particle tracks in fluorescent nuclear track detectors (FNTD) was evaluated and compared to confocal laser scanning microscopy (CLSM). FNTDs were irradiated with an external alpha source and imaged using both methodologies. SIM imaging resulted in improved resolution, without increase in scan time. Alpha particle energy estimation based on the track length, direction and intensity produced results in good agreement with the expected alpha particle energy distribution. A pronounced difference was seen in the spatial scattering of alpha particles in the detectors, where SIM showed an almost 50% reduction compared to CLSM. The improved resolution of SIM allows for more detailed studies of the tracks induced by ionising particles. The combination of SIM and FNTDs for alpha radiation paves the way for affordable and fast alpha spectroscopy and dosimetry. © 2018 The Authors. Journal of Microscopy published by JohnWiley & Sons Ltd on behalf of Royal Microscopical Society.

Ultrafast ultrasound localization microscopy for deep super-resolution vascular imaging

NASA Astrophysics Data System (ADS)

Errico, Claudia; Pierre, Juliette; Pezet, Sophie; Desailly, Yann; Lenkei, Zsolt; Couture, Olivier; Tanter, Mickael

2015-11-01

Non-invasive imaging deep into organs at microscopic scales remains an open quest in biomedical imaging. Although optical microscopy is still limited to surface imaging owing to optical wave diffusion and fast decorrelation in tissue, revolutionary approaches such as fluorescence photo-activated localization microscopy led to a striking increase in resolution by more than an order of magnitude in the last decade. In contrast with optics, ultrasonic waves propagate deep into organs without losing their coherence and are much less affected by in vivo decorrelation processes. However, their resolution is impeded by the fundamental limits of diffraction, which impose a long-standing trade-off between resolution and penetration. This limits clinical and preclinical ultrasound imaging to a sub-millimetre scale. Here we demonstrate in vivo that ultrasound imaging at ultrafast frame rates (more than 500 frames per second) provides an analogue to optical localization microscopy by capturing the transient signal decorrelation of contrast agents—inert gas microbubbles. Ultrafast ultrasound localization microscopy allowed both non-invasive sub-wavelength structural imaging and haemodynamic quantification of rodent cerebral microvessels (less than ten micrometres in diameter) more than ten millimetres below the tissue surface, leading to transcranial whole-brain imaging within short acquisition times (tens of seconds). After intravenous injection, single echoes from individual microbubbles were detected through ultrafast imaging. Their localization, not limited by diffraction, was accumulated over 75,000 images, yielding 1,000,000 events per coronal plane and statistically independent pixels of ten micrometres in size. Precise temporal tracking of microbubble positions allowed us to extract accurately in-plane velocities of the blood flow with a large dynamic range (from one millimetre per second to several centimetres per second). These results pave the way for deep non

Ultrafast ultrasound localization microscopy for deep super-resolution vascular imaging.

PubMed

Errico, Claudia; Pierre, Juliette; Pezet, Sophie; Desailly, Yann; Lenkei, Zsolt; Couture, Olivier; Tanter, Mickael

2015-11-26

Non-invasive imaging deep into organs at microscopic scales remains an open quest in biomedical imaging. Although optical microscopy is still limited to surface imaging owing to optical wave diffusion and fast decorrelation in tissue, revolutionary approaches such as fluorescence photo-activated localization microscopy led to a striking increase in resolution by more than an order of magnitude in the last decade. In contrast with optics, ultrasonic waves propagate deep into organs without losing their coherence and are much less affected by in vivo decorrelation processes. However, their resolution is impeded by the fundamental limits of diffraction, which impose a long-standing trade-off between resolution and penetration. This limits clinical and preclinical ultrasound imaging to a sub-millimetre scale. Here we demonstrate in vivo that ultrasound imaging at ultrafast frame rates (more than 500 frames per second) provides an analogue to optical localization microscopy by capturing the transient signal decorrelation of contrast agents--inert gas microbubbles. Ultrafast ultrasound localization microscopy allowed both non-invasive sub-wavelength structural imaging and haemodynamic quantification of rodent cerebral microvessels (less than ten micrometres in diameter) more than ten millimetres below the tissue surface, leading to transcranial whole-brain imaging within short acquisition times (tens of seconds). After intravenous injection, single echoes from individual microbubbles were detected through ultrafast imaging. Their localization, not limited by diffraction, was accumulated over 75,000 images, yielding 1,000,000 events per coronal plane and statistically independent pixels of ten micrometres in size. Precise temporal tracking of microbubble positions allowed us to extract accurately in-plane velocities of the blood flow with a large dynamic range (from one millimetre per second to several centimetres per second). These results pave the way for deep non

Reducible dictionaries for single image super-resolution based on patch matching and mean shifting

NASA Astrophysics Data System (ADS)

Rasti, Pejman; Nasrollahi, Kamal; Orlova, Olga; Tamberg, Gert; Moeslund, Thomas B.; Anbarjafari, Gholamreza

2017-03-01

A single-image super-resolution (SR) method is proposed. The proposed method uses a generated dictionary from pairs of high resolution (HR) images and their corresponding low resolution (LR) representations. First, HR images and the corresponding LR ones are divided into patches of HR and LR, respectively, and then they are collected into separate dictionaries. Afterward, when performing SR, the distance between every patch of the input LR image and those of available LR patches in the LR dictionary is calculated. The minimum distance between the input LR patch and those in the LR dictionary is taken, and its counterpart from the HR dictionary is passed through an illumination enhancement process. By this technique, the noticeable change of illumination between neighbor patches in the super-resolved image is significantly reduced. The enhanced HR patch represents the HR patch of the super-resolved image. Finally, to remove the blocking effect caused by merging the patches, an average of the obtained HR image and the interpolated image obtained using bicubic interpolation is calculated. The quantitative and qualitative analyses show the superiority of the proposed technique over the conventional and state-of-art methods.

Temporally flickering nanoparticles for compound cellular imaging and super resolution

NASA Astrophysics Data System (ADS)

Ilovitsh, Tali; Danan, Yossef; Meir, Rinat; Meiri, Amihai; Zalevsky, Zeev

2016-03-01

This work presents the use of flickering nanoparticles for imaging biological samples. The method has high noise immunity, and it enables the detection of overlapping types of GNPs, at significantly sub-diffraction distances, making it attractive for super resolving localization microscopy techniques. The method utilizes a lock-in technique at which the imaging of the sample is done using a time-modulated laser beam that match the number of the types of gold nanoparticles (GNPs) that label a given sample, and resulting in the excitation of the temporal flickering of the scattered light at known temporal frequencies. The final image where the GNPs are spatially separated is obtained using post processing where the proper spectral components corresponding to the different modulation frequencies are extracted. This allows the simultaneous super resolved imaging of multiple types of GNPs that label targets of interest within biological samples. Additionally applying the post-processing algorithm of the K-factor image decomposition algorithm can further improve the performance of the proposed approach.

Antimicrobial agent triclosan disrupts mitochondrial structure, revealed by super-resolution microscopy, and inhibits mast cell signaling via calcium modulation.

PubMed

Weatherly, Lisa M; Nelson, Andrew J; Shim, Juyoung; Riitano, Abigail M; Gerson, Erik D; Hart, Andrew J; de Juan-Sanz, Jaime; Ryan, Timothy A; Sher, Roger; Hess, Samuel T; Gosse, Julie A

2018-06-15

The antimicrobial agent triclosan (TCS) is used in products such as toothpaste and surgical soaps and is readily absorbed into oral mucosa and human skin. These and many other tissues contain mast cells, which are involved in numerous physiologies and diseases. Mast cells release chemical mediators through a process termed degranulation, which is inhibited by TCS. Investigation into the underlying mechanisms led to the finding that TCS is a mitochondrial uncoupler at non-cytotoxic, low-micromolar doses in several cell types and live zebrafish. Our aim was to determine the mechanisms underlying TCS disruption of mitochondrial function and of mast cell signaling. We combined super-resolution (fluorescence photoactivation localization) microscopy and multiple fluorescence-based assays to detail triclosan's effects in living mast cells, fibroblasts, and primary human keratinocytes. TCS disrupts mitochondrial nanostructure, causing mitochondria to undergo fission and to form a toroidal, "donut" shape. TCS increases reactive oxygen species production, decreases mitochondrial membrane potential, and disrupts ER and mitochondrial Ca 2+ levels, processes that cause mitochondrial fission. TCS is 60 × more potent than the banned uncoupler 2,4-dinitrophenol. TCS inhibits mast cell degranulation by decreasing mitochondrial membrane potential, disrupting microtubule polymerization, and inhibiting mitochondrial translocation, which reduces Ca 2+ influx into the cell. Our findings provide mechanisms for both triclosan's inhibition of mast cell signaling and its universal disruption of mitochondria. These mechanisms provide partial explanations for triclosan's adverse effects on human reproduction, immunology, and development. This study is the first to utilize super-resolution microscopy in the field of toxicology. Copyright © 2018 Elsevier Inc. All rights reserved.

Single molecules, cells, and super-resolution optics (Presentation Video)

NASA Astrophysics Data System (ADS)

Betzig, Eric

2015-03-01

In this plenary presentation, Eric Betzig talks about his scientific journey that led to the Nobel Prize. He made waves early in his career by helping to develop a technique known as near-field microscopy, which brought into focus structures that scientists had long considered too small to see with a light microscope. Eric Betzig is a group leader at Janelia Research Campus of the Howard Hughes Medical Institute (HHMI) in Ashburn, VA. He recieved a BS in physics from California Institute of Technology and a PhD in applied and engineering physics from Cornell University. Betzig received the 2014 Nobel Prize in Chemistry, along with William Moerner and Stefan Hell, for their development of super-resolved fluorescence microscopy.

Super-resolution with a positive epsilon multi-quantum-well super-lens

DOE Office of Scientific and Technical Information (OSTI.GOV)

Bak, A. O.; Giannini, V.; Maier, S. A.

2013-12-23

We design an anisotropic and dichroic quantum metamaterial that is able to achieve super-resolution without the need for a negative permittivity. When exploring the parameters of the structure, we take into account the limits of semiconductor fabrication technology based on quantum well stacks. By heavily doping the structure with free electrons, we infer an anisotropic effective medium with a prolate ellipsoid dispersion curve which allows for near-diffractionless propagation of light (similar to an epsilon-near-zero hyperbolic lens). This, coupled with low absorption, allows us to resolve images at the sub-wavelength scale at distances 6 times greater than equivalent natural materials.

Super-Resolving Toraldo Pupils for Radio Astronomical Applications: Current Status and Future Prospects

NASA Astrophysics Data System (ADS)

Olmi, Luca

2017-11-01

More than half a century ago, in 1952, Giuliano Toraldo di Francia suggested that the resolving power of an optical instrument could be improved using a filter consisting of finite-width concentric coronae of different amplitude and phase transmittance, now known as Toraldo Pupils (TPs). The concept of 'super- resolution' was born, and in the cur- rent literature it is generally associated with various meth- ods for improving the angular resolution of an optical imag- ing system beyond the classical diffraction limit. In the mi- crowave range, the first successful laboratory test of TPs was performed in 2003. These first results suggested that TPs could represent a viable approach to achieve super- resolution in Radio Astronomy. We have therefore started a project devoted to an exhaustive study of TPs and how they could be implemented on a radio telescope. In this work we present a summary of the status of this project, and then we will describe our future plans.

A user's guide to localization-based super-resolution fluorescence imaging.

PubMed

Dempsey, Graham T

2013-01-01

Advances in far-field fluorescence microscopy over the past decade have led to the development of super-resolution imaging techniques that provide more than an order of magnitude improvement in spatial resolution compared to conventional light microscopy. One such approach, called Stochastic Optical Reconstruction Microscopy (STORM) uses the sequential, nanometer-scale localization of individual fluorophores to reconstruct a high-resolution image of a structure of interest. This is an attractive method for biological investigation at the nanoscale due to its relative simplicity, both conceptually and practically in the laboratory. Like most research tools, however, the devil is in the details. The aim of this chapter is to serve as a guide for applying STORM to the study of biological samples. This chapter will discuss considerations for choosing a photoswitchable fluorescent probe, preparing a sample, selecting hardware for data acquisition, and collecting and analyzing data for image reconstruction. Copyright © 2013 Elsevier Inc. All rights reserved.

Analysis of replication factories in human cells by super-resolution light microscopy

PubMed Central

2009-01-01

Background DNA replication in human cells is performed in discrete sub-nuclear locations known as replication foci or factories. These factories form in the nucleus during S phase and are sites of DNA synthesis and high local concentrations of enzymes required for chromatin replication. Why these structures are required, and how they are organised internally has yet to be identified. It has been difficult to analyse the structure of these factories as they are small in size and thus below the resolution limit of the standard confocal microscope. We have used stimulated emission depletion (STED) microscopy, which improves on the resolving power of the confocal microscope, to probe the structure of these factories at sub-diffraction limit resolution. Results Using immunofluorescent imaging of PCNA (proliferating cell nuclear antigen) and RPA (replication protein A) we show that factories are smaller in size (approximately 150 nm diameter), and greater in number (up to 1400 in an early S- phase nucleus), than is determined by confocal imaging. The replication inhibitor hydroxyurea caused an approximately 40% reduction in number and a 30% increase in diameter of replication factories, changes that were not clearly identified by standard confocal imaging. Conclusions These measurements for replication factory size now approach the dimensions suggested by electron microscopy. This agreement between these two methods, that use very different sample preparation and imaging conditions, suggests that we have arrived at a true measurement for the size of these structures. The number of individual factories present in a single nucleus that we measure using this system is greater than has been previously reported. This analysis therefore suggests that each replication factory contains fewer active replication forks than previously envisaged. PMID:20015367

Analyzing blinking effects in super resolution localization microscopy with single-photon SPAD imagers

NASA Astrophysics Data System (ADS)

Antolovic, Ivan Michel; Burri, Samuel; Bruschini, Claudio; Hoebe, Ron; Charbon, Edoardo

2016-02-01

For many scientific applications, electron multiplying charge coupled devices (EMCCDs) have been the sensor of choice because of their high quantum efficiency and built-in electron amplification. Lately, many researchers introduced scientific complementary metal-oxide semiconductor (sCMOS) imagers in their instrumentation, so as to take advantage of faster readout and the absence of excess noise. Alternatively, single-photon avalanche diode (SPAD) imagers can provide even faster frame rates and zero readout noise. SwissSPAD is a 1-bit 512×128 SPAD imager, one of the largest of its kind, featuring a frame duration of 6.4 μs. Additionally, a gating mechanism enables photosensitive windows as short as 5 ns with a skew better than 150 ps across the entire array. The SwissSPAD photon detection efficiency (PDE) uniformity is very high, thanks on one side to a photon-to-digital conversion and on the other to a reduced fraction of "hot pixels" or "screamers", which would pollute the image with noise. A low native fill factor was recovered to a large extent using a microlens array, leading to a maximum PDE increase of 12×. This enabled us to detect single fluorophores, as required by ground state depletion followed by individual molecule return imaging microscopy (GSDIM). We show the first super resolution results obtained with a SPAD imager, with an estimated localization uncertainty of 30 nm and resolution of 100 nm. The high time resolution of 6.4 μs can be utilized to explore the dye's photophysics or for dye optimization. We also present the methodology for the blinking analysis on experimental data.

Super-resolution imaging applied to moving object tracking

NASA Astrophysics Data System (ADS)

Swalaganata, Galandaru; Ratna Sulistyaningrum, Dwi; Setiyono, Budi

2017-10-01

Moving object tracking in a video is a method used to detect and analyze changes that occur in an object that being observed. Visual quality and the precision of the tracked target are highly wished in modern tracking system. The fact that the tracked object does not always seem clear causes the tracking result less precise. The reasons are low quality video, system noise, small object, and other factors. In order to improve the precision of the tracked object especially for small object, we propose a two step solution that integrates a super-resolution technique into tracking approach. First step is super-resolution imaging applied into frame sequences. This step was done by cropping the frame in several frame or all of frame. Second step is tracking the result of super-resolution images. Super-resolution image is a technique to obtain high-resolution images from low-resolution images. In this research single frame super-resolution technique is proposed for tracking approach. Single frame super-resolution was a kind of super-resolution that it has the advantage of fast computation time. The method used for tracking is Camshift. The advantages of Camshift was simple calculation based on HSV color that use its histogram for some condition and color of the object varies. The computational complexity and large memory requirements required for the implementation of super-resolution and tracking were reduced and the precision of the tracked target was good. Experiment showed that integrate a super-resolution imaging into tracking technique can track the object precisely with various background, shape changes of the object, and in a good light conditions.

Structured Illumination Microscopy for the Investigation of Synaptic Structure and Function.

PubMed

Hong, Soyon; Wilton, Daniel K; Stevens, Beth; Richardson, Douglas S

2017-01-01

The neuronal synapse is a primary building block of the nervous system to which alterations in structure or function can result in numerous pathologies. Studying its formation and elimination is the key to understanding how brains are wired during development, maintained throughout adulthood plasticity, and disrupted during disease. However, due to its diffraction-limited size, investigations of the synaptic junction at the structural level have primarily relied on labor-intensive electron microscopy or ultra-thin section array tomography. Recent advances in the field of super-resolution light microscopy now allow researchers to image synapses and associated molecules with high-spatial resolution, while taking advantage of the key characteristics of light microscopy, such as easy sample preparation and the ability to detect multiple targets with molecular specificity. One such super-resolution technique, Structured Illumination Microscopy (SIM), has emerged as an attractive method to examine synapse structure and function. SIM requires little change in standard light microscopy sample preparation steps, but results in a twofold improvement in both lateral and axial resolutions compared to widefield microscopy. The following protocol outlines a method for imaging synaptic structures at resolutions capable of resolving the intricacies of these neuronal connections.

Structural analysis of herpes simplex virus by optical super-resolution imaging

NASA Astrophysics Data System (ADS)

Laine, Romain F.; Albecka, Anna; van de Linde, Sebastian; Rees, Eric J.; Crump, Colin M.; Kaminski, Clemens F.

2015-01-01

Herpes simplex virus type-1 (HSV-1) is one of the most widespread pathogens among humans. Although the structure of HSV-1 has been extensively investigated, the precise organization of tegument and envelope proteins remains elusive. Here we use super-resolution imaging by direct stochastic optical reconstruction microscopy (dSTORM) in combination with a model-based analysis of single-molecule localization data, to determine the position of protein layers within virus particles. We resolve different protein layers within individual HSV-1 particles using multi-colour dSTORM imaging and discriminate envelope-anchored glycoproteins from tegument proteins, both in purified virions and in virions present in infected cells. Precise characterization of HSV-1 structure was achieved by particle averaging of purified viruses and model-based analysis of the radial distribution of the tegument proteins VP16, VP1/2 and pUL37, and envelope protein gD. From this data, we propose a model of the protein organization inside the tegument.

Barnacle Bill in Super Resolution from Super Panorama

NASA Image and Video Library

1998-07-03

"Barnacle Bill" is a small rock immediately west-northwest of the Mars Pathfinder lander and was the first rock visited by the Sojourner Rover's alpha proton X-ray spectrometer (APXS) instrument. This image shows super resolution techniques applied to the first APXS target rock, which was never imaged with the rover's forward cameras. Super resolution was applied to help to address questions about the texture of this rock and what it might tell us about its mode of origin. This view of Barnacle Bill was produced by combining the "Super Panorama" frames from the IMP camera. Super resolution was applied to help to address questions about the texture of these rocks and what it might tell us about their mode of origin. The composite color frames that make up this anaglyph were produced for both the right and left eye of the IMP. The composites consist of 7 frames in the right eye and 8 frames in the left eye, taken with different color filters that were enlarged by 500% and then co-added using Adobe Photoshop to produce, in effect, a super-resolution panchromatic frame that is sharper than an individual frame would be. These panchromatic frames were then colorized with the red, green, and blue filtered images from the same sequence. The color balance was adjusted to approximate the true color of Mars. The anaglyph view was produced by combining the left with the right eye color composite frames by assigning the left eye composite view to the red color plane and the right eye composite view to the green and blue color planes (cyan), to produce a stereo anaglyph mosaic. This mosaic can be viewed in 3-D on your computer monitor or in color print form by wearing red-blue 3-D glasses. http://photojournal.jpl.nasa.gov/catalog/PIA01409

Parallel detecting super-resolution microscopy using correlation based image restoration

NASA Astrophysics Data System (ADS)

Yu, Zhongzhi; Liu, Shaocong; Zhu, Dazhao; Kuang, Cuifang; Liu, Xu

2017-12-01

A novel approach to achieve the image restoration is proposed in which each detector's relative position in the detector array is no longer a necessity. We can identify each detector's relative location by extracting a certain area from one of the detector's image and scanning it on other detectors' images. According to this location, we can generate the point spread functions (PSF) for each detector and perform deconvolution for image restoration. Equipped with this method, the microscope with discretionally designed detector array can be easily constructed without the concern of exact relative locations of detectors. The simulated results and experimental results show the total improvement in resolution with a factor of 1.7 compared to conventional confocal fluorescence microscopy. With the significant enhancement in resolution and easiness for application of this method, this novel method should have potential for a wide range of application in fluorescence microscopy based on parallel detecting.

Super-resolution for asymmetric resolution of FIB-SEM 3D imaging using AI with deep learning.

PubMed

Hagita, Katsumi; Higuchi, Takeshi; Jinnai, Hiroshi

2018-04-12

Scanning electron microscopy equipped with a focused ion beam (FIB-SEM) is a promising three-dimensional (3D) imaging technique for nano- and meso-scale morphologies. In FIB-SEM, the specimen surface is stripped by an ion beam and imaged by an SEM installed orthogonally to the FIB. The lateral resolution is governed by the SEM, while the depth resolution, i.e., the FIB milling direction, is determined by the thickness of the stripped thin layer. In most cases, the lateral resolution is superior to the depth resolution; hence, asymmetric resolution is generated in the 3D image. Here, we propose a new approach based on an image-processing or deep-learning-based method for super-resolution of 3D images with such asymmetric resolution, so as to restore the depth resolution to achieve symmetric resolution. The deep-learning-based method learns from high-resolution sub-images obtained via SEM and recovers low-resolution sub-images parallel to the FIB milling direction. The 3D morphologies of polymeric nano-composites are used as test images, which are subjected to the deep-learning-based method as well as conventional methods. We find that the former yields superior restoration, particularly as the asymmetric resolution is increased. Our super-resolution approach for images having asymmetric resolution enables observation time reduction.

3-D Cellular Ultrastructure Can Be Resolved by X-ray Microscopy | Center for Cancer Research

Cancer.gov

X-ray microscopy (XRM) is more rapid than cryoelectron tomography or super-resolution fluorescence microscopy and could fill an important gap in current technologies used to investigate in situ three-dimensional structure of cells. New XRM methods developed by first author Gerd Schneider, Ph.D., working with James McNally. Ph.D., and a team of colleagues, is capable of

The ultimate picture-the combination of live cell superresolution microscopy and single molecule tracking yields highest spatio-temporal resolution.

PubMed

Dersch, Simon; Graumann, Peter L

2018-06-01

We are witnessing a breathtaking development in light (fluorescence) microscopy, where structures can be resolved down to the size of a ribosome within cells. This has already yielded surprising insight into the subcellular structure of cells, including the smallest cells, bacteria. Moreover, it has become possible to visualize and track single fluorescent protein fusions in real time, and quantify molecule numbers within individual cells. Combined, super resolution and single molecule tracking are pushing the limits of our understanding of the spatio-temporal organization even of the smallest cells to an unprecedented depth. Copyright © 2017 Elsevier Ltd. All rights reserved.

Custom Super-Resolution Microscope for the Structural Analysis of Nanostructures

DTIC Science & Technology

2018-05-29

research community. As part of our validation of the new design approach, we performed two - color imaging of pairs of adjacent oligo probes hybridized...nanostructures and biological targets. Our microscope features a large field of view and custom optics that facilitate 3D imaging and enhanced contrast in...our imaging throughput by creating two microscopy platforms for high-throughput, super-resolution materials characterization, with the AO set-up being

Super-resolution reconstruction of hyperspectral images.

PubMed

Akgun, Toygar; Altunbasak, Yucel; Mersereau, Russell M

2005-11-01

Hyperspectral images are used for aerial and space imagery applications, including target detection, tracking, agricultural, and natural resource exploration. Unfortunately, atmospheric scattering, secondary illumination, changing viewing angles, and sensor noise degrade the quality of these images. Improving their resolution has a high payoff, but applying super-resolution techniques separately to every spectral band is problematic for two main reasons. First, the number of spectral bands can be in the hundreds, which increases the computational load excessively. Second, considering the bands separately does not make use of the information that is present across them. Furthermore, separate band super-resolution does not make use of the inherent low dimensionality of the spectral data, which can effectively be used to improve the robustness against noise. In this paper, we introduce a novel super-resolution method for hyperspectral images. An integral part of our work is to model the hyperspectral image acquisition process. We propose a model that enables us to represent the hyperspectral observations from different wavelengths as weighted linear combinations of a small number of basis image planes. Then, a method for applying super resolution to hyperspectral images using this model is presented. The method fuses information from multiple observations and spectral bands to improve spatial resolution and reconstruct the spectrum of the observed scene as a combination of a small number of spectral basis functions.

Saturated virtual fluorescence emission difference microscopy based on detector array

NASA Astrophysics Data System (ADS)

Liu, Shaocong; Sun, Shiyi; Kuang, Cuifang; Ge, Baoliang; Wang, Wensheng; Liu, Xu

2017-07-01

Virtual fluorescence emission difference microscopy (vFED) has been proposed recently to enhance the lateral resolution of confocal microscopy with a detector array, implemented by scanning a doughnut-shaped pattern. Theoretically, the resolution can be enhanced by around 1.3-fold compared with that in confocal microscopy. For further improvement of the resolving ability of vFED, a novel method is presented utilizing fluorescence saturation for super-resolution imaging, which we called saturated virtual fluorescence emission difference microscopy (svFED). With a point detector array, matched solid and hollow point spread functions (PSF) can be obtained by photon reassignment, and the difference results between them can be used to boost the transverse resolution. Results show that the diffraction barrier can be surpassed by at least 34% compared with that in vFED and the resolution is around 2-fold higher than that in confocal microscopy.

On Super-Resolution and the MUSIC Algorithm,

DTIC Science & Technology

1985-05-01

SUPER-RESOLUTION AND THE MUSIC ALGORITHM AUTHOR: G D de Villiers DATE: May 1985 SUMMARY Simulation results for phased array signal processing using...the MUSIC algorithm are presented. The model used is more realistic than previous ones and it gives an indication as to how the algorithm would perform...resolution ON SUPER-RESOLUTION AND THE MUSIC ALGORITHM 1. INTRODUCTION At present there is a considerable amount of interest in "high-resolution" b

Quantitative super-resolution imaging of Bruchpilot distinguishes active zone states

NASA Astrophysics Data System (ADS)

Ehmann, Nadine; van de Linde, Sebastian; Alon, Amit; Ljaschenko, Dmitrij; Keung, Xi Zhen; Holm, Thorge; Rings, Annika; Diantonio, Aaron; Hallermann, Stefan; Ashery, Uri; Heckmann, Manfred; Sauer, Markus; Kittel, Robert J.

2014-08-01

The precise molecular architecture of synaptic active zones (AZs) gives rise to different structural and functional AZ states that fundamentally shape chemical neurotransmission. However, elucidating the nanoscopic protein arrangement at AZs is impeded by the diffraction-limited resolution of conventional light microscopy. Here we introduce new approaches to quantify endogenous protein organization at single-molecule resolution in situ with super-resolution imaging by direct stochastic optical reconstruction microscopy (dSTORM). Focusing on the Drosophila neuromuscular junction (NMJ), we find that the AZ cytomatrix (CAZ) is composed of units containing ~137 Bruchpilot (Brp) proteins, three quarters of which are organized into about 15 heptameric clusters. We test for a quantitative relationship between CAZ ultrastructure and neurotransmitter release properties by engaging Drosophila mutants and electrophysiology. Our results indicate that the precise nanoscopic organization of Brp distinguishes different physiological AZ states and link functional diversification to a heretofore unrecognized neuronal gradient of the CAZ ultrastructure.

Super-resolution structured illumination in optically thick specimens without fluorescent tagging

NASA Astrophysics Data System (ADS)

Hoffman, Zachary R.; DiMarzio, Charles A.

2017-11-01

This research extends the work of Hoffman et al. to provide both sectioning and super-resolution using random patterns within thick specimens. Two methods of processing structured illumination in reflectance have been developed without the need for a priori knowledge of either the optical system or the modulation patterns. We explore the use of two deconvolution algorithms that assume either Gaussian or sparse priors. This paper will show that while both methods accomplish their intended objective, the sparse priors method provides superior resolution and contrast against all tested targets, providing anywhere from ˜1.6× to ˜2× resolution enhancement. The methods developed here can reasonably be implemented to work without a priori knowledge about the patterns or point spread function. Further, all experiments are run using an incoherent light source, unknown random modulation patterns, and without the use of fluorescent tagging. These additional modifications are challenging, but the generalization of these methods makes them prime candidates for clinical application, providing super-resolved noninvasive sectioning in vivo.

Single-image super-resolution based on Markov random field and contourlet transform

NASA Astrophysics Data System (ADS)

Wu, Wei; Liu, Zheng; Gueaieb, Wail; He, Xiaohai

2011-04-01

Learning-based methods are well adopted in image super-resolution. In this paper, we propose a new learning-based approach using contourlet transform and Markov random field. The proposed algorithm employs contourlet transform rather than the conventional wavelet to represent image features and takes into account the correlation between adjacent pixels or image patches through the Markov random field (MRF) model. The input low-resolution (LR) image is decomposed with the contourlet transform and fed to the MRF model together with the contourlet transform coefficients from the low- and high-resolution image pairs in the training set. The unknown high-frequency components/coefficients for the input low-resolution image are inferred by a belief propagation algorithm. Finally, the inverse contourlet transform converts the LR input and the inferred high-frequency coefficients into the super-resolved image. The effectiveness of the proposed method is demonstrated with the experiments on facial, vehicle plate, and real scene images. A better visual quality is achieved in terms of peak signal to noise ratio and the image structural similarity measurement.

Design of discrete and continuous super-resolving Toraldo pupils in the microwave range.

PubMed

Olmi, Luca; Bolli, Pietro; Mugnai, Daniela

2018-03-20

The concept of super-resolution refers to various methods for improving the angular resolution of an optical imaging system beyond the classical diffraction limit. In optical microscopy, several techniques have been successfully developed with the aim of narrowing the central lobe of the illumination point spread function. In astronomy, however, no similar techniques can be used. A feasible method to design antennas and telescopes with angular resolution better than the diffraction limit consists of using variable transmittance pupils. In particular, discrete binary phase masks (0 or π ) with finite phase-jump positions, known as Toraldo pupils (TPs), have the advantage of being easy to fabricate but offer relatively little flexibility in terms of achieving specific trade-offs between design parameters, such as the angular width of the main lobe and the intensity of sidelobes. In this paper, we show that a complex transmittance filter (equivalent to a continuous TP, i.e., consisting of infinitely narrow concentric rings) can achieve more easily the desired trade-off between design parameters. We also show how the super-resolution effect can be generated with both amplitude- and phase-only masks and confirm the expected performance with electromagnetic numerical simulations in the microwave range.

Infrared super-resolution imaging based on compressed sensing

NASA Astrophysics Data System (ADS)

Sui, Xiubao; Chen, Qian; Gu, Guohua; Shen, Xuewei

2014-03-01

The theoretical basis of traditional infrared super-resolution imaging method is Nyquist sampling theorem. The reconstruction premise is that the relative positions of the infrared objects in the low-resolution image sequences should keep fixed and the image restoration means is the inverse operation of ill-posed issues without fixed rules. The super-resolution reconstruction ability of the infrared image, algorithm's application area and stability of reconstruction algorithm are limited. To this end, we proposed super-resolution reconstruction method based on compressed sensing in this paper. In the method, we selected Toeplitz matrix as the measurement matrix and realized it by phase mask method. We researched complementary matching pursuit algorithm and selected it as the recovery algorithm. In order to adapt to the moving target and decrease imaging time, we take use of area infrared focal plane array to acquire multiple measurements at one time. Theoretically, the method breaks though Nyquist sampling theorem and can greatly improve the spatial resolution of the infrared image. The last image contrast and experiment data indicate that our method is effective in improving resolution of infrared images and is superior than some traditional super-resolution imaging method. The compressed sensing super-resolution method is expected to have a wide application prospect.

Dissecting the actin cortex density and membrane-cortex distance in living cells by super-resolution microscopy

NASA Astrophysics Data System (ADS)

Clausen, M. P.; Colin-York, H.; Schneider, F.; Eggeling, C.; Fritzsche, M.

2017-02-01

Nanoscale spacing between the plasma membrane and the underlying cortical actin cytoskeleton profoundly modulates cellular morphology, mechanics, and function. Measuring this distance has been a key challenge in cell biology. Current methods for dissecting the nanoscale spacing either limit themselves to complex survey design using fixed samples or rely on diffraction-limited fluorescence imaging whose spatial resolution is insufficient to quantify distances on the nanoscale. Using dual-color super-resolution STED (stimulated-emission-depletion) microscopy, we here overcome this challenge and accurately measure the density distribution of the cortical actin cytoskeleton and the distance between the actin cortex and the membrane in live Jurkat T-cells. We found an asymmetric cortical actin density distribution with a mean width of 230 (+105/-125) nm. The spatial distances measured between the maximum density peaks of the cortex and the membrane were bi-modally distributed with mean values of 50  ±  15 nm and 120  ±  40 nm, respectively. Taken together with the finite width of the cortex, our results suggest that in some regions the cortical actin is closer than 10 nm to the membrane and a maximum of 20 nm in others.

Photon-efficient super-resolution laser radar

NASA Astrophysics Data System (ADS)

Shin, Dongeek; Shapiro, Jeffrey H.; Goyal, Vivek K.

2017-08-01

The resolution achieved in photon-efficient active optical range imaging systems can be low due to non-idealities such as propagation through a diffuse scattering medium. We propose a constrained optimization-based frame- work to address extremes in scarcity of photons and blurring by a forward imaging kernel. We provide two algorithms for the resulting inverse problem: a greedy algorithm, inspired by sparse pursuit algorithms; and a convex optimization heuristic that incorporates image total variation regularization. We demonstrate that our framework outperforms existing deconvolution imaging techniques in terms of peak signal-to-noise ratio. Since our proposed method is able to super-resolve depth features using small numbers of photon counts, it can be useful for observing fine-scale phenomena in remote sensing through a scattering medium and through-the-skin biomedical imaging applications.

Self-interference 3D super-resolution microscopy for deep tissue investigations.

PubMed

Bon, Pierre; Linarès-Loyez, Jeanne; Feyeux, Maxime; Alessandri, Kevin; Lounis, Brahim; Nassoy, Pierre; Cognet, Laurent

2018-06-01

Fluorescence localization microscopy has achieved near-molecular resolution capable of revealing ultra-structures, with a broad range of applications, especially in cellular biology. However, it remains challenging to attain such resolution in three dimensions and inside biological tissues beyond the first cell layer. Here we introduce SELFI, a framework for 3D single-molecule localization within multicellular specimens and tissues. The approach relies on self-interference generated within the microscope's point spread function (PSF) to simultaneously encode equiphase and intensity fluorescence signals, which together provide the 3D position of an emitter. We combined SELFI with conventional localization microscopy to visualize F-actin 3D filament networks and reveal the spatial distribution of the transcription factor OCT4 in human induced pluripotent stem cells at depths up to 50 µm inside uncleared tissue spheroids. SELFI paves the way to nanoscale investigations of native cellular processes in intact tissues.

A Global Approach for Quantitative Super Resolution and Electron Microscopy on Cryo and Epoxy Sections Using Self-labeling Protein Tags.

PubMed

Müller, Andreas; Neukam, Martin; Ivanova, Anna; Sönmez, Anke; Münster, Carla; Kretschmar, Susanne; Kalaidzidis, Yannis; Kurth, Thomas; Verbavatz, Jean-Marc; Solimena, Michele

2017-02-02

Correlative light and electron microscopy (CLEM) is a powerful approach to investigate the molecular ultrastructure of labeled cell compartments. However, quantitative CLEM studies are rare, mainly due to small sample sizes and the sensitivity of fluorescent proteins to strong fixatives and contrasting reagents for EM. Here, we show that fusion of a self-labeling protein to insulin allows for the quantification of age-distinct insulin granule pools in pancreatic beta cells by a combination of super resolution and transmission electron microscopy on Tokuyasu cryosections. In contrast to fluorescent proteins like GFP organic dyes covalently bound to self-labeling proteins retain their fluorescence also in epoxy resin following high pressure freezing and freeze substitution, or remarkably even after strong chemical fixation. This enables for the assessment of age-defined granule morphology and degradation. Finally, we demonstrate that this CLEM protocol is highly versatile, being suitable for single and dual fluorescent labeling and detection of different proteins with optimal ultrastructure preservation and contrast.

3-D Cellular Ultrastructure Can Be Resolved by X-ray Microscopy | Center for Cancer Research

Cancer.gov

X-ray microscopy (XRM) is more rapid than cryoelectron tomography or super-resolution fluorescence microscopy and could fill an important gap in current technologies used to investigate in situ three-dimensional structure of cells. New XRM methods developed by first author Gerd Schneider, Ph.D., working with James McNally. Ph.D., and a team of colleagues, is capable of revealing full cellular ultrastructure without requiring fixation, staining, or sectioning.

PREFACE: Time-resolved scanning tunnelling microscopy Time-resolved scanning tunnelling microscopy

NASA Astrophysics Data System (ADS)

Zandvliet, Harold J. W.; Lin, Nian

2010-07-01

Scanning tunnelling microscopy has revolutionized our ability to image, manipulate, and investigate solid surfaces on the length scale of individual atoms and molecules. The strength of this technique lies in its imaging capabilities, since for many scientists 'seeing is believing'. However, scanning tunnelling microscopy also suffers from a severe limitation, namely its poor time resolution. Recording a scanning tunnelling microscopy image typically requires a few tens of seconds for a conventional scanning tunnelling microscope to a fraction of a second for a specially designed fast scanning tunnelling microscope. Designing and building such a fast scanning tunnelling microscope is a formidable task in itself and therefore, only a limited number of these microscopes have been built [1]. There is, however, another alternative route to significantly enhance the time resolution of a scanning tunnelling microscope. In this alternative method, the tunnelling current is measured as a function of time with the feedback loop switched off. The time resolution is determined by the bandwidth of the IV converter rather than the cut-off frequency of the feedback electronics. Such an approach requires a stable microscope and goes, of course, at the expense of spatial information. In this issue, we have collected a set of papers that gives an impression of the current status of this rapidly emerging field [2]. One of the very first attempts to extract information from tunnel current fluctuations was reported by Tringides' group in the mid-1990s [3]. They showed that the collective diffusion coefficient can be extracted from the autocorrelation of the time-dependent tunnelling current fluctuations produced by atom motion in and out of the tunnelling junction. In general, current-time traces provide direct information on switching/conformation rates and distributions of residence times. In the case where these processes are thermally induced it is rather straightforward to map

Time multiplexing super-resolution nanoscopy based on the Brownian motion of gold nanoparticles

NASA Astrophysics Data System (ADS)

Ilovitsh, Tali; Ilovitsh, Asaf; Wagner, Omer; Zalevsky, Zeev

2017-02-01

Super-resolution localization microscopy can overcome the diffraction limit and achieve a tens of order improvement in resolution. It requires labeling the sample with fluorescent probes followed with their repeated cycles of activation and photobleaching. This work presents an alternative approach that is free from direct labeling and does not require the activation and photobleaching cycles. Fluorescently labeled gold nanoparticles in a solution are distributed on top of the sample. The nanoparticles move in a random Brownian motion, and interact with the sample. By obscuring different areas in the sample, the nanoparticles encode the sub-wavelength features. A sequence of images of the sample is captured and decoded by digital post processing to create the super-resolution image. The achievable resolution is limited by the additive noise and the size of the nanoparticles. Regular nanoparticles with diameter smaller than 100nm are barely seen in a conventional bright field microscope, thus fluorescently labeled gold nanoparticles were used, with proper

Demosaiced pixel super-resolution for multiplexed holographic color imaging

PubMed Central

Wu, Yichen; Zhang, Yibo; Luo, Wei; Ozcan, Aydogan

2016-01-01

To synthesize a holographic color image, one can sequentially take three holograms at different wavelengths, e.g., at red (R), green (G) and blue (B) parts of the spectrum, and digitally merge them. To speed up the imaging process by a factor of three, a Bayer color sensor-chip can also be used to demultiplex three wavelengths that simultaneously illuminate the sample and digitally retrieve individual set of holograms using the known transmission spectra of the Bayer color filters. However, because the pixels of different channels (R, G, B) on a Bayer color sensor are not at the same physical location, conventional demosaicing techniques generate color artifacts in holographic imaging using simultaneous multi-wavelength illumination. Here we demonstrate that pixel super-resolution can be merged into the color de-multiplexing process to significantly suppress the artifacts in wavelength-multiplexed holographic color imaging. This new approach, termed Demosaiced Pixel Super-Resolution (D-PSR), generates color images that are similar in performance to sequential illumination at three wavelengths, and therefore improves the speed of holographic color imaging by 3-fold. D-PSR method is broadly applicable to holographic microscopy applications, where high-resolution imaging and multi-wavelength illumination are desired. PMID:27353242

Super-resolution imaging based on the temperature-dependent electron-phonon collision frequency effect of metal thin films

NASA Astrophysics Data System (ADS)

Ding, Chenliang; Wei, Jingsong; Xiao, Mufei

2018-05-01

We herein propose a far-field super-resolution imaging with metal thin films based on the temperature-dependent electron-phonon collision frequency effect. In the proposed method, neither fluorescence labeling nor any special properties are required for the samples. The 100 nm lands and 200 nm grooves on the Blu-ray disk substrates were clearly resolved and imaged through a laser scanning microscope of wavelength 405 nm. The spot size was approximately 0.80 μm , and the imaging resolution of 1/8 of the laser spot size was experimentally obtained. This work can be applied to the far-field super-resolution imaging of samples with neither fluorescence labeling nor any special properties.

Measuring the performance of super-resolution reconstruction algorithms

NASA Astrophysics Data System (ADS)

Dijk, Judith; Schutte, Klamer; van Eekeren, Adam W. M.; Bijl, Piet

2012-06-01

For many military operations situational awareness is of great importance. This situational awareness and related tasks such as Target Acquisition can be acquired using cameras, of which the resolution is an important characteristic. Super resolution reconstruction algorithms can be used to improve the effective sensor resolution. In order to judge these algorithms and the conditions under which they operate best, performance evaluation methods are necessary. This evaluation, however, is not straightforward for several reasons. First of all, frequency-based evaluation techniques alone will not provide a correct answer, due to the fact that they are unable to discriminate between structure-related and noise-related effects. Secondly, most super-resolution packages perform additional image enhancement techniques such as noise reduction and edge enhancement. As these algorithms improve the results they cannot be evaluated separately. Thirdly, a single high-resolution ground truth is rarely available. Therefore, evaluation of the differences in high resolution between the estimated high resolution image and its ground truth is not that straightforward. Fourth, different artifacts can occur due to super-resolution reconstruction, which are not known on forehand and hence are difficult to evaluate. In this paper we present a set of new evaluation techniques to assess super-resolution reconstruction algorithms. Some of these evaluation techniques are derived from processing on dedicated (synthetic) imagery. Other evaluation techniques can be evaluated on both synthetic and natural images (real camera data). The result is a balanced set of evaluation algorithms that can be used to assess the performance of super-resolution reconstruction algorithms.

Comparison of Confocal and Super-Resolution Reflectance Imaging of Metal Oxide Nanoparticles

PubMed Central

Guggenheim, Emily J.; Khan, Abdullah; Pike, Jeremy; Chang, Lynne; Lynch, Iseult; Rappoport, Joshua Z.

2016-01-01

The potential for human exposure to manufactured nanoparticles (NPs) has increased in recent years, in part through the incorporation of engineered particles into a wide range of commercial goods and medical applications. NP are ideal candidates for use as therapeutic and diagnostic tools within biomedicine, however concern exists regarding their efficacy and safety. Thus, developing techniques for the investigation of NP uptake into cells is critically important. Current intracellular NP investigations rely on the use of either Transmission Electron Microscopy (TEM), which provides ultrahigh resolution, but involves cumbersome sample preparation rendering the technique incompatible with live cell imaging, or fluorescent labelling, which suffers from photobleaching, poor bioconjugation and, often, alteration of NP surface properties. Reflected light imaging provides an alternative non-destructive label free technique well suited, but not limited to, the visualisation of NP uptake within model systems, such as cells. Confocal reflectance microscopy provides optical sectioning and live imaging capabilities, with little sample preparation. However confocal microscopy is diffraction limited, thus the X-Y resolution is restricted to ~250 nm, substantially larger than the <100 nm size of NPs. Techniques such as super-resolution light microscopy overcome this fundamental limitation, providing increased X-Y resolution. The use of Reflectance SIM (R-SIM) for NP imaging has previously only been demonstrated on custom built microscopes, restricting the widespread use and limiting NP investigations. This paper demonstrates the use of a commercial SIM microscope for the acquisition of super-resolution reflectance data with X-Y resolution of 115 nm, a greater than two-fold increase compared to that attainable with RCM. This increase in resolution is advantageous for visualising small closely spaced structures, such as NP clusters, previously unresolvable by RCM. This is

Super-Resolution Imaging of Molecular Emission Spectra and Single Molecule Spectral Fluctuations

PubMed Central

Mlodzianoski, Michael J.; Curthoys, Nikki M.; Gunewardene, Mudalige S.; Carter, Sean; Hess, Samuel T.

2016-01-01

Localization microscopy can image nanoscale cellular details. To address biological questions, the ability to distinguish multiple molecular species simultaneously is invaluable. Here, we present a new version of fluorescence photoactivation localization microscopy (FPALM) which detects the emission spectrum of each localized molecule, and can quantify changes in emission spectrum of individual molecules over time. This information can allow for a dramatic increase in the number of different species simultaneously imaged in a sample, and can create super-resolution maps showing how single molecule emission spectra vary with position and time in a sample. PMID:27002724

Nanoscale Membrane Curvature detected by Polarized Localization Microscopy

NASA Astrophysics Data System (ADS)

Kelly, Christopher; Maarouf, Abir; Woodward, Xinxin

Nanoscale membrane curvature is a necessary component of countless cellular processes. Here we present Polarized Localization Microscopy (PLM), a super-resolution optical imaging technique that enables the detection of nanoscale membrane curvature with order-of-magnitude improvements over comparable optical techniques. PLM combines the advantages of polarized total internal reflection fluorescence microscopy and fluorescence localization microscopy to reveal single-fluorophore locations and orientations without reducing localization precision by point spread function manipulation. PLM resolved nanoscale membrane curvature of a supported lipid bilayer draped over polystyrene nanoparticles on a glass coverslip, thus creating a model membrane with coexisting flat and curved regions and membrane radii of curvature as small as 20 nm. Further, PLM provides single-molecule trajectories and the aggregation of curvature-inducing proteins with super-resolution to reveal the correlated effects of membrane curvature, dynamics, and molecular sorting. For example, cholera toxin subunit B has been observed to induce nanoscale membrane budding and concentrate at the bud neck. PLM reveals a previously hidden and critical information of membrane topology.

Image super-resolution via sparse representation.

PubMed

Yang, Jianchao; Wright, John; Huang, Thomas S; Ma, Yi

2010-11-01

This paper presents a new approach to single-image super-resolution, based on sparse signal representation. Research on image statistics suggests that image patches can be well-represented as a sparse linear combination of elements from an appropriately chosen over-complete dictionary. Inspired by this observation, we seek a sparse representation for each patch of the low-resolution input, and then use the coefficients of this representation to generate the high-resolution output. Theoretical results from compressed sensing suggest that under mild conditions, the sparse representation can be correctly recovered from the downsampled signals. By jointly training two dictionaries for the low- and high-resolution image patches, we can enforce the similarity of sparse representations between the low resolution and high resolution image patch pair with respect to their own dictionaries. Therefore, the sparse representation of a low resolution image patch can be applied with the high resolution image patch dictionary to generate a high resolution image patch. The learned dictionary pair is a more compact representation of the patch pairs, compared to previous approaches, which simply sample a large amount of image patch pairs, reducing the computational cost substantially. The effectiveness of such a sparsity prior is demonstrated for both general image super-resolution and the special case of face hallucination. In both cases, our algorithm generates high-resolution images that are competitive or even superior in quality to images produced by other similar SR methods. In addition, the local sparse modeling of our approach is naturally robust to noise, and therefore the proposed algorithm can handle super-resolution with noisy inputs in a more unified framework.

From single-molecule spectroscopy to super-resolution imaging of the neuron: a review

PubMed Central

Laine, Romain F; Kaminski Schierle, Gabriele S; van de Linde, Sebastian; Kaminski, Clemens F

2016-01-01

Abstract For more than 20 years, single-molecule spectroscopy has been providing invaluable insights into nature at the molecular level. The field has received a powerful boost with the development of the technique into super-resolution imaging methods, ca. 10 years ago, which overcome the limitations imposed by optical diffraction. Today, single molecule super-resolution imaging is routinely used in the study of macromolecular function and structure in the cell. Concomitantly, computational methods have been developed that provide information on numbers and positions of molecules at the nanometer-scale. In this overview, we outline the technical developments that have led to the emergence of localization microscopy techniques from single-molecule spectroscopy. We then provide a comprehensive review on the application of the technique in the field of neuroscience research. PMID:28809165

Time-resolved wide-field optically sectioned fluorescence microscopy

NASA Astrophysics Data System (ADS)

Dupuis, Guillaume; Benabdallah, Nadia; Chopinaud, Aurélien; Mayet, Céline; Lévêque-Fort, Sandrine

2013-02-01

We present the implementation of a fast wide-field optical sectioning technique called HiLo microscopy on a fluorescence lifetime imaging microscope. HiLo microscopy is based on the fusion of two images, one with structured illumination and another with uniform illumination. Optically sectioned images are then digitally generated thanks to a fusion algorithm. HiLo images are comparable in quality with confocal images but they can be acquired faster over larger fields of view. We obtain 4D imaging by combining HiLo optical sectioning, time-gated detection, and z-displacement. We characterize the performances of this set-up in terms of 3D spatial resolution and time-resolved capabilities in both fixed- and live-cell imaging modes.

Nobel Prize Recipient Eric Betzig Presents Lecture on Efforts to Improve High-Resolution Microscopy | Poster

Cancer.gov

Eric Betzig, Ph.D., a 2014 recipient of the Nobel Prize in Chemistry and a scientist at Janelia Research Campus (JRC), Howard Hughes Medical Institute, in Ashburn, Va., visited NCI at Frederick on Sept. 10 to present a Distinguished Scientist lecture and discuss the latest high-resolution microscopy techniques. Betzig co-invented photoactivation localization microscopy (PALM) in collaboration with scientists at NIH. PALM achieves 10-fold improvement in spatial resolution of cells, going from the resolution limit of approximately 250 nm in standard optical microscopy down to approximately 20 nm, thus producing a so-called “super-resolution” image. Spatial resolution refers to the clarity of an image or, in other words, the smallest details that can be observed from an image.

Robust video super-resolution with registration efficiency adaptation

NASA Astrophysics Data System (ADS)

Zhang, Xinfeng; Xiong, Ruiqin; Ma, Siwei; Zhang, Li; Gao, Wen

2010-07-01

Super-Resolution (SR) is a technique to construct a high-resolution (HR) frame by fusing a group of low-resolution (LR) frames describing the same scene. The effectiveness of the conventional super-resolution techniques, when applied on video sequences, strongly relies on the efficiency of motion alignment achieved by image registration. Unfortunately, such efficiency is limited by the motion complexity in the video and the capability of adopted motion model. In image regions with severe registration errors, annoying artifacts usually appear in the produced super-resolution video. This paper proposes a robust video super-resolution technique that adapts itself to the spatially-varying registration efficiency. The reliability of each reference pixel is measured by the corresponding registration error and incorporated into the optimization objective function of SR reconstruction. This makes the SR reconstruction highly immune to the registration errors, as outliers with higher registration errors are assigned lower weights in the objective function. In particular, we carefully design a mechanism to assign weights according to registration errors. The proposed superresolution scheme has been tested with various video sequences and experimental results clearly demonstrate the effectiveness of the proposed method.

Framework for Detection and Localization of Extreme Climate Event with Pixel Recursive Super Resolution

NASA Astrophysics Data System (ADS)

Kim, S. K.; Lee, J.; Zhang, C.; Ames, S.; Williams, D. N.

2017-12-01

Deep learning techniques have been successfully applied to solve many problems in climate and geoscience using massive-scaled observed and modeled data. For extreme climate event detections, several models based on deep neural networks have been recently proposed and attend superior performance that overshadows all previous handcrafted expert based method. The issue arising, though, is that accurate localization of events requires high quality of climate data. In this work, we propose framework capable of detecting and localizing extreme climate events in very coarse climate data. Our framework is based on two models using deep neural networks, (1) Convolutional Neural Networks (CNNs) to detect and localize extreme climate events, and (2) Pixel recursive recursive super resolution model to reconstruct high resolution climate data from low resolution climate data. Based on our preliminary work, we have presented two CNNs in our framework for different purposes, detection and localization. Our results using CNNs for extreme climate events detection shows that simple neural nets can capture the pattern of extreme climate events with high accuracy from very coarse reanalysis data. However, localization accuracy is relatively low due to the coarse resolution. To resolve this issue, the pixel recursive super resolution model reconstructs the resolution of input of localization CNNs. We present a best networks using pixel recursive super resolution model that synthesizes details of tropical cyclone in ground truth data while enhancing their resolution. Therefore, this approach not only dramat- ically reduces the human effort, but also suggests possibility to reduce computing cost required for downscaling process to increase resolution of data.

Watching entangled circular DNA in real time with super-resolution

NASA Astrophysics Data System (ADS)

Jee, Ah-Young; Kim, Hyeongju; Granick, Steve

In this talk, we will show how we unraveled the conformational dynamics of entangled ring-shaped polymers in network, which is one of the most well-known problems in polymer physics, using deep imaging based on super-resolution fluorescence imaging, stimulated emission depletion (STED) microscopy. By using home-written software, we obtained the statistics of each of the hundreds of molecules, mapping out a large statistical distribution. Through inspection we not only found some aspects of the classic understanding of polymers, but some surprising aspects as well.

A multi-emitter fitting algorithm for potential live cell super-resolution imaging over a wide range of molecular densities.

PubMed

Takeshima, T; Takahashi, T; Yamashita, J; Okada, Y; Watanabe, S

2018-05-25

Multi-emitter fitting algorithms have been developed to improve the temporal resolution of single-molecule switching nanoscopy, but the molecular density range they can analyse is narrow and the computation required is intensive, significantly limiting their practical application. Here, we propose a computationally fast method, wedged template matching (WTM), an algorithm that uses a template matching technique to localise molecules at any overlapping molecular density from sparse to ultrahigh density with subdiffraction resolution. WTM achieves the localization of overlapping molecules at densities up to 600 molecules μm -2 with a high detection sensitivity and fast computational speed. WTM also shows localization precision comparable with that of DAOSTORM (an algorithm for high-density super-resolution microscopy), at densities up to 20 molecules μm -2 , and better than DAOSTORM at higher molecular densities. The application of WTM to a high-density biological sample image demonstrated that it resolved protein dynamics from live cell images with subdiffraction resolution and a temporal resolution of several hundred milliseconds or less through a significant reduction in the number of camera images required for a high-density reconstruction. WTM algorithm is a computationally fast, multi-emitter fitting algorithm that can analyse over a wide range of molecular densities. The algorithm is available through the website. https://doi.org/10.17632/bf3z6xpn5j.1. © 2018 The Authors. Journal of Microscopy published by JohnWiley & Sons Ltd on behalf of Royal Microscopical Society.

Enhanced simulator software for image validation and interpretation for multimodal localization super-resolution fluorescence microscopy

NASA Astrophysics Data System (ADS)

Erdélyi, Miklós; Sinkó, József; Gajdos, Tamás.; Novák, Tibor

2017-02-01

Optical super-resolution techniques such as single molecule localization have become one of the most dynamically developed areas in optical microscopy. These techniques routinely provide images of fixed cells or tissues with sub-diffraction spatial resolution, and can even be applied for live cell imaging under appropriate circumstances. Localization techniques are based on the precise fitting of the point spread functions (PSF) to the measured images of stochastically excited, identical fluorescent molecules. These techniques require controlling the rate between the on, off and the bleached states, keeping the number of active fluorescent molecules at an optimum value, so their diffraction limited images can be detected separately both spatially and temporally. Because of the numerous (and sometimes unknown) parameters, the imaging system can only be handled stochastically. For example, the rotation of the dye molecules obscures the polarization dependent PSF shape, and only an averaged distribution - typically estimated by a Gaussian function - is observed. TestSTORM software was developed to generate image stacks for traditional localization microscopes, where localization meant the precise determination of the spatial position of the molecules. However, additional optical properties (polarization, spectra, etc.) of the emitted photons can be used for further monitoring the chemical and physical properties (viscosity, pH, etc.) of the local environment. The image stack generating program was upgraded by several new features, such as: multicolour, polarization dependent PSF, built-in 3D visualization, structured background. These features make the program an ideal tool for optimizing the imaging and sample preparation conditions.

A direct electron detector for time-resolved MeV electron microscopy

DOE Office of Scientific and Technical Information (OSTI.GOV)

Vecchione, T.; Denes, P.; Jobe, R. K.

The introduction of direct electron detectors enabled the structural biology revolution of cryogenic electron microscopy. Direct electron detectors are now expected to have a similarly dramatic impact on time-resolved MeV electron microscopy, particularly by enabling both spatial and temporal jitter correction. Here we report on the commissioning of a direct electron detector for time-resolved MeV electron microscopy. The direct electron detector demonstrated MeV single electron sensitivity and is capable of recording megapixel images at 180 Hz. The detector has a 15-bit dynamic range, better than 30-μmμm spatial resolution and less than 20 analogue-to-digital converter count RMS pixel noise. The uniquemore » capabilities of the direct electron detector and the data analysis required to take advantage of these capabilities are presented. The technical challenges associated with generating and processing large amounts of data are also discussed.« less

Hippo in Super Resolution from Super Panorama

NASA Image and Video Library

1998-07-03

This view of the "Hippo," 25 meters to the west of the lander, was produced by combining the "Super Panorama" frames from the IMP camera. Super resolution was applied to help to address questions about the texture of this rock and what it might tell us about its mode of origin. The composite color frames that make up this anaglyph were produced for both the right and left eye of the IMP. These composites consist of more than 15 frames per eye (because multiple sequences covered the same area), taken with different color filters that were enlarged by 500% and then co-added using Adobe Photoshop to produce, in effect, a super-resolution panchromatic frame that is sharper than an individual frame would be. These panchromatic frames were then colorized with the red, green, and blue filtered images from the same sequence. The color balance was adjusted to approximate the true color of Mars. The anaglyph view was produced by combining the left with the right eye color composite frames by assigning the left eye composite view to the red color plane and the right eye composite view to the green and blue color planes (cyan), to produce a stereo anaglyph mosaic. This mosaic can be viewed in 3-D on your computer monitor or in color print form by wearing red-blue 3-D glasses. http://photojournal.jpl.nasa.gov/catalog/PIA01421

High Resolution Bathymetry Estimation Improvement with Single Image Super-Resolution Algorithm Super-Resolution Forests

DTIC Science & Technology

2017-01-26

Naval Research Laboratory Washington, DC 20375-5320 NRL/MR/5514--17-9692 High Resolution Bathymetry Estimation Improvement with Single Image Super...collection of information is estimated to average 1 hour per response, including the time for reviewing instructions, searching existing data sources...gathering and maintaining the data needed, and completing and reviewing this collection of information. Send comments regarding this burden estimate

Super-resolved thickness maps of thin film phantoms and in vivo visualization of tear film lipid layer using OCT

PubMed Central

dos Santos, Valentin Aranha; Schmetterer, Leopold; Triggs, Graham J.; Leitgeb, Rainer A.; Gröschl, Martin; Messner, Alina; Schmidl, Doreen; Garhofer, Gerhard; Aschinger, Gerold; Werkmeister, René M.

2016-01-01

In optical coherence tomography (OCT), the axial resolution is directly linked to the coherence length of the employed light source. It is currently unclear if OCT allows measuring thicknesses below its axial resolution value. To investigate spectral-domain OCT imaging in the super-resolution regime, we derived a signal model and compared it with the experiment. Several island thin film samples of known refractive indices and thicknesses in the range 46 – 163 nm were fabricated and imaged. Reference thickness measurements were performed using a commercial atomic force microscope. In vivo measurements of the tear film were performed in 4 healthy subjects. Our results show that quantitative super-resolved thickness measurement can be performed using OCT. In addition, we report repeatable tear film lipid layer visualization. Our results provide a novel interpretation of the OCT axial resolution limit and open a perspective to deeper extraction of the information hidden in the coherence volume. PMID:27446696

Adaptive Markov Random Fields for Example-Based Super-resolution of Faces

NASA Astrophysics Data System (ADS)

Stephenson, Todd A.; Chen, Tsuhan

2006-12-01

Image enhancement of low-resolution images can be done through methods such as interpolation, super-resolution using multiple video frames, and example-based super-resolution. Example-based super-resolution, in particular, is suited to images that have a strong prior (for those frameworks that work on only a single image, it is more like image restoration than traditional, multiframe super-resolution). For example, hallucination and Markov random field (MRF) methods use examples drawn from the same domain as the image being enhanced to determine what the missing high-frequency information is likely to be. We propose to use even stronger prior information by extending MRF-based super-resolution to use adaptive observation and transition functions, that is, to make these functions region-dependent. We show with face images how we can adapt the modeling for each image patch so as to improve the resolution.

Super Resolution Image of Yogi

NASA Technical Reports Server (NTRS)

1997-01-01

Yogi is a meter-size rock about 5 meters northwest of the Mars Pathfinder lander and was the second rock visited by the Sojourner Rover's alpha proton X-ray spectrometer (APXS) instrument. This mosaic shows super resolution techniques applied to the second APXS target rock, which was poorly illuminated in the rover's forward camera view taken before the instrument was deployed. Super resolution was applied to help to address questions about the texture of this rock and what it might tell us about its mode of origin.

This mosaic of Yogi was produced by combining four 'Super Pan' frames taken with the IMP camera. This composite color mosaic consists of 7 frames from the right eye, taken with different color filters that were enlarged by 500% and then co-added using Adobe Photoshop to produce, in effect, a super-resolution panchromatic frame that is sharper than an individual frame would be. This panchromatic frame was then colorized with the red, green, and blue filtered images from the same sequence. The color balance was adjusted to approximate the true color of Mars. Shadows were processed separately from the rest of the rock and combined with the rest of the scene to bring out details in the shadow of Yogi that would be too dark to view at the same time as the sunlit surfaces.

Mars Pathfinder is the second in NASA's Discovery program of low-cost spacecraft with highly focused science goals. The Jet Propulsion Laboratory, Pasadena, CA, developed and manages the Mars Pathfinder mission for NASA's Office of Space Science, Washington, D.C. JPL is a division of the California Institute of Technology (Caltech).

Texton-based super-resolution for achieving high spatiotemporal resolution in hybrid camera system

NASA Astrophysics Data System (ADS)

Kamimura, Kenji; Tsumura, Norimichi; Nakaguchi, Toshiya; Miyake, Yoichi

2010-05-01

Many super-resolution methods have been proposed to enhance the spatial resolution of images by using iteration and multiple input images. In a previous paper, we proposed the example-based super-resolution method to enhance an image through pixel-based texton substitution to reduce the computational cost. In this method, however, we only considered the enhancement of a texture image. In this study, we modified this texton substitution method for a hybrid camera to reduce the required bandwidth of a high-resolution video camera. We applied our algorithm to pairs of high- and low-spatiotemporal-resolution videos, which were synthesized to simulate a hybrid camera. The result showed that the fine detail of the low-resolution video can be reproduced compared with bicubic interpolation and the required bandwidth could be reduced to about 1/5 in a video camera. It was also shown that the peak signal-to-noise ratios (PSNRs) of the images improved by about 6 dB in a trained frame and by 1.0-1.5 dB in a test frame, as determined by comparison with the processed image using bicubic interpolation, and the average PSNRs were higher than those obtained by the well-known Freeman’s patch-based super-resolution method. Compared with that of the Freeman’s patch-based super-resolution method, the computational time of our method was reduced to almost 1/10.

Microsphere-assisted super-resolution imaging with enlarged numerical aperture by semi-immersion

NASA Astrophysics Data System (ADS)

Wang, Fengge; Yang, Songlin; Ma, Huifeng; Shen, Ping; Wei, Nan; Wang, Meng; Xia, Yang; Deng, Yun; Ye, Yong-Hong

2018-01-01

Microsphere-assisted imaging is an extraordinary simple technology that can obtain optical super-resolution under white-light illumination. Here, we introduce a method to improve the resolution of a microsphere lens by increasing its numerical aperture. In our proposed structure, BaTiO3 glass (BTG) microsphere lenses are semi-immersed in a S1805 layer with a refractive index of 1.65, and then, the semi-immersed microspheres are fully embedded in an elastomer with an index of 1.4. We experimentally demonstrate that this structure, in combination with a conventional optical microscope, can clearly resolve a two-dimensional 200-nm-diameter hexagonally close-packed (hcp) silica microsphere array. On the contrary, the widely used structure where BTG microsphere lenses are fully immersed in a liquid or elastomer cannot even resolve a 250-nm-diameter hcp silica microsphere array. The improvement in resolution through the proposed structure is due to an increase in the effective numerical aperture by semi-immersing BTG microsphere lenses in a high-refractive-index S1805 layer. Our results will inform on the design of microsphere-based high-resolution imaging systems.

Three-dimensional wide-field pump-probe structured illumination microscopy

PubMed Central

Kim, Yang-Hyo; So, Peter T.C.

2017-01-01

We propose a new structured illumination scheme for achieving depth resolved wide-field pump-probe microscopy with sub-diffraction limit resolution. By acquiring coherent pump-probe images using a set of 3D structured light illumination patterns, a 3D super-resolution pump-probe image can be reconstructed. We derive the theoretical framework to describe the coherent image formation and reconstruction scheme for this structured illumination pump-probe imaging system and carry out numerical simulations to investigate its imaging performance. The results demonstrate a lateral resolution improvement by a factor of three and providing 0.5 µm level axial optical sectioning. PMID:28380860

Dynamic placement of plasmonic hotspots for super-resolution surface-enhanced Raman scattering.

PubMed

Ertsgaard, Christopher T; McKoskey, Rachel M; Rich, Isabel S; Lindquist, Nathan C

2014-10-28

In this paper, we demonstrate dynamic placement of locally enhanced plasmonic fields using holographic laser illumination of a silver nanohole array. To visualize these focused "hotspots", the silver surface was coated with various biological samples for surface-enhanced Raman spectroscopy (SERS) imaging. Due to the large field enhancements, blinking behavior of the SERS hotspots was observed and processed using a stochastic optical reconstruction microscopy algorithm enabling super-resolution localization of the hotspots to within 10 nm. These hotspots were then shifted across the surface in subwavelength (<100 nm for a wavelength of 660 nm) steps using holographic illumination from a spatial light modulator. This created a dynamic imaging and sensing surface, whereas static illumination would only have produced stationary hotspots. Using this technique, we also show that such subwavelength shifting and localization of plasmonic hotspots has potential for imaging applications. Interestingly, illuminating the surface with randomly shifting SERS hotspots was sufficient to completely fill in a wide field of view for super-resolution chemical imaging.

Developing Photo Activated Localization Microscopy

NASA Astrophysics Data System (ADS)

Hess, Harald

2015-03-01

Photo Activated Localization Microscopy, PALM, acquires super-resolution images by activating a subset of activatable fluorescent labels and estimating the center of the each molecular label to sub-diffractive accuracy. When this process is repeated thousands of times for different subsets of molecules, then an image can be rendered from all the center coordinates of the molecules. I will describe the circuitous story of its development that began with another super-resolution technique, NSOM, developed by my colleague Eric Betzig, who imaged single molecules at room temperature, and later we spectrally resolved individual luminescent centers of quantum wells. These two observations inspired a generalized path to localization microscopy, but that path was abandoned because no really useful fluorescent labels were available. After a decade of nonacademic industrial pursuits and the subsequent freedom of unemployment, we came across a class of genetically expressible fluorescent proteins that were switchable or convertible that enabled the concept to be implemented and be biologically promising. The past ten years have been very active with many groups exploring applications and enhancements of this concept. Demonstrating significant biological relevance will be the metric if its success.

A direct electron detector for time-resolved MeV electron microscopy

DOE PAGES

Vecchione, T.; Denes, P.; Jobe, R. K.; ...

2017-03-15

The introduction of direct electron detectors enabled the structural biology revolution of cryogenic electron microscopy. Direct electron detectors are now expected to have a similarly dramatic impact on time-resolved MeV electron microscopy, particularly by enabling both spatial and temporal jitter correction. Here in this paper, we report on the commissioning of a direct electron detector for time-resolved MeV electron microscopy. The direct electron detector demonstrated MeV single electron sensitivity and is capable of recording megapixel images at 180 Hz. The detector has a 15-bit dynamic range, better than 30-μm spatial resolution and less than 20 analogue-to-digital converter count RMS pixelmore » noise. The unique capabilities of the direct electron detector and the data analysis required to take advantage of these capabilities are presented. The technical challenges associated with generating and processing large amounts of data are also discussed.« less

A direct electron detector for time-resolved MeV electron microscopy

DOE Office of Scientific and Technical Information (OSTI.GOV)

Vecchione, T.; Denes, P.; Jobe, R. K.

The introduction of direct electron detectors enabled the structural biology revolution of cryogenic electron microscopy. Direct electron detectors are now expected to have a similarly dramatic impact on time-resolved MeV electron microscopy, particularly by enabling both spatial and temporal jitter correction. Here in this paper, we report on the commissioning of a direct electron detector for time-resolved MeV electron microscopy. The direct electron detector demonstrated MeV single electron sensitivity and is capable of recording megapixel images at 180 Hz. The detector has a 15-bit dynamic range, better than 30-μm spatial resolution and less than 20 analogue-to-digital converter count RMS pixelmore » noise. The unique capabilities of the direct electron detector and the data analysis required to take advantage of these capabilities are presented. The technical challenges associated with generating and processing large amounts of data are also discussed.« less

Image quality improvement in cone-beam CT using the super-resolution technique.

PubMed

Oyama, Asuka; Kumagai, Shinobu; Arai, Norikazu; Takata, Takeshi; Saikawa, Yusuke; Shiraishi, Kenshiro; Kobayashi, Takenori; Kotoku, Jun'ichi

2018-04-05

This study was conducted to improve cone-beam computed tomography (CBCT) image quality using the super-resolution technique, a method of inferring a high-resolution image from a low-resolution image. This technique is used with two matrices, so-called dictionaries, constructed respectively from high-resolution and low-resolution image bases. For this study, a CBCT image, as a low-resolution image, is represented as a linear combination of atoms, the image bases in the low-resolution dictionary. The corresponding super-resolution image was inferred by multiplying the coefficients and the high-resolution dictionary atoms extracted from planning CT images. To evaluate the proposed method, we computed the root mean square error (RMSE) and structural similarity (SSIM). The resulting RMSE and SSIM between the super-resolution images and the planning CT images were, respectively, as much as 0.81 and 1.29 times better than those obtained without using the super-resolution technique. We used super-resolution technique to improve the CBCT image quality.

Filling the gap: adding super-resolution to array tomography for correlated ultrastructural and molecular identification of electrical synapses at the C. elegans connectome.

PubMed

Markert, Sebastian Matthias; Britz, Sebastian; Proppert, Sven; Lang, Marietta; Witvliet, Daniel; Mulcahy, Ben; Sauer, Markus; Zhen, Mei; Bessereau, Jean-Louis; Stigloher, Christian

2016-10-01

Correlating molecular labeling at the ultrastructural level with high confidence remains challenging. Array tomography (AT) allows for a combination of fluorescence and electron microscopy (EM) to visualize subcellular protein localization on serial EM sections. Here, we describe an application for AT that combines near-native tissue preservation via high-pressure freezing and freeze substitution with super-resolution light microscopy and high-resolution scanning electron microscopy (SEM) analysis on the same section. We established protocols that combine SEM with structured illumination microscopy (SIM) and direct stochastic optical reconstruction microscopy (dSTORM). We devised a method for easy, precise, and unbiased correlation of EM images and super-resolution imaging data using endogenous cellular landmarks and freely available image processing software. We demonstrate that these methods allow us to identify and label gap junctions in Caenorhabditis elegans with precision and confidence, and imaging of even smaller structures is feasible. With the emergence of connectomics, these methods will allow us to fill in the gap-acquiring the correlated ultrastructural and molecular identity of electrical synapses.

Coherent total internal reflection dark-field microscopy: label-free imaging beyond the diffraction limit.

PubMed

von Olshausen, Philipp; Rohrbach, Alexander

2013-10-15

Coherent imaging is barely applicable in life-science microscopy due to multiple interference artifacts. Here, we show how these interferences can be used to improve image resolution and contrast. We present a dark-field microscopy technique with evanescent illumination via total internal reflection that delivers high-contrast images of coherently scattering samples. By incoherent averaging of multiple coherent images illuminated from different directions we can resolve image structures that remain unresolved by conventional (incoherent) fluorescence microscopy. We provide images of 190 nm beads revealing resolution beyond the diffraction limit and slightly increased object distances. An analytical model is introduced that accounts for the observed effects and which is confirmed by numerical simulations. Our approach may be a route to fast, label-free, super-resolution imaging in live-cell microscopy.

Evaluation of fluorophores for optimal performance in localization-based super-resolution imaging

PubMed Central

Dempsey, Graham T.; Vaughan, Joshua C.; Chen, Kok Hao; Bates, Mark; Zhuang, Xiaowei

2011-01-01

One approach to super-resolution fluorescence imaging uses sequential activation and localization of individual fluorophores to achieve high spatial resolution. Essential to this technique is the choice of fluorescent probes — the properties of the probes, including photons per switching event, on/off duty cycle, photostability, and number of switching cycles, largely dictate the quality of super-resolution images. While many probes have been reported, a systematic characterization of the properties of these probes and their impact on super-resolution image quality has been described in only a few cases. Here, we quantitatively characterized the switching properties of 26 organic dyes and directly related these properties to the quality of super-resolution images. This analysis provides a set of guidelines for characterization of super-resolution probes and a resource for selecting probes based on performance. Our evaluation identified several photoswitchable dyes with good to excellent performance in four independent spectral ranges, with which we demonstrated low crosstalk, four-color super-resolution imaging. PMID:22056676

3D high- and super-resolution imaging using single-objective SPIM.

PubMed

Galland, Remi; Grenci, Gianluca; Aravind, Ajay; Viasnoff, Virgile; Studer, Vincent; Sibarita, Jean-Baptiste

2015-07-01

Single-objective selective-plane illumination microscopy (soSPIM) is achieved with micromirrored cavities combined with a laser beam-steering unit installed on a standard inverted microscope. The illumination and detection are done through the same objective. soSPIM can be used with standard sample preparations and features high background rejection and efficient photon collection, allowing for 3D single-molecule-based super-resolution imaging of whole cells or cell aggregates. Using larger mirrors enabled us to broaden the capabilities of our system to image Drosophila embryos.

Super-resolution imaging and tracking of protein-protein interactions in sub-diffraction cellular space

NASA Astrophysics Data System (ADS)

Liu, Zhen; Xing, Dong; Su, Qian Peter; Zhu, Yun; Zhang, Jiamei; Kong, Xinyu; Xue, Boxin; Wang, Sheng; Sun, Hao; Tao, Yile; Sun, Yujie

2014-07-01

Imaging the location and dynamics of individual interacting protein pairs is essential but often difficult because of the fluorescent background from other paired and non-paired molecules, particularly in the sub-diffraction cellular space. Here we develop a new method combining bimolecular fluorescence complementation and photoactivated localization microscopy for super-resolution imaging and single-molecule tracking of specific protein-protein interactions. The method is used to study the interaction of two abundant proteins, MreB and EF-Tu, in Escherichia coli cells. The super-resolution imaging shows interesting distribution and domain sizes of interacting MreB-EF-Tu pairs as a subpopulation of total EF-Tu. The single-molecule tracking of MreB, EF-Tu and MreB-EF-Tu pairs reveals intriguing localization-dependent heterogonous dynamics and provides valuable insights to understanding the roles of MreB-EF-Tu interactions.

Super-resolution imaging and tracking of protein–protein interactions in sub-diffraction cellular space

PubMed Central

Liu, Zhen; Xing, Dong; Su, Qian Peter; Zhu, Yun; Zhang, Jiamei; Kong, Xinyu; Xue, Boxin; Wang, Sheng; Sun, Hao; Tao, Yile; Sun, Yujie

2014-01-01

Imaging the location and dynamics of individual interacting protein pairs is essential but often difficult because of the fluorescent background from other paired and non-paired molecules, particularly in the sub-diffraction cellular space. Here we develop a new method combining bimolecular fluorescence complementation and photoactivated localization microscopy for super-resolution imaging and single-molecule tracking of specific protein–protein interactions. The method is used to study the interaction of two abundant proteins, MreB and EF-Tu, in Escherichia coli cells. The super-resolution imaging shows interesting distribution and domain sizes of interacting MreB–EF-Tu pairs as a subpopulation of total EF-Tu. The single-molecule tracking of MreB, EF-Tu and MreB–EF-Tu pairs reveals intriguing localization-dependent heterogonous dynamics and provides valuable insights to understanding the roles of MreB–EF-Tu interactions. PMID:25030837

Super-resolved Parallel MRI by Spatiotemporal Encoding

PubMed Central

Schmidt, Rita; Baishya, Bikash; Ben-Eliezer, Noam; Seginer, Amir; Frydman, Lucio

2016-01-01

Recent studies described an alternative “ultrafast” scanning method based on spatiotemporal (SPEN) principles. SPEN demonstrates numerous potential advantages over EPI-based alternatives, at no additional expense in experimental complexity. An important aspect that SPEN still needs to achieve for providing a competitive acquisition alternative entails exploiting parallel imaging algorithms, without compromising its proven capabilities. The present work introduces a combination of multi-band frequency-swept pulses simultaneously encoding multiple, partial fields-of-view; together with a new algorithm merging a Super-Resolved SPEN image reconstruction and SENSE multiple-receiving methods. The ensuing approach enables one to reduce both the excitation and acquisition times of ultrafast SPEN acquisitions by the customary acceleration factor R, without compromises in either the ensuing spatial resolution, SAR deposition, or the capability to operate in multi-slice mode. The performance of these new single-shot imaging sequences and their ancillary algorithms were explored on phantoms and human volunteers at 3T. The gains of the parallelized approach were particularly evident when dealing with heterogeneous systems subject to major T2/T2* effects, as is the case upon single-scan imaging near tissue/air interfaces. PMID:24120293

Hierarchical super-structure identified by polarized light microscopy, electron microscopy and nanoindentation: Implications for the limits of biological control over the growth mode of abalone sea shells

PubMed Central

2012-01-01

Background Mollusc shells are commonly investigated using high-resolution imaging techniques based on cryo-fixation. Less detailed information is available regarding the light-optical properties. Sea shells of Haliotis pulcherina were embedded for polishing in defined orientations in order to investigate the interface between prismatic calcite and nacreous aragonite by standard materialographic methods. A polished thin section of the interface was prepared with a defined thickness of 60 μm for quantitative birefringence analysis using polarized light and LC-PolScope microscopy. Scanning electron microscopy images were obtained for comparison. In order to study structural-mechanical relationships, nanoindentation experiments were performed. Results Incident light microscopy revealed a super-structure in semi-transparent regions of the polished cross-section under a defined angle. This super-structure is not visible in transmitted birefringence analysis due to the blurred polarization of small nacre platelets and numerous organic interfaces. The relative orientation and homogeneity of calcite prisms was directly identified, some of them with their optical axes exactly normal to the imaging plane. Co-oriented "prism colonies" were identified by polarized light analyses. The nacreous super-structure was also visualized by secondary electron imaging under defined angles. The domains of the super-structure were interpreted to consist of crystallographically aligned platelet stacks. Nanoindentation experiments showed that mechanical properties changed with the same periodicity as the domain size. Conclusions In this study, we have demonstrated that insights into the growth mechanisms of nacre can be obtained by conventional light-optical methods. For example, we observed super-structures formed by co-oriented nacre platelets as previously identified using X-ray Photo-electron Emission Microscopy (X-PEEM) [Gilbert et al., Journal of the American Chemical Society 2008, 130

Super-Resolution Imaging of a Dielectric Microsphere Is Governed by the Waist of Its Photonic Nanojet.

PubMed

Yang, Hui; Trouillon, Raphaël; Huszka, Gergely; Gijs, Martin A M

2016-08-10

Dielectric microspheres with appropriate refractive index can image objects with super-resolution, that is, with a precision well beyond the classical diffraction limit. A microsphere is also known to generate upon illumination a photonic nanojet, which is a scattered beam of light with a high-intensity main lobe and very narrow waist. Here, we report a systematic study of the imaging of water-immersed nanostructures by barium titanate glass microspheres of different size. A numerical study of the light propagation through a microsphere points out the light focusing capability of microspheres of different size and the waist of their photonic nanojet. The former correlates to the magnification factor of the virtual images obtained from linear test nanostructures, the biggest magnification being obtained with microspheres of ∼6-7 μm in size. Analyzing the light intensity distribution of microscopy images allows determining analytically the point spread function of the optical system and thereby quantifies its resolution. We find that the super-resolution imaging of a microsphere is dependent on the waist of its photonic nanojet, the best resolution being obtained with a 6 μm Ø microsphere, which generates the nanojet with the minimum waist. This comparison allows elucidating the super-resolution imaging mechanism.

Long-distance super-resolution imaging assisted by enhanced spatial Fourier transform.

PubMed

Tang, Heng-He; Liu, Pu-Kun

2015-09-07

A new gradient-index (GRIN) lens that can realize enhanced spatial Fourier transform (FT) over optically long distances is demonstrated. By using an anisotropic GRIN metamaterial with hyperbolic dispersion, evanescent wave in free space can be transformed into propagating wave in the metamaterial and then focused outside due to negative-refraction. Both the results based on the ray tracing and the finite element simulation show that the spatial frequency bandwidth of the spatial FT can be extended to 2.7k(0) (k(0) is the wave vector in free space). Furthermore, assisted by the enhanced spatial FT, a new long-distance (in the optical far-field region) super-resolution imaging scheme is also proposed and the super resolved capability of λ/5 (λ is the wavelength in free space) is verified. The work may provide technical support for designing new-type high-speed microscopes with long working distances.

Resolution enhancement in deep-tissue nanoparticle imaging based on plasmonic saturated excitation microscopy

NASA Astrophysics Data System (ADS)

Deka, Gitanjal; Nishida, Kentaro; Mochizuki, Kentaro; Ding, Hou-Xian; Fujita, Katsumasa; Chu, Shi-Wei

2018-03-01

Recently, many resolution enhancing techniques are demonstrated, but most of them are severely limited for deep tissue applications. For example, wide-field based localization techniques lack the ability of optical sectioning, and structured light based techniques are susceptible to beam distortion due to scattering/aberration. Saturated excitation (SAX) microscopy, which relies on temporal modulation that is less affected when penetrating into tissues, should be the best candidate for deep-tissue resolution enhancement. Nevertheless, although fluorescence saturation has been successfully adopted in SAX, it is limited by photobleaching, and its practical resolution enhancement is less than two-fold. Recently, we demonstrated plasmonic SAX which provides bleaching-free imaging with three-fold resolution enhancement. Here we show that the three-fold resolution enhancement is sustained throughout the whole working distance of an objective, i.e., 200 μm, which is the deepest super-resolution record to our knowledge, and is expected to extend into deeper tissues. In addition, SAX offers the advantage of background-free imaging by rejecting unwanted scattering background from biological tissues. This study provides an inspirational direction toward deep-tissue super-resolution imaging and has the potential in tumor monitoring and beyond.

Sub-10 fs Time-Resolved Vibronic Optical Microscopy

PubMed Central

2016-01-01

We introduce femtosecond wide-field transient absorption microscopy combining sub-10 fs pump and probe pulses covering the complete visible (500–650 nm) and near-infrared (650–950 nm) spectrum with diffraction-limited optical resolution. We demonstrate the capabilities of our system by reporting the spatially- and spectrally-resolved transient electronic response of MAPbI3–xClx perovskite films and reveal significant quenching of the transient bleach signal at grain boundaries. The unprecedented temporal resolution enables us to directly observe the formation of band-gap renormalization, completed in 25 fs after photoexcitation. In addition, we acquire hyperspectral Raman maps of TIPS pentacene films with sub-400 nm spatial and sub-15 cm–1 spectral resolution covering the 100–2000 cm–1 window. Our approach opens up the possibility of studying ultrafast dynamics on nanometer length and femtosecond time scales in a variety of two-dimensional and nanoscopic systems. PMID:27934055

Coherent optical adaptive technique improves the spatial resolution of STED microscopy in thick samples

PubMed Central

Yan, Wei; Yang, Yanlong; Tan, Yu; Chen, Xun; Li, Yang; Qu, Junle; Ye, Tong

2018-01-01

Stimulated emission depletion microscopy (STED) is one of far-field optical microscopy techniques that can provide sub-diffraction spatial resolution. The spatial resolution of the STED microscopy is determined by the specially engineered beam profile of the depletion beam and its power. However, the beam profile of the depletion beam may be distorted due to aberrations of optical systems and inhomogeneity of specimens’ optical properties, resulting in a compromised spatial resolution. The situation gets deteriorated when thick samples are imaged. In the worst case, the sever distortion of the depletion beam profile may cause complete loss of the super resolution effect no matter how much depletion power is applied to specimens. Previously several adaptive optics approaches have been explored to compensate aberrations of systems and specimens. However, it is hard to correct the complicated high-order optical aberrations of specimens. In this report, we demonstrate that the complicated distorted wavefront from a thick phantom sample can be measured by using the coherent optical adaptive technique (COAT). The full correction can effectively maintain and improve the spatial resolution in imaging thick samples. PMID:29400356

Super-resolution Time-Lapse Seismic Waveform Inversion

NASA Astrophysics Data System (ADS)

Ovcharenko, O.; Kazei, V.; Peter, D. B.; Alkhalifah, T.

2017-12-01

Time-lapse seismic waveform inversion is a technique, which allows tracking changes in the reservoirs over time. Such monitoring is relatively computationally extensive and therefore it is barely feasible to perform it on-the-fly. Most of the expenses are related to numerous FWI iterations at high temporal frequencies, which is inevitable since the low-frequency components can not resolve fine scale features of a velocity model. Inverted velocity changes are also blurred when there is noise in the data, so the problem of low-resolution images is widely known. One of the problems intensively tackled by computer vision research community is the recovering of high-resolution images having their low-resolution versions. Usage of artificial neural networks to reach super-resolution from a single downsampled image is one of the leading solutions for this problem. Each pixel of the upscaled image is affected by all the pixels of its low-resolution version, which enables the workflow to recover features that are likely to occur in the corresponding environment. In the present work, we adopt machine learning image enhancement technique to improve the resolution of time-lapse full-waveform inversion. We first invert the baseline model with conventional FWI. Then we run a few iterations of FWI on a set of the monitoring data to find desired model changes. These changes are blurred and we enhance their resolution by using a deep neural network. The network is trained to map low-resolution model updates predicted by FWI into the real perturbations of the baseline model. For supervised training of the network we generate a set of random perturbations in the baseline model and perform FWI on the noisy data from the perturbed models. We test the approach on a realistic perturbation of Marmousi II model and demonstrate that it outperforms conventional convolution-based deblurring techniques.

A stochastically fully connected conditional random field framework for super resolution OCT

NASA Astrophysics Data System (ADS)

Boroomand, A.; Tan, B.; Wong, A.; Bizheva, K.

2017-02-01

A number of factors can degrade the resolution and contrast of OCT images, such as: (1) changes of the OCT pointspread function (PSF) resulting from wavelength dependent scattering and absorption of light along the imaging depth (2) speckle noise, as well as (3) motion artifacts. We propose a new Super Resolution OCT (SR OCT) imaging framework that takes advantage of a Stochastically Fully Connected Conditional Random Field (SF-CRF) model to generate a Super Resolved OCT (SR OCT) image of higher quality from a set of Low-Resolution OCT (LR OCT) images. The proposed SF-CRF SR OCT imaging is able to simultaneously compensate for all of the factors mentioned above, that degrade the OCT image quality, using a unified computational framework. The proposed SF-CRF SR OCT imaging framework was tested on a set of simulated LR human retinal OCT images generated from a high resolution, high contrast retinal image, and on a set of in-vivo, high resolution, high contrast rat retinal OCT images. The reconstructed SR OCT images show considerably higher spatial resolution, less speckle noise and higher contrast compared to other tested methods. Visual assessment of the results demonstrated the usefulness of the proposed approach in better preservation of fine details and structures of the imaged sample, retaining biological tissue boundaries while reducing speckle noise using a unified computational framework. Quantitative evaluation using both Contrast to Noise Ratio (CNR) and Edge Preservation (EP) parameter also showed superior performance of the proposed SF-CRF SR OCT approach compared to other image processing approaches.

Bimetallic Effect of Single Nanocatalysts Visualized by Super-Resolution Catalysis Imaging

DOE PAGES

Chen, Guanqun; Zou, Ningmu; Chen, Bo; ...

2017-11-01

Compared with their monometallic counterparts, bimetallic nanoparticles often show enhanced catalytic activity associated with the bimetallic interface. Direct quantitation of catalytic activity at the bimetallic interface is important for understanding the enhancement mechanism, but challenging experimentally. Here using single-molecule super-resolution catalysis imaging in correlation with electron microscopy, we report the first quantitative visualization of enhanced bimetallic activity within single bimetallic nanoparticles. We focus on heteronuclear bimetallic PdAu nanoparticles that present a well-defined Pd–Au bimetallic interface in catalyzing a photodriven fluorogenic disproportionation reaction. Our approach also enables a direct comparison between the bimetallic and monometallic regions within the same nanoparticle. Theoreticalmore » calculations further provide insights into the electronic nature of N–O bond activation of the reactant (resazurin) adsorbed on bimetallic sites. Subparticle activity correlation between bimetallic enhancement and monometallic activity suggests that the favorable locations to construct bimetallic sites are those monometallic sites with higher activity, leading to a strategy for making effective bimetallic nanocatalysts. Furthermore, the results highlight the power of super-resolution catalysis imaging in gaining insights that could help improve nanocatalysts.« less

Pixel-super-resolved lensfree holography using adaptive relaxation factor and positional error correction

NASA Astrophysics Data System (ADS)

Zhang, Jialin; Chen, Qian; Sun, Jiasong; Li, Jiaji; Zuo, Chao

2018-01-01

Lensfree holography provides a new way to effectively bypass the intrinsical trade-off between the spatial resolution and field-of-view (FOV) of conventional lens-based microscopes. Unfortunately, due to the limited sensor pixel-size, unpredictable disturbance during image acquisition, and sub-optimum solution to the phase retrieval problem, typical lensfree microscopes only produce compromised imaging quality in terms of lateral resolution and signal-to-noise ratio (SNR). In this paper, we propose an adaptive pixel-super-resolved lensfree imaging (APLI) method to address the pixel aliasing problem by Z-scanning only, without resorting to subpixel shifting or beam-angle manipulation. Furthermore, an automatic positional error correction algorithm and adaptive relaxation strategy are introduced to enhance the robustness and SNR of reconstruction significantly. Based on APLI, we perform full-FOV reconstruction of a USAF resolution target across a wide imaging area of {29.85 mm2 and achieve half-pitch lateral resolution of 770 nm, surpassing 2.17 times of the theoretical Nyquist-Shannon sampling resolution limit imposed by the sensor pixel-size (1.67 μm). Full-FOV imaging result of a typical dicot root is also provided to demonstrate its promising potential applications in biologic imaging.

Super-resolution in a defocused plenoptic camera: a wave-optics-based approach.

PubMed

Sahin, Erdem; Katkovnik, Vladimir; Gotchev, Atanas

2016-03-01

Plenoptic cameras enable the capture of a light field with a single device. However, with traditional light field rendering procedures, they can provide only low-resolution two-dimensional images. Super-resolution is considered to overcome this drawback. In this study, we present a super-resolution method for the defocused plenoptic camera (Plenoptic 1.0), where the imaging system is modeled using wave optics principles and utilizing low-resolution depth information of the scene. We are particularly interested in super-resolution of in-focus and near in-focus scene regions, which constitute the most challenging cases. The simulation results show that the employed wave-optics model makes super-resolution possible for such regions as long as sufficiently accurate depth information is available.

Memory-effect based deconvolution microscopy for super-resolution imaging through scattering media

NASA Astrophysics Data System (ADS)

Edrei, Eitan; Scarcelli, Giuliano

2016-09-01

High-resolution imaging through turbid media is a fundamental challenge of optical sciences that has attracted a lot of attention in recent years for its wide range of potential applications. Here, we demonstrate that the resolution of imaging systems looking behind a highly scattering medium can be improved below the diffraction-limit. To achieve this, we demonstrate a novel microscopy technique enabled by the optical memory effect that uses a deconvolution image processing and thus it does not require iterative focusing, scanning or phase retrieval procedures. We show that this newly established ability of direct imaging through turbid media provides fundamental and practical advantages such as three-dimensional refocusing and unambiguous object reconstruction.

Memory-effect based deconvolution microscopy for super-resolution imaging through scattering media.

PubMed

Edrei, Eitan; Scarcelli, Giuliano

2016-09-16

High-resolution imaging through turbid media is a fundamental challenge of optical sciences that has attracted a lot of attention in recent years for its wide range of potential applications. Here, we demonstrate that the resolution of imaging systems looking behind a highly scattering medium can be improved below the diffraction-limit. To achieve this, we demonstrate a novel microscopy technique enabled by the optical memory effect that uses a deconvolution image processing and thus it does not require iterative focusing, scanning or phase retrieval procedures. We show that this newly established ability of direct imaging through turbid media provides fundamental and practical advantages such as three-dimensional refocusing and unambiguous object reconstruction.

Axial tomography in live cell laser microscopy

NASA Astrophysics Data System (ADS)

Richter, Verena; Bruns, Sarah; Bruns, Thomas; Weber, Petra; Wagner, Michael; Cremer, Christoph; Schneckenburger, Herbert

2017-09-01

Single cell microscopy in a three-dimensional (3-D) environment is reported. Cells are grown in an agarose culture gel, located within microcapillaries and observed from different sides after adaptation of an innovative device for sample rotation. Thus, z-stacks can be recorded by confocal microscopy in different directions and used for illustration in 3-D. This gives additional information, since cells or organelles that appear superimposed in one direction, may be well resolved in another one. The method is tested and validated with single cells expressing a membrane or a mitochondrially associated green fluorescent protein, or cells accumulating fluorescent quantum dots. In addition, axial tomography supports measurements of cellular uptake and distribution of the anticancer drug doxorubicin in the nucleus (2 to 6 h after incubation) or the cytoplasm (24 h). This paper discusses that upon cell rotation an enhanced optical resolution in lateral direction compared to axial direction can be utilized to obtain an improved effective 3-D resolution, which represents an important step toward super-resolution microscopy of living cells.

Structured illumination microscopy for dual-modality 3D sub-diffraction resolution fluorescence and refractive-index reconstruction

PubMed Central

Chowdhury, Shwetadwip; Eldridge, Will J.; Wax, Adam; Izatt, Joseph A.

2017-01-01

Though structured illumination (SI) microscopy is a popular imaging technique conventionally associated with fluorescent super-resolution, recent works have suggested its applicability towards sub-diffraction resolution coherent imaging with quantitative endogenous biological contrast. Here, we demonstrate that SI can efficiently integrate together the principles of fluorescent super-resolution and coherent synthetic aperture to achieve 3D dual-modality sub-diffraction resolution, fluorescence and refractive-index (RI) visualizations of biological samples. We experimentally demonstrate this framework by introducing a SI microscope capable of 3D sub-diffraction resolution fluorescence and RI imaging, and verify its biological visualization capabilities by experimentally reconstructing 3D RI/fluorescence visualizations of fluorescent calibration microspheres as well as alveolar basal epithelial adenocarcinoma (A549) and human colorectal adenocarcinmoa (HT-29) cells, fluorescently stained for F-actin. This demonstration may suggest SI as an especially promising imaging technique to enable future biological studies that explore synergistically operating biophysical/biochemical and molecular mechanisms at sub-diffraction resolutions. PMID:29296504

Super-Resolution Enhancement From Multiple Overlapping Images: A Fractional Area Technique

NASA Astrophysics Data System (ADS)

Michaels, Joshua A.

With the availability of large quantities of relatively low-resolution data from several decades of space borne imaging, methods of creating an accurate, higher-resolution image from the multiple lower-resolution images (i.e. super-resolution), have been developed almost since such imagery has been around. The fractional-area super-resolution technique developed in this thesis has never before been documented. Satellite orbits, like Landsat, have a quantifiable variation, which means each image is not centered on the exact same spot more than once and the overlapping information from these multiple images may be used for super-resolution enhancement. By splitting a single initial pixel into many smaller, desired pixels, a relationship can be created between them using the ratio of the area within the initial pixel. The ideal goal for this technique is to obtain smaller pixels with exact values and no error, yielding a better potential result than those methods that yield interpolated pixel values with consequential loss of spatial resolution. A Fortran 95 program was developed to perform all calculations associated with the fractional-area super-resolution technique. The fractional areas are calculated using traditional trigonometry and coordinate geometry and Linear Algebra Package (LAPACK; Anderson et al., 1999) is used to solve for the higher-resolution pixel values. In order to demonstrate proof-of-concept, a synthetic dataset was created using the intrinsic Fortran random number generator and Adobe Illustrator CS4 (for geometry). To test the real-life application, digital pictures from a Sony DSC-S600 digital point-and-shoot camera with a tripod were taken of a large US geological map under fluorescent lighting. While the fractional-area super-resolution technique works in perfect synthetic conditions, it did not successfully produce a reasonable or consistent solution in the digital photograph enhancement test. The prohibitive amount of processing time (up to

Optimized two-color super resolution imaging of Drp1 during mitochondrial fission with a slow-switching Dronpa variant.

PubMed

Rosenbloom, Alyssa B; Lee, Sang-Hyuk; To, Milton; Lee, Antony; Shin, Jae Yen; Bustamante, Carlos

2014-09-09

We studied the single-molecule photo-switching properties of Dronpa, a green photo-switchable fluorescent protein and a popular marker for photoactivated localization microscopy. We found the excitation light photoactivates as well as deactivates Dronpa single molecules, hindering temporal separation and limiting super resolution. To resolve this limitation, we have developed a slow-switching Dronpa variant, rsKame, featuring a V157L amino acid substitution proximal to the chromophore. The increased steric hindrance generated by the substitution reduced the excitation light-induced photoactivation from the dark to fluorescent state. To demonstrate applicability, we paired rsKame with PAmCherry1 in a two-color photoactivated localization microscopy imaging method to observe the inner and outer mitochondrial membrane structures and selectively labeled dynamin related protein 1 (Drp1), responsible for membrane scission during mitochondrial fission. We determined the diameter and length of Drp1 helical rings encircling mitochondria during fission and showed that, whereas their lengths along mitochondria were not significantly changed, their diameters decreased significantly. These results suggest support for the twistase model of Drp1 constriction, with potential loss of subunits at the helical ends.

Holographic pixel super-resolution in portable lensless on-chip microscopy using a fiber-optic array.

PubMed

Bishara, Waheb; Sikora, Uzair; Mudanyali, Onur; Su, Ting-Wei; Yaglidere, Oguzhan; Luckhart, Shirley; Ozcan, Aydogan

2011-04-07

We report a portable lensless on-chip microscope that can achieve <1 µm resolution over a wide field-of-view of ∼ 24 mm(2) without the use of any mechanical scanning. This compact on-chip microscope weighs ∼ 95 g and is based on partially coherent digital in-line holography. Multiple fiber-optic waveguides are butt-coupled to light emitting diodes, which are controlled by a low-cost micro-controller to sequentially illuminate the sample. The resulting lensfree holograms are then captured by a digital sensor-array and are rapidly processed using a pixel super-resolution algorithm to generate much higher resolution holographic images (both phase and amplitude) of the objects. This wide-field and high-resolution on-chip microscope, being compact and light-weight, would be important for global health problems such as diagnosis of infectious diseases in remote locations. Toward this end, we validate the performance of this field-portable microscope by imaging human malaria parasites (Plasmodium falciparum) in thin blood smears. Our results constitute the first-time that a lensfree on-chip microscope has successfully imaged malaria parasites.

The journey of integrins and partners in a complex interactions landscape studied by super-resolution microscopy and single protein tracking

DOE Office of Scientific and Technical Information (OSTI.GOV)

Rossier, Olivier; Giannone, Grégory; CNRS, Interdisciplinary Institute for Neuroscience, UMR 5297, F-33000 Bordeaux

Cells adjust their adhesive and cytoskeletal organizations according to changes in the biochemical and physical nature of their surroundings. In return, by adhering and generating forces on the extracellular matrix (ECM) cells organize their microenvironment. Integrin-dependent focal adhesions (FAs) are the converging zones integrating biochemical and biomechanical signals arising from the ECM and the actin cytoskeleton. Thus, integrin-mediated adhesion and mechanotransduction, the conversion of mechanical forces into biochemical signals, are involved in critical cellular functions such as migration, proliferation and differentiation, and their deregulation contributes to pathologies including cancer. A challenging problem is to decipher how stochastic protein movements andmore » interactions lead to formation of dynamic architecture such as integrin-dependent adhesive structures. In this review, we will describe recent advances made possible by super-resolution microscopies and single molecule tracking approaches that provided new understanding on the organization and the dynamics of integrins and intracellular regulators at the nanoscale in living cells.« less

The journey of integrins and partners in a complex interactions landscape studied by super-resolution microscopy and single protein tracking.

PubMed

Rossier, Olivier; Giannone, Grégory

2016-04-10

Cells adjust their adhesive and cytoskeletal organizations according to changes in the biochemical and physical nature of their surroundings. In return, by adhering and generating forces on the extracellular matrix (ECM) cells organize their microenvironment. Integrin-dependent focal adhesions (FAs) are the converging zones integrating biochemical and biomechanical signals arising from the ECM and the actin cytoskeleton. Thus, integrin-mediated adhesion and mechanotransduction, the conversion of mechanical forces into biochemical signals, are involved in critical cellular functions such as migration, proliferation and differentiation, and their deregulation contributes to pathologies including cancer. A challenging problem is to decipher how stochastic protein movements and interactions lead to formation of dynamic architecture such as integrin-dependent adhesive structures. In this review, we will describe recent advances made possible by super-resolution microscopies and single molecule tracking approaches that provided new understanding on the organization and the dynamics of integrins and intracellular regulators at the nanoscale in living cells. Copyright © 2015. Published by Elsevier Inc.

Nanocrystals of [Cu3(btc)2] (HKUST-1): a combined time-resolved light scattering and scanning electron microscopy study.

PubMed

Zacher, Denise; Liu, Jianing; Huber, Klaus; Fischer, Roland A

2009-03-07

The formation of [Cu(3)(btc)(2)] (HKUST-1; btc = 1,3,5-benzenetricarboxylate) nanocrystals from a super-saturated mother solution at room temperature was monitored by time-resolved light scattering (TLS); the system is characterized by a rapid growth up to a size limit of 200 nm within a few minutes, and the size and shape of the crystallites were also determined by scanning electron microscopy (SEM).

Wide field of view 3D label-free super-resolution imaging

NASA Astrophysics Data System (ADS)

Nolvi, Anton; Laidmäe, Ivo; Maconi, Göran; Heinämäki, Jyrki; Hæggström, Edward; Kassamakov, Ivan

2018-02-01

Recently, 3D label-free super-resolution profilers based on microsphere-assisted scanning white light interferometry were introduced having vertical resolution of few angstroms (Å) and a lateral resolution approaching 100 nm. However, the use of a single microsphere to generate the photonic nanojet (PNJ) limits their field of view. We overcome this limitation by using polymer microfibers to generate the PNJ. This increases the field of view by order of magnitude in comparison to the previously developed solutions while still resolving sub 100 nm features laterally and keeping the vertical resolution in 1nm range. To validate the capabilities of our system we used a recordable Blu-ray disc as a sample. It features a grooved surface topology with heights in the range of 20 nm and with distinguishable sub 100 nm lateral features that are unresolvable by diffraction limited optics. We achieved agreement between all three measurement devices across lateral and vertical dimensions. The field of view of our instrument was 110 μm by 2 μm and the imaging time was a couple of seconds.

Determination of atomic positions from time resolved high resolution transmission electron microscopy images.

PubMed

Hussaini, Zahra; Lin, Pin Ann; Natarajan, Bharath; Zhu, Wenhui; Sharma, Renu

2018-03-01

For many reaction processes, such as catalysis, phase transformations, nanomaterial synthesis etc., nanoscale observations at high spatial (sub-nanometer) and temporal (millisecond) resolution are required to characterize and comprehend the underlying factors that favor one reaction over another. The combination of such spatial and temporal resolution (up to 600 µs), while rich in information, produces a large number of snapshots, each of which must be analyzed to obtain the structural (and thereby chemical) information. Here we present a methodology for automated quantitative measurement of real-time atomic position fluctuations in a nanoparticle. We leverage a combination of several image processing algorithms to precisely identify the positions of the atomic columns in each image. A geometric model is then used to measure the time-evolution of distances and angles between neighboring atomic columns to identify different phases and quantify local structural fluctuations. We apply this technique to determine the atomic-level fluctuations in the relative fractions of metal and metal-carbide phases in a cobalt catalyst nanoparticle during single-walled carbon nanotube (SWCNT) growth. These measurements provided a means to obtain the number of carbon atoms incorporated into and released from the catalyst particle, thereby helping resolve carbon reaction pathways during SWCNT growth. Further we demonstrate the use of this technique to measure the reaction kinetics of iron oxide reduction. Apart from reducing the data analysis time, the statistical approach allows us to measure atomic distances with sub-pixel resolution. We show that this method can be applied universally to measure atomic positions with a precision of 0.01 nm from any set of atomic-resolution video images. With the advent of high time-resolution direct detection cameras, we anticipate such methods will be essential in addressing the metrology problem of quantifying large datasets of time-resolved

Demosaiced pixel super-resolution in digital holography for multiplexed computational color imaging on-a-chip (Conference Presentation)

NASA Astrophysics Data System (ADS)

Wu, Yichen; Zhang, Yibo; Luo, Wei; Ozcan, Aydogan

2017-03-01

Digital holographic on-chip microscopy achieves large space-bandwidth-products (e.g., >1 billion) by making use of pixel super-resolution techniques. To synthesize a digital holographic color image, one can take three sets of holograms representing the red (R), green (G) and blue (B) parts of the spectrum and digitally combine them to synthesize a color image. The data acquisition efficiency of this sequential illumination process can be improved by 3-fold using wavelength-multiplexed R, G and B illumination that simultaneously illuminates the sample, and using a Bayer color image sensor with known or calibrated transmission spectra to digitally demultiplex these three wavelength channels. This demultiplexing step is conventionally used with interpolation-based Bayer demosaicing methods. However, because the pixels of different color channels on a Bayer image sensor chip are not at the same physical location, conventional interpolation-based demosaicing process generates strong color artifacts, especially at rapidly oscillating hologram fringes, which become even more pronounced through digital wave propagation and phase retrieval processes. Here, we demonstrate that by merging the pixel super-resolution framework into the demultiplexing process, such color artifacts can be greatly suppressed. This novel technique, termed demosaiced pixel super-resolution (D-PSR) for digital holographic imaging, achieves very similar color imaging performance compared to conventional sequential R,G,B illumination, with 3-fold improvement in image acquisition time and data-efficiency. We successfully demonstrated the color imaging performance of this approach by imaging stained Pap smears. The D-PSR technique is broadly applicable to high-throughput, high-resolution digital holographic color microscopy techniques that can be used in resource-limited-settings and point-of-care offices.

Spectrally resolved laser interference microscopy

NASA Astrophysics Data System (ADS)

Butola, Ankit; Ahmad, Azeem; Dubey, Vishesh; Senthilkumaran, P.; Singh Mehta, Dalip

2018-07-01

We developed a new quantitative phase microscopy technique, namely, spectrally resolved laser interference microscopy (SR-LIM), with which it is possible to quantify multi-spectral phase information related to biological specimens without color crosstalk using a color CCD camera. It is a single shot technique where sequential switched on/off of red, green, and blue (RGB) wavelength light sources are not required. The method is implemented using a three-wavelength interference microscope and a customized compact grating based imaging spectrometer fitted at the output port. The results of the USAF resolution chart while employing three different light sources, namely, a halogen lamp, light emitting diodes, and lasers, are discussed and compared. The broadband light sources like the halogen lamp and light emitting diodes lead to stretching in the spectrally decomposed images, whereas it is not observed in the case of narrow-band light sources, i.e. lasers. The proposed technique is further successfully employed for single-shot quantitative phase imaging of human red blood cells at three wavelengths simultaneously without color crosstalk. Using the present technique, one can also use a monochrome camera, even though the experiments are performed using multi-color light sources. Finally, SR-LIM is not only limited to RGB wavelengths, it can be further extended to red, near infra-red, and infra-red wavelengths, which are suitable for various biological applications.

Fluorescence microscopy.

PubMed

Sanderson, Michael J; Smith, Ian; Parker, Ian; Bootman, Martin D

2014-10-01

Fluorescence microscopy is a major tool with which to monitor cell physiology. Although the concepts of fluorescence and its optical separation using filters remain similar, microscope design varies with the aim of increasing image contrast and spatial resolution. The basics of wide-field microscopy are outlined to emphasize the selection, advantages, and correct use of laser scanning confocal microscopy, two-photon microscopy, scanning disk confocal microscopy, total internal reflection, and super-resolution microscopy. In addition, the principles of how these microscopes form images are reviewed to appreciate their capabilities, limitations, and constraints for operation. © 2014 Cold Spring Harbor Laboratory Press.

Fluorescence Microscopy

PubMed Central

Sanderson, Michael J.; Smith, Ian; Parker, Ian; Bootman, Martin D.

2016-01-01

Fluorescence microscopy is a major tool with which to monitor cell physiology. Although the concepts of fluorescence and its optical separation using filters remain similar, microscope design varies with the aim of increasing image contrast and spatial resolution. The basics of wide-field microscopy are outlined to emphasize the selection, advantages, and correct use of laser scanning confocal microscopy, two-photon microscopy, scanning disk confocal microscopy, total internal reflection, and super-resolution microscopy. In addition, the principles of how these microscopes form images are reviewed to appreciate their capabilities, limitations, and constraints for operation. PMID:25275114

Image reconstructions from super-sampled data sets with resolution modeling in PET imaging.

PubMed

Li, Yusheng; Matej, Samuel; Metzler, Scott D

2014-12-01

Spatial resolution in positron emission tomography (PET) is still a limiting factor in many imaging applications. To improve the spatial resolution for an existing scanner with fixed crystal sizes, mechanical movements such as scanner wobbling and object shifting have been considered for PET systems. Multiple acquisitions from different positions can provide complementary information and increased spatial sampling. The objective of this paper is to explore an efficient and useful reconstruction framework to reconstruct super-resolution images from super-sampled low-resolution data sets. The authors introduce a super-sampling data acquisition model based on the physical processes with tomographic, downsampling, and shifting matrices as its building blocks. Based on the model, we extend the MLEM and Landweber algorithms to reconstruct images from super-sampled data sets. The authors also derive a backprojection-filtration-like (BPF-like) method for the super-sampling reconstruction. Furthermore, they explore variant methods for super-sampling reconstructions: the separate super-sampling resolution-modeling reconstruction and the reconstruction without downsampling to further improve image quality at the cost of more computation. The authors use simulated reconstruction of a resolution phantom to evaluate the three types of algorithms with different super-samplings at different count levels. Contrast recovery coefficient (CRC) versus background variability, as an image-quality metric, is calculated at each iteration for all reconstructions. The authors observe that all three algorithms can significantly and consistently achieve increased CRCs at fixed background variability and reduce background artifacts with super-sampled data sets at the same count levels. For the same super-sampled data sets, the MLEM method achieves better image quality than the Landweber method, which in turn achieves better image quality than the BPF-like method. The authors also demonstrate

Far-field optical imaging with subdiffraction resolution enabled by nonlinear saturation absorption

NASA Astrophysics Data System (ADS)

Ding, Chenliang; Wei, Jingsong

2016-01-01

The resolution of far-field optical imaging is required to improve beyond the Abbe limit to the subdiffraction or even the nanoscale. In this work, inspired by scanning electronic microscopy (SEM) imaging, in which carbon (or Au) thin films are usually required to be coated on the sample surface before imaging to remove the charging effect while imaging by electrons. We propose a saturation-absorption-induced far-field super-resolution optical imaging method (SAI-SRIM). In the SAI-SRIM, the carbon (or Au) layers in SEM imaging are replaced by nonlinear-saturation-absorption (NSA) thin films, which are directly coated onto the sample surfaces using advanced thin film deposition techniques. The surface fluctuant morphologies are replicated to the NSA thin films, accordingly. The coated sample surfaces are then imaged using conventional laser scanning microscopy. Consequently, the imaging resolution is greatly improved, and subdiffraction-resolved optical images are obtained theoretically and experimentally. The SAI-SRIM provides an effective and easy way to achieve far-field super-resolution optical imaging for sample surfaces with geometric fluctuant morphology characteristics.

Underwater video enhancement using multi-camera super-resolution

NASA Astrophysics Data System (ADS)

Quevedo, E.; Delory, E.; Callicó, G. M.; Tobajas, F.; Sarmiento, R.

2017-12-01

Image spatial resolution is critical in several fields such as medicine, communications or satellite, and underwater applications. While a large variety of techniques for image restoration and enhancement has been proposed in the literature, this paper focuses on a novel Super-Resolution fusion algorithm based on a Multi-Camera environment that permits to enhance the quality of underwater video sequences without significantly increasing computation. In order to compare the quality enhancement, two objective quality metrics have been used: PSNR (Peak Signal-to-Noise Ratio) and the SSIM (Structural SIMilarity) index. Results have shown that the proposed method enhances the objective quality of several underwater sequences, avoiding the appearance of undesirable artifacts, with respect to basic fusion Super-Resolution algorithms.

Amplified stimulated emission in upconversion nanoparticles for super-resolution nanoscopy

NASA Astrophysics Data System (ADS)

Liu, Yujia; Lu, Yiqing; Yang, Xusan; Zheng, Xianlin; Wen, Shihui; Wang, Fan; Vidal, Xavier; Zhao, Jiangbo; Liu, Deming; Zhou, Zhiguang; Ma, Chenshuo; Zhou, Jiajia; Piper, James A.; Xi, Peng; Jin, Dayong

2017-02-01

Lanthanide-doped glasses and crystals are attractive for laser applications because the metastable energy levels of the trivalent lanthanide ions facilitate the establishment of population inversion and amplified stimulated emission at relatively low pump power. At the nanometre scale, lanthanide-doped upconversion nanoparticles (UCNPs) can now be made with precisely controlled phase, dimension and doping level. When excited in the near-infrared, these UCNPs emit stable, bright visible luminescence at a variety of selectable wavelengths, with single-nanoparticle sensitivity, which makes them suitable for advanced luminescence microscopy applications. Here we show that UCNPs doped with high concentrations of thulium ions (Tm3+), excited at a wavelength of 980 nanometres, can readily establish a population inversion on their intermediate metastable 3H4 level: the reduced inter-emitter distance at high Tm3+ doping concentration leads to intense cross-relaxation, inducing a photon-avalanche-like effect that rapidly populates the metastable 3H4 level, resulting in population inversion relative to the 3H6 ground level within a single nanoparticle. As a result, illumination by a laser at 808 nanometres, matching the upconversion band of the 3H4 → 3H6 transition, can trigger amplified stimulated emission to discharge the 3H4 intermediate level, so that the upconversion pathway to generate blue luminescence can be optically inhibited. We harness these properties to realize low-power super-resolution stimulated emission depletion (STED) microscopy and achieve nanometre-scale optical resolution (nanoscopy), imaging single UCNPs; the resolution is 28 nanometres, that is, 1/36th of the wavelength. These engineered nanocrystals offer saturation intensity two orders of magnitude lower than those of fluorescent probes currently employed in stimulated emission depletion microscopy, suggesting a new way of alleviating the square-root law that typically limits the

Bright monomeric photoactivatable red fluorescent protein for two-color super-resolution sptPALM of live cells.

PubMed

Subach, Fedor V; Patterson, George H; Renz, Malte; Lippincott-Schwartz, Jennifer; Verkhusha, Vladislav V

2010-05-12

Rapidly emerging techniques of super-resolution single-molecule microscopy of living cells rely on the continued development of genetically encoded photoactivatable fluorescent proteins. On the basis of monomeric TagRFP, we have developed a photoactivatable TagRFP protein that is initially dark but becomes red fluorescent after violet light irradiation. Compared to other monomeric dark-to-red photoactivatable proteins including PAmCherry, PATagRFP has substantially higher molecular brightness, better pH stability, substantially less sensitivity to blue light, and better photostability in both ensemble and single-molecule modes. Spectroscopic analysis suggests that PATagRFP photoactivation is a two-step photochemical process involving sequential one-photon absorbance by two distinct chromophore forms. True monomeric behavior, absence of green fluorescence, and single-molecule performance in live cells make PATagRFP an excellent protein tag for two-color imaging techniques, including conventional diffraction-limited photoactivation microscopy, super-resolution photoactivated localization microscopy (PALM), and single particle tracking PALM (sptPALM) of living cells. Two-color sptPALM imaging was demonstrated using several PATagRFP tagged transmembrane proteins together with PAGFP-tagged clathrin light chain. Analysis of the resulting sptPALM images revealed that single-molecule transmembrane proteins, which are internalized into a cell via endocytosis, colocalize in space and time with plasma membrane domains enriched in clathrin light-chain molecules.

A super resolution framework for low resolution document image OCR

NASA Astrophysics Data System (ADS)

Ma, Di; Agam, Gady

2013-01-01

Optical character recognition is widely used for converting document images into digital media. Existing OCR algorithms and tools produce good results from high resolution, good quality, document images. In this paper, we propose a machine learning based super resolution framework for low resolution document image OCR. Two main techniques are used in our proposed approach: a document page segmentation algorithm and a modified K-means clustering algorithm. Using this approach, by exploiting coherence in the document, we reconstruct from a low resolution document image a better resolution image and improve OCR results. Experimental results show substantial gain in low resolution documents such as the ones captured from video.

Super-Resolution Localization Microscopy of γ-H2AX and Heterochromatin after Folate Deficiency.

PubMed

Bach, Margund; Savini, Claudia; Krufczik, Matthias; Cremer, Christoph; Rösl, Frank; Hausmann, Michael

2017-08-08

Folate is an essential water-soluble vitamin in food and nutrition supplements. As a one-carbon source, it is involved in many central regulatory processes, such as DNA, RNA, and protein methylation as well as DNA synthesis and repair. Deficiency in folate is considered to be associated with an increased incidence of several malignancies, including cervical cancer that is etiologically linked to an infection with "high-risk" human papilloma viruses (HPV). However, it is still not known how a recommended increase in dietary folate after its deprivation affects the physiological status of cells. To study the impact of folate depletion and its subsequent reconstitution in single cells, we used quantitative chromatin conformation measurements obtained by super-resolution fluorescence microscopy, i.e., single molecule localization microscopy (SMLM). As a read-out, we examined the levels and the (re)positioning of γ-H2AX tags and histone H3K9me3 heterochromatin tags after immunostaining in three-dimensional (3D)-conserved cell nuclei. As model, we used HPV16 positive immortalized human keratinocytes that were cultivated under normal, folate deficient, and reconstituted conditions for different periods of time. The results were compared to cells continuously cultivated in standard folate medium. After 13 weeks in low folate, an increase in the phosphorylation of the histone H2AX was noted, indicative of an accumulation of DNA double strand breaks. DNA repair activity represented by the formation of those γ-H2AX clusters was maintained during the following 15 weeks of examination. However, the clustered arrangements of tags appeared to relax in a time-dependent manner. Parallel to the repair activity, the chromatin methylation activity increased as detected by H3K9me3 tags. The progress of DNA double strand repair was accompanied by a reduction of the detected nucleosome density around the γ-H2AX clusters, suggesting a shift from hetero- to euchromatin to allow access

Challenges for Super-Resolution Localization Microscopy and Biomolecular Fluorescent Nano-Probing in Cancer Research

PubMed Central

Ilić, Nataša; Pilarczyk, Götz; Lee, Jin-Ho; Logeswaran, Abiramy; Borroni, Aurora Paola; Krufczik, Matthias; Theda, Franziska; Waltrich, Nadine; Bestvater, Felix; Hildenbrand, Georg; Cremer, Christoph; Blank, Michael

2017-01-01

Understanding molecular interactions and regulatory mechanisms in tumor initiation, progression, and treatment response are key requirements towards advanced cancer diagnosis and novel treatment procedures in personalized medicine. Beyond decoding the gene expression, malfunctioning and cancer-related epigenetic pathways, investigations of the spatial receptor arrangements in membranes and genome organization in cell nuclei, on the nano-scale, contribute to elucidating complex molecular mechanisms in cells and tissues. By these means, the correlation between cell function and spatial organization of molecules or molecular complexes can be studied, with respect to carcinogenesis, tumor sensitivity or tumor resistance to anticancer therapies, like radiation or antibody treatment. Here, we present several new applications for bio-molecular nano-probes and super-resolution, laser fluorescence localization microscopy and their potential in life sciences, especially in biomedical and cancer research. By means of a tool-box of fluorescent antibodies, green fluorescent protein (GFP) tagging, or specific oligonucleotides, we present tumor relevant re-arrangements of Erb-receptors in membranes, spatial organization of Smad specific ubiquitin protein ligase 2 (Smurf2) in the cytosol, tumor cell characteristic heterochromatin organization, and molecular re-arrangements induced by radiation or antibody treatment. The main purpose of this article is to demonstrate how nano-scaled distance measurements between bio-molecules, tagged by appropriate nano-probes, can be applied to elucidate structures and conformations of molecular complexes which are characteristic of tumorigenesis and treatment responses. These applications open new avenues towards a better interpretation of the spatial organization and treatment responses of functionally relevant molecules, at the single cell level, in normal and cancer cells, offering new potentials for individualized medicine. PMID:28956810

Challenges for Super-Resolution Localization Microscopy and Biomolecular Fluorescent Nano-Probing in Cancer Research.

PubMed

Hausmann, Michael; Ilić, Nataša; Pilarczyk, Götz; Lee, Jin-Ho; Logeswaran, Abiramy; Borroni, Aurora Paola; Krufczik, Matthias; Theda, Franziska; Waltrich, Nadine; Bestvater, Felix; Hildenbrand, Georg; Cremer, Christoph; Blank, Michael

2017-09-28

Understanding molecular interactions and regulatory mechanisms in tumor initiation, progression, and treatment response are key requirements towards advanced cancer diagnosis and novel treatment procedures in personalized medicine. Beyond decoding the gene expression, malfunctioning and cancer-related epigenetic pathways, investigations of the spatial receptor arrangements in membranes and genome organization in cell nuclei, on the nano-scale, contribute to elucidating complex molecular mechanisms in cells and tissues. By these means, the correlation between cell function and spatial organization of molecules or molecular complexes can be studied, with respect to carcinogenesis, tumor sensitivity or tumor resistance to anticancer therapies, like radiation or antibody treatment. Here, we present several new applications for bio-molecular nano-probes and super-resolution, laser fluorescence localization microscopy and their potential in life sciences, especially in biomedical and cancer research. By means of a tool-box of fluorescent antibodies, green fluorescent protein (GFP) tagging, or specific oligonucleotides, we present tumor relevant re-arrangements of Erb-receptors in membranes, spatial organization of Smad specific ubiquitin protein ligase 2 (Smurf2) in the cytosol, tumor cell characteristic heterochromatin organization, and molecular re-arrangements induced by radiation or antibody treatment. The main purpose of this article is to demonstrate how nano-scaled distance measurements between bio-molecules, tagged by appropriate nano-probes, can be applied to elucidate structures and conformations of molecular complexes which are characteristic of tumorigenesis and treatment responses. These applications open new avenues towards a better interpretation of the spatial organization and treatment responses of functionally relevant molecules, at the single cell level, in normal and cancer cells, offering new potentials for individualized medicine.

Super-resolution microscopy reveals protein spatial reorganization in early innate immune responses.

DOE Office of Scientific and Technical Information (OSTI.GOV)

Carson, Bryan D.; Aaron, Jesse S.; Timlin, Jerilyn Ann

2010-10-01

Over the past decade optical approaches were introduced that effectively break the diffraction barrier. Of particular note were introductions of Stimulated Emission/Depletion (STED) microscopy, Photo-Activated Localization Microscopy (PALM), and the closely related Stochastic Optical Reconstruction Microscopy (STORM). STORM represents an attractive method for researchers, as it does not require highly specialized optical setups, can be implemented using commercially available dyes, and is more easily amenable to multicolor imaging. We implemented a simultaneous dual-color, direct-STORM imaging system through the use of an objective-based TIRF microscope and filter-based image splitter. This system allows for excitation and detection of two fluorophors simultaneously, viamore » projection of each fluorophor's signal onto separate regions of a detector. We imaged the sub-resolution organization of the TLR4 receptor, a key mediator of innate immune response, after challenge with lipopolysaccharide (LPS), a bacteria-specific antigen. While distinct forms of LPS have evolved among various bacteria, only some LPS variations (such as that derived from E. coli) typically result in significant cellular immune response. Others (such as from the plague bacteria Y. pestis) do not, despite affinity to TLR4. We will show that challenge with LPS antigens produces a statistically significant increase in TLR4 receptor clusters on the cell membrane, presumably due to recruitment of receptors to lipid rafts. These changes, however, are only detectable below the diffraction limit and are not evident using conventional imaging methods. Furthermore, we will compare the spatiotemporal behavior of TLR4 receptors in response to different LPS chemotypes in order to elucidate possible routes by which pathogens such as Y. pestis are able to circumvent the innate immune system. Finally, we will exploit the dual-color STORM capabilities to simultaneously image LPS and TLR4 receptors in the

Distinguishing one from many using super-resolution compressive sensing

DOE Office of Scientific and Technical Information (OSTI.GOV)

Anthony, Stephen Michael; Mulcahy-Stanislawczyk, Johnathan; Shields, Eric A.

We present that distinguishing whether a signal corresponds to a single source or a limited number of highly overlapping point spread functions (PSFs) is a ubiquitous problem across all imaging scales, whether detecting receptor-ligand interactions in cells or detecting binary stars. Super-resolution imaging based upon compressed sensing exploits the relative sparseness of the point sources to successfully resolve sources which may be separated by much less than the Rayleigh criterion. However, as a solution to an underdetermined system of linear equations, compressive sensing requires the imposition of constraints which may not always be valid. One typical constraint is that themore » PSF is known. However, the PSF of the actual optical system may reflect aberrations not present in the theoretical ideal optical system. Even when the optics are well characterized, the actual PSF may reflect factors such as non-uniform emission of the point source (e.g. fluorophore dipole emission). As such, the actual PSF may differ from the PSF used as a constraint. Similarly, multiple different regularization constraints have been suggested including the l 1-norm, l 0-norm, and generalized Gaussian Markov random fields (GGMRFs), each of which imposes a different constraint. Other important factors include the signal-to-noise ratio of the point sources and whether the point sources vary in intensity. In this work, we explore how these factors influence super-resolution image recovery robustness, determining the sensitivity and specificity. In conclusion, we determine an approach that is more robust to the types of PSF errors present in actual optical systems.« less

Distinguishing one from many using super-resolution compressive sensing

DOE PAGES

Anthony, Stephen Michael; Mulcahy-Stanislawczyk, Johnathan; Shields, Eric A.; ...

2018-05-14

We present that distinguishing whether a signal corresponds to a single source or a limited number of highly overlapping point spread functions (PSFs) is a ubiquitous problem across all imaging scales, whether detecting receptor-ligand interactions in cells or detecting binary stars. Super-resolution imaging based upon compressed sensing exploits the relative sparseness of the point sources to successfully resolve sources which may be separated by much less than the Rayleigh criterion. However, as a solution to an underdetermined system of linear equations, compressive sensing requires the imposition of constraints which may not always be valid. One typical constraint is that themore » PSF is known. However, the PSF of the actual optical system may reflect aberrations not present in the theoretical ideal optical system. Even when the optics are well characterized, the actual PSF may reflect factors such as non-uniform emission of the point source (e.g. fluorophore dipole emission). As such, the actual PSF may differ from the PSF used as a constraint. Similarly, multiple different regularization constraints have been suggested including the l 1-norm, l 0-norm, and generalized Gaussian Markov random fields (GGMRFs), each of which imposes a different constraint. Other important factors include the signal-to-noise ratio of the point sources and whether the point sources vary in intensity. In this work, we explore how these factors influence super-resolution image recovery robustness, determining the sensitivity and specificity. In conclusion, we determine an approach that is more robust to the types of PSF errors present in actual optical systems.« less

Correlation Functions Quantify Super-Resolution Images and Estimate Apparent Clustering Due to Over-Counting

PubMed Central

Veatch, Sarah L.; Machta, Benjamin B.; Shelby, Sarah A.; Chiang, Ethan N.; Holowka, David A.; Baird, Barbara A.

2012-01-01

We present an analytical method using correlation functions to quantify clustering in super-resolution fluorescence localization images and electron microscopy images of static surfaces in two dimensions. We use this method to quantify how over-counting of labeled molecules contributes to apparent self-clustering and to calculate the effective lateral resolution of an image. This treatment applies to distributions of proteins and lipids in cell membranes, where there is significant interest in using electron microscopy and super-resolution fluorescence localization techniques to probe membrane heterogeneity. When images are quantified using pair auto-correlation functions, the magnitude of apparent clustering arising from over-counting varies inversely with the surface density of labeled molecules and does not depend on the number of times an average molecule is counted. In contrast, we demonstrate that over-counting does not give rise to apparent co-clustering in double label experiments when pair cross-correlation functions are measured. We apply our analytical method to quantify the distribution of the IgE receptor (FcεRI) on the plasma membranes of chemically fixed RBL-2H3 mast cells from images acquired using stochastic optical reconstruction microscopy (STORM/dSTORM) and scanning electron microscopy (SEM). We find that apparent clustering of FcεRI-bound IgE is dominated by over-counting labels on individual complexes when IgE is directly conjugated to organic fluorophores. We verify this observation by measuring pair cross-correlation functions between two distinguishably labeled pools of IgE-FcεRI on the cell surface using both imaging methods. After correcting for over-counting, we observe weak but significant self-clustering of IgE-FcεRI in fluorescence localization measurements, and no residual self-clustering as detected with SEM. We also apply this method to quantify IgE-FcεRI redistribution after deliberate clustering by crosslinking with two

Super-resolution chemical imaging with dynamic placement of plasmonic hotspots

NASA Astrophysics Data System (ADS)

Olson, Aeli P.; Ertsgaard, Christopher T.; McKoskey, Rachel M.; Rich, Isabel S.; Lindquist, Nathan C.

2015-08-01

We demonstrate dynamic placement of plasmonic "hotspots" for super-resolution chemical imaging via Surface Enhanced Raman Spectroscopy (SERS). A silver nanohole array surface was coated with biological samples and illuminated with a laser. Due to the large plasmonic field enhancements, blinking behavior of the SERS hotspots was observed and processed using a Stochastic Optical Reconstruction Microscopy (STORM) algorithm enabling localization to within 10 nm. However, illumination of the sample with a single static laser beam (i.e., a slightly defocused Gaussian beam) only produced SERS hotspots in fixed locations on the surface, leaving noticeable gaps in any final image. But, by using a spatial light modulator (SLM), the illumination profile of the beam could be altered, shifting any hotspots across the nanohole array surface in sub-wavelength steps. Therefore, by properly structuring an illuminating light field with the SLM, we show the possibility of positioning plasmonic hotspots over a metallic nanohole surface on-the-fly. Using this and our SERS-STORM imaging technique, we show potential for high-resolution chemical imaging without the noticeable gaps that were present with static laser illumination. Interestingly, even illuminating the surface with randomly shifting SLM phase profiles was sufficient to completely fill in a wide field of view for super-resolution SERS imaging of a single strand of 100-nm thick collagen protein fibrils. Images were then compared to those obtained with a scanning electron microscope (SEM). Additionally, we explored alternative methods of phase shifting other than holographic illumination through the SLM to create localization of hotspots necessary for SERS-STORM imaging.

Magnetic Resonance Super-resolution Imaging Measurement with Dictionary-optimized Sparse Learning

NASA Astrophysics Data System (ADS)

Li, Jun-Bao; Liu, Jing; Pan, Jeng-Shyang; Yao, Hongxun

2017-06-01

Magnetic Resonance Super-resolution Imaging Measurement (MRIM) is an effective way of measuring materials. MRIM has wide applications in physics, chemistry, biology, geology, medical and material science, especially in medical diagnosis. It is feasible to improve the resolution of MR imaging through increasing radiation intensity, but the high radiation intensity and the longtime of magnetic field harm the human body. Thus, in the practical applications the resolution of hardware imaging reaches the limitation of resolution. Software-based super-resolution technology is effective to improve the resolution of image. This work proposes a framework of dictionary-optimized sparse learning based MR super-resolution method. The framework is to solve the problem of sample selection for dictionary learning of sparse reconstruction. The textural complexity-based image quality representation is proposed to choose the optimal samples for dictionary learning. Comprehensive experiments show that the dictionary-optimized sparse learning improves the performance of sparse representation.

Introduction to the virtual special issue on super-resolution imaging techniques

NASA Astrophysics Data System (ADS)

Cao, Liangcai; Liu, Zhengjun

2017-12-01

Until quite recently, the resolution of optical imaging instruments, including telescopes, cameras and microscopes, was considered to be limited by the diffraction of light and by image sensors. In the past few years, many exciting super-resolution approaches have emerged that demonstrate intriguing ways to bypass the classical limit in optics and detectors. More and more research groups are engaged in the study of advanced super-resolution schemes, devices, algorithms, systems, and applications [1-6]. Super-resolution techniques involve new methods in science and engineering of optics [7,8], measurements [9,10], chemistry [11,12] and information [13,14]. Promising applications, particularly in biomedical research and semiconductor industry, have been successfully demonstrated.

Super-Resolution for Color Imagery

DTIC Science & Technology

2017-09-01

separately; however, it requires performing the super-resolution computation 3 times. We transform images in the default red, green, blue (RGB) color space...chrominance components based on ARL’s alias-free image upsampling using Fourier-based windowing methods. A reverse transformation is performed on... Transformation from sRGB to CIELAB............................................... 3 Fig. 2 YCbCr mathematical coordinate transformation

Detecting breast microcalcifications using super-resolution ultrasound imaging: a clinical study

NASA Astrophysics Data System (ADS)

Huang, Lianjie; Labyed, Yassin; Hanson, Kenneth; Sandoval, Daniel; Pohl, Jennifer; Williamson, Michael

2013-03-01

Imaging breast microcalcifications is crucial for early detection and diagnosis of breast cancer. It is challenging for current clinical ultrasound to image breast microcalcifications. However, new imaging techniques using data acquired with a synthetic-aperture ultrasound system have the potential to significantly improve ultrasound imaging. We recently developed a super-resolution ultrasound imaging method termed the phase-coherent multiple-signal classification (PC-MUSIC). This signal subspace method accounts for the phase response of transducer elements to improve image resolution. In this paper, we investigate the clinical feasibility of our super-resolution ultrasound imaging method for detecting breast microcalcifications. We use our custom-built, real-time synthetic-aperture ultrasound system to acquire breast ultrasound data for 40 patients whose mammograms show the presence of breast microcalcifications. We apply our super-resolution ultrasound imaging method to the patient data, and produce clear images of breast calcifications. Our super-resolution ultrasound PC-MUSIC imaging with synthetic-aperture ultrasound data can provide a new imaging modality for detecting breast microcalcifications in clinic without using ionizing radiation.

High resolution atomic force microscopy of double-stranded RNA.

PubMed

Ares, Pablo; Fuentes-Perez, Maria Eugenia; Herrero-Galán, Elías; Valpuesta, José M; Gil, Adriana; Gomez-Herrero, Julio; Moreno-Herrero, Fernando

2016-06-09

Double-stranded (ds) RNA mediates the suppression of specific gene expression, it is the genetic material of a number of viruses, and a key activator of the innate immune response against viral infections. The ever increasing list of roles played by dsRNA in the cell and its potential biotechnological applications over the last decade has raised an interest for the characterization of its mechanical properties and structure, and that includes approaches using Atomic Force Microscopy (AFM) and other single-molecule techniques. Recent reports have resolved the structure of dsDNA with AFM at unprecedented resolution. However, an equivalent study with dsRNA is still lacking. Here, we have visualized the double helix of dsRNA under near-physiological conditions and at sufficient resolution to resolve the A-form sub-helical pitch periodicity. We have employed different high-sensitive force-detection methods and obtained images with similar spatial resolution. Therefore, we show here that the limiting factors for high-resolution AFM imaging of soft materials in liquid medium are, rather than the imaging mode, the force between the tip and the sample and the sharpness of the tip apex.

Spectroscopic photon localization microscopy: breaking the resolution limit of single molecule localization microscopy (Conference Presentation)

NASA Astrophysics Data System (ADS)

Dong, Biqin; Almassalha, Luay Matthew; Urban, Ben E.; Nguyen, The-Quyen; Khuon, Satya; Chew, Teng-Leong; Backman, Vadim; Sun, Cheng; Zhang, Hao F.

2017-02-01

Distinguishing minute differences in spectroscopic signatures is crucial for revealing the fluorescence heterogeneity among fluorophores to achieve a high molecular specificity. Here we report spectroscopic photon localization microscopy (SPLM), a newly developed far-field spectroscopic imaging technique, to achieve nanoscopic resolution based on the principle of single-molecule localization microscopy while simultaneously uncovering the inherent molecular spectroscopic information associated with each stochastic event (Dong et al., Nature Communications 2016, in press). In SPLM, by using a slit-less monochromator, both the zero-order and the first-order diffractions from a grating were recorded simultaneously by an electron multiplying charge-coupled device to reveal the spatial distribution and the associated emission spectra of individual stochastic radiation events, respectively. As a result, the origins of photon emissions from different molecules can be identified according to their spectral differences with sub-nm spectral resolution, even when the molecules are within close proximity. With the newly developed algorithms including background subtraction and spectral overlap unmixing, we established and tested a method which can significantly extend the fundamental spatial resolution limit of single molecule localization microscopy by molecular discrimination through spectral regression. Taking advantage of this unique capability, we demonstrated improvement in spatial resolution of PALM/STORM up to ten fold with selected fluorophores. This technique can be readily adopted by other research groups to greatly enhance the optical resolution of single molecule localization microscopy without the need to modify their existing staining methods and protocols. This new resolving capability can potentially provide new insights into biological phenomena and enable significant research progress to be made in the life sciences.

Optical Super-Resolution by High-Index Liquid-Immersed Microspheres

DTIC Science & Technology

2012-01-01

the BD without liquid can be achieved using microspheres with small-to-moderate index of refraction such as borosilicate glass (n 1.47), soda lime ...titanate glass microspheres with diameters (D) in the range 2–220 lm and with high refractive index (n 1.9–2.1) can be used for super-resolution...achieving optical super-resolution. It has been demonstrated10 that silica spheres with refractive index (n) about 1.46 and with diame- ters (D) in the

Geometrical Patterning of Super-Hydrophobic Biosensing Transistors Enables Space and Time Resolved Analysis of Biological Mixtures.

PubMed

Gentile, Francesco; Ferrara, Lorenzo; Villani, Marco; Bettelli, Manuele; Iannotta, Salvatore; Zappettini, Andrea; Cesarelli, Mario; Di Fabrizio, Enzo; Coppedè, Nicola

2016-01-12

PSS is a conductive polymer that can be integrated into last generation Organic Electrochemical Transistor (OECT) devices for biological inspection, identification and analysis. While a variety of reports in literature demonstrated the chemical and biological sensitivity of these devices, still their ability in resolving complex mixtures remains controversial. Similar OECT devices display good time dynamics behavior but lack spatial resolution. In this work, we integrated PSS with patterns of super-hydrophobic pillars in which a finite number of those pillars is independently controlled for site-selective measurement of a solution. We obtained a multifunctional, hierarchical OECT device that bridges the micro- to the nano-scales for specific, combined time and space resolved analysis of the sample. Due to super-hydrophobic surface properties, the biological species in the drop are driven by convection, diffusion, and the externally applied electric field: the balance/unbalance between these forces will cause the molecules to be transported differently within its volume depending on particle size thus realizing a size-selective separation. Within this framework, the separation and identification of two different molecules, namely Cetyl Trimethyl Ammonium Bromid (CTAB) and adrenaline, in a biological mixture have been demonstrated, showing that geometrical control at the micro-nano scale impart unprecedented selectivity to the devices.

Geometrical Patterning of Super-Hydrophobic Biosensing Transistors Enables Space and Time Resolved Analysis of Biological Mixtures

PubMed Central

Gentile, Francesco; Ferrara, Lorenzo; Villani, Marco; Bettelli, Manuele; Iannotta, Salvatore; Zappettini, Andrea; Cesarelli, Mario; Di Fabrizio, Enzo; Coppedè, Nicola

2016-01-01

PEDOT:PSS is a conductive polymer that can be integrated into last generation Organic Electrochemical Transistor (OECT) devices for biological inspection, identification and analysis. While a variety of reports in literature demonstrated the chemical and biological sensitivity of these devices, still their ability in resolving complex mixtures remains controversial. Similar OECT devices display good time dynamics behavior but lack spatial resolution. In this work, we integrated PEDOT:PSS with patterns of super-hydrophobic pillars in which a finite number of those pillars is independently controlled for site-selective measurement of a solution. We obtained a multifunctional, hierarchical OECT device that bridges the micro- to the nano-scales for specific, combined time and space resolved analysis of the sample. Due to super-hydrophobic surface properties, the biological species in the drop are driven by convection, diffusion, and the externally applied electric field: the balance/unbalance between these forces will cause the molecules to be transported differently within its volume depending on particle size thus realizing a size-selective separation. Within this framework, the separation and identification of two different molecules, namely Cetyl Trimethyl Ammonium Bromid (CTAB) and adrenaline, in a biological mixture have been demonstrated, showing that geometrical control at the micro-nano scale impart unprecedented selectivity to the devices. PMID:26753611

Geometrical Patterning of Super-Hydrophobic Biosensing Transistors Enables Space and Time Resolved Analysis of Biological Mixtures

NASA Astrophysics Data System (ADS)

Gentile, Francesco; Ferrara, Lorenzo; Villani, Marco; Bettelli, Manuele; Iannotta, Salvatore; Zappettini, Andrea; Cesarelli, Mario; di Fabrizio, Enzo; Coppedè, Nicola

2016-01-01

PEDOT:PSS is a conductive polymer that can be integrated into last generation Organic Electrochemical Transistor (OECT) devices for biological inspection, identification and analysis. While a variety of reports in literature demonstrated the chemical and biological sensitivity of these devices, still their ability in resolving complex mixtures remains controversial. Similar OECT devices display good time dynamics behavior but lack spatial resolution. In this work, we integrated PEDOT:PSS with patterns of super-hydrophobic pillars in which a finite number of those pillars is independently controlled for site-selective measurement of a solution. We obtained a multifunctional, hierarchical OECT device that bridges the micro- to the nano-scales for specific, combined time and space resolved analysis of the sample. Due to super-hydrophobic surface properties, the biological species in the drop are driven by convection, diffusion, and the externally applied electric field: the balance/unbalance between these forces will cause the molecules to be transported differently within its volume depending on particle size thus realizing a size-selective separation. Within this framework, the separation and identification of two different molecules, namely Cetyl Trimethyl Ammonium Bromid (CTAB) and adrenaline, in a biological mixture have been demonstrated, showing that geometrical control at the micro-nano scale impart unprecedented selectivity to the devices.

A Bayesian Nonparametric Approach to Image Super-Resolution.

PubMed

Polatkan, Gungor; Zhou, Mingyuan; Carin, Lawrence; Blei, David; Daubechies, Ingrid

2015-02-01

Super-resolution methods form high-resolution images from low-resolution images. In this paper, we develop a new Bayesian nonparametric model for super-resolution. Our method uses a beta-Bernoulli process to learn a set of recurring visual patterns, called dictionary elements, from the data. Because it is nonparametric, the number of elements found is also determined from the data. We test the results on both benchmark and natural images, comparing with several other models from the research literature. We perform large-scale human evaluation experiments to assess the visual quality of the results. In a first implementation, we use Gibbs sampling to approximate the posterior. However, this algorithm is not feasible for large-scale data. To circumvent this, we then develop an online variational Bayes (VB) algorithm. This algorithm finds high quality dictionaries in a fraction of the time needed by the Gibbs sampler.

Fast live-cell conventional fluorophore nanoscopy with ImageJ through super-resolution radial fluctuations

PubMed Central

Gustafsson, Nils; Culley, Siân; Ashdown, George; Owen, Dylan M.; Pereira, Pedro Matos; Henriques, Ricardo

2016-01-01

Despite significant progress, high-speed live-cell super-resolution studies remain limited to specialized optical setups, generally requiring intense phototoxic illumination. Here, we describe a new analytical approach, super-resolution radial fluctuations (SRRF), provided as a fast graphics processing unit-enabled ImageJ plugin. In the most challenging data sets for super-resolution, such as those obtained in low-illumination live-cell imaging with GFP, we show that SRRF is generally capable of achieving resolutions better than 150 nm. Meanwhile, for data sets similar to those obtained in PALM or STORM imaging, SRRF achieves resolutions approaching those of standard single-molecule localization analysis. The broad applicability of SRRF and its performance at low signal-to-noise ratios allows super-resolution using modern widefield, confocal or TIRF microscopes with illumination orders of magnitude lower than methods such as PALM, STORM or STED. We demonstrate this by super-resolution live-cell imaging over timescales ranging from minutes to hours. PMID:27514992

Recent advances in the field of super resolved imaging and sensing

NASA Astrophysics Data System (ADS)

Zalevsky, Zeev; Borkowski, Amikam; Marom, Emanuel; Javidi, Bahram; Beiderman, Yevgeny; Micó, Vicente; García, Javier

2011-05-01

In this paper we start by presenting one recent development in the field of geometric super resolution. The new approach overcomes the reduction of resolution caused by the non ideal sampling of the image done by the spatial averaging of each pixel of the sampling array. Right after, we demonstrate a remote super sensing technique allowing monitoring, from a distance, the heart beats, blood pulse pressure and the glucose level in the blood stream of a patient by tracking the trajectory of secondary speckle patterns reflected from the skin of the wrist or from the sclera.

Field-portable pixel super-resolution colour microscope.

PubMed

Greenbaum, Alon; Akbari, Najva; Feizi, Alborz; Luo, Wei; Ozcan, Aydogan

2013-01-01

Based on partially-coherent digital in-line holography, we report a field-portable microscope that can render lensfree colour images over a wide field-of-view of e.g., >20 mm(2). This computational holographic microscope weighs less than 145 grams with dimensions smaller than 17×6×5 cm, making it especially suitable for field settings and point-of-care use. In this lensfree imaging design, we merged a colorization algorithm with a source shifting based multi-height pixel super-resolution technique to mitigate 'rainbow' like colour artefacts that are typical in holographic imaging. This image processing scheme is based on transforming the colour components of an RGB image into YUV colour space, which separates colour information from brightness component of an image. The resolution of our super-resolution colour microscope was characterized using a USAF test chart to confirm sub-micron spatial resolution, even for reconstructions that employ multi-height phase recovery to handle dense and connected objects. To further demonstrate the performance of this colour microscope Papanicolaou (Pap) smears were also successfully imaged. This field-portable and wide-field computational colour microscope could be useful for tele-medicine applications in resource poor settings.

Single-shot and single-sensor high/super-resolution microwave imaging based on metasurface.

PubMed

Wang, Libo; Li, Lianlin; Li, Yunbo; Zhang, Hao Chi; Cui, Tie Jun

2016-06-01

Real-time high-resolution (including super-resolution) imaging with low-cost hardware is a long sought-after goal in various imaging applications. Here, we propose broadband single-shot and single-sensor high-/super-resolution imaging by using a spatio-temporal dispersive metasurface and an imaging reconstruction algorithm. The metasurface with spatio-temporal dispersive property ensures the feasibility of the single-shot and single-sensor imager for super- and high-resolution imaging, since it can convert efficiently the detailed spatial information of the probed object into one-dimensional time- or frequency-dependent signal acquired by a single sensor fixed in the far-field region. The imaging quality can be improved by applying a feature-enhanced reconstruction algorithm in post-processing, and the desired imaging resolution is related to the distance between the object and metasurface. When the object is placed in the vicinity of the metasurface, the super-resolution imaging can be realized. The proposed imaging methodology provides a unique means to perform real-time data acquisition, high-/super-resolution images without employing expensive hardware (e.g. mechanical scanner, antenna array, etc.). We expect that this methodology could make potential breakthroughs in the areas of microwave, terahertz, optical, and even ultrasound imaging.

Single-shot and single-sensor high/super-resolution microwave imaging based on metasurface

PubMed Central

Wang, Libo; Li, Lianlin; Li, Yunbo; Zhang, Hao Chi; Cui, Tie Jun

2016-01-01

Real-time high-resolution (including super-resolution) imaging with low-cost hardware is a long sought-after goal in various imaging applications. Here, we propose broadband single-shot and single-sensor high-/super-resolution imaging by using a spatio-temporal dispersive metasurface and an imaging reconstruction algorithm. The metasurface with spatio-temporal dispersive property ensures the feasibility of the single-shot and single-sensor imager for super- and high-resolution imaging, since it can convert efficiently the detailed spatial information of the probed object into one-dimensional time- or frequency-dependent signal acquired by a single sensor fixed in the far-field region. The imaging quality can be improved by applying a feature-enhanced reconstruction algorithm in post-processing, and the desired imaging resolution is related to the distance between the object and metasurface. When the object is placed in the vicinity of the metasurface, the super-resolution imaging can be realized. The proposed imaging methodology provides a unique means to perform real-time data acquisition, high-/super-resolution images without employing expensive hardware (e.g. mechanical scanner, antenna array, etc.). We expect that this methodology could make potential breakthroughs in the areas of microwave, terahertz, optical, and even ultrasound imaging. PMID:27246668

Bayesian Deconvolution for Angular Super-Resolution in Forward-Looking Scanning Radar

PubMed Central

Zha, Yuebo; Huang, Yulin; Sun, Zhichao; Wang, Yue; Yang, Jianyu

2015-01-01

Scanning radar is of notable importance for ground surveillance, terrain mapping and disaster rescue. However, the angular resolution of a scanning radar image is poor compared to the achievable range resolution. This paper presents a deconvolution algorithm for angular super-resolution in scanning radar based on Bayesian theory, which states that the angular super-resolution can be realized by solving the corresponding deconvolution problem with the maximum a posteriori (MAP) criterion. The algorithm considers that the noise is composed of two mutually independent parts, i.e., a Gaussian signal-independent component and a Poisson signal-dependent component. In addition, the Laplace distribution is used to represent the prior information about the targets under the assumption that the radar image of interest can be represented by the dominant scatters in the scene. Experimental results demonstrate that the proposed deconvolution algorithm has higher precision for angular super-resolution compared with the conventional algorithms, such as the Tikhonov regularization algorithm, the Wiener filter and the Richardson–Lucy algorithm. PMID:25806871

Common fluorescent proteins for single-molecule localization microscopy

NASA Astrophysics Data System (ADS)

Klementieva, Natalia V.; Bozhanova, Nina G.; Mishina, Natalie M.; Zagaynova, Elena V.; Lukyanov, Konstantin A.; Mishin, Alexander S.

2015-07-01

Super-resolution techniques for breaking the diffraction barrier are spread out over multiple studies nowadays. Single-molecule localization microscopy such as PALM, STORM, GSDIM, etc allow to get super-resolved images of cell ultrastructure by precise localization of individual fluorescent molecules via their temporal isolation. However, these methods are supposed the use of fluorescent dyes and proteins with special characteristics (photoactivation/photoconversion). At the same time, there is a need for retaining high photostability of fluorophores during long-term acquisition. Here, we first showed the potential of common red fluorescent protein for single-molecule localization microscopy based on spontaneous intrinsic blinking. Also, we assessed the effect of different imaging media on photobleaching of these fluorescent proteins. Monomeric orange and red fluorescent proteins were examined for stochastic switching from a dark state to a bright fluorescent state. We studied fusions with cytoskeletal proteins in NIH/3T3 and HeLa cells. Imaging was performed on the Nikon N-STORM system equipped with EMCCD camera. To define the optimal imaging conditions we tested several types of cell culture media and buffers. As a result, high-resolution images of cytoskeleton structure were obtained. Essentially, low-intensity light was sufficient to initiate the switching of tested red fluorescent protein reducing phototoxicity and provide long-term live-cell imaging.

Enhancing multi-spot structured illumination microscopy with fluorescence difference

NASA Astrophysics Data System (ADS)

Ward, Edward N.; Torkelsen, Frida H.; Pal, Robert

2018-03-01

Structured illumination microscopy is a super-resolution technique used extensively in biological research. However, this technique is limited in the maximum possible resolution increase. Here we report the results of simulations of a novel enhanced multi-spot structured illumination technique. This method combines the super-resolution technique of difference microscopy with structured illumination deconvolution. Initial results give at minimum a 1.4-fold increase in resolution over conventional structured illumination in a low-noise environment. This new technique also has the potential to be expanded to further enhance axial resolution with three-dimensional difference microscopy. The requirement for precise pattern determination in this technique also led to the development of a new pattern estimation algorithm which proved more efficient and reliable than other methods tested.

Enhancing multi-spot structured illumination microscopy with fluorescence difference

PubMed Central

Torkelsen, Frida H.

2018-01-01

Structured illumination microscopy is a super-resolution technique used extensively in biological research. However, this technique is limited in the maximum possible resolution increase. Here we report the results of simulations of a novel enhanced multi-spot structured illumination technique. This method combines the super-resolution technique of difference microscopy with structured illumination deconvolution. Initial results give at minimum a 1.4-fold increase in resolution over conventional structured illumination in a low-noise environment. This new technique also has the potential to be expanded to further enhance axial resolution with three-dimensional difference microscopy. The requirement for precise pattern determination in this technique also led to the development of a new pattern estimation algorithm which proved more efficient and reliable than other methods tested. PMID:29657751

Super-Resolution in Plenoptic Cameras Using FPGAs

PubMed Central

Pérez, Joel; Magdaleno, Eduardo; Pérez, Fernando; Rodríguez, Manuel; Hernández, David; Corrales, Jaime

2014-01-01

Plenoptic cameras are a new type of sensor that extend the possibilities of current commercial cameras allowing 3D refocusing or the capture of 3D depths. One of the limitations of plenoptic cameras is their limited spatial resolution. In this paper we describe a fast, specialized hardware implementation of a super-resolution algorithm for plenoptic cameras. The algorithm has been designed for field programmable graphic array (FPGA) devices using VHDL (very high speed integrated circuit (VHSIC) hardware description language). With this technology, we obtain an acceleration of several orders of magnitude using its extremely high-performance signal processing capability through parallelism and pipeline architecture. The system has been developed using generics of the VHDL language. This allows a very versatile and parameterizable system. The system user can easily modify parameters such as data width, number of microlenses of the plenoptic camera, their size and shape, and the super-resolution factor. The speed of the algorithm in FPGA has been successfully compared with the execution using a conventional computer for several image sizes and different 3D refocusing planes. PMID:24841246

Super-resolution in plenoptic cameras using FPGAs.

PubMed

Pérez, Joel; Magdaleno, Eduardo; Pérez, Fernando; Rodríguez, Manuel; Hernández, David; Corrales, Jaime

2014-05-16

Plenoptic cameras are a new type of sensor that extend the possibilities of current commercial cameras allowing 3D refocusing or the capture of 3D depths. One of the limitations of plenoptic cameras is their limited spatial resolution. In this paper we describe a fast, specialized hardware implementation of a super-resolution algorithm for plenoptic cameras. The algorithm has been designed for field programmable graphic array (FPGA) devices using VHDL (very high speed integrated circuit (VHSIC) hardware description language). With this technology, we obtain an acceleration of several orders of magnitude using its extremely high-performance signal processing capability through parallelism and pipeline architecture. The system has been developed using generics of the VHDL language. This allows a very versatile and parameterizable system. The system user can easily modify parameters such as data width, number of microlenses of the plenoptic camera, their size and shape, and the super-resolution factor. The speed of the algorithm in FPGA has been successfully compared with the execution using a conventional computer for several image sizes and different 3D refocusing planes.

Signal Characteristics of Super-Resolution Near-Field Structure Disks with 100 GB Capacity

NASA Astrophysics Data System (ADS)

Kim, Jooho; Hwang, Inoh; Kim, Hyunki; Park, Insik; Tominaga, Junji

2005-05-01

We report the basic characteristics of super resolution near-field structure (Super-RENS) media at a blue laser optical system (laser wavelength 405 nm, numerical aperture 0.85). Using a novel write once read many (WORM) structure for a blue laser system, we obtained a carrier-to-noise ratio (CNR) above 33 dB from the signal of the 37.5 nm mark length, which is equivalent to a 100 GB capacity with a 0.32 micrometer track pitch, and an eye pattern for 50 GB (2T: 75 nm) capacity using a patterned signal. Using a novel super-resolution material (tellurium, Te) with low super-resolution readout power, we also improved the read stability.

Giga-pixel lensfree holographic microscopy and tomography using color image sensors.

PubMed

Isikman, Serhan O; Greenbaum, Alon; Luo, Wei; Coskun, Ahmet F; Ozcan, Aydogan

2012-01-01

We report Giga-pixel lensfree holographic microscopy and tomography using color sensor-arrays such as CMOS imagers that exhibit Bayer color filter patterns. Without physically removing these color filters coated on the sensor chip, we synthesize pixel super-resolved lensfree holograms, which are then reconstructed to achieve ~350 nm lateral resolution, corresponding to a numerical aperture of ~0.8, across a field-of-view of ~20.5 mm(2). This constitutes a digital image with ~0.7 Billion effective pixels in both amplitude and phase channels (i.e., ~1.4 Giga-pixels total). Furthermore, by changing the illumination angle (e.g., ± 50°) and scanning a partially-coherent light source across two orthogonal axes, super-resolved images of the same specimen from different viewing angles are created, which are then digitally combined to synthesize tomographic images of the object. Using this dual-axis lensfree tomographic imager running on a color sensor-chip, we achieve a 3D spatial resolution of ~0.35 µm × 0.35 µm × ~2 µm, in x, y and z, respectively, creating an effective voxel size of ~0.03 µm(3) across a sample volume of ~5 mm(3), which is equivalent to >150 Billion voxels. We demonstrate the proof-of-concept of this lensfree optical tomographic microscopy platform on a color CMOS image sensor by creating tomograms of micro-particles as well as a wild-type C. elegans nematode.

Resolution enhancement of 2-photon microscopy using high-refractive index microspheres

NASA Astrophysics Data System (ADS)

Tehrani, Kayvan Forouhesh; Darafsheh, Arash; Phang, Sendy; Mortensen, Luke J.

2018-02-01

Intravital microscopy using multiphoton processes is the standard tool for deep tissue imaging inside of biological specimens. Usually, near-infrared and infrared light is used to excite the sample, which enables imaging several mean free path inside a scattering tissues. Using longer wavelengths, however, increases the width of the effective multiphoton Point Spread Function (PSF). Many features inside of cells and tissues are smaller than the diffraction limit, and therefore not possible to distinguish using a large PSF. Microscopy using high refractive index microspheres has shown promise to increase the numerical aperture of an imaging system and enhance the resolution. It has been shown that microspheres can image features λ/7 using single photon process fluorescence. In this work, we investigate resolution enhancement for Second Harmonic Generation (SHG) and 2-photon fluorescence microscopy. We used Barium Titanate glass microspheres with diameters ˜20-30 μm and refractive index ˜1.9-2.1. We show microsphere-assisted SHG imaging in bone collagen fibers. Since bone is a very dense tissue constructed of bundles of collagen fibers, it is nontrivial to image individual fibers. We placed microspheres on a dense area of the mouse cranial bone, and achieved imaging of individual fibers. We found that microsphere assisted SHG imaging resolves features of the bone fibers that are not readily visible in conventional SHG imaging. We extended this work to 2-photon microscopy of mitochondria in mouse soleus muscle, and with the help of microsphere resolving power, we were able to trace individual mitochondrion from their ensemble.

Field-Portable Pixel Super-Resolution Colour Microscope

PubMed Central

Greenbaum, Alon; Akbari, Najva; Feizi, Alborz; Luo, Wei; Ozcan, Aydogan

2013-01-01

Based on partially-coherent digital in-line holography, we report a field-portable microscope that can render lensfree colour images over a wide field-of-view of e.g., >20 mm2. This computational holographic microscope weighs less than 145 grams with dimensions smaller than 17×6×5 cm, making it especially suitable for field settings and point-of-care use. In this lensfree imaging design, we merged a colorization algorithm with a source shifting based multi-height pixel super-resolution technique to mitigate ‘rainbow’ like colour artefacts that are typical in holographic imaging. This image processing scheme is based on transforming the colour components of an RGB image into YUV colour space, which separates colour information from brightness component of an image. The resolution of our super-resolution colour microscope was characterized using a USAF test chart to confirm sub-micron spatial resolution, even for reconstructions that employ multi-height phase recovery to handle dense and connected objects. To further demonstrate the performance of this colour microscope Papanicolaou (Pap) smears were also successfully imaged. This field-portable and wide-field computational colour microscope could be useful for tele-medicine applications in resource poor settings. PMID:24086742

Multi-frame super-resolution with quality self-assessment for retinal fundus videos.

PubMed

Köhler, Thomas; Brost, Alexander; Mogalle, Katja; Zhang, Qianyi; Köhler, Christiane; Michelson, Georg; Hornegger, Joachim; Tornow, Ralf P

2014-01-01

This paper proposes a novel super-resolution framework to reconstruct high-resolution fundus images from multiple low-resolution video frames in retinal fundus imaging. Natural eye movements during an examination are used as a cue for super-resolution in a robust maximum a-posteriori scheme. In order to compensate heterogeneous illumination on the fundus, we integrate retrospective illumination correction for photometric registration to the underlying imaging model. Our method utilizes quality self-assessment to provide objective quality scores for reconstructed images as well as to select regularization parameters automatically. In our evaluation on real data acquired from six human subjects with a low-cost video camera, the proposed method achieved considerable enhancements of low-resolution frames and improved noise and sharpness characteristics by 74%. In terms of image analysis, we demonstrate the importance of our method for the improvement of automatic blood vessel segmentation as an example application, where the sensitivity was increased by 13% using super-resolution reconstruction.

Macrophages in the Human Cochlea: Saviors or Predators—A Study Using Super-Resolution Immunohistochemistry

PubMed Central

Liu, Wei; Molnar, Matyas; Garnham, Carolyn; Benav, Heval; Rask-Andersen, Helge

2018-01-01

The human inner ear, which is segregated by a blood/labyrinth barrier, contains resident macrophages [CD163, ionized calcium-binding adaptor molecule 1 (IBA1)-, and CD68-positive cells] within the connective tissue, neurons, and supporting cells. In the lateral wall of the cochlea, these cells frequently lie close to blood vessels as perivascular macrophages. Macrophages are also shown to be recruited from blood-borne monocytes to damaged and dying hair cells induced by noise, ototoxic drugs, aging, and diphtheria toxin-induced hair cell degeneration. Precise monitoring may be crucial to avoid self-targeting. Macrophage biology has recently shown that populations of resident tissue macrophages may be fundamentally different from circulating macrophages. We removed uniquely preserved human cochleae during surgery for treating petroclival meningioma compressing the brain stem, after ethical consent. Molecular and cellular characterization using immunofluorescence with antibodies against IBA1, TUJ1, CX3CL1, and type IV collagen, and super-resolution structured illumination microscopy (SR-SIM) were made together with transmission electron microscopy. The super-resolution microscopy disclosed remarkable phenotypic variants of IBA1 cells closely associated with the spiral ganglion cells. Monitoring cells adhered to neurons with “synapse-like” specializations and protrusions. Active macrophages migrated occasionally nearby damaged hair cells. Results suggest that the human auditory nerve is under the surveillance and possible neurotrophic stimulation of a well-developed resident macrophage system. It may be alleviated by the non-myelinated nerve soma partly explaining why, in contrary to most mammals, the human’s auditory nerve is conserved following deafferentiation. It makes cochlear implantation possible, for the advantage of the profoundly deaf. The IBA1 cells may serve additional purposes such as immune modulation, waste disposal, and nerve regeneration. Their

Radial super-resolution in digital holographic microscopy using structured illumination with circular symmetry

NASA Astrophysics Data System (ADS)

Yin, Yujian; Su, Ping; Ma, Jianshe

2018-01-01

A method to improve the radial resolution using special structured light is proposed in the field of digital holographic microscopy (DHM). A specimen is illuminated with circular symmetrical structured light that makes the spectrum have radial movement, so that high frequency components of the specimen are moved into the passband of the receiver to overcome the diffraction limit. In the DHM imaging system, Computer Generated Hologram (CGH) technology is used to generate the required structured light grating. Then the grating is loaded into a spatial light modulator (SLM) to obtain specific structured illumination. After recording the hologram, digital reconstruction, for the microstructure of a binary optical element that needs to observe radial distribution, the radial resolution of the specimen is improved experimentally compare it with the result of one-dimensional sinusoidal structured light imaging. And a method of designing structured light is presented.

High-Resolution Intravital Microscopy

PubMed Central

Andresen, Volker; Pollok, Karolin; Rinnenthal, Jan-Leo; Oehme, Laura; Günther, Robert; Spiecker, Heinrich; Radbruch, Helena; Gerhard, Jenny; Sporbert, Anje; Cseresnyes, Zoltan; Hauser, Anja E.; Niesner, Raluca

2012-01-01

Cellular communication constitutes a fundamental mechanism of life, for instance by permitting transfer of information through synapses in the nervous system and by leading to activation of cells during the course of immune responses. Monitoring cell-cell interactions within living adult organisms is crucial in order to draw conclusions on their behavior with respect to the fate of cells, tissues and organs. Until now, there is no technology available that enables dynamic imaging deep within the tissue of living adult organisms at sub-cellular resolution, i.e. detection at the level of few protein molecules. Here we present a novel approach called multi-beam striped-illumination which applies for the first time the principle and advantages of structured-illumination, spatial modulation of the excitation pattern, to laser-scanning-microscopy. We use this approach in two-photon-microscopy - the most adequate optical deep-tissue imaging-technique. As compared to standard two-photon-microscopy, it achieves significant contrast enhancement and up to 3-fold improved axial resolution (optical sectioning) while photobleaching, photodamage and acquisition speed are similar. Its imaging depth is comparable to multifocal two-photon-microscopy and only slightly less than in standard single-beam two-photon-microscopy. Precisely, our studies within mouse lymph nodes demonstrated 216% improved axial and 23% improved lateral resolutions at a depth of 80 µm below the surface. Thus, we are for the first time able to visualize the dynamic interactions between B cells and immune complex deposits on follicular dendritic cells within germinal centers (GCs) of live mice. These interactions play a decisive role in the process of clonal selection, leading to affinity maturation of the humoral immune response. This novel high-resolution intravital microscopy method has a huge potential for numerous applications in neurosciences, immunology, cancer research and developmental biology

Optical super-resolution and periodical focusing effects by dielectric microspheres

NASA Astrophysics Data System (ADS)

Darafsheh, Arash

Optical microscopy is one of the oldest and most important imaging techniques; however, its far-field resolution is diffraction-limited. In this dissertation, we proposed and developed a novel method of optical microscopy with super-resolution by using high-index dielectric microspheres immersed in liquid and placed on the surface of the structures under study. We used barium titanate glass microspheres with diameters of D~2-220 mum and refractive indices n˜1.9-2.1 to discern minimal feature sizes ˜lambda/4 (down to ˜lambda/7) of various photonic and plasmonic nanostructures, where lambda is the illumination wavelength. We studied the magnification, field of view, and resolving power, in detail, as a function of sphere sizes. We studied optical coupling, transport, focusing, and polarization properties of linear arrays of dielectric spheres. We showed that in arrays of spheres with refractive index n=3, a special type of rays with transverse magnetic (TM) polarization incident on the spheres under the Brewster's angle form periodically focused modes with radial polarization and 2D period, where D is the diameter of the spheres. We showed that the formation of periodically focused modes in arrays of dielectric spheres gives a physical explanation for beam focusing and extraordinarily small attenuation of light in such chains. We showed that the light propagation in such arrays is strongly polarization-dependent, indicating that such arrays can be used as filters of beams with radial polarization. The effect of forming progressively smaller focused beams was experimentally observed in chains of sapphire spheres in agreement with the theory. We studied optical coupling,transport, focusing, and polarization properties of linear arrays of dielectric spheres. We showed that in arrays of spheres with refractive index n=a3, a special type of rays with transverse magnetic (TM) polarization incident on the spheres under the Brewster's angle form periodically focused modes

Super resolution terahertz imaging by subpixel estimation: application to hyperspectral beam profiling

NASA Astrophysics Data System (ADS)

Logofătu, Petre C.; Damian, Victor

2018-05-01

A super-resolution terahertz imaging technique based on subpixel estimation was applied to hyperspectral beam profiling. The topic of hyperspectral beam profiling was chosen because the beam profile and its dependence on wavelength are not well known and are important for imaging applications. Super-resolution is required here to avoid diffraction effects and to provide a stronger signal. Super-resolution usually adds supplementary information to the measurement, but in this case, it is a prerequisite for it. We report that the beam profile is almost Gaussian for many frequencies; the waist of the Gaussian profile increases with frequency while the center wobbles slightly. Knowledge of the beam profile may subsequently be used as reference for imaging.

Three-Dimensional Localization of Single Molecules for Super-Resolution Imaging and Single-Particle Tracking

PubMed Central

von Diezmann, Alex; Shechtman, Yoav; Moerner, W. E.

2017-01-01

Single-molecule super-resolution fluorescence microscopy and single-particle tracking are two imaging modalities that illuminate the properties of cells and materials on spatial scales down to tens of nanometers, or with dynamical information about nanoscale particle motion in the millisecond range, respectively. These methods generally use wide-field microscopes and two-dimensional camera detectors to localize molecules to much higher precision than the diffraction limit. Given the limited total photons available from each single-molecule label, both modalities require careful mathematical analysis and image processing. Much more information can be obtained about the system under study by extending to three-dimensional (3D) single-molecule localization: without this capability, visualization of structures or motions extending in the axial direction can easily be missed or confused, compromising scientific understanding. A variety of methods for obtaining both 3D super-resolution images and 3D tracking information have been devised, each with their own strengths and weaknesses. These include imaging of multiple focal planes, point-spread-function engineering, and interferometric detection. These methods may be compared based on their ability to provide accurate and precise position information of single-molecule emitters with limited photons. To successfully apply and further develop these methods, it is essential to consider many practical concerns, including the effects of optical aberrations, field-dependence in the imaging system, fluorophore labeling density, and registration between different color channels. Selected examples of 3D super-resolution imaging and tracking are described for illustration from a variety of biological contexts and with a variety of methods, demonstrating the power of 3D localization for understanding complex systems. PMID:28151646

A super-resolution ultrasound method for brain vascular mapping

PubMed Central

O'Reilly, Meaghan A.; Hynynen, Kullervo

2013-01-01

Purpose: High-resolution vascular imaging has not been achieved in the brain due to limitations of current clinical imaging modalities. The authors present a method for transcranial ultrasound imaging of single micrometer-size bubbles within a tube phantom. Methods: Emissions from single bubbles within a tube phantom were mapped through an ex vivo human skull using a sparse hemispherical receiver array and a passive beamforming algorithm. Noninvasive phase and amplitude correction techniques were applied to compensate for the aberrating effects of the skull bone. The positions of the individual bubbles were estimated beyond the diffraction limit of ultrasound to produce a super-resolution image of the tube phantom, which was compared with microcomputed tomography (micro-CT). Results: The resulting super-resolution ultrasound image is comparable to results obtained via the micro-CT for small tissue specimen imaging. Conclusions: This method provides superior resolution to deep-tissue contrast ultrasound and has the potential to be extended to provide complete vascular network imaging in the brain. PMID:24320408

Single molecule super-resolution imaging of proteins in living Salmonella enterica using self-labelling enzymes

PubMed Central

Barlag, Britta; Beutel, Oliver; Janning, Dennis; Czarniak, Frederik; Richter, Christian P.; Kommnick, Carina; Göser, Vera; Kurre, Rainer; Fabiani, Florian; Erhardt, Marc; Piehler, Jacob; Hensel, Michael

2016-01-01

The investigation of the subcellular localization, dynamics and interaction of proteins and protein complexes in prokaryotes is complicated by the small size of the cells. Super-resolution microscopy (SRM) comprise various new techniques that allow light microscopy with a resolution that can be up to ten-fold higher than conventional light microscopy. Application of SRM techniques to living prokaryotes demands the introduction of suitable fluorescent probes, usually by fusion of proteins of interest to fluorescent proteins with properties compatible to SRM. Here we describe an approach that is based on the genetically encoded self-labelling enzymes HaloTag and SNAP-tag. Proteins of interest are fused to HaloTag or SNAP-tag and cell permeable substrates can be labelled with various SRM-compatible fluorochromes. Fusions of the enzyme tags to subunits of a type I secretion system (T1SS), a T3SS, the flagellar rotor and a transcription factor were generated and analysed in living Salmonella enterica. The new approach is versatile in tagging proteins of interest in bacterial cells and allows to determine the number, relative subcellular localization and dynamics of protein complexes in living cells. PMID:27534893

Interferometric temporal focusing microscopy using three-photon excitation fluorescence.

PubMed

Toda, Keisuke; Isobe, Keisuke; Namiki, Kana; Kawano, Hiroyuki; Miyawaki, Atsushi; Midorikawa, Katsumi

2018-04-01

Super-resolution microscopy has become a powerful tool for biological research. However, its spatial resolution and imaging depth are limited, largely due to background light. Interferometric temporal focusing (ITF) microscopy, which combines structured illumination microscopy and three-photon excitation fluorescence microscopy, can overcome these limitations. Here, we demonstrate ITF microscopy using three-photon excitation fluorescence, which has a spatial resolution of 106 nm at an imaging depth of 100 µm with an excitation wavelength of 1060 nm.

A graphene oxide-carbon nanotube grid for high-resolution transmission electron microscopy of nanomaterials.

PubMed

Zhang, Lina; Zhang, Haoxu; Zhou, Ruifeng; Chen, Zhuo; Li, Qunqing; Fan, Shoushan; Ge, Guanglu; Liu, Renxiao; Jiang, Kaili

2011-09-23

A novel grid for use in transmission electron microscopy is developed. The supporting film of the grid is composed of thin graphene oxide films overlying a super-aligned carbon nanotube network. The composite film combines the advantages of graphene oxide and carbon nanotube networks and has the following properties: it is ultra-thin, it has a large flat and smooth effective supporting area with a homogeneous amorphous appearance, high stability, and good conductivity. The graphene oxide-carbon nanotube grid has a distinct advantage when characterizing the fine structure of a mass of nanomaterials over conventional amorphous carbon grids. Clear high-resolution transmission electron microscopy images of various nanomaterials are obtained easily using the new grids.

Application of Super-Resolution Convolutional Neural Network for Enhancing Image Resolution in Chest CT.

PubMed

Umehara, Kensuke; Ota, Junko; Ishida, Takayuki

2017-10-18

In this study, the super-resolution convolutional neural network (SRCNN) scheme, which is the emerging deep-learning-based super-resolution method for enhancing image resolution in chest CT images, was applied and evaluated using the post-processing approach. For evaluation, 89 chest CT cases were sampled from The Cancer Imaging Archive. The 89 CT cases were divided randomly into 45 training cases and 44 external test cases. The SRCNN was trained using the training dataset. With the trained SRCNN, a high-resolution image was reconstructed from a low-resolution image, which was down-sampled from an original test image. For quantitative evaluation, two image quality metrics were measured and compared to those of the conventional linear interpolation methods. The image restoration quality of the SRCNN scheme was significantly higher than that of the linear interpolation methods (p < 0.001 or p < 0.05). The high-resolution image reconstructed by the SRCNN scheme was highly restored and comparable to the original reference image, in particular, for a ×2 magnification. These results indicate that the SRCNN scheme significantly outperforms the linear interpolation methods for enhancing image resolution in chest CT images. The results also suggest that SRCNN may become a potential solution for generating high-resolution CT images from standard CT images.

Multiband super-resolution imaging of graded-index photonic crystal flat lens

NASA Astrophysics Data System (ADS)

Xie, Jianlan; Wang, Junzhong; Ge, Rui; Yan, Bei; Liu, Exian; Tan, Wei; Liu, Jianjun

2018-05-01

Multiband super-resolution imaging of point source is achieved by a graded-index photonic crystal flat lens. With the calculations of six bands in common photonic crystal (CPC) constructed with scatterers of different refractive indices, it can be found that the super-resolution imaging of point source can be realized by different physical mechanisms in three different bands. In the first band, the imaging of point source is based on far-field condition of spherical wave while in the second band, it is based on the negative effective refractive index and exhibiting higher imaging quality than that of the CPC. However, in the fifth band, the imaging of point source is mainly based on negative refraction of anisotropic equi-frequency surfaces. The novel method of employing different physical mechanisms to achieve multiband super-resolution imaging of point source is highly meaningful for the field of imaging.

Capturing the Surface Texture and Shape of Pollen: A Comparison of Microscopy Techniques

PubMed Central

Sivaguru, Mayandi; Mander, Luke; Fried, Glenn; Punyasena, Surangi W.

2012-01-01

Research on the comparative morphology of pollen grains depends crucially on the application of appropriate microscopy techniques. Information on the performance of microscopy techniques can be used to inform that choice. We compared the ability of several microscopy techniques to provide information on the shape and surface texture of three pollen types with differing morphologies. These techniques are: widefield, apotome, confocal and two-photon microscopy (reflected light techniques), and brightfield and differential interference contrast microscopy (DIC) (transmitted light techniques). We also provide a first view of pollen using super-resolution microscopy. The three pollen types used to contrast the performance of each technique are: Croton hirtus (Euphorbiaceae), Mabea occidentalis (Euphorbiaceae) and Agropyron repens (Poaceae). No single microscopy technique provided an adequate picture of both the shape and surface texture of any of the three pollen types investigated here. The wavelength of incident light, photon-collection ability of the optical technique, signal-to-noise ratio, and the thickness and light absorption characteristics of the exine profoundly affect the recovery of morphological information by a given optical microscopy technique. Reflected light techniques, particularly confocal and two-photon microscopy, best capture pollen shape but provide limited information on very fine surface texture. In contrast, transmitted light techniques, particularly differential interference contrast microscopy, can resolve very fine surface texture but provide limited information on shape. Texture comprising sculptural elements that are spaced near the diffraction limit of light (∼250 nm; NDL) presents an acute challenge to optical microscopy. Super-resolution structured illumination microscopy provides data on the NDL texture of A. repens that is more comparable to textural data from scanning electron microscopy than any other optical microscopy technique

Submicron-resolution photoacoustic microscopy of endogenous light-absorbing biomolecules

NASA Astrophysics Data System (ADS)

Zhang, Chi

Photoacoustic imaging in biomedicine has the unique advantage of probing endogenous light absorbers at various length scales with a 100% relative sensitivity. Among the several modalities of photoacoustic imaging, optical-resolution photoacoustic microscopy (OR-PAM) can achieve high spatial resolution, on the order of optical wavelength, at <1 mm depth in biological tissue (the optical ballistic regime). OR-PAM has been applied successfully to structural and functional imaging of blood vasculature and red blood cells in vivo. Any molecules which absorb sufficient light at certain wavelengths can potentially be imaged by PAM. Compared with pure optical imaging, which typically targets fluorescent markers, label-free PAM avoids the major concerns that the fluorescent labeling probes may disturb the function of biomolecules and may have an insufficient density. This dissertation aims to advance label-free OR-PAM to the subcellular scale. The first part of this dissertation describes the technological advancement of PAM yielding high spatial resolution in 3D. The lateral resolution was improved by using optical objectives with high numerical apertures for optical focusing. The axial resolution was improved by using broadband ultrasonic transducers for ultrasound detection. We achieved 220 nm lateral resolution in transmission mode, 0.43 microm lateral resolution in reflection mode, 7.6 microm axial resolution in normal tissue, and 5.8 microm axial resolution with silicone oil immersion/injection. The achieved lateral resolution and axial resolution were the finest reported at the time. With high-resolution in 3D, PAM was demonstrated to resolve cellular and subcellular structures in vivo, such as red blood cells and melanosomes in melanoma cells. Compared with previous PAM systems, our high-resolution PAM could resolve capillaries in mouse ears more clearly. As an example application, we demonstrated intracellular temperature imaging, assisted by fluorescence signal

High resolution MR microscopy

NASA Astrophysics Data System (ADS)

Ciobanu, Luisa

Magnetic resonance imaging (MRI) microscopy [1] has the potential to bring the full capabilities of NMR to arbitrarily specified localized positions within small samples. The most interesting target of study is the living biological cell, with typical dimensions ˜100 mum, but with substructures that are much smaller, such as the cell nucleus (typically ˜10 mu m) and mitochondria (1--10 mum). One anticipates that the development of MR microscopy with resolution at the level of these substructures or better and with a wide, three dimensional field-of-view could open a new avenue of investigation into the biology of the living cell. Although the first MR image of a single biological cell was reported in 1987 [2], the cell imaged had quite large (˜1 mm diameter) spatial dimensions and the resolution obtained (on the order of 10 mu m) was not adequate for meaningful imaging of more typically sized cells. The quest for higher resolution has continued. In 1989 Zhou et al. [3] obtained fully three dimensional images with spatial resolution of (6.37 mum)3, or 260 femtoliters. While better "in-plane" resolutions (i.e., the resolution in 2 of the 3 spatial dimensions) have since been obtained, [4, 5] this volume resolution was not exceeded until quite recently by Lee et al., [6] who report 2D images having volume resolution of 75 mum 3 and in-plane resolution of 1 mum. In parallel with these advances in raw resolution several investigators [7, 8, 9] have focused on localized spectroscopy and/or chemical shift imaging. The key obstacles to overcome in MR microscopy are (1) the loss of signal to noise that occurs when observing small volumes and (2) molecular diffusion during the measurement or encoding. To date the problem of sensitivity has typically been addressed by employing small micro-coil receivers. [10] The problem of molecular diffusion can only be defeated with strong magnetic field gradients that can encode spatial information quickly. We report MR microscopy

Single Image Super-Resolution Based on Multi-Scale Competitive Convolutional Neural Network

PubMed Central

Qu, Xiaobo; He, Yifan

2018-01-01

Deep convolutional neural networks (CNNs) are successful in single-image super-resolution. Traditional CNNs are limited to exploit multi-scale contextual information for image reconstruction due to the fixed convolutional kernel in their building modules. To restore various scales of image details, we enhance the multi-scale inference capability of CNNs by introducing competition among multi-scale convolutional filters, and build up a shallow network under limited computational resources. The proposed network has the following two advantages: (1) the multi-scale convolutional kernel provides the multi-context for image super-resolution, and (2) the maximum competitive strategy adaptively chooses the optimal scale of information for image reconstruction. Our experimental results on image super-resolution show that the performance of the proposed network outperforms the state-of-the-art methods. PMID:29509666

Single Image Super-Resolution Based on Multi-Scale Competitive Convolutional Neural Network.

PubMed

Du, Xiaofeng; Qu, Xiaobo; He, Yifan; Guo, Di

2018-03-06

Deep convolutional neural networks (CNNs) are successful in single-image super-resolution. Traditional CNNs are limited to exploit multi-scale contextual information for image reconstruction due to the fixed convolutional kernel in their building modules. To restore various scales of image details, we enhance the multi-scale inference capability of CNNs by introducing competition among multi-scale convolutional filters, and build up a shallow network under limited computational resources. The proposed network has the following two advantages: (1) the multi-scale convolutional kernel provides the multi-context for image super-resolution, and (2) the maximum competitive strategy adaptively chooses the optimal scale of information for image reconstruction. Our experimental results on image super-resolution show that the performance of the proposed network outperforms the state-of-the-art methods.

ON THE IMPACT OF SUPER RESOLUTION WSR-88D DOPPLER RADAR DATA ASSIMILATION ON HIGH RESOLUTION NUMERICAL MODEL FORECASTS

DOE Office of Scientific and Technical Information (OSTI.GOV)

Chiswell, S

2009-01-11

Assimilation of radar velocity and precipitation fields into high-resolution model simulations can improve precipitation forecasts with decreased 'spin-up' time and improve short-term simulation of boundary layer winds (Benjamin, 2004 & 2007; Xiao, 2008) which is critical to improving plume transport forecasts. Accurate description of wind and turbulence fields is essential to useful atmospheric transport and dispersion results, and any improvement in the accuracy of these fields will make consequence assessment more valuable during both routine operation as well as potential emergency situations. During 2008, the United States National Weather Service (NWS) radars implemented a significant upgrade which increased the real-timemore » level II data resolution to 8 times their previous 'legacy' resolution, from 1 km range gate and 1.0 degree azimuthal resolution to 'super resolution' 250 m range gate and 0.5 degree azimuthal resolution (Fig 1). These radar observations provide reflectivity, velocity and returned power spectra measurements at a range of up to 300 km (460 km for reflectivity) at a frequency of 4-5 minutes and yield up to 13.5 million point observations per level in super-resolution mode. The migration of National Weather Service (NWS) WSR-88D radars to super resolution is expected to improve warning lead times by detecting small scale features sooner with increased reliability; however, current operational mesoscale model domains utilize grid spacing several times larger than the legacy data resolution, and therefore the added resolution of radar data is not fully exploited. The assimilation of super resolution reflectivity and velocity data into high resolution numerical weather model forecasts where grid spacing is comparable to the radar data resolution is investigated here to determine the impact of the improved data resolution on model predictions.« less

High-speed X-ray microscopy by use of high-resolution zone plates and synchrotron radiation.

PubMed

Hou, Qiyue; Wang, Zhili; Gao, Kun; Pan, Zhiyun; Wang, Dajiang; Ge, Xin; Zhang, Kai; Hong, Youli; Zhu, Peiping; Wu, Ziyu

2012-09-01

X-ray microscopy based on synchrotron radiation has become a fundamental tool in biology and life sciences to visualize the morphology of a specimen. These studies have particular requirements in terms of radiation damage and the image exposure time, which directly determines the total acquisition speed. To monitor and improve these key parameters, we present a novel X-ray microscopy method using a high-resolution zone plate as the objective and the matching condenser. Numerical simulations based on the scalar wave field theory validate the feasibility of the method and also indicate the performance of X-ray microscopy is optimized most with sub-10-nm-resolution zone plates. The proposed method is compatible with conventional X-ray microscopy techniques, such as computed tomography, and will find wide applications in time-resolved and/or dose-sensitive studies such as living cell imaging.

On the dynamic readout characteristic of nonlinear super-resolution optical storage

NASA Astrophysics Data System (ADS)

Wei, Jingsong

2013-03-01

Researchers have developed nonlinear super-resolution optical storage for the past twenty years. However, several concerns remain, including (1) the presence of readout threshold power; (2) the increase of threshold power with the reduction of the mark size, and (3) the increase of the carrier-to-noise ratio (CNR) at the initial stage and then decrease with the increase of readout laser power or laser irradiation time. The present work calculates and analyzes the super-resolution spot formed by the thin film masks and the readout threshold power characteristic according to the derived formula and based on the nonlinear saturable absorption characteristic and threshold of structural change. The obtained theoretical calculation and experimental data answer the concerns regarding the dynamic readout threshold characteristic and CNR dependence on laser power and irradiation time. The near-field optical spot scanning experiment further verifies the super-resolution spot formation produced through the nonlinear thin film masks.

Super-Resolution Reconstruction of Remote Sensing Images Using Multifractal Analysis

PubMed Central

Hu, Mao-Gui; Wang, Jin-Feng; Ge, Yong

2009-01-01

Satellite remote sensing (RS) is an important contributor to Earth observation, providing various kinds of imagery every day, but low spatial resolution remains a critical bottleneck in a lot of applications, restricting higher spatial resolution analysis (e.g., intra-urban). In this study, a multifractal-based super-resolution reconstruction method is proposed to alleviate this problem. The multifractal characteristic is common in Nature. The self-similarity or self-affinity presented in the image is useful to estimate details at larger and smaller scales than the original. We first look for the presence of multifractal characteristics in the images. Then we estimate parameters of the information transfer function and noise of the low resolution image. Finally, a noise-free, spatial resolution-enhanced image is generated by a fractal coding-based denoising and downscaling method. The empirical case shows that the reconstructed super-resolution image performs well in detail enhancement. This method is not only useful for remote sensing in investigating Earth, but also for other images with multifractal characteristics. PMID:22291530

Localization microscopy of DNA in situ using Vybrant{sup ®} DyeCycle™ Violet fluorescent probe: A new approach to study nuclear nanostructure at single molecule resolution

DOE Office of Scientific and Technical Information (OSTI.GOV)

Żurek-Biesiada, Dominika; Szczurek, Aleksander T.; Prakash, Kirti

Higher order chromatin structure is not only required to compact and spatially arrange long chromatids within a nucleus, but have also important functional roles, including control of gene expression and DNA processing. However, studies of chromatin nanostructures cannot be performed using conventional widefield and confocal microscopy because of the limited optical resolution. Various methods of superresolution microscopy have been described to overcome this difficulty, like structured illumination and single molecule localization microscopy. We report here that the standard DNA dye Vybrant{sup ®} DyeCycle™ Violet can be used to provide single molecule localization microscopy (SMLM) images of DNA in nuclei ofmore » fixed mammalian cells. This SMLM method enabled optical isolation and localization of large numbers of DNA-bound molecules, usually in excess of 10{sup 6} signals in one cell nucleus. The technique yielded high-quality images of nuclear DNA density, revealing subdiffraction chromatin structures of the size in the order of 100 nm; the interchromatin compartment was visualized at unprecedented optical resolution. The approach offers several advantages over previously described high resolution DNA imaging methods, including high specificity, an ability to record images using a single wavelength excitation, and a higher density of single molecule signals than reported in previous SMLM studies. The method is compatible with DNA/multicolor SMLM imaging which employs simple staining methods suited also for conventional optical microscopy. - Highlights: • Super-resolution imaging of nuclear DNA with Vybrant Violet and blue excitation. • 90nm resolution images of DNA structures in optically thick eukaryotic nuclei. • Enhanced resolution confirms the existence of DNA-free regions inside the nucleus. • Optimized imaging conditions enable multicolor super-resolution imaging.« less

Vernier-like super resolution with guided correlated photon pairs.

PubMed

Nespoli, Matteo; Goan, Hsi-Sheng; Shih, Min-Hsiung

2016-01-11

We describe a dispersion-enabled, ultra-low power realization of super-resolution in an integrated Mach-Zehnder interferometer. Our scheme is based on a Vernier-like effect in the coincident detection of frequency correlated, non-degenerate photon pairs at the sensor output in the presence of group index dispersion. We design and simulate a realistic integrated refractive index sensor in a silicon nitride on silica platform and characterize its performance in the proposed scheme. We present numerical results showing a sensitivity improvement upward of 40 times over a traditional sensing scheme. The device we design is well within the reach of modern semiconductor fabrication technology. We believe this is the first metrology scheme that uses waveguide group index dispersion as a resource to attain super-resolution.

Improved vocal tract reconstruction and modeling using an image super-resolution technique.

PubMed

Zhou, Xinhui; Woo, Jonghye; Stone, Maureen; Prince, Jerry L; Espy-Wilson, Carol Y

2013-06-01

Magnetic resonance imaging has been widely used in speech production research. Often only one image stack (sagittal, axial, or coronal) is used for vocal tract modeling. As a result, complementary information from other available stacks is not utilized. To overcome this, a recently developed super-resolution technique was applied to integrate three orthogonal low-resolution stacks into one isotropic volume. The results on vowels show that the super-resolution volume produces better vocal tract visualization than any of the low-resolution stacks. Its derived area functions generally produce formant predictions closer to the ground truth, particularly for those formants sensitive to area perturbations at constrictions.

Multiframe super resolution reconstruction method based on light field angular images

NASA Astrophysics Data System (ADS)

Zhou, Shubo; Yuan, Yan; Su, Lijuan; Ding, Xiaomin; Wang, Jichao

2017-12-01

The plenoptic camera can directly obtain 4-dimensional light field information from a 2-dimensional sensor. However, based on the sampling theorem, the spatial resolution is greatly limited by the microlenses. In this paper, we present a method of reconstructing high-resolution images from the angular images. First, the ray tracing method is used to model the telecentric-based light field imaging process. Then, we analyze the subpixel shifts between the angular images extracted from the defocused light field data and the blur in the angular images. According to the analysis above, we construct the observation model from the ideal high-resolution image to the angular images. Applying the regularized super resolution method, we can obtain the super resolution result with a magnification ratio of 8. The results demonstrate the effectiveness of the proposed observation model.

Materials characterisation by angle-resolved scanning transmission electron microscopy.

PubMed

Müller-Caspary, Knut; Oppermann, Oliver; Grieb, Tim; Krause, Florian F; Rosenauer, Andreas; Schowalter, Marco; Mehrtens, Thorsten; Beyer, Andreas; Volz, Kerstin; Potapov, Pavel

2016-11-16

Solid-state properties such as strain or chemical composition often leave characteristic fingerprints in the angular dependence of electron scattering. Scanning transmission electron microscopy (STEM) is dedicated to probe scattered intensity with atomic resolution, but it drastically lacks angular resolution. Here we report both a setup to exploit the explicit angular dependence of scattered intensity and applications of angle-resolved STEM to semiconductor nanostructures. Our method is applied to measure nitrogen content and specimen thickness in a GaN x As 1-x layer independently at atomic resolution by evaluating two dedicated angular intervals. We demonstrate contrast formation due to strain and composition in a Si- based metal-oxide semiconductor field effect transistor (MOSFET) with Ge x Si 1-x stressors as a function of the angles used for imaging. To shed light on the validity of current theoretical approaches this data is compared with theory, namely the Rutherford approach and contemporary multislice simulations. Inconsistency is found for the Rutherford model in the whole angular range of 16-255 mrad. Contrary, the multislice simulations are applicable for angles larger than 35 mrad whereas a significant mismatch is observed at lower angles. This limitation of established simulations is discussed particularly on the basis of inelastic scattering.

Resolution Limits of Nanoimprinted Patterns by Fluorescence Microscopy

NASA Astrophysics Data System (ADS)

Kubo, Shoichi; Tomioka, Tatsuya; Nakagawa, Masaru

2013-06-01

The authors investigated optical resolution limits to identify minimum distances between convex lines of fluorescent dye-doped nanoimprinted resist patterns by fluorescence microscopy. Fluorescent ultraviolet (UV)-curable resin and thermoplastic resin films were transformed into line-and-space patterns by UV nanoimprinting and thermal nanoimprinting, respectively. Fluorescence immersion observation needed an immersion medium immiscible to the resist films, and an ionic liquid of triisobutyl methylphosphonium tosylate was appropriate for soluble thermoplastic polystyrene patterns. Observation with various numerical aperture (NA) values and two detection wavelength ranges showed that the resolution limits were smaller than the values estimated by the Sparrow criterion. The space width to identify line patterns became narrower as the line width increased. The space width of 100 nm was demonstrated to be sufficient to resolve 300-nm-wide lines in the detection wavelength range of 575-625 nm using an objective lens of NA= 1.40.

Recent advancements in structured-illumination microscopy toward live-cell imaging.

PubMed

Hirano, Yasuhiro; Matsuda, Atsushi; Hiraoka, Yasushi

2015-08-01

Fluorescence microscopy allows us to observe fluorescently labeled molecules in diverse biological processes and organelle structures within living cells. However, the diffraction limit restricts its spatial resolution to about half of its wavelength, limiting the capability of biological observation at the molecular level. Structured-illumination microscopy (SIM), a type of super-resolution microscopy, doubles the spatial resolution in all three dimensions by illuminating the sample with a patterned excitation light, followed by computer reconstruction. SIM uses a relatively low illumination power compared with other methods of super-resolution microscopy and is easily available for multicolor imaging. SIM has great potential for meeting the requirements of live-cell imaging. Recent developments in diverse types of SIM have achieved higher spatial (∼50 nm lateral) and temporal (∼100 Hz) resolutions. Here, we review recent advancements in SIM and discuss its application in noninvasive live-cell imaging. © The Author 2015. Published by Oxford University Press on behalf of The Japanese Society of Microscopy. All rights reserved. For permissions, please e-mail: journals.permissions@oup.com.

Sub-pixel mapping of hyperspectral imagery using super-resolution

NASA Astrophysics Data System (ADS)

Sharma, Shreya; Sharma, Shakti; Buddhiraju, Krishna M.

2016-04-01

With the development of remote sensing technologies, it has become possible to obtain an overview of landscape elements which helps in studying the changes on earth's surface due to climate, geological, geomorphological and human activities. Remote sensing measures the electromagnetic radiations from the earth's surface and match the spectral similarity between the observed signature and the known standard signatures of the various targets. However, problem lies when image classification techniques assume pixels to be pure. In hyperspectral imagery, images have high spectral resolution but poor spatial resolution. Therefore, the spectra obtained is often contaminated due to the presence of mixed pixels and causes misclassification. To utilise this high spectral information, spatial resolution has to be enhanced. Many factors make the spatial resolution one of the most expensive and hardest to improve in imaging systems. To solve this problem, post-processing of hyperspectral images is done to retrieve more information from the already acquired images. The algorithm to enhance spatial resolution of the images by dividing them into sub-pixels is known as super-resolution and several researches have been done in this domain.In this paper, we propose a new method for super-resolution based on ant colony optimization and review the popular methods of sub-pixel mapping of hyperspectral images along with their comparative analysis.

Micelle-templated composite quantum dots for super-resolution imaging.

PubMed

Xu, Jianquan; Fan, Qirui; Mahajan, Kalpesh D; Ruan, Gang; Herrington, Andrew; Tehrani, Kayvan F; Kner, Peter; Winter, Jessica O

2014-05-16

Quantum dots (QDs) have tremendous potential for biomedical imaging, including super-resolution techniques that permit imaging below the diffraction limit. However, most QDs are produced via organic methods, and hence require surface treatment to render them water-soluble for biological applications. Previously, we reported a micelle-templating method that yields nanocomposites containing multiple core/shell ZnS-CdSe QDs within the same nanocarrier, increasing overall particle brightness and virtually eliminating QD blinking. Here, this technique is extended to the encapsulation of Mn-doped ZnSe QDs (Mn-ZnSe QDs), which have potential applications in super-resolution imaging as a result of the introduction of Mn(2+) dopant energy levels. The size, shape and fluorescence characteristics of these doped QD-micelles were compared to those of micelles created using core/shell ZnS-CdSe QDs (ZnS-CdSe QD-micelles). Additionally, the stability of both types of particles to photo-oxidation was investigated. Compared to commercial QDs, micelle-templated QDs demonstrated superior fluorescence intensity, higher signal-to-noise ratios, and greater stability against photo-oxidization,while reducing blinking. Additionally, the fluorescence of doped QD-micelles could be modulated from a bright 'on' state to a dark 'off' state, with a modulation depth of up to 76%, suggesting the potential of doped QD-micelles for applications in super-resolution imaging.

Single image super-resolution via an iterative reproducing kernel Hilbert space method.

PubMed

Deng, Liang-Jian; Guo, Weihong; Huang, Ting-Zhu

2016-11-01

Image super-resolution, a process to enhance image resolution, has important applications in satellite imaging, high definition television, medical imaging, etc. Many existing approaches use multiple low-resolution images to recover one high-resolution image. In this paper, we present an iterative scheme to solve single image super-resolution problems. It recovers a high quality high-resolution image from solely one low-resolution image without using a training data set. We solve the problem from image intensity function estimation perspective and assume the image contains smooth and edge components. We model the smooth components of an image using a thin-plate reproducing kernel Hilbert space (RKHS) and the edges using approximated Heaviside functions. The proposed method is applied to image patches, aiming to reduce computation and storage. Visual and quantitative comparisons with some competitive approaches show the effectiveness of the proposed method.

Conical diffraction as a versatile building block to implement new imaging modalities for superresolution in fluorescence microscopy

NASA Astrophysics Data System (ADS)

Fallet, Clément; Caron, Julien; Oddos, Stephane; Tinevez, Jean-Yves; Moisan, Lionel; Sirat, Gabriel Y.; Braitbart, Philippe O.; Shorte, Spencer L.

2014-08-01

We present a new technology for super-resolution fluorescence imaging, based on conical diffraction. Conical diffraction is a linear, singular phenomenon taking place when a polarized beam is diffracted through a biaxial crystal. The illumination patterns generated by conical diffraction are more compact than the classical Gaussian beam; we use them to generate a super-resolution imaging modality. Conical Diffraction Microscopy (CODIM) resolution enhancement can be achieved with any type of objective on any kind of sample preparation and standard fluorophores. Conical diffraction can be used in multiple fashion to create new and disruptive technologies for super-resolution microscopy. This paper will focus on the first one that has been implemented and give a glimpse at what the future of microscopy using conical diffraction could be.

Resolution enhancement of tri-stereo remote sensing images by super resolution methods

NASA Astrophysics Data System (ADS)

Tuna, Caglayan; Akoguz, Alper; Unal, Gozde; Sertel, Elif

2016-10-01

Super resolution (SR) refers to generation of a High Resolution (HR) image from a decimated, blurred, low-resolution (LR) image set, which can be either a single frame or multi-frame that contains a collection of several images acquired from slightly different views of the same observation area. In this study, we propose a novel application of tri-stereo Remote Sensing (RS) satellite images to the super resolution problem. Since the tri-stereo RS images of the same observation area are acquired from three different viewing angles along the flight path of the satellite, these RS images are properly suited to a SR application. We first estimate registration between the chosen reference LR image and other LR images to calculate the sub pixel shifts among the LR images. Then, the warping, blurring and down sampling matrix operators are created as sparse matrices to avoid high memory and computational requirements, which would otherwise make the RS-SR solution impractical. Finally, the overall system matrix, which is constructed based on the obtained operator matrices is used to obtain the estimate HR image in one step in each iteration of the SR algorithm. Both the Laplacian and total variation regularizers are incorporated separately into our algorithm and the results are presented to demonstrate an improved quantitative performance against the standard interpolation method as well as improved qualitative results due expert evaluations.

"Supertrap" at Work: Extremely Efficient Nonradiative Recombination Channels in MAPbI3 Perovskites Revealed by Luminescence Super-Resolution Imaging and Spectroscopy.

PubMed

Merdasa, Aboma; Tian, Yuxi; Camacho, Rafael; Dobrovolsky, Alexander; Debroye, Elke; Unger, Eva L; Hofkens, Johan; Sundström, Villy; Scheblykin, Ivan G

2017-06-27

Organo-metal halide perovskites are some of the most promising materials for the new generation of low-cost photovoltaic and light-emitting devices. Their solution processability is a beneficial trait, although it leads to a spatial inhomogeneity of perovskite films with a variation of the trap state density at the nanoscale. Comprehending their properties using traditional spectroscopy therefore becomes difficult, calling for a combination with microscopy in order to see beyond the ensemble-averaged response. We studied photoluminescence (PL) blinking of micrometer-sized individual methylammonium lead iodide (MAPbI 3 ) perovskite polycrystals, as well as monocrystalline microrods up to 10 μm long. We correlated their PL dynamics with structure employing scanning electron and optical super-resolution microscopy. Combining super-resolution localization imaging and super-resolution optical fluctuation imaging (SOFI), we could detect and quantify preferential emitting regions in polycrystals exhibiting different types of blinking. We propose that blinking in MAPbI 3 occurs by the activation/passivation of a "supertrap" which presumably is a donor-acceptor pair able to trap both electrons and holes. As such, nonradiative recombination via supertraps, in spite being present at a rather low concentrations (10 12 -10 15 cm -3 ), is much more efficient than via all other defect states present in the material at higher concentrations (10 16 -10 18 cm -3 ). We speculate that activation/deactivation of a supertrap occurs by its temporary dissociation into free donor and acceptor impurities. We found that supertraps are most efficient in structurally homogeneous and large MAPbI 3 crystals where carrier diffusion is efficient, which may therefore pose limitations on the efficiency of perovskite-based devices.

Breaking resolution limits in ultrafast electron diffraction and microscopy.

PubMed

Baum, Peter; Zewail, Ahmed H

2006-10-31

Ultrafast electron microscopy and diffraction are powerful techniques for the study of the time-resolved structures of molecules, materials, and biological systems. Central to these approaches is the use of ultrafast coherent electron packets. The electron pulses typically have an energy of 30 keV for diffraction and 100-200 keV for microscopy, corresponding to speeds of 33-70% of the speed of light. Although the spatial resolution can reach the atomic scale, the temporal resolution is limited by the pulse width and by the difference in group velocities of electrons and the light used to initiate the dynamical change. In this contribution, we introduce the concept of tilted optical pulses into diffraction and imaging techniques and demonstrate the methodology experimentally. These advances allow us to reach limits of time resolution down to regimes of a few femtoseconds and, possibly, attoseconds. With tilted pulses, every part of the sample is excited at precisely the same time as when the electrons arrive at the specimen. Here, this approach is demonstrated for the most unfavorable case of ultrafast crystallography. We also present a method for measuring the duration of electron packets by autocorrelating electron pulses in free space and without streaking, and we discuss the potential of tilting the electron pulses themselves for applications in domains involving nuclear and electron motions.

Breaking resolution limits in ultrafast electron diffraction and microscopy

PubMed Central

Baum, Peter; Zewail, Ahmed H.

2006-01-01

Ultrafast electron microscopy and diffraction are powerful techniques for the study of the time-resolved structures of molecules, materials, and biological systems. Central to these approaches is the use of ultrafast coherent electron packets. The electron pulses typically have an energy of 30 keV for diffraction and 100–200 keV for microscopy, corresponding to speeds of 33–70% of the speed of light. Although the spatial resolution can reach the atomic scale, the temporal resolution is limited by the pulse width and by the difference in group velocities of electrons and the light used to initiate the dynamical change. In this contribution, we introduce the concept of tilted optical pulses into diffraction and imaging techniques and demonstrate the methodology experimentally. These advances allow us to reach limits of time resolution down to regimes of a few femtoseconds and, possibly, attoseconds. With tilted pulses, every part of the sample is excited at precisely the same time as when the electrons arrive at the specimen. Here, this approach is demonstrated for the most unfavorable case of ultrafast crystallography. We also present a method for measuring the duration of electron packets by autocorrelating electron pulses in free space and without streaking, and we discuss the potential of tilting the electron pulses themselves for applications in domains involving nuclear and electron motions. PMID:17056711

NMR Microscopy - Micron-Level Resolution.

NASA Astrophysics Data System (ADS)

Kwok, Wing-Chi Edmund

1990-01-01

Nuclear Magnetic Resonance Imaging (MRI) has been developed into a powerful and widely used diagnostic tool since the invention of techniques using linear magnetic field gradients in 1973. The variety of imaging contrasts obtainable in MRI, such as spin density, relaxation times and flow rate, gives MRI a significant advantage over other imaging techniques. For common diagnostic applications, image resolutions have been in the order of millimeters with slice thicknesses in centimeters. For many research applications, however, resolutions in the order of tens of microns or smaller are needed. NMR Imaging in these high resolution disciplines is known as NMR microscopy. Compared with conventional microscopy, NMR microscopy has the advantage of being non-invasive and non-destructive. The major obstacles of NMR microscopy are low signal-to-noise ratio and effects due to spin diffusion. To overcome these difficulties, more sensitive RF probes and very high magnetic field gradients have to be used. The most effective way to increase sensitivity is to build smaller probes. Microscope probes of different designs have been built and evaluated. Magnetic field gradient coils that can produce linear field gradients up to 450 Gauss/cm were also assembled. In addition, since microscope probes often employ remote capacitors for RF tuning, the associated signal loss in the transmission line was studied. Imaging experiments have been carried out in a 2.1 Tesla small bore superconducting magnet using the typical two-dimensional spin warp imaging technique. Images have been acquired for both biological and non-biological samples. The highest resolution was obtained in an image of a nerve bundle from the spinal cord of a racoon and has an in-plane resolution of 4 microns. These experiments have demonstrated the potential application of NMR microscopy to pathological research, nervous system study and non -destructive testings of materials. One way to further improve NMR microscopy is

Sub-diffraction-limit localization imaging of a plasmonic nanoparticle pair with wavelength-resolved dark-field microscopy.

PubMed

Wei, Lin; Ma, Yanhong; Zhu, Xupeng; Xu, Jianghong; Wang, Yaxin; Duan, Huigao; Xiao, Lehui

2017-06-29

In this work, with wavelength-resolved dark-field microscopy, the center-of-mass localization information from nanoparticle pairs (i.e., spherical (45 nm in diameter) and rod (45 × 70 nm) shaped gold nanoparticle pairs with different gap distances and orientations) was explored and compared with the results determined by scanning electron microscopy (SEM) measurements. When the gap distance was less than 20 nm, the scattering spectrum of the nanoparticle pair was seriously modulated by the plasmonic coupling effect. The measured coordinate information determined by the optical method (Gaussian fitting) was not consistent with the true results determined by SEM measurement. A good correlation between the optical and SEM measurements was achieved when the gap distance was further increased (e.g., 20, 40 and 60 nm). Under these conditions, well-defined scattering peaks assigned to the corresponding individual nanoparticles could be distinguished from the obtained scattering spectrum. These results would afford valuable information for the studies on single plasmonic nanoparticle imaging applications with the optical microscopy method such as super-localization imaging, high precision single particle tracking in a crowding environment and so on.

Resolution limits of ultrafast ultrasound localization microscopy

NASA Astrophysics Data System (ADS)

Desailly, Yann; Pierre, Juliette; Couture, Olivier; Tanter, Mickael

2015-11-01

As in other imaging methods based on waves, the resolution of ultrasound imaging is limited by the wavelength. However, the diffraction-limit can be overcome by super-localizing single events from isolated sources. In recent years, we developed plane-wave ultrasound allowing frame rates up to 20 000 fps. Ultrafast processes such as rapid movement or disruption of ultrasound contrast agents (UCA) can thus be monitored, providing us with distinct punctual sources that could be localized beyond the diffraction limit. We previously showed experimentally that resolutions beyond λ/10 can be reached in ultrafast ultrasound localization microscopy (uULM) using a 128 transducer matrix in reception. Higher resolutions are theoretically achievable and the aim of this study is to predict the maximum resolution in uULM with respect to acquisition parameters (frequency, transducer geometry, sampling electronics). The accuracy of uULM is the error on the localization of a bubble, considered a point-source in a homogeneous medium. The proposed model consists in two steps: determining the timing accuracy of the microbubble echo in radiofrequency data, then transferring this time accuracy into spatial accuracy. The simplified model predicts a maximum resolution of 40 μm for a 1.75 MHz transducer matrix composed of two rows of 64 elements. Experimental confirmation of the model was performed by flowing microbubbles within a 60 μm microfluidic channel and localizing their blinking under ultrafast imaging (500 Hz frame rate). The experimental resolution, determined as the standard deviation in the positioning of the microbubbles, was predicted within 6 μm (13%) of the theoretical values and followed the analytical relationship with respect to the number of elements and depth. Understanding the underlying physical principles determining the resolution of superlocalization will allow the optimization of the imaging setup for each organ. Ultimately, accuracies better than the size

Patch-Based Super-Resolution of MR Spectroscopic Images: Application to Multiple Sclerosis

PubMed Central

Jain, Saurabh; Sima, Diana M.; Sanaei Nezhad, Faezeh; Hangel, Gilbert; Bogner, Wolfgang; Williams, Stephen; Van Huffel, Sabine; Maes, Frederik; Smeets, Dirk

2017-01-01

Purpose: Magnetic resonance spectroscopic imaging (MRSI) provides complementary information to conventional magnetic resonance imaging. Acquiring high resolution MRSI is time consuming and requires complex reconstruction techniques. Methods: In this paper, a patch-based super-resolution method is presented to increase the spatial resolution of metabolite maps computed from MRSI. The proposed method uses high resolution anatomical MR images (T1-weighted and Fluid-attenuated inversion recovery) to regularize the super-resolution process. The accuracy of the method is validated against conventional interpolation techniques using a phantom, as well as simulated and in vivo acquired human brain images of multiple sclerosis subjects. Results: The method preserves tissue contrast and structural information, and matches well with the trend of acquired high resolution MRSI. Conclusions: These results suggest that the method has potential for clinically relevant neuroimaging applications. PMID:28197066

Transfer function characteristics of super resolving systems

NASA Technical Reports Server (NTRS)

Milster, Tom D.; Curtis, Craig H.

1992-01-01

Signal quality in an optical storage device greatly depends on the optical system transfer function used to write and read data patterns. The problem is similar to analysis of scanning optical microscopes. Hopkins and Braat have analyzed write-once-read-many (WORM) optical data storage devices. Herein, transfer function analysis of magnetooptic (MO) data storage devices is discussed with respect to improving transfer-function characteristics. Several authors have described improving the transfer function as super resolution. However, none have thoroughly analyzed the MO optical system and effects of the medium. Both the optical system transfer function and effects of the medium of this development are discussed.

Super-Chelators for Advanced Protein Labeling in Living Cells.

PubMed

Gatterdam, Karl; Joest, Eike F; Dietz, Marina S; Heilemann, Mike; Tampé, Robert

2018-05-14

Live-cell labeling, super-resolution microscopy, single-molecule applications, protein localization, or chemically induced assembly are emerging approaches, which require specific and very small interaction pairs. The minimal disturbance of protein function is essential to derive unbiased insights into cellular processes. Herein, we define a new class of hexavalent N-nitrilotriacetic acid (hexaNTA) chelators, displaying the highest affinity and stability of all NTA-based small interaction pairs described so far. Coupled to bright organic fluorophores with fine-tuned photophysical properties, the super-chelator probes were delivered into human cells by chemically gated nanopores. These super-chelators permit kinetic profiling, multiplexed labeling of His 6 - and His 12 -tagged proteins as well as single-molecule-based super-resolution imaging. © 2018 Wiley-VCH Verlag GmbH & Co. KGaA, Weinheim.

Resolution doubling in fluorescence microscopy with confocal spinning-disk image scanning microscopy.

PubMed

Schulz, Olaf; Pieper, Christoph; Clever, Michaela; Pfaff, Janine; Ruhlandt, Aike; Kehlenbach, Ralph H; Wouters, Fred S; Großhans, Jörg; Bunt, Gertrude; Enderlein, Jörg

2013-12-24

We demonstrate how a conventional confocal spinning-disk (CSD) microscope can be converted into a doubly resolving image scanning microscopy (ISM) system without changing any part of its optical or mechanical elements. Making use of the intrinsic properties of a CSD microscope, we illuminate stroboscopically, generating an array of excitation foci that are moved across the sample by varying the phase between stroboscopic excitation and rotation of the spinning disk. ISM then generates an image with nearly doubled resolution. Using conventional fluorophores, we have imaged single nuclear pore complexes in the nuclear membrane and aggregates of GFP-conjugated Tau protein in three dimensions. Multicolor ISM was shown on cytoskeletal-associated structural proteins and on 3D four-color images including MitoTracker and Hoechst staining. The simple adaptation of conventional CSD equipment allows superresolution investigations of a broad variety of cell biological questions.

Super-resolution using a light inception layer in convolutional neural network

NASA Astrophysics Data System (ADS)

Mou, Qinyang; Guo, Jun

2018-04-01

Recently, several models based on CNN architecture have achieved great result on Single Image Super-Resolution (SISR) problem. In this paper, we propose an image super-resolution method (SR) using a light inception layer in convolutional network (LICN). Due to the strong representation ability of our well-designed inception layer that can learn richer representation with less parameters, we can build our model with shallow architecture that can reduce the effect of vanishing gradients problem and save computational costs. Our model strike a balance between computational speed and the quality of the result. Compared with state-of-the-art result, we produce comparable or better results with faster computational speed.

Time-resolved polarization imaging by pump-probe (stimulated emission) fluorescence microscopy.

PubMed Central

Buehler, C; Dong, C Y; So, P T; French, T; Gratton, E

2000-01-01

We report the application of pump-probe fluorescence microscopy in time-resolved polarization imaging. We derived the equations governing the pump-probe stimulated emission process and characterized the pump and probe laser power levels for signal saturation. Our emphasis is to use this novel methodology to image polarization properties of fluorophores across entire cells. As a feasibility study, we imaged a 15-microm orange latex sphere and found that there is depolarization that is possibly due to energy transfer among fluorescent molecules inside the sphere. We also imaged a mouse fibroblast labeled with CellTracker Orange CMTMR (5-(and-6)-(((4-chloromethyl)benzoyl)amino)tetramethyl-rhodamine). We observed that Orange CMTMR complexed with gluthathione rotates fast, indicating the relatively low fluid-phase viscosity of the cytoplasmic microenvironment as seen by Orange CMTMR. The measured rotational correlation time ranged from approximately 30 to approximately 150 ps. This work demonstrates the effectiveness of stimulated emission measurements in acquiring high-resolution, time-resolved polarization information across the entire cell. PMID:10866979

Breast Microcalcification Detection Using Super-Resolution Ultrasound Image Reconstruction

DTIC Science & Technology

2010-09-01

microcalcifications often occur as one of two types: calcium oxalate dihydrate or calcium hydroxyapatite. Their sizes range approximately from 0.1 mm to 0.5 mm...super-resolution imaging, ultrasound imaging, wave equation. 1. INTRODUCTION Microcalcifications, tiny specks of mineral deposits ( calcium ), are the

The Super-Linear Slope Of The Spatially-resolved Star Formation Law In NGC 3521 And NGC 5194 (m51a)

NASA Astrophysics Data System (ADS)

Liu, Guilin; Koda, J.; Calzetti, D.; Fukuhara, M.; Momose, R.

2011-01-01

We have conducted interferometric observations with CARMA and an OTF mapping with the 45-m telescope at NRO in the CO (1-0) emission line of NGC 3521. Combining these new data, together with similar data for M51a and archival SINGS H-alpha, 24um, THINGS H I and GALEX FUV data for both galaxies, we investigate the empirical scaling law that connects the surface density of star formation rate (SFR) and cold gas (the Schmidt-Kennicutt law) on a spatially-resolved basis, and find a super-linear slope when carefully subtracting the background emissions in the SFR image. We argue that plausibly deriving SFR maps of nearby galaxies requires the diffuse stellar/dust background emission to be carefully subtracted (especially in mid-IR). An approach to complete this task is presented and applied in our pixel-by-pixel analysis on both galaxies, showing that the controversial results whether the molecular S-K law is super-linear or basically linear is a result of removing or preserving the local background. In both galaxies, the power index of the molecular S-K law is super-linear (1.5-1.9) at the highest available resolution (230 pc), and decreases monotonically for decreasing resolution; while the scatter (mainly intrinsic) increases as the resolution becomes higher, indicating a trend for which the S-K law breaks down below some scale. Both quantities are systematically larger in M51a than in NGC 3521, but when plotted against the de-projected scale, they become highly consistent between the two galaxies, tentatively suggesting that the sub-kpc molecular S-K law in spiral galaxies depends only on the scale being considered, without varying amongst spiral galaxies. We obtaion slope=-1.1[log(scale/kpc)]+1.4 and scatter=-0.2 [scale/kpc]+0.7 through fitting to the M51a data, which describes both galaxies impressively well on sub-kpc scales. However, a larger sample of galaxies with better sensitivity, resolution and broader FoV are required to test these results.

Simple fiber-optic confocal microscopy with nanoscale depth resolution beyond the diffraction barrier.

PubMed

Ilev, Ilko; Waynant, Ronald; Gannot, Israel; Gandjbakhche, Amir

2007-09-01

A novel fiber-optic confocal approach for ultrahigh depth-resolution (microscopy beyond the diffraction barrier in the subwavelength nanometric range below 200 nm is presented. The key idea is based on a simple fiber-optic confocal microscope approach that is compatible with a differential confocal microscope technique. To improve the dynamic range of the resolving laser power and to achieve a high resolution in the nanometric range, we have designed a simple apertureless reflection confocal microscope with a highly sensitive single-mode-fiber confocal output. The fiber-optic design is an effective alternative to conventional pinhole-based confocal systems and offers a number of advantages in terms of spatial resolution, flexibility, miniaturization, and scanning potential. Furthermore, the design is compatible with the differential confocal pinhole microscope based on the use of the sharp diffraction-free slope of the axial confocal response curve rather than the area around the maximum of that curve. Combining the advantages of ultrahigh-resolution fiber-optic confocal microscopy, we can work beyond the diffraction barrier in the subwavelength (below 200 nm) nanometric range exploiting confocal nanobioimaging of single cell and intracellular analytes.

In-line FINCH super resolution digital holographic fluorescence microscopy using a high efficiency transmission liquid crystal GRIN lens.

PubMed

Brooker, Gary; Siegel, Nisan; Rosen, Joseph; Hashimoto, Nobuyuki; Kurihara, Makoto; Tanabe, Ayano

2013-12-15

We report a new optical arrangement that creates high-efficiency, high-quality Fresnel incoherent correlation holography (FINCH) holograms using polarization sensitive transmission liquid crystal gradient index (TLCGRIN) diffractive lenses. In contrast, current universal practice in the field employs a reflective spatial light modulator (SLM) to separate sample and reference beams. Polarization sensitive TLCGRIN lenses enable a straight optical path, have >90% transmission efficiency, are not pixilated, and are free of many limitations of reflective SLM devices. For each sample point, two spherical beams created by a glass lens in combination with a polarization sensitive TLCGRIN lens interfere and create a hologram and resultant super resolution image.

Serpentine Ultralong Path with Extended Routing (SUPER) High Resolution Traveling Wave Ion Mobility-MS using Structures for Lossless Ion Manipulations

DOE Office of Scientific and Technical Information (OSTI.GOV)

Deng, Liulin; Webb, Ian K.; Garimella, Sandilya V. B.

Ion mobility (IM) separations have a broad range of analytical applications, but insufficient resolution limits many applications. Here we report on traveling wave (TW) ion mobility (IM) separations in a Serpentine Ultra-long Path with Extended Routing (SUPER) Structures for Lossless Ion Manipulations (SLIM) module in conjunction with mass spectrometry (MS). The extended routing utilized multiple passes was facilitated by the introduction of a lossless ion switch at the end of the ion path that either directed ions to the MS detector or to another pass through the serpentine separation region, providing theoretically unlimited TWIM path lengths. Ions were confined inmore » the SLIM by rf fields in conjunction with a DC guard bias, enabling essentially lossless TW transmission over greatly extended paths (e.g., ~1094 meters over 81 passes through the 13.5 m serpentine path). In this multi-pass SUPER TWIM provided resolution approximately proportional to the square root of the number of passes (or path length). More than 30-fold higher IM resolution for Agilent tuning mix m/z 622 and 922 ions (~340 vs. ~10) was achieved for 40 passes compared to commercially available drift tube IM and other TWIM-based platforms. An initial evaluation of the isomeric sugars Lacto-N-hexaose and Lacto-N-neohexaose showed the isomeric structures to be baseline resolved, and a new conformational feature for Lacto-N-neohexaose was revealed after 9 passes. The new SLIM SUPER high resolution TWIM platform has broad utility in conjunction with MS and is expected to enable a broad range of previously challenging or intractable separations.« less

Stochastic Optical Reconstruction Microscopy (STORM).

PubMed

Xu, Jianquan; Ma, Hongqiang; Liu, Yang

2017-07-05

Super-resolution (SR) fluorescence microscopy, a class of optical microscopy techniques at a spatial resolution below the diffraction limit, has revolutionized the way we study biology, as recognized by the Nobel Prize in Chemistry in 2014. Stochastic optical reconstruction microscopy (STORM), a widely used SR technique, is based on the principle of single molecule localization. STORM routinely achieves a spatial resolution of 20 to 30 nm, a ten-fold improvement compared to conventional optical microscopy. Among all SR techniques, STORM offers a high spatial resolution with simple optical instrumentation and standard organic fluorescent dyes, but it is also prone to image artifacts and degraded image resolution due to improper sample preparation or imaging conditions. It requires careful optimization of all three aspects-sample preparation, image acquisition, and image reconstruction-to ensure a high-quality STORM image, which will be extensively discussed in this unit. © 2017 by John Wiley & Sons, Inc. Copyright © 2017 John Wiley & Sons, Inc.

MIiSR: Molecular Interactions in Super-Resolution Imaging Enables the Analysis of Protein Interactions, Dynamics and Formation of Multi-protein Structures.

PubMed

Caetano, Fabiana A; Dirk, Brennan S; Tam, Joshua H K; Cavanagh, P Craig; Goiko, Maria; Ferguson, Stephen S G; Pasternak, Stephen H; Dikeakos, Jimmy D; de Bruyn, John R; Heit, Bryan

2015-12-01

Our current understanding of the molecular mechanisms which regulate cellular processes such as vesicular trafficking has been enabled by conventional biochemical and microscopy techniques. However, these methods often obscure the heterogeneity of the cellular environment, thus precluding a quantitative assessment of the molecular interactions regulating these processes. Herein, we present Molecular Interactions in Super Resolution (MIiSR) software which provides quantitative analysis tools for use with super-resolution images. MIiSR combines multiple tools for analyzing intermolecular interactions, molecular clustering and image segmentation. These tools enable quantification, in the native environment of the cell, of molecular interactions and the formation of higher-order molecular complexes. The capabilities and limitations of these analytical tools are demonstrated using both modeled data and examples derived from the vesicular trafficking system, thereby providing an established and validated experimental workflow capable of quantitatively assessing molecular interactions and molecular complex formation within the heterogeneous environment of the cell.

Resolution improvement by nonconfocal theta microscopy.

PubMed

Lindek, S; Stelzer, E H

1999-11-01

We present a novel scanning fluorescence microscopy technique, nonconfocal theta microscopy (NCTM), that provides almost isotropic resolution. In NCTM, multiphoton absorption from two orthogonal illumination directions is used to induce fluorescence emission. Therefore the point-spread function of the microscope is described by the product of illumination point-spread functions with reduced spatial overlap, which provides the resolution improvement and the more isotropic observation volume. We discuss the technical details of this new method.

Optical super-resolution effect induced by nonlinear characteristics of graphene oxide films

NASA Astrophysics Data System (ADS)

Zhao, Yong-chuang; Nie, Zhong-quan; Zhai, Ai-ping; Tian, Yan-ting; Liu, Chao; Shi, Chang-kun; Jia, Bao-hua

2018-01-01

In this work, we focus on the optical super-resolution effect induced by strong nonlinear saturation absorption (NSA) of graphene oxide (GO) membranes. The third-order optical nonlinearities are characterized by the canonical Z-scan technique under femtosecond laser (wavelength: 800 nm, pulse width: 100 fs) excitation. Through controlling the applied femtosecond laser energy, NSA of the GO films can be tuned continuously. The GO film is placed at the focal plane as a unique amplitude filter to improve the resolution of the focused field. A multi-layer system model is proposed to present the generation of a deep sub-wavelength spot associated with the nonlinearity of GO films. Moreover, the parameter conditions to achieve the best resolution (˜λ/6) are determined entirely. The demonstrated results here are useful for high density optical recoding and storage, nanolithography, and super-resolution optical imaging.

Super-resolution image reconstruction from UAS surveillance video through affine invariant interest point-based motion estimation

NASA Astrophysics Data System (ADS)

He, Qiang; Schultz, Richard R.; Wang, Yi; Camargo, Aldo; Martel, Florent

2008-01-01

In traditional super-resolution methods, researchers generally assume that accurate subpixel image registration parameters are given a priori. In reality, accurate image registration on a subpixel grid is the single most critically important step for the accuracy of super-resolution image reconstruction. In this paper, we introduce affine invariant features to improve subpixel image registration, which considerably reduces the number of mismatched points and hence makes traditional image registration more efficient and more accurate for super-resolution video enhancement. Affine invariant interest points include those corners that are invariant to affine transformations, including scale, rotation, and translation. They are extracted from the second moment matrix through the integration and differentiation covariance matrices. Our tests are based on two sets of real video captured by a small Unmanned Aircraft System (UAS) aircraft, which is highly susceptible to vibration from even light winds. The experimental results from real UAS surveillance video show that affine invariant interest points are more robust to perspective distortion and present more accurate matching than traditional Harris/SIFT corners. In our experiments on real video, all matching affine invariant interest points are found correctly. In addition, for the same super-resolution problem, we can use many fewer affine invariant points than Harris/SIFT corners to obtain good super-resolution results.

Super-Resolution Imaging Reveals TCTN2 Depletion-Induced IFT88 Lumen Leakage and Ciliary Weakening.

PubMed

Weng, Rueyhung Roc; Yang, T Tony; Huang, Chia-En; Chang, Chih-Wei; Wang, Won-Jing; Liao, Jung-Chi

2018-06-01

The primary cilium is an essential organelle mediating key signaling activities, such as sonic hedgehog signaling. The molecular composition of the ciliary compartment is distinct from that of the cytosol, with the transition zone (TZ) gated the ciliary base. The TZ is a packed and organized protein complex containing multiple ciliopathy-associated protein species. Tectonic 2 (TCTN2) is one of the TZ proteins in the vicinity of the ciliary membrane, and its mutation is associated with Meckel syndrome. Despite its importance in ciliopathies, the role of TCTN2 in ciliary structure and molecules remains unclear. Here, we created a CRISPR/Cas9 TCTN2 knockout human retinal pigment epithelial cell line and conducted quantitative analysis of geometric localization using both wide-field and super-resolution microscopy techniques. We found that TCTN2 depletion resulted in partial TZ damage, loss of ciliary membrane proteins, leakage of intraflagellar transport protein IFT88 toward the basal body lumen, and cilium shortening and curving. The basal body lumen occupancy of IFT88 was also observed in si-RPGRIP1L cells and cytochalasin-D-treated wild-type cells, suggesting varying lumen accessibility for intraflagellar transport proteins under different perturbed conditions. Our findings support two possible models for the lumen leakage of IFT88, i.e., a tip leakage model and a misregulation model. Together, our quantitative image analysis augmented by super-resolution microscopy facilitates the observation of structural destruction and molecular redistribution in TCTN2 -/- cilia, shedding light on mechanistic understanding of TZ-protein-associated ciliopathies. Copyright © 2018 Biophysical Society. Published by Elsevier Inc. All rights reserved.

Simultaneous digital super-resolution and nonuniformity correction for infrared imaging systems.

PubMed

Meza, Pablo; Machuca, Guillermo; Torres, Sergio; Martin, Cesar San; Vera, Esteban

2015-07-20

In this article, we present a novel algorithm to achieve simultaneous digital super-resolution and nonuniformity correction from a sequence of infrared images. We propose to use spatial regularization terms that exploit nonlocal means and the absence of spatial correlation between the scene and the nonuniformity noise sources. We derive an iterative optimization algorithm based on a gradient descent minimization strategy. Results from infrared image sequences corrupted with simulated and real fixed-pattern noise show a competitive performance compared with state-of-the-art methods. A qualitative analysis on the experimental results obtained with images from a variety of infrared cameras indicates that the proposed method provides super-resolution images with significantly less fixed-pattern noise.

Super-resolution processing for multi-functional LPI waveforms

NASA Astrophysics Data System (ADS)

Li, Zhengzheng; Zhang, Yan; Wang, Shang; Cai, Jingxiao

2014-05-01

Super-resolution (SR) is a radar processing technique closely related to the pulse compression (or correlation receiver). There are many super-resolution algorithms developed for the improved range resolution and reduced sidelobe contaminations. Traditionally, the waveforms used for the SR have been either phase-coding (such as LKP3 code, Barker code) or the frequency modulation (chirp, or nonlinear frequency modulation). There are, however, an important class of waveforms which are either random in nature (such as random noise waveform), or randomly modulated for multiple function operations (such as the ADS-B radar signals in [1]). These waveforms have the advantages of low-probability-of-intercept (LPI). If the existing SR techniques can be applied to these waveforms, there will be much more flexibility for using these waveforms in actual sensing missions. Also, SR usually has great advantage that the final output (as estimation of ground truth) is largely independent of the waveform. Such benefits are attractive to many important primary radar applications. In this paper the general introduction of the SR algorithms are provided first, and some implementation considerations are discussed. The selected algorithms are applied to the typical LPI waveforms, and the results are discussed. It is observed that SR algorithms can be reliably used for LPI waveforms, on the other hand, practical considerations should be kept in mind in order to obtain the optimal estimation results.

ATOMIC RESOLUTION CRYO ELECTRON MICROSCOPY OF MACROMOLECULAR COMPLEXES

PubMed Central

ZHOU, Z. HONG

2013-01-01

Single-particle cryo electron microscopy (cryoEM) is a technique for determining three-dimensional (3D) structures from projection images of molecular complexes preserved in their “native,” noncrystalline state. Recently, atomic or near-atomic resolution structures of several viruses and protein assemblies have been determined by single-particle cryoEM, allowing ab initio atomic model building by following the amino acid side chains or nucleic acid bases identifiable in their cryoEM density maps. In particular, these cryoEM structures have revealed extended arms contributing to molecular interactions that are otherwise not resolved by the conventional structural method of X-ray crystallography at similar resolutions. High-resolution cryoEM requires careful consideration of a number of factors, including proper sample preparation to ensure structural homogeneity, optimal configuration of electron imaging conditions to record high-resolution cryoEM images, accurate determination of image parameters to correct image distortions, efficient refinement and computation to reconstruct a 3D density map, and finally appropriate choice of modeling tools to construct atomic models for functional interpretation. This progress illustrates the power of cryoEM and ushers it into the arsenal of structural biology, alongside conventional techniques of X-ray crystallography and NMR, as a major tool (and sometimes the preferred one) for the studies of molecular interactions in supramolecular assemblies or machines. PMID:21501817

Large-area super-resolution optical imaging by using core-shell microfibers

NASA Astrophysics Data System (ADS)

Liu, Cheng-Yang; Lo, Wei-Chieh

2017-09-01

We first numerically and experimentally report large-area super-resolution optical imaging achieved by using core-shell microfibers. The particular spatial electromagnetic waves for different core-shell microfibers are studied by using finite-difference time-domain and ray tracing calculations. The focusing properties of photonic nanojets are evaluated in terms of intensity profile and full width at half-maximum along propagation and transversal directions. In experiment, the general optical fiber is chemically etched down to 6 μm diameter and coated with different metallic thin films by using glancing angle deposition. The direct imaging of photonic nanojets for different core-shell microfibers is performed with a scanning optical microscope system. We show that the intensity distribution of a photonic nanojet is highly related to the metallic shell due to the surface plasmon polaritons. Furthermore, large-area super-resolution optical imaging is performed by using different core-shell microfibers placed over the nano-scale grating with 150 nm line width. The core-shell microfiber-assisted imaging is achieved with super-resolution and hundreds of times the field-of-view in contrast to microspheres. The possible applications of these core-shell optical microfibers include real-time large-area micro-fluidics and nano-structure inspections.

Resolution doubling in fluorescence microscopy with confocal spinning-disk image scanning microscopy

PubMed Central

Schulz, Olaf; Pieper, Christoph; Clever, Michaela; Pfaff, Janine; Ruhlandt, Aike; Kehlenbach, Ralph H.; Wouters, Fred S.; Großhans, Jörg; Bunt, Gertrude; Enderlein, Jörg

2013-01-01

We demonstrate how a conventional confocal spinning-disk (CSD) microscope can be converted into a doubly resolving image scanning microscopy (ISM) system without changing any part of its optical or mechanical elements. Making use of the intrinsic properties of a CSD microscope, we illuminate stroboscopically, generating an array of excitation foci that are moved across the sample by varying the phase between stroboscopic excitation and rotation of the spinning disk. ISM then generates an image with nearly doubled resolution. Using conventional fluorophores, we have imaged single nuclear pore complexes in the nuclear membrane and aggregates of GFP-conjugated Tau protein in three dimensions. Multicolor ISM was shown on cytoskeletal-associated structural proteins and on 3D four-color images including MitoTracker and Hoechst staining. The simple adaptation of conventional CSD equipment allows superresolution investigations of a broad variety of cell biological questions. PMID:24324140

Super-Resolution of Plant Disease Images for the Acceleration of Image-based Phenotyping and Vigor Diagnosis in Agriculture.

PubMed

Yamamoto, Kyosuke; Togami, Takashi; Yamaguchi, Norio

2017-11-06

Unmanned aerial vehicles (UAVs or drones) are a very promising branch of technology, and they have been utilized in agriculture-in cooperation with image processing technologies-for phenotyping and vigor diagnosis. One of the problems in the utilization of UAVs for agricultural purposes is the limitation in flight time. It is necessary to fly at a high altitude to capture the maximum number of plants in the limited time available, but this reduces the spatial resolution of the captured images. In this study, we applied a super-resolution method to the low-resolution images of tomato diseases to recover detailed appearances, such as lesions on plant organs. We also conducted disease classification using high-resolution, low-resolution, and super-resolution images to evaluate the effectiveness of super-resolution methods in disease classification. Our results indicated that the super-resolution method outperformed conventional image scaling methods in spatial resolution enhancement of tomato disease images. The results of disease classification showed that the accuracy attained was also better by a large margin with super-resolution images than with low-resolution images. These results indicated that our approach not only recovered the information lost in low-resolution images, but also exerted a beneficial influence on further image analysis. The proposed approach will accelerate image-based phenotyping and vigor diagnosis in the field, because it not only saves time to capture images of a crop in a cultivation field but also secures the accuracy of these images for further analysis.

Image inpainting and super-resolution using non-local recursive deep convolutional network with skip connections

NASA Astrophysics Data System (ADS)

Liu, Miaofeng

2017-07-01

In recent years, deep convolutional neural networks come into use in image inpainting and super-resolution in many fields. Distinct to most of the former methods requiring to know beforehand the local information for corrupted pixels, we propose a 20-depth fully convolutional network to learn an end-to-end mapping a dataset of damaged/ground truth subimage pairs realizing non-local blind inpainting and super-resolution. As there often exist image with huge corruptions or inpainting on a low-resolution image that the existing approaches unable to perform well, we also share parameters in local area of layers to achieve spatial recursion and enlarge the receptive field. To avoid the difficulty of training this deep neural network, skip-connections between symmetric convolutional layers are designed. Experimental results shows that the proposed method outperforms state-of-the-art methods for diverse corrupting and low-resolution conditions, it works excellently when realizing super-resolution and image inpainting simultaneously

Time reversal through a solid-liquid interface and super-resolution

NASA Astrophysics Data System (ADS)

Tsogka, Chrysoula; Papanicolaou, George C.

2002-12-01

We present numerical computations that reproduce the time-reversal experiments of Draeger et al (Draeger C, Cassereau D and Fink M 1998 Appl. Phys. Lett. 72 1567-9), where ultrasound elastic waves are time-reversed back to their source with a time-reversal mirror in a fluid adjacent to the solid. We also show numerically that multipathing caused by random inhomogeneities improves the focusing of the back-propagated elastic waves beyond the diffraction limit seen previously in acoustic wave propagation (Dowling D R and Jackson D R 1990 J. Acoust. Soc. Am. 89 171-81, Dowling D R and Jackson D R 1992 J. Acoust. Soc. Am. 91 3257-77, Fink M 1999 Sci. Am. 91-7, Kuperman W A, Hodgkiss W S, Song H C, Akal T, Ferla C and Jackson D R 1997 J. Acoust. Soc. Am. 103 25-40, Derode A, Roux P and Fink M 1995 Phys. Rev. Lett. 75 4206-9), which is called super-resolution. A theoretical explanation of the robustness of super-resolution is given, along with several numerical computations that support this explanation (Blomgren P, Papanicolaou G and Zhao H 2002 J. Acoust. Soc. Am. 111 238-48). Time reversal with super-resolution can be used in non-destructive testing and, in a different way, in imaging with active arrays (Borcea L, Papanicolaou G, Tsogka C and Berryman J 2002 Inverse Problems 18 1247-79).

Rotary-scanning optical resolution photoacoustic microscopy

NASA Astrophysics Data System (ADS)

Qi, Weizhi; Xi, Lei

2016-10-01

Optical resolution photoacoustic microscopy (ORPAM) is currently one of the fastest evolving photoacoustic imaging modalities. It has a comparable spatial resolution to pure optical microscopic techniques such as epifluorescence microscopy, confocal microscopy, and two-photon microscopy, but also owns a deeper penetration depth. In this paper, we report a rotary-scanning (RS)-ORPAM that utilizes a galvanometer scanner integrated with objective to achieve rotary laser scanning. A 15 MHz cylindrically focused ultrasonic transducer is mounted onto a motorized rotation stage to follow optical scanning traces synchronously. To minimize the loss of signal to noise ratio, the acoustic focus is precisely adjusted to reach confocal with optical focus. Black tapes and carbon fibers are firstly imaged to evaluate the performance of the system, and then in vivo imaging of vasculature networks inside the ears and brains of mice is demonstrated using this system.

Recovery of the SuperTIGER Instrument and Preparations for the Flight of SuperTIGER-2

NASA Astrophysics Data System (ADS)

Walsh, N. E.; Supertiger Collaboration

2016-03-01

On December 8, 2012, the SuperTIGER (Trans-Iron Galactic Element Recorder) instrument began its long-duration balloon flight from Williams Field, Antarctica. Flying for a record-breaking 55 days at a mean altitude of 125,000 feet, the instrument successfully measured the relative elemental abundances of Galactic cosmic ray nuclei having charge (Z) greater than Z=10, showing very well resolved individual element peaks up to Z=40. The instrument measures particle charge and energy through the combined use of two Cherenkov detectors and three scintillation detectors, and determines particle trajectory with a scintillating fiber hodoscope. After cutdown and two years on the ice, SuperTIGER was successfully recovered in January, 2015. Its detectors and hodoscopes are being tested and refurbished, and are expected to be used again for a second flight, SuperTIGER-2. The second flight is aimed at improving SuperTIGER's already excellent charge resolution as well as at accumulating more data to be combined with that of SuperTIGER for improved statistics. In November 2015, a test of the scintillator saturation effect was performed at CERN using a beam of interacted Pb nuclei to help create more accurate charge reconstruction models that will help resolve elements in the range Z=41 to Z=60. This research was supported by NASA under Grants NNX09AC17G, NNX14AB25G, the Peggy and Steve Fossett Foundation and the McDonnell Center for the Space Sciences at Washington University.

An approach to spin-resolved molecular gas microscopy

NASA Astrophysics Data System (ADS)

Covey, Jacob P.; De Marco, Luigi; Acevedo, Óscar L.; Rey, Ana Maria; Ye, Jun

2018-04-01

Ultracold polar molecules are an ideal platform for studying many-body physics with long-range dipolar interactions. Experiments in this field have progressed enormously, and several groups are pursuing advanced apparatus for manipulation of molecules with electric fields as well as single-atom-resolved in situ detection. Such detection has become ubiquitous for atoms in optical lattices and tweezer arrays, but has yet to be demonstrated for ultracold polar molecules. Here we present a proposal for the implementation of site-resolved microscopy for polar molecules, and specifically discuss a technique for spin-resolved molecular detection. We use numerical simulation of spin dynamics of lattice-confined polar molecules to show how such a scheme would be of utility in a spin-diffusion experiment.

Dictionary learning based noisy image super-resolution via distance penalty weight model

PubMed Central

Han, Yulan; Zhao, Yongping; Wang, Qisong

2017-01-01

In this study, we address the problem of noisy image super-resolution. Noisy low resolution (LR) image is always obtained in applications, while most of the existing algorithms assume that the LR image is noise-free. As to this situation, we present an algorithm for noisy image super-resolution which can achieve simultaneously image super-resolution and denoising. And in the training stage of our method, LR example images are noise-free. For different input LR images, even if the noise variance varies, the dictionary pair does not need to be retrained. For the input LR image patch, the corresponding high resolution (HR) image patch is reconstructed through weighted average of similar HR example patches. To reduce computational cost, we use the atoms of learned sparse dictionary as the examples instead of original example patches. We proposed a distance penalty model for calculating the weight, which can complete a second selection on similar atoms at the same time. Moreover, LR example patches removed mean pixel value are also used to learn dictionary rather than just their gradient features. Based on this, we can reconstruct initial estimated HR image and denoised LR image. Combined with iterative back projection, the two reconstructed images are applied to obtain final estimated HR image. We validate our algorithm on natural images and compared with the previously reported algorithms. Experimental results show that our proposed method performs better noise robustness. PMID:28759633

Quantitative super-resolution localization microscopy of DNA in situ using Vybrant® DyeCycle™ Violet fluorescent probe.

PubMed

Żurek-Biesiada, Dominika; Szczurek, Aleksander T; Prakash, Kirti; Best, Gerrit; Mohana, Giriram K; Lee, Hyun-Keun; Roignant, Jean-Yves; Dobrucki, Jurek W; Cremer, Christoph; Birk, Udo

2016-06-01

Single Molecule Localization Microscopy (SMLM) is a recently emerged optical imaging method that was shown to achieve a resolution in the order of tens of nanometers in intact cells. Novel high resolution imaging methods might be crucial for understanding of how the chromatin, a complex of DNA and proteins, is arranged in the eukaryotic cell nucleus. Such an approach utilizing switching of a fluorescent, DNA-binding dye Vybrant® DyeCycle™ Violet has been previously demonstrated by us (Żurek-Biesiada et al., 2015) [1]. Here we provide quantitative information on the influence of the chemical environment on the behavior of the dye, discuss the variability in the DNA-associated signal density, and demonstrate direct proof of enhanced structural resolution. Furthermore, we compare different visualization approaches. Finally, we describe various opportunities of multicolor DNA/SMLM imaging in eukaryotic cell nuclei.

Quantitative super-resolution localization microscopy of DNA in situ using Vybrant® DyeCycle™ Violet fluorescent probe

PubMed Central

Żurek-Biesiada, Dominika; Szczurek, Aleksander T.; Prakash, Kirti; Best, Gerrit; Mohana, Giriram K.; Lee, Hyun-Keun; Roignant, Jean-Yves; Dobrucki, Jurek W.; Cremer, Christoph; Birk, Udo

2016-01-01

Single Molecule Localization Microscopy (SMLM) is a recently emerged optical imaging method that was shown to achieve a resolution in the order of tens of nanometers in intact cells. Novel high resolution imaging methods might be crucial for understanding of how the chromatin, a complex of DNA and proteins, is arranged in the eukaryotic cell nucleus. Such an approach utilizing switching of a fluorescent, DNA-binding dye Vybrant® DyeCycle™ Violet has been previously demonstrated by us (Żurek-Biesiada et al., 2015) [1]. Here we provide quantitative information on the influence of the chemical environment on the behavior of the dye, discuss the variability in the DNA-associated signal density, and demonstrate direct proof of enhanced structural resolution. Furthermore, we compare different visualization approaches. Finally, we describe various opportunities of multicolor DNA/SMLM imaging in eukaryotic cell nuclei. PMID:27054149

Full-field dual-color 100-nm super-resolution imaging reveals organization and dynamics of mitochondrial and ER networks.

PubMed

Brunstein, Maia; Wicker, Kai; Hérault, Karine; Heintzmann, Rainer; Oheim, Martin

2013-11-04

Most structured illumination microscopes use a physical or synthetic grating that is projected into the sample plane to generate a periodic illumination pattern. Albeit simple and cost-effective, this arrangement hampers fast or multi-color acquisition, which is a critical requirement for time-lapse imaging of cellular and sub-cellular dynamics. In this study, we designed and implemented an interferometric approach allowing large-field, fast, dual-color imaging at an isotropic 100-nm resolution based on a sub-diffraction fringe pattern generated by the interference of two colliding evanescent waves. Our all-mirror-based system generates illumination pat-terns of arbitrary orientation and period, limited only by the illumination aperture (NA = 1.45), the response time of a fast, piezo-driven tip-tilt mirror (10 ms) and the available fluorescence signal. At low µW laser powers suitable for long-period observation of life cells and with a camera exposure time of 20 ms, our system permits the acquisition of super-resolved 50 µm by 50 µm images at 3.3 Hz. The possibility it offers for rapidly adjusting the pattern between images is particularly advantageous for experiments that require multi-scale and multi-color information. We demonstrate the performance of our instrument by imaging mitochondrial dynamics in cultured cortical astrocytes. As an illustration of dual-color excitation dual-color detection, we also resolve interaction sites between near-membrane mitochondria and the endoplasmic reticulum. Our TIRF-SIM microscope provides a versatile, compact and cost-effective arrangement for super-resolution imaging, allowing the investigation of co-localization and dynamic interactions between organelles--important questions in both cell biology and neurophysiology.

Super-Resolution of Plant Disease Images for the Acceleration of Image-based Phenotyping and Vigor Diagnosis in Agriculture

PubMed Central

Togami, Takashi; Yamaguchi, Norio

2017-01-01

Unmanned aerial vehicles (UAVs or drones) are a very promising branch of technology, and they have been utilized in agriculture—in cooperation with image processing technologies—for phenotyping and vigor diagnosis. One of the problems in the utilization of UAVs for agricultural purposes is the limitation in flight time. It is necessary to fly at a high altitude to capture the maximum number of plants in the limited time available, but this reduces the spatial resolution of the captured images. In this study, we applied a super-resolution method to the low-resolution images of tomato diseases to recover detailed appearances, such as lesions on plant organs. We also conducted disease classification using high-resolution, low-resolution, and super-resolution images to evaluate the effectiveness of super-resolution methods in disease classification. Our results indicated that the super-resolution method outperformed conventional image scaling methods in spatial resolution enhancement of tomato disease images. The results of disease classification showed that the accuracy attained was also better by a large margin with super-resolution images than with low-resolution images. These results indicated that our approach not only recovered the information lost in low-resolution images, but also exerted a beneficial influence on further image analysis. The proposed approach will accelerate image-based phenotyping and vigor diagnosis in the field, because it not only saves time to capture images of a crop in a cultivation field but also secures the accuracy of these images for further analysis. PMID:29113104

Barnacle Bill in Super Resolution from Insurance Panorama

NASA Technical Reports Server (NTRS)

1998-01-01

Barnacle Bill is a small rock immediately west-northwest of the Mars Pathfinder lander and was the first rock visited by the Sojourner Rover's alpha proton X-ray spectrometer (APXS) instrument. This image shows super resolution techniques applied to the first APXS target rock, which was never imaged with the rover's forward cameras. Super resolution was applied to help to address questions about the texture of this rock and what it might tell us about its mode of origin.

This view of Barnacle Bill was produced by combining the 'Insurance Pan' frames taken while the IMP camera was still in its stowed position on sol2. The composite color frames that make up this anaglyph were produced for both the right and left eye of the IMP. The right eye composite consists of 5 frames, taken with different color filters, the left eye consists of only 1 frame. The resultant image from each eye was enlarged by 500% and then co-added using Adobe Photoshop to produce, in effect, a super-resolution panchromatic frame that is sharper than an individual frame would be. These panchromatic frames were then colorized with the red, green, and blue filtered images from the same sequence. The color balance was adjusted to approximate the true color of Mars.

The anaglyph view was produced by combining the left with the right eye color composite frames by assigning the left eye composite view to the red color plane and the right eye composite view to the green and blue color planes (cyan), to produce a stereo anaglyph mosaic. This mosaic can be viewed in 3-D on your computer monitor or in color print form by wearing red-blue 3-D glasses.

Mars Pathfinder is the second in NASA's Discovery program of low-cost spacecraft with highly focused science goals. Barnacle Bill is a small rock immediately west-northwest of the Mars Pathfinder lander and was the first rock visited by the Sojourner Rover's alpha proton X-ray spectrometer (APXS) instrument.

High-resolution imaging of silicene on an Ag(111) surface by atomic force microscopy

NASA Astrophysics Data System (ADS)

Onoda, Jo; Yabuoshi, Keisuke; Miyazaki, Hiroki; Sugimoto, Yoshiaki

2017-12-01

Silicene, a two-dimensional (2D) honeycomb arrangement of Si atoms, is expected to have better electronic properties than graphene and has been mostly synthesized on Ag surfaces. Although scanning tunneling microscopy (STM) has been used for visualizing its atomic structure in real space, the interpretation of STM contrast is not straightforward and only the topmost Si atoms were observed on the (4 ×4 ) silicene/Ag(111) surface. Here, we demonstrate that high-resolution atomic force microscopy (AFM) can resolve all constituent Si atoms in the buckled honeycomb arrangement of the (4 ×4 ) silicene. Site-specific force spectroscopy attributes the origin of the high-resolution AFM images to chemical bonds between the AFM probe apex and the individual Si atoms on the (4 ×4 ) silicene. A detailed analysis of the geometric parameters suggests that the pulling up of lower-buckled Si atoms by the AFM tip could be a key for high-resolution AFM, implying a weakening of the Si-Ag interactions at the interface. We expect that high-resolution AFM will also unveil atomic structures of edges and defects of silicene, or other emerging 2D materials.

Elemental Abundances of Ultra-Heavy Galactic Cosmic Rays from the SuperTIGER Instrument

NASA Astrophysics Data System (ADS)

Murphy, Ryan

2016-07-01

The SuperTIGER (Trans-Iron Galactic Element Recorder) experiment was launched on a long-duration balloon flight from Williams Field, Antarctica, on December 8, 2012. The instrument measured the relative elemental abundances of Galactic Cosmic Rays (GCR) for charge (Z) Z>10 with excellent charge resolution, displaying well resolved individual element peaks for 10 ≤ Z ≤ 40. During its record-breaking 55-day flight, SuperTIGER collected ˜4.73 x10^{6} Iron nuclei, ˜8 times as many as detected by its predecessor, TIGER, with charge resolution at iron of 0.17 cu. SuperTIGER measures charge (Z) and energy (E) using a combination of three scintillator and two Cherenkov detectors, and employs a scintillating fiber hodoscope for event trajectory determination. The SuperTIGER data have been analyzed to correct for instrument effects and remove events that underwent nuclear interactions within the instrument. The data include more than 600 events in the charge range 30 < Z ≤ 40. SuperTIGER is the first experiment to resolve elemental abundances of every element in this charge range with high statistics and single-element resolution. The relative abundances of the galactic cosmic ray source have been derived from the measured relative elemental abundances using atmospheric and interstellar propagations. The SuperTIGER measured abundances are generally consistent with previous experimental results from TIGER and ACE-CRIS, with improved statistical precision. The SuperTIGER results confirm the earlier results from TIGER, supporting a model of cosmic-ray origin in OB associations, with preferential acceleration of refractory elements over volatile elements ordered by atomic mass (A). A second SuperTIGER Antarctic flight is planned for December 2017. Details of the instrument, flight, data analysis, and ongoing preparations will be presented.

Enhancing the isotropy of lateral resolution in coherent structured illumination microscopy

PubMed Central

Park, Joo Hyun; Lee, Jae Yong; Lee, Eun Seong

2014-01-01

We present a method to improve the isotropy of spatial resolution in a structured illumination microscopy (SIM) implemented for imaging non-fluorescent samples. To alleviate the problem of anisotropic resolution involved with the previous scheme of coherent SIM that employs the two orthogonal standing-wave illumination, referred to as the orthogonal SIM, we introduce a hexagonal-lattice illumination that incorporates three standing-wave fields simultaneously superimposed at the orientations equally divided in the lateral plane. A theoretical formulation is worked out rigorously for the coherent image formation with such a simultaneous multiple-beam illumination and an explicit Fourier-domain framework is derived for reconstructing an image with enhanced resolution. Using a computer-synthesized resolution target as a 2D coherent sample, we perform numerical simulations to examine the imaging characteristics of our three-angle SIM compared with the orthogonal SIM. The investigation on the 2D resolving power with the various test patterns of different periods and orientations reveal that the orientation-dependent undulation of lateral resolution can be reduced from 27% to 8% by using the three-angle SIM while the best resolution (0.54 times the resolution limit of conventional coherent imaging) in the directions of structured illumination is slightly deteriorated by 4.6% from that of the orthogonal SIM. PMID:24940548

Super-Resolution Imaging of the Golgi in Live Cells with a Bio-orthogonal Ceramide Probe**

PubMed Central

Erdmann, Roman S.; Takakura, Hideo; Thompson, Alexander D.; Rivera-Molina, Felix; Allgeyer, Edward S.; Bewersdorf, Joerg; Toomre, Derek K.; Schepartz, Alanna

2014-01-01

We report a lipid-based strategy to visualize Golgi structure and dynamics at super-resolution in live cells. The method is based on two novel reagents: a trans-cyclooctene-containing ceramide lipid (Cer-TCO) and a highly reactive, tetrazine-tagged near-IR dye (SiR-Tz). These reagents assemble via an extremely rapid ‘tetrazine-click’ reaction into Cer-SiR, a highly photostable ‘vital dye’ that enables prolonged live cell imaging of the Golgi apparatus by 3D confocal and STED microscopy. Cer-SiR is non-toxic at concentrations as high as 2 μM and does not perturb the mobility of Golgi-resident enzymes or the traffic of cargo from the endoplasmic reticulum through the Golgi and to the plasma membrane. PMID:25081303

Multiple-image hiding using super resolution reconstruction in high-frequency domains

NASA Astrophysics Data System (ADS)

Li, Xiao-Wei; Zhao, Wu-Xiang; Wang, Jun; Wang, Qiong-Hua

2017-12-01

In this paper, a robust multiple-image hiding method using the computer-generated integral imaging and the modified super-resolution reconstruction algorithm is proposed. In our work, the host image is first transformed into frequency domains by cellular automata (CA), to assure the quality of the stego-image, the secret images are embedded into the CA high-frequency domains. The proposed method has the following advantages: (1) robustness to geometric attacks because of the memory-distributed property of elemental images, (2) increasing quality of the reconstructed secret images as the scheme utilizes the modified super-resolution reconstruction algorithm. The simulation results show that the proposed multiple-image hiding method outperforms other similar hiding methods and is robust to some geometric attacks, e.g., Gaussian noise and JPEG compression attacks.

Sparse super-resolution reconstructions of video from mobile devices in digital TV broadcast applications

NASA Astrophysics Data System (ADS)

Boon, Choong S.; Guleryuz, Onur G.; Kawahara, Toshiro; Suzuki, Yoshinori

2006-08-01

We consider the mobile service scenario where video programming is broadcast to low-resolution wireless terminals. In such a scenario, broadcasters utilize simultaneous data services and bi-directional communications capabilities of the terminals in order to offer substantially enriched viewing experiences to users by allowing user participation and user tuned content. While users immediately benefit from this service when using their phones in mobile environments, the service is less appealing in stationary environments where a regular television provides competing programming at much higher display resolutions. We propose a fast super-resolution technique that allows the mobile terminals to show a much enhanced version of the broadcast video on nearby high-resolution devices, extending the appeal and usefulness of the broadcast service. The proposed single frame super-resolution algorithm uses recent sparse recovery results to provide high quality and high-resolution video reconstructions based solely on individual decoded frames provided by the low-resolution broadcast.

Resolution enhancement techniques in microscopy

NASA Astrophysics Data System (ADS)

Cremer, Christoph; Masters, Barry R.

2013-05-01

We survey the history of resolution enhancement techniques in microscopy and their impact on current research in biomedicine. Often these techniques are labeled superresolution, or enhanced resolution microscopy, or light-optical nanoscopy. First, we introduce the development of diffraction theory in its relation to enhanced resolution; then we explore the foundations of resolution as expounded by the astronomers and the physicists and describe the conditions for which they apply. Then we elucidate Ernst Abbe's theory of optical formation in the microscope, and its experimental verification and dissemination to the world wide microscope communities. Second, we describe and compare the early techniques that can enhance the resolution of the microscope. Third, we present the historical development of various techniques that substantially enhance the optical resolution of the light microscope. These enhanced resolution techniques in their modern form constitute an active area of research with seminal applications in biology and medicine. Our historical survey of the field of resolution enhancement uncovers many examples of reinvention, rediscovery, and independent invention and development of similar proposals, concepts, techniques, and instruments. Attribution of credit is therefore confounded by the fact that for understandable reasons authors stress the achievements from their own research groups and sometimes obfuscate their contributions and the prior art of others. In some cases, attribution of credit is also made more complex by the fact that long term developments are difficult to allocate to a specific individual because of the many mutual connections often existing between sometimes fiercely competing, sometimes strongly collaborating groups. Since applications in biology and medicine have been a major driving force in the development of resolution enhancing approaches, we focus on the contribution of enhanced resolution to these fields.

Single image super-resolution using self-optimizing mask via fractional-order gradient interpolation and reconstruction.

PubMed

Yang, Qi; Zhang, Yanzhu; Zhao, Tiebiao; Chen, YangQuan

2017-04-04

Image super-resolution using self-optimizing mask via fractional-order gradient interpolation and reconstruction aims to recover detailed information from low-resolution images and reconstruct them into high-resolution images. Due to the limited amount of data and information retrieved from low-resolution images, it is difficult to restore clear, artifact-free images, while still preserving enough structure of the image such as the texture. This paper presents a new single image super-resolution method which is based on adaptive fractional-order gradient interpolation and reconstruction. The interpolated image gradient via optimal fractional-order gradient is first constructed according to the image similarity and afterwards the minimum energy function is employed to reconstruct the final high-resolution image. Fractional-order gradient based interpolation methods provide an additional degree of freedom which helps optimize the implementation quality due to the fact that an extra free parameter α-order is being used. The proposed method is able to produce a rich texture detail while still being able to maintain structural similarity even under large zoom conditions. Experimental results show that the proposed method performs better than current single image super-resolution techniques. Copyright © 2017 ISA. Published by Elsevier Ltd. All rights reserved.

Single image super-resolution based on convolutional neural networks

NASA Astrophysics Data System (ADS)

Zou, Lamei; Luo, Ming; Yang, Weidong; Li, Peng; Jin, Liujia

2018-03-01

We present a deep learning method for single image super-resolution (SISR). The proposed approach learns end-to-end mapping between low-resolution (LR) images and high-resolution (HR) images. The mapping is represented as a deep convolutional neural network which inputs the LR image and outputs the HR image. Our network uses 5 convolution layers, which kernels size include 5×5, 3×3 and 1×1. In our proposed network, we use residual-learning and combine different sizes of convolution kernels at the same layer. The experiment results show that our proposed method performs better than the existing methods in reconstructing quality index and human visual effects on benchmarked images.

Super-resolution optics for virtual reality

NASA Astrophysics Data System (ADS)

Grabovičkić, Dejan; Benitez, Pablo; Miñano, Juan C.; Zamora, Pablo; Buljan, Marina; Narasimhan, Bharathwaj; Nikolic, Milena I.; Lopez, Jesus; Gorospe, Jorge; Sanchez, Eduardo; Lastres, Carmen; Mohedano, Ruben

2017-06-01

In present commercial Virtual Reality (VR) headsets the resolution perceived is still limited, since the VR pixel density (typically 10-15 pixels/deg) is well below what the human eye can resolve (60 pixels/deg). We present here novel advanced optical design approaches that dramatically increase the perceived resolution of the VR keeping the large FoV required in VR applications. This approach can be applied to a vast number of optical architectures, including some advanced configurations, as multichannel designs. All this is done at the optical design stage, and no eye tracker is needed in the headset.

Non-heuristic automatic techniques for overcoming low signal-to-noise-ratio bias of localization microscopy and multiple signal classification algorithm.

PubMed

Agarwal, Krishna; Macháň, Radek; Prasad, Dilip K

2018-03-21

Localization microscopy and multiple signal classification algorithm use temporal stack of image frames of sparse emissions from fluorophores to provide super-resolution images. Localization microscopy localizes emissions in each image independently and later collates the localizations in all the frames, giving same weight to each frame irrespective of its signal-to-noise ratio. This results in a bias towards frames with low signal-to-noise ratio and causes cluttered background in the super-resolved image. User-defined heuristic computational filters are employed to remove a set of localizations in an attempt to overcome this bias. Multiple signal classification performs eigen-decomposition of the entire stack, irrespective of the relative signal-to-noise ratios of the frames, and uses a threshold to classify eigenimages into signal and null subspaces. This results in under-representation of frames with low signal-to-noise ratio in the signal space and over-representation in the null space. Thus, multiple signal classification algorithms is biased against frames with low signal-to-noise ratio resulting into suppression of the corresponding fluorophores. This paper presents techniques to automatically debias localization microscopy and multiple signal classification algorithm of these biases without compromising their resolution and without employing heuristics, user-defined criteria. The effect of debiasing is demonstrated through five datasets of invitro and fixed cell samples.

Wavelet Filter Banks for Super-Resolution SAR Imaging

NASA Technical Reports Server (NTRS)

Sheybani, Ehsan O.; Deshpande, Manohar; Memarsadeghi, Nargess

2011-01-01

This paper discusses Innovative wavelet-based filter banks designed to enhance the analysis of super resolution Synthetic Aperture Radar (SAR) images using parametric spectral methods and signal classification algorithms, SAR finds applications In many of NASA's earth science fields such as deformation, ecosystem structure, and dynamics of Ice, snow and cold land processes, and surface water and ocean topography. Traditionally, standard methods such as Fast-Fourier Transform (FFT) and Inverse Fast-Fourier Transform (IFFT) have been used to extract Images from SAR radar data, Due to non-parametric features of these methods and their resolution limitations and observation time dependence, use of spectral estimation and signal pre- and post-processing techniques based on wavelets to process SAR radar data has been proposed. Multi-resolution wavelet transforms and advanced spectral estimation techniques have proven to offer efficient solutions to this problem.

Super-resolution links vinculin localization to function in focal adhesions.

PubMed

Giannone, Grégory

2015-07-01

Integrin-based focal adhesions integrate biochemical and biomechanical signals from the extracellular matrix and the actin cytoskeleton. The combination of three-dimensional super-resolution imaging and loss- or gain-of-function protein mutants now links the nanoscale dynamic localization of proteins to their activation and function within focal adhesions.

Towards breaking the spatial resolution barriers: An optical flow and super-resolution approach for sea ice motion estimation

NASA Astrophysics Data System (ADS)

Petrou, Zisis I.; Xian, Yang; Tian, YingLi

2018-04-01

Estimation of sea ice motion at fine scales is important for a number of regional and local level applications, including modeling of sea ice distribution, ocean-atmosphere and climate dynamics, as well as safe navigation and sea operations. In this study, we propose an optical flow and super-resolution approach to accurately estimate motion from remote sensing images at a higher spatial resolution than the original data. First, an external example learning-based super-resolution method is applied on the original images to generate higher resolution versions. Then, an optical flow approach is applied on the higher resolution images, identifying sparse correspondences and interpolating them to extract a dense motion vector field with continuous values and subpixel accuracies. Our proposed approach is successfully evaluated on passive microwave, optical, and Synthetic Aperture Radar data, proving appropriate for multi-sensor applications and different spatial resolutions. The approach estimates motion with similar or higher accuracy than the original data, while increasing the spatial resolution of up to eight times. In addition, the adopted optical flow component outperforms a state-of-the-art pattern matching method. Overall, the proposed approach results in accurate motion vectors with unprecedented spatial resolutions of up to 1.5 km for passive microwave data covering the entire Arctic and 20 m for radar data, and proves promising for numerous scientific and operational applications.

Single image super-resolution via regularized extreme learning regression for imagery from microgrid polarimeters

NASA Astrophysics Data System (ADS)

Sargent, Garrett C.; Ratliff, Bradley M.; Asari, Vijayan K.

2017-08-01

The advantage of division of focal plane imaging polarimeters is their ability to obtain temporally synchronized intensity measurements across a scene; however, they sacrifice spatial resolution in doing so due to their spatially modulated arrangement of the pixel-to-pixel polarizers and often result in aliased imagery. Here, we propose a super-resolution method based upon two previously trained extreme learning machines (ELM) that attempt to recover missing high frequency and low frequency content beyond the spatial resolution of the sensor. This method yields a computationally fast and simple way of recovering lost high and low frequency content from demosaicing raw microgrid polarimetric imagery. The proposed method outperforms other state-of-the-art single-image super-resolution algorithms in terms of structural similarity and peak signal-to-noise ratio.

Super-resolution mapping of scaffold nucleoporins in the nuclear pore complex.

PubMed

Ma, Jiong; Kelich, Joseph M; Junod, Samuel L; Yang, Weidong

2017-04-01

The nuclear pore complex (NPC), composed of ∼30 different nucleoporins (Nups), is one of the largest supramolecular structures in eukaryotic cells. Its octagonal ring scaffold perforates the nuclear envelope and features a unique molecular machinery that regulates nucleocytoplasmic transport. However, the precise copy number and the spatial location of each Nup in the native NPC remain obscure due to the inherent difficulty of counting and localizing proteins inside of the sub-micrometer supramolecular complex. Here, we combined super-resolution single-point edge-excitation subdiffraction (SPEED) microscopy and nanobody-specific labeling to reveal the spatial distribution of scaffold Nups within three separate layers in the native NPC with a precision of ∼3 nm. Our data reveal both the radial and axial spatial distributions for Pom121, Nup37 and Nup35 and provide evidence for their copy numbers of 8, 32 and 16, respectively, per NPC. This approach can help pave the path for mapping the entirety of Nups in native NPCs and also other structural components of macromolecular complexes. © 2017. Published by The Company of Biologists Ltd.

Super-resolution mapping of scaffold nucleoporins in the nuclear pore complex

PubMed Central

Ma, Jiong; Kelich, Joseph M.; Junod, Samuel L.

2017-01-01

ABSTRACT The nuclear pore complex (NPC), composed of ∼30 different nucleoporins (Nups), is one of the largest supramolecular structures in eukaryotic cells. Its octagonal ring scaffold perforates the nuclear envelope and features a unique molecular machinery that regulates nucleocytoplasmic transport. However, the precise copy number and the spatial location of each Nup in the native NPC remain obscure due to the inherent difficulty of counting and localizing proteins inside of the sub-micrometer supramolecular complex. Here, we combined super-resolution single-point edge-excitation subdiffraction (SPEED) microscopy and nanobody-specific labeling to reveal the spatial distribution of scaffold Nups within three separate layers in the native NPC with a precision of ∼3 nm. Our data reveal both the radial and axial spatial distributions for Pom121, Nup37 and Nup35 and provide evidence for their copy numbers of 8, 32 and 16, respectively, per NPC. This approach can help pave the path for mapping the entirety of Nups in native NPCs and also other structural components of macromolecular complexes. PMID:28202688

Advanced fluorescence microscopy techniques for the life sciences

PubMed Central

Aguib, Yasmine; Yacoub, Magdi H.

The development of super-resolved fluorescence microscopy, for which the Nobel Prize was awarded in 2014, has been a topic of interest to physicists and biologists alike. It is inevitable that numerous questions in biomedical research cannot be answered by means other than direct observation. In this review, advances to fluorescence microscopy are covered in a widely accessible fashion to facilitate its use in decisions related to its acquisition and utilization in biomedical research. PMID:29043264

An angle encoder for super-high resolution and super-high accuracy using SelfA