A statistical method for the conservative adjustment of false discovery rate (q-value).

PubMed

Lai, Yinglei

2017-03-14

q-value is a widely used statistical method for estimating false discovery rate (FDR), which is a conventional significance measure in the analysis of genome-wide expression data. q-value is a random variable and it may underestimate FDR in practice. An underestimated FDR can lead to unexpected false discoveries in the follow-up validation experiments. This issue has not been well addressed in literature, especially in the situation when the permutation procedure is necessary for p-value calculation. We proposed a statistical method for the conservative adjustment of q-value. In practice, it is usually necessary to calculate p-value by a permutation procedure. This was also considered in our adjustment method. We used simulation data as well as experimental microarray or sequencing data to illustrate the usefulness of our method. The conservativeness of our approach has been mathematically confirmed in this study. We have demonstrated the importance of conservative adjustment of q-value, particularly in the situation that the proportion of differentially expressed genes is small or the overall differential expression signal is weak.

High-throughput discovery of rare human nucleotide polymorphisms by Ecotilling

PubMed Central

Till, Bradley J.; Zerr, Troy; Bowers, Elisabeth; Greene, Elizabeth A.; Comai, Luca; Henikoff, Steven

2006-01-01

Human individuals differ from one another at only ∼0.1% of nucleotide positions, but these single nucleotide differences account for most heritable phenotypic variation. Large-scale efforts to discover and genotype human variation have been limited to common polymorphisms. However, these efforts overlook rare nucleotide changes that may contribute to phenotypic diversity and genetic disorders, including cancer. Thus, there is an increasing need for high-throughput methods to robustly detect rare nucleotide differences. Toward this end, we have adapted the mismatch discovery method known as Ecotilling for the discovery of human single nucleotide polymorphisms. To increase throughput and reduce costs, we developed a universal primer strategy and implemented algorithms for automated band detection. Ecotilling was validated by screening 90 human DNA samples for nucleotide changes in 5 gene targets and by comparing results to public resequencing data. To increase throughput for discovery of rare alleles, we pooled samples 8-fold and found Ecotilling to be efficient relative to resequencing, with a false negative rate of 5% and a false discovery rate of 4%. We identified 28 new rare alleles, including some that are predicted to damage protein function. The detection of rare damaging mutations has implications for models of human disease. PMID:16893952

Jointly determining significance levels of primary and replication studies by controlling the false discovery rate in two-stage genome-wide association studies.

PubMed

Jiang, Wei; Yu, Weichuan

2017-01-01

In genome-wide association studies, we normally discover associations between genetic variants and diseases/traits in primary studies, and validate the findings in replication studies. We consider the associations identified in both primary and replication studies as true findings. An important question under this two-stage setting is how to determine significance levels in both studies. In traditional methods, significance levels of the primary and replication studies are determined separately. We argue that the separate determination strategy reduces the power in the overall two-stage study. Therefore, we propose a novel method to determine significance levels jointly. Our method is a reanalysis method that needs summary statistics from both studies. We find the most powerful significance levels when controlling the false discovery rate in the two-stage study. To enjoy the power improvement from the joint determination method, we need to select single nucleotide polymorphisms for replication at a less stringent significance level. This is a common practice in studies designed for discovery purpose. We suggest this practice is also suitable in studies with validation purpose in order to identify more true findings. Simulation experiments show that our method can provide more power than traditional methods and that the false discovery rate is well-controlled. Empirical experiments on datasets of five diseases/traits demonstrate that our method can help identify more associations. The R-package is available at: http://bioinformatics.ust.hk/RFdr.html .

Separate class true discovery rate degree of association sets for biomarker identification.

PubMed

Crager, Michael R; Ahmed, Murat

2014-01-01

In 2008, Efron showed that biological features in a high-dimensional study can be divided into classes and a separate false discovery rate (FDR) analysis can be conducted in each class using information from the entire set of features to assess the FDR within each class. We apply this separate class approach to true discovery rate degree of association (TDRDA) set analysis, which is used in clinical-genomic studies to identify sets of biomarkers having strong association with clinical outcome or state while controlling the FDR. Careful choice of classes based on prior information can increase the identification power of the separate class analysis relative to the overall analysis.

Controlling the joint local false discovery rate is more powerful than meta-analysis methods in joint analysis of summary statistics from multiple genome-wide association studies.

PubMed

Jiang, Wei; Yu, Weichuan

2017-02-15

In genome-wide association studies (GWASs) of common diseases/traits, we often analyze multiple GWASs with the same phenotype together to discover associated genetic variants with higher power. Since it is difficult to access data with detailed individual measurements, summary-statistics-based meta-analysis methods have become popular to jointly analyze datasets from multiple GWASs. In this paper, we propose a novel summary-statistics-based joint analysis method based on controlling the joint local false discovery rate (Jlfdr). We prove that our method is the most powerful summary-statistics-based joint analysis method when controlling the false discovery rate at a certain level. In particular, the Jlfdr-based method achieves higher power than commonly used meta-analysis methods when analyzing heterogeneous datasets from multiple GWASs. Simulation experiments demonstrate the superior power of our method over meta-analysis methods. Also, our method discovers more associations than meta-analysis methods from empirical datasets of four phenotypes. The R-package is available at: http://bioinformatics.ust.hk/Jlfdr.html . eeyu@ust.hk. Supplementary data are available at Bioinformatics online. © The Author 2016. Published by Oxford University Press. All rights reserved. For Permissions, please e-mail: journals.permissions@oup.com

Maximizing the sensitivity and reliability of peptide identification in large-scale proteomic experiments by harnessing multiple search engines.

PubMed

Yu, Wen; Taylor, J Alex; Davis, Michael T; Bonilla, Leo E; Lee, Kimberly A; Auger, Paul L; Farnsworth, Chris C; Welcher, Andrew A; Patterson, Scott D

2010-03-01

Despite recent advances in qualitative proteomics, the automatic identification of peptides with optimal sensitivity and accuracy remains a difficult goal. To address this deficiency, a novel algorithm, Multiple Search Engines, Normalization and Consensus is described. The method employs six search engines and a re-scoring engine to search MS/MS spectra against protein and decoy sequences. After the peptide hits from each engine are normalized to error rates estimated from the decoy hits, peptide assignments are then deduced using a minimum consensus model. These assignments are produced in a series of progressively relaxed false-discovery rates, thus enabling a comprehensive interpretation of the data set. Additionally, the estimated false-discovery rate was found to have good concordance with the observed false-positive rate calculated from known identities. Benchmarking against standard proteins data sets (ISBv1, sPRG2006) and their published analysis, demonstrated that the Multiple Search Engines, Normalization and Consensus algorithm consistently achieved significantly higher sensitivity in peptide identifications, which led to increased or more robust protein identifications in all data sets compared with prior methods. The sensitivity and the false-positive rate of peptide identification exhibit an inverse-proportional and linear relationship with the number of participating search engines.

Subjective Cognitive Decline Is Associated With Altered Default Mode Network Connectivity in Individuals With a Family History of Alzheimer's Disease.

PubMed

Verfaillie, Sander C J; Pichet Binette, Alexa; Vachon-Presseau, Etienne; Tabrizi, Shirin; Savard, Mélissa; Bellec, Pierre; Ossenkoppele, Rik; Scheltens, Philip; van der Flier, Wiesje M; Breitner, John C S; Villeneuve, Sylvia

2018-05-01

Both subjective cognitive decline (SCD) and a family history of Alzheimer's disease (AD) portend risk of brain abnormalities and progression to dementia. Posterior default mode network (pDMN) connectivity is altered early in the course of AD. It is unclear whether SCD predicts similar outcomes in cognitively normal individuals with a family history of AD. We studied 124 asymptomatic individuals with a family history of AD (age 64 ± 5 years). Participants were categorized as having SCD if they reported that their memory was becoming worse (SCD + ). We used extensive neuropsychological assessment to investigate five different cognitive domain performances at baseline (n = 124) and 1 year later (n = 59). We assessed interconnectivity among three a priori defined ROIs: pDMN, anterior ventral DMN, medial temporal memory system (MTMS), and the connectivity of each with the rest of brain. Sixty-eight (55%) participants reported SCD. Baseline cognitive performance was comparable between groups (all false discovery rate-adjusted p values > .05). At follow-up, immediate and delayed memory improved across groups, but the improvement in immediate memory was reduced in SCD + compared with SCD - (all false discovery rate-adjusted p values < .05). When compared with SCD - , SCD + subjects showed increased pDMN-MTMS connectivity (false discovery rate-adjusted p < .05). Higher connectivity between the MTMS and the rest of the brain was associated with better baseline immediate memory, attention, and global cognition, whereas higher MTMS and pDMN-MTMS connectivity were associated with lower immediate memory over time (all false discovery rate-adjusted p values < .05). SCD in cognitively normal individuals is associated with diminished immediate memory practice effects and a brain connectivity pattern that mirrors early AD-related connectivity failure. Copyright © 2017 Society of Biological Psychiatry. Published by Elsevier Inc. All rights reserved.

Precision and recall estimates for two-hybrid screens

PubMed Central

Huang, Hailiang; Bader, Joel S.

2009-01-01

Motivation: Yeast two-hybrid screens are an important method to map pairwise protein interactions. This method can generate spurious interactions (false discoveries), and true interactions can be missed (false negatives). Previously, we reported a capture–recapture estimator for bait-specific precision and recall. Here, we present an improved method that better accounts for heterogeneity in bait-specific error rates. Result: For yeast, worm and fly screens, we estimate the overall false discovery rates (FDRs) to be 9.9%, 13.2% and 17.0% and the false negative rates (FNRs) to be 51%, 42% and 28%. Bait-specific FDRs and the estimated protein degrees are then used to identify protein categories that yield more (or fewer) false positive interactions and more (or fewer) interaction partners. While membrane proteins have been suggested to have elevated FDRs, the current analysis suggests that intrinsic membrane proteins may actually have reduced FDRs. Hydrophobicity is positively correlated with decreased error rates and fewer interaction partners. These methods will be useful for future two-hybrid screens, which could use ultra-high-throughput sequencing for deeper sampling of interacting bait–prey pairs. Availability: All software (C source) and datasets are available as supplemental files and at http://www.baderzone.org under the Lesser GPL v. 3 license. Contact: joel.bader@jhu.edu Supplementary information: Supplementary data are available at Bioinformatics online. PMID:19091773

An investigation of the false discovery rate and the misinterpretation of p-values

PubMed Central

Colquhoun, David

2014-01-01

If you use p=0.05 to suggest that you have made a discovery, you will be wrong at least 30% of the time. If, as is often the case, experiments are underpowered, you will be wrong most of the time. This conclusion is demonstrated from several points of view. First, tree diagrams which show the close analogy with the screening test problem. Similar conclusions are drawn by repeated simulations of t-tests. These mimic what is done in real life, which makes the results more persuasive. The simulation method is used also to evaluate the extent to which effect sizes are over-estimated, especially in underpowered experiments. A script is supplied to allow the reader to do simulations themselves, with numbers appropriate for their own work. It is concluded that if you wish to keep your false discovery rate below 5%, you need to use a three-sigma rule, or to insist on p≤0.001. And never use the word ‘significant’. PMID:26064558

Enhancing the detection of barcoded reads in high throughput DNA sequencing data by controlling the false discovery rate.

PubMed

Buschmann, Tilo; Zhang, Rong; Brash, Douglas E; Bystrykh, Leonid V

2014-08-07

DNA barcodes are short unique sequences used to label DNA or RNA-derived samples in multiplexed deep sequencing experiments. During the demultiplexing step, barcodes must be detected and their position identified. In some cases (e.g., with PacBio SMRT), the position of the barcode and DNA context is not well defined. Many reads start inside the genomic insert so that adjacent primers might be missed. The matter is further complicated by coincidental similarities between barcode sequences and reference DNA. Therefore, a robust strategy is required in order to detect barcoded reads and avoid a large number of false positives or negatives.For mass inference problems such as this one, false discovery rate (FDR) methods are powerful and balanced solutions. Since existing FDR methods cannot be applied to this particular problem, we present an adapted FDR method that is suitable for the detection of barcoded reads as well as suggest possible improvements. In our analysis, barcode sequences showed high rates of coincidental similarities with the Mus musculus reference DNA. This problem became more acute when the length of the barcode sequence decreased and the number of barcodes in the set increased. The method presented in this paper controls the tail area-based false discovery rate to distinguish between barcoded and unbarcoded reads. This method helps to establish the highest acceptable minimal distance between reads and barcode sequences. In a proof of concept experiment we correctly detected barcodes in 83% of the reads with a precision of 89%. Sensitivity improved to 99% at 99% precision when the adjacent primer sequence was incorporated in the analysis. The analysis was further improved using a paired end strategy. Following an analysis of the data for sequence variants induced in the Atp1a1 gene of C57BL/6 murine melanocytes by ultraviolet light and conferring resistance to ouabain, we found no evidence of cross-contamination of DNA material between samples. Our method offers a proper quantitative treatment of the problem of detecting barcoded reads in a noisy sequencing environment. It is based on the false discovery rate statistics that allows a proper trade-off between sensitivity and precision to be chosen.

Detecting outliers when fitting data with nonlinear regression – a new method based on robust nonlinear regression and the false discovery rate

PubMed Central

Motulsky, Harvey J; Brown, Ronald E

2006-01-01

Background Nonlinear regression, like linear regression, assumes that the scatter of data around the ideal curve follows a Gaussian or normal distribution. This assumption leads to the familiar goal of regression: to minimize the sum of the squares of the vertical or Y-value distances between the points and the curve. Outliers can dominate the sum-of-the-squares calculation, and lead to misleading results. However, we know of no practical method for routinely identifying outliers when fitting curves with nonlinear regression. Results We describe a new method for identifying outliers when fitting data with nonlinear regression. We first fit the data using a robust form of nonlinear regression, based on the assumption that scatter follows a Lorentzian distribution. We devised a new adaptive method that gradually becomes more robust as the method proceeds. To define outliers, we adapted the false discovery rate approach to handling multiple comparisons. We then remove the outliers, and analyze the data using ordinary least-squares regression. Because the method combines robust regression and outlier removal, we call it the ROUT method. When analyzing simulated data, where all scatter is Gaussian, our method detects (falsely) one or more outlier in only about 1–3% of experiments. When analyzing data contaminated with one or several outliers, the ROUT method performs well at outlier identification, with an average False Discovery Rate less than 1%. Conclusion Our method, which combines a new method of robust nonlinear regression with a new method of outlier identification, identifies outliers from nonlinear curve fits with reasonable power and few false positives. PMID:16526949

Quantitative assessment of hit detection and confirmation in single and duplicate high-throughput screenings.

PubMed

Wu, Zhijin; Liu, Dongmei; Sui, Yunxia

2008-02-01

The process of identifying active targets (hits) in high-throughput screening (HTS) usually involves 2 steps: first, removing or adjusting for systematic variation in the measurement process so that extreme values represent strong biological activity instead of systematic biases such as plate effect or edge effect and, second, choosing a meaningful cutoff on the calculated statistic to declare positive compounds. Both false-positive and false-negative errors are inevitable in this process. Common control or estimation of error rates is often based on an assumption of normal distribution of the noise. The error rates in hit detection, especially false-negative rates, are hard to verify because in most assays, only compounds selected in primary screening are followed up in confirmation experiments. In this article, the authors take advantage of a quantitative HTS experiment in which all compounds are tested 42 times over a wide range of 14 concentrations so true positives can be found through a dose-response curve. Using the activity status defined by dose curve, the authors analyzed the effect of various data-processing procedures on the sensitivity and specificity of hit detection, the control of error rate, and hit confirmation. A new summary score is proposed and demonstrated to perform well in hit detection and useful in confirmation rate estimation. In general, adjusting for positional effects is beneficial, but a robust test can prevent overadjustment. Error rates estimated based on normal assumption do not agree with actual error rates, for the tails of noise distribution deviate from normal distribution. However, false discovery rate based on empirically estimated null distribution is very close to observed false discovery proportion.

Characterization and correction of the false-discovery rates in resting state connectivity using functional near-infrared spectroscopy

NASA Astrophysics Data System (ADS)

Santosa, Hendrik; Aarabi, Ardalan; Perlman, Susan B.; Huppert, Theodore J.

2017-05-01

Functional near-infrared spectroscopy (fNIRS) is a noninvasive neuroimaging technique that uses low levels of red to near-infrared light to measure changes in cerebral blood oxygenation. Spontaneous (resting state) functional connectivity (sFC) has become a critical tool for cognitive neuroscience for understanding task-independent neural networks, revealing pertinent details differentiating healthy from disordered brain function, and discovering fluctuations in the synchronization of interacting individuals during hyperscanning paradigms. Two of the main challenges to sFC-NIRS analysis are (i) the slow temporal structure of both systemic physiology and the response of blood vessels, which introduces false spurious correlations, and (ii) motion-related artifacts that result from movement of the fNIRS sensors on the participants' head and can introduce non-normal and heavy-tailed noise structures. In this work, we systematically examine the false-discovery rates of several time- and frequency-domain metrics of functional connectivity for characterizing sFC-NIRS. Specifically, we detail the modifications to the statistical models of these methods needed to avoid high levels of false-discovery related to these two sources of noise in fNIRS. We compare these analysis procedures using both simulated and experimental resting-state fNIRS data. Our proposed robust correlation method has better performance in terms of being more reliable to the noise outliers due to the motion artifacts.

How often should we expect to be wrong? Statistical power, P values, and the expected prevalence of false discoveries.

PubMed

Marino, Michael J

2018-05-01

There is a clear perception in the literature that there is a crisis in reproducibility in the biomedical sciences. Many underlying factors contributing to the prevalence of irreproducible results have been highlighted with a focus on poor design and execution of experiments along with the misuse of statistics. While these factors certainly contribute to irreproducibility, relatively little attention outside of the specialized statistical literature has focused on the expected prevalence of false discoveries under idealized circumstances. In other words, when everything is done correctly, how often should we expect to be wrong? Using a simple simulation of an idealized experiment, it is possible to show the central role of sample size and the related quantity of statistical power in determining the false discovery rate, and in accurate estimation of effect size. According to our calculations, based on current practice many subfields of biomedical science may expect their discoveries to be false at least 25% of the time, and the only viable course to correct this is to require the reporting of statistical power and a minimum of 80% power (1 - β = 0.80) for all studies. Copyright © 2017 Elsevier Inc. All rights reserved.

Glioblastoma: Vascular Habitats Detected at Preoperative Dynamic Susceptibility-weighted Contrast-enhanced Perfusion MR Imaging Predict Survival.

PubMed

Juan-Albarracín, Javier; Fuster-Garcia, Elies; Pérez-Girbés, Alexandre; Aparici-Robles, Fernando; Alberich-Bayarri, Ángel; Revert-Ventura, Antonio; Martí-Bonmatí, Luis; García-Gómez, Juan M

2018-06-01

Purpose To determine if preoperative vascular heterogeneity of glioblastoma is predictive of overall survival of patients undergoing standard-of-care treatment by using an unsupervised multiparametric perfusion-based habitat-discovery algorithm. Materials and Methods Preoperative magnetic resonance (MR) imaging including dynamic susceptibility-weighted contrast material-enhanced perfusion studies in 50 consecutive patients with glioblastoma were retrieved. Perfusion parameters of glioblastoma were analyzed and used to automatically draw four reproducible habitats that describe the tumor vascular heterogeneity: high-angiogenic and low-angiogenic regions of the enhancing tumor, potentially tumor-infiltrated peripheral edema, and vasogenic edema. Kaplan-Meier and Cox proportional hazard analyses were conducted to assess the prognostic potential of the hemodynamic tissue signature to predict patient survival. Results Cox regression analysis yielded a significant correlation between patients' survival and maximum relative cerebral blood volume (rCBV max ) and maximum relative cerebral blood flow (rCBF max ) in high-angiogenic and low-angiogenic habitats (P < .01, false discovery rate-corrected P < .05). Moreover, rCBF max in the potentially tumor-infiltrated peripheral edema habitat was also significantly correlated (P < .05, false discovery rate-corrected P < .05). Kaplan-Meier analysis demonstrated significant differences between the observed survival of populations divided according to the median of the rCBV max or rCBF max at the high-angiogenic and low-angiogenic habitats (log-rank test P < .05, false discovery rate-corrected P < .05), with an average survival increase of 230 days. Conclusion Preoperative perfusion heterogeneity contains relevant information about overall survival in patients who undergo standard-of-care treatment. The hemodynamic tissue signature method automatically describes this heterogeneity, providing a set of vascular habitats with high prognostic capabilities. © RSNA, 2018.

Target-decoy Based False Discovery Rate Estimation for Large-scale Metabolite Identification.

PubMed

Wang, Xusheng; Jones, Drew R; Shaw, Timothy I; Cho, Ji-Hoon; Wang, Yuanyuan; Tan, Haiyan; Xie, Boer; Zhou, Suiping; Li, Yuxin; Peng, Junmin

2018-05-23

Metabolite identification is a crucial step in mass spectrometry (MS)-based metabolomics. However, it is still challenging to assess the confidence of assigned metabolites. In this study, we report a novel method for estimating false discovery rate (FDR) of metabolite assignment with a target-decoy strategy, in which the decoys are generated through violating the octet rule of chemistry by adding small odd numbers of hydrogen atoms. The target-decoy strategy was integrated into JUMPm, an automated metabolite identification pipeline for large-scale MS analysis, and was also evaluated with two other metabolomics tools, mzMatch and mzMine 2. The reliability of FDR calculation was examined by false datasets, which were simulated by altering MS1 or MS2 spectra. Finally, we used the JUMPm pipeline coupled with the target-decoy strategy to process unlabeled and stable-isotope labeled metabolomic datasets. The results demonstrate that the target-decoy strategy is a simple and effective method for evaluating the confidence of high-throughput metabolite identification.

Reducing false-positive incidental findings with ensemble genotyping and logistic regression based variant filtering methods.

PubMed

Hwang, Kyu-Baek; Lee, In-Hee; Park, Jin-Ho; Hambuch, Tina; Choe, Yongjoon; Kim, MinHyeok; Lee, Kyungjoon; Song, Taemin; Neu, Matthew B; Gupta, Neha; Kohane, Isaac S; Green, Robert C; Kong, Sek Won

2014-08-01

As whole genome sequencing (WGS) uncovers variants associated with rare and common diseases, an immediate challenge is to minimize false-positive findings due to sequencing and variant calling errors. False positives can be reduced by combining results from orthogonal sequencing methods, but costly. Here, we present variant filtering approaches using logistic regression (LR) and ensemble genotyping to minimize false positives without sacrificing sensitivity. We evaluated the methods using paired WGS datasets of an extended family prepared using two sequencing platforms and a validated set of variants in NA12878. Using LR or ensemble genotyping based filtering, false-negative rates were significantly reduced by 1.1- to 17.8-fold at the same levels of false discovery rates (5.4% for heterozygous and 4.5% for homozygous single nucleotide variants (SNVs); 30.0% for heterozygous and 18.7% for homozygous insertions; 25.2% for heterozygous and 16.6% for homozygous deletions) compared to the filtering based on genotype quality scores. Moreover, ensemble genotyping excluded > 98% (105,080 of 107,167) of false positives while retaining > 95% (897 of 937) of true positives in de novo mutation (DNM) discovery in NA12878, and performed better than a consensus method using two sequencing platforms. Our proposed methods were effective in prioritizing phenotype-associated variants, and an ensemble genotyping would be essential to minimize false-positive DNM candidates. © 2014 WILEY PERIODICALS, INC.

Reducing false positive incidental findings with ensemble genotyping and logistic regression-based variant filtering methods

PubMed Central

Hwang, Kyu-Baek; Lee, In-Hee; Park, Jin-Ho; Hambuch, Tina; Choi, Yongjoon; Kim, MinHyeok; Lee, Kyungjoon; Song, Taemin; Neu, Matthew B.; Gupta, Neha; Kohane, Isaac S.; Green, Robert C.; Kong, Sek Won

2014-01-01

As whole genome sequencing (WGS) uncovers variants associated with rare and common diseases, an immediate challenge is to minimize false positive findings due to sequencing and variant calling errors. False positives can be reduced by combining results from orthogonal sequencing methods, but costly. Here we present variant filtering approaches using logistic regression (LR) and ensemble genotyping to minimize false positives without sacrificing sensitivity. We evaluated the methods using paired WGS datasets of an extended family prepared using two sequencing platforms and a validated set of variants in NA12878. Using LR or ensemble genotyping based filtering, false negative rates were significantly reduced by 1.1- to 17.8-fold at the same levels of false discovery rates (5.4% for heterozygous and 4.5% for homozygous SNVs; 30.0% for heterozygous and 18.7% for homozygous insertions; 25.2% for heterozygous and 16.6% for homozygous deletions) compared to the filtering based on genotype quality scores. Moreover, ensemble genotyping excluded > 98% (105,080 of 107,167) of false positives while retaining > 95% (897 of 937) of true positives in de novo mutation (DNM) discovery, and performed better than a consensus method using two sequencing platforms. Our proposed methods were effective in prioritizing phenotype-associated variants, and ensemble genotyping would be essential to minimize false positive DNM candidates. PMID:24829188

Testing jumps via false discovery rate control.

PubMed

Yen, Yu-Min

2013-01-01

Many recently developed nonparametric jump tests can be viewed as multiple hypothesis testing problems. For such multiple hypothesis tests, it is well known that controlling type I error often makes a large proportion of erroneous rejections, and such situation becomes even worse when the jump occurrence is a rare event. To obtain more reliable results, we aim to control the false discovery rate (FDR), an efficient compound error measure for erroneous rejections in multiple testing problems. We perform the test via the Barndorff-Nielsen and Shephard (BNS) test statistic, and control the FDR with the Benjamini and Hochberg (BH) procedure. We provide asymptotic results for the FDR control. From simulations, we examine relevant theoretical results and demonstrate the advantages of controlling the FDR. The hybrid approach is then applied to empirical analysis on two benchmark stock indices with high frequency data.

Multiplicity Control in Structural Equation Modeling

ERIC Educational Resources Information Center

Cribbie, Robert A.

2007-01-01

Researchers conducting structural equation modeling analyses rarely, if ever, control for the inflated probability of Type I errors when evaluating the statistical significance of multiple parameters in a model. In this study, the Type I error control, power and true model rates of famsilywise and false discovery rate controlling procedures were…

Exploring Site-Specific N-Glycosylation Microheterogeneity of Haptoglobin using Glycopeptide CID Tandem Mass Spectra and Glycan Database Search

PubMed Central

Chandler, Kevin Brown; Pompach, Petr; Goldman, Radoslav

2013-01-01

Glycosylation is a common protein modification with a significant role in many vital cellular processes and human diseases, making the characterization of protein-attached glycan structures important for understanding cell biology and disease processes. Direct analysis of protein N-glycosylation by tandem mass spectrometry of glycopeptides promises site-specific elucidation of N-glycan microheterogeneity, something which detached N-glycan and de-glycosylated peptide analyses cannot provide. However, successful implementation of direct N-glycopeptide analysis by tandem mass spectrometry remains a challenge. In this work, we consider algorithmic techniques for the analysis of LC-MS/MS data acquired from glycopeptide-enriched fractions of enzymatic digests of purified proteins. We implement a computational strategy which takes advantage of the properties of CID fragmentation spectra of N-glycopeptides, matching the MS/MS spectra to peptide-glycan pairs from protein sequences and glycan structure databases. Significantly, we also propose a novel false-discovery-rate estimation technique to estimate and manage the number of false identifications. We use a human glycoprotein standard, haptoglobin, digested with trypsin and GluC, enriched for glycopeptides using HILIC chromatography, and analyzed by LC-MS/MS to demonstrate our algorithmic strategy and evaluate its performance. Our software, GlycoPeptideSearch (GPS), assigned glycopeptide identifications to 246 of the spectra at false-discovery-rate 5.58%, identifying 42 distinct haptoglobin peptide-glycan pairs at each of the four haptoglobin N-linked glycosylation sites. We further demonstrate the effectiveness of this approach by analyzing plasma-derived haptoglobin, identifying 136 N-linked glycopeptide spectra at false-discovery-rate 0.4%, representing 15 distinct glycopeptides on at least three of the four N-linked glycosylation sites. The software, GlycoPeptideSearch, is available for download from http://edwardslab.bmcb.georgetown.edu/GPS. PMID:23829323

Specificity control for read alignments using an artificial reference genome-guided false discovery rate.

PubMed

Giese, Sven H; Zickmann, Franziska; Renard, Bernhard Y

2014-01-01

Accurate estimation, comparison and evaluation of read mapping error rates is a crucial step in the processing of next-generation sequencing data, as further analysis steps and interpretation assume the correctness of the mapping results. Current approaches are either focused on sensitivity estimation and thereby disregard specificity or are based on read simulations. Although continuously improving, read simulations are still prone to introduce a bias into the mapping error quantitation and cannot capture all characteristics of an individual dataset. We introduce ARDEN (artificial reference driven estimation of false positives in next-generation sequencing data), a novel benchmark method that estimates error rates of read mappers based on real experimental reads, using an additionally generated artificial reference genome. It allows a dataset-specific computation of error rates and the construction of a receiver operating characteristic curve. Thereby, it can be used for optimization of parameters for read mappers, selection of read mappers for a specific problem or for filtering alignments based on quality estimation. The use of ARDEN is demonstrated in a general read mapper comparison, a parameter optimization for one read mapper and an application example in single-nucleotide polymorphism discovery with a significant reduction in the number of false positive identifications. The ARDEN source code is freely available at http://sourceforge.net/projects/arden/.

Assessing differential gene expression with small sample sizes in oligonucleotide arrays using a mean-variance model.

PubMed

Hu, Jianhua; Wright, Fred A

2007-03-01

The identification of the genes that are differentially expressed in two-sample microarray experiments remains a difficult problem when the number of arrays is very small. We discuss the implications of using ordinary t-statistics and examine other commonly used variants. For oligonucleotide arrays with multiple probes per gene, we introduce a simple model relating the mean and variance of expression, possibly with gene-specific random effects. Parameter estimates from the model have natural shrinkage properties that guard against inappropriately small variance estimates, and the model is used to obtain a differential expression statistic. A limiting value to the positive false discovery rate (pFDR) for ordinary t-tests provides motivation for our use of the data structure to improve variance estimates. Our approach performs well compared to other proposed approaches in terms of the false discovery rate.

Apparently low reproducibility of true differential expression discoveries in microarray studies.

PubMed

Zhang, Min; Yao, Chen; Guo, Zheng; Zou, Jinfeng; Zhang, Lin; Xiao, Hui; Wang, Dong; Yang, Da; Gong, Xue; Zhu, Jing; Li, Yanhui; Li, Xia

2008-09-15

Differentially expressed gene (DEG) lists detected from different microarray studies for a same disease are often highly inconsistent. Even in technical replicate tests using identical samples, DEG detection still shows very low reproducibility. It is often believed that current small microarray studies will largely introduce false discoveries. Based on a statistical model, we show that even in technical replicate tests using identical samples, it is highly likely that the selected DEG lists will be very inconsistent in the presence of small measurement variations. Therefore, the apparently low reproducibility of DEG detection from current technical replicate tests does not indicate low quality of microarray technology. We also demonstrate that heterogeneous biological variations existing in real cancer data will further reduce the overall reproducibility of DEG detection. Nevertheless, in small subsamples from both simulated and real data, the actual false discovery rate (FDR) for each DEG list tends to be low, suggesting that each separately determined list may comprise mostly true DEGs. Rather than simply counting the overlaps of the discovery lists from different studies for a complex disease, novel metrics are needed for evaluating the reproducibility of discoveries characterized with correlated molecular changes. Supplementaty information: Supplementary data are available at Bioinformatics online.

An Integrated Microfluidic Processor for DNA-Encoded Combinatorial Library Functional Screening

PubMed Central

2017-01-01

DNA-encoded synthesis is rekindling interest in combinatorial compound libraries for drug discovery and in technology for automated and quantitative library screening. Here, we disclose a microfluidic circuit that enables functional screens of DNA-encoded compound beads. The device carries out library bead distribution into picoliter-scale assay reagent droplets, photochemical cleavage of compound from the bead, assay incubation, laser-induced fluorescence-based assay detection, and fluorescence-activated droplet sorting to isolate hits. DNA-encoded compound beads (10-μm diameter) displaying a photocleavable positive control inhibitor pepstatin A were mixed (1920 beads, 729 encoding sequences) with negative control beads (58 000 beads, 1728 encoding sequences) and screened for cathepsin D inhibition using a biochemical enzyme activity assay. The circuit sorted 1518 hit droplets for collection following 18 min incubation over a 240 min analysis. Visual inspection of a subset of droplets (1188 droplets) yielded a 24% false discovery rate (1166 pepstatin A beads; 366 negative control beads). Using template barcoding strategies, it was possible to count hit collection beads (1863) using next-generation sequencing data. Bead-specific barcodes enabled replicate counting, and the false discovery rate was reduced to 2.6% by only considering hit-encoding sequences that were observed on >2 beads. This work represents a complete distributable small molecule discovery platform, from microfluidic miniaturized automation to ultrahigh-throughput hit deconvolution by sequencing. PMID:28199790

An Integrated Microfluidic Processor for DNA-Encoded Combinatorial Library Functional Screening.

PubMed

MacConnell, Andrew B; Price, Alexander K; Paegel, Brian M

2017-03-13

DNA-encoded synthesis is rekindling interest in combinatorial compound libraries for drug discovery and in technology for automated and quantitative library screening. Here, we disclose a microfluidic circuit that enables functional screens of DNA-encoded compound beads. The device carries out library bead distribution into picoliter-scale assay reagent droplets, photochemical cleavage of compound from the bead, assay incubation, laser-induced fluorescence-based assay detection, and fluorescence-activated droplet sorting to isolate hits. DNA-encoded compound beads (10-μm diameter) displaying a photocleavable positive control inhibitor pepstatin A were mixed (1920 beads, 729 encoding sequences) with negative control beads (58 000 beads, 1728 encoding sequences) and screened for cathepsin D inhibition using a biochemical enzyme activity assay. The circuit sorted 1518 hit droplets for collection following 18 min incubation over a 240 min analysis. Visual inspection of a subset of droplets (1188 droplets) yielded a 24% false discovery rate (1166 pepstatin A beads; 366 negative control beads). Using template barcoding strategies, it was possible to count hit collection beads (1863) using next-generation sequencing data. Bead-specific barcodes enabled replicate counting, and the false discovery rate was reduced to 2.6% by only considering hit-encoding sequences that were observed on >2 beads. This work represents a complete distributable small molecule discovery platform, from microfluidic miniaturized automation to ultrahigh-throughput hit deconvolution by sequencing.

A pleiotropy-informed Bayesian false discovery rate adapted to a shared control design finds new disease associations from GWAS summary statistics.

PubMed

Liley, James; Wallace, Chris

2015-02-01

Genome-wide association studies (GWAS) have been successful in identifying single nucleotide polymorphisms (SNPs) associated with many traits and diseases. However, at existing sample sizes, these variants explain only part of the estimated heritability. Leverage of GWAS results from related phenotypes may improve detection without the need for larger datasets. The Bayesian conditional false discovery rate (cFDR) constitutes an upper bound on the expected false discovery rate (FDR) across a set of SNPs whose p values for two diseases are both less than two disease-specific thresholds. Calculation of the cFDR requires only summary statistics and have several advantages over traditional GWAS analysis. However, existing methods require distinct control samples between studies. Here, we extend the technique to allow for some or all controls to be shared, increasing applicability. Several different SNP sets can be defined with the same cFDR value, and we show that the expected FDR across the union of these sets may exceed expected FDR in any single set. We describe a procedure to establish an upper bound for the expected FDR among the union of such sets of SNPs. We apply our technique to pairwise analysis of p values from ten autoimmune diseases with variable sharing of controls, enabling discovery of 59 SNP-disease associations which do not reach GWAS significance after genomic control in individual datasets. Most of the SNPs we highlight have previously been confirmed using replication studies or larger GWAS, a useful validation of our technique; we report eight SNP-disease associations across five diseases not previously declared. Our technique extends and strengthens the previous algorithm, and establishes robust limits on the expected FDR. This approach can improve SNP detection in GWAS, and give insight into shared aetiology between phenotypically related conditions.

cn.FARMS: a latent variable model to detect copy number variations in microarray data with a low false discovery rate.

PubMed

Clevert, Djork-Arné; Mitterecker, Andreas; Mayr, Andreas; Klambauer, Günter; Tuefferd, Marianne; De Bondt, An; Talloen, Willem; Göhlmann, Hinrich; Hochreiter, Sepp

2011-07-01

Cost-effective oligonucleotide genotyping arrays like the Affymetrix SNP 6.0 are still the predominant technique to measure DNA copy number variations (CNVs). However, CNV detection methods for microarrays overestimate both the number and the size of CNV regions and, consequently, suffer from a high false discovery rate (FDR). A high FDR means that many CNVs are wrongly detected and therefore not associated with a disease in a clinical study, though correction for multiple testing takes them into account and thereby decreases the study's discovery power. For controlling the FDR, we propose a probabilistic latent variable model, 'cn.FARMS', which is optimized by a Bayesian maximum a posteriori approach. cn.FARMS controls the FDR through the information gain of the posterior over the prior. The prior represents the null hypothesis of copy number 2 for all samples from which the posterior can only deviate by strong and consistent signals in the data. On HapMap data, cn.FARMS clearly outperformed the two most prevalent methods with respect to sensitivity and FDR. The software cn.FARMS is publicly available as a R package at http://www.bioinf.jku.at/software/cnfarms/cnfarms.html.

Controlling the Rate of GWAS False Discoveries

PubMed Central

Brzyski, Damian; Peterson, Christine B.; Sobczyk, Piotr; Candès, Emmanuel J.; Bogdan, Malgorzata; Sabatti, Chiara

2017-01-01

With the rise of both the number and the complexity of traits of interest, control of the false discovery rate (FDR) in genetic association studies has become an increasingly appealing and accepted target for multiple comparison adjustment. While a number of robust FDR-controlling strategies exist, the nature of this error rate is intimately tied to the precise way in which discoveries are counted, and the performance of FDR-controlling procedures is satisfactory only if there is a one-to-one correspondence between what scientists describe as unique discoveries and the number of rejected hypotheses. The presence of linkage disequilibrium between markers in genome-wide association studies (GWAS) often leads researchers to consider the signal associated to multiple neighboring SNPs as indicating the existence of a single genomic locus with possible influence on the phenotype. This a posteriori aggregation of rejected hypotheses results in inflation of the relevant FDR. We propose a novel approach to FDR control that is based on prescreening to identify the level of resolution of distinct hypotheses. We show how FDR-controlling strategies can be adapted to account for this initial selection both with theoretical results and simulations that mimic the dependence structure to be expected in GWAS. We demonstrate that our approach is versatile and useful when the data are analyzed using both tests based on single markers and multiple regression. We provide an R package that allows practitioners to apply our procedure on standard GWAS format data, and illustrate its performance on lipid traits in the North Finland Birth Cohort 66 cohort study. PMID:27784720

Controlling the Rate of GWAS False Discoveries.

PubMed

Brzyski, Damian; Peterson, Christine B; Sobczyk, Piotr; Candès, Emmanuel J; Bogdan, Malgorzata; Sabatti, Chiara

2017-01-01

With the rise of both the number and the complexity of traits of interest, control of the false discovery rate (FDR) in genetic association studies has become an increasingly appealing and accepted target for multiple comparison adjustment. While a number of robust FDR-controlling strategies exist, the nature of this error rate is intimately tied to the precise way in which discoveries are counted, and the performance of FDR-controlling procedures is satisfactory only if there is a one-to-one correspondence between what scientists describe as unique discoveries and the number of rejected hypotheses. The presence of linkage disequilibrium between markers in genome-wide association studies (GWAS) often leads researchers to consider the signal associated to multiple neighboring SNPs as indicating the existence of a single genomic locus with possible influence on the phenotype. This a posteriori aggregation of rejected hypotheses results in inflation of the relevant FDR. We propose a novel approach to FDR control that is based on prescreening to identify the level of resolution of distinct hypotheses. We show how FDR-controlling strategies can be adapted to account for this initial selection both with theoretical results and simulations that mimic the dependence structure to be expected in GWAS. We demonstrate that our approach is versatile and useful when the data are analyzed using both tests based on single markers and multiple regression. We provide an R package that allows practitioners to apply our procedure on standard GWAS format data, and illustrate its performance on lipid traits in the North Finland Birth Cohort 66 cohort study. Copyright © 2017 by the Genetics Society of America.

Bon-EV: an improved multiple testing procedure for controlling false discovery rates.

PubMed

Li, Dongmei; Xie, Zidian; Zand, Martin; Fogg, Thomas; Dye, Timothy

2017-01-03

Stability of multiple testing procedures, defined as the standard deviation of total number of discoveries, can be used as an indicator of variability of multiple testing procedures. Improving stability of multiple testing procedures can help to increase the consistency of findings from replicated experiments. Benjamini-Hochberg's and Storey's q-value procedures are two commonly used multiple testing procedures for controlling false discoveries in genomic studies. Storey's q-value procedure has higher power and lower stability than Benjamini-Hochberg's procedure. To improve upon the stability of Storey's q-value procedure and maintain its high power in genomic data analysis, we propose a new multiple testing procedure, named Bon-EV, to control false discovery rate (FDR) based on Bonferroni's approach. Simulation studies show that our proposed Bon-EV procedure can maintain the high power of the Storey's q-value procedure and also result in better FDR control and higher stability than Storey's q-value procedure for samples of large size(30 in each group) and medium size (15 in each group) for either independent, somewhat correlated, or highly correlated test statistics. When sample size is small (5 in each group), our proposed Bon-EV procedure has performance between the Benjamini-Hochberg procedure and the Storey's q-value procedure. Examples using RNA-Seq data show that the Bon-EV procedure has higher stability than the Storey's q-value procedure while maintaining equivalent power, and higher power than the Benjamini-Hochberg's procedure. For medium or large sample sizes, the Bon-EV procedure has improved FDR control and stability compared with the Storey's q-value procedure and improved power compared with the Benjamini-Hochberg procedure. The Bon-EV multiple testing procedure is available as the BonEV package in R for download at https://CRAN.R-project.org/package=BonEV .

Robust and Accurate Anomaly Detection in ECG Artifacts Using Time Series Motif Discovery

PubMed Central

Sivaraks, Haemwaan

2015-01-01

Electrocardiogram (ECG) anomaly detection is an important technique for detecting dissimilar heartbeats which helps identify abnormal ECGs before the diagnosis process. Currently available ECG anomaly detection methods, ranging from academic research to commercial ECG machines, still suffer from a high false alarm rate because these methods are not able to differentiate ECG artifacts from real ECG signal, especially, in ECG artifacts that are similar to ECG signals in terms of shape and/or frequency. The problem leads to high vigilance for physicians and misinterpretation risk for nonspecialists. Therefore, this work proposes a novel anomaly detection technique that is highly robust and accurate in the presence of ECG artifacts which can effectively reduce the false alarm rate. Expert knowledge from cardiologists and motif discovery technique is utilized in our design. In addition, every step of the algorithm conforms to the interpretation of cardiologists. Our method can be utilized to both single-lead ECGs and multilead ECGs. Our experiment results on real ECG datasets are interpreted and evaluated by cardiologists. Our proposed algorithm can mostly achieve 100% of accuracy on detection (AoD), sensitivity, specificity, and positive predictive value with 0% false alarm rate. The results demonstrate that our proposed method is highly accurate and robust to artifacts, compared with competitive anomaly detection methods. PMID:25688284

Poisson Statistics of Combinatorial Library Sampling Predict False Discovery Rates of Screening

PubMed Central

2017-01-01

Microfluidic droplet-based screening of DNA-encoded one-bead-one-compound combinatorial libraries is a miniaturized, potentially widely distributable approach to small molecule discovery. In these screens, a microfluidic circuit distributes library beads into droplets of activity assay reagent, photochemically cleaves the compound from the bead, then incubates and sorts the droplets based on assay result for subsequent DNA sequencing-based hit compound structure elucidation. Pilot experimental studies revealed that Poisson statistics describe nearly all aspects of such screens, prompting the development of simulations to understand system behavior. Monte Carlo screening simulation data showed that increasing mean library sampling (ε), mean droplet occupancy, or library hit rate all increase the false discovery rate (FDR). Compounds identified as hits on k > 1 beads (the replicate k class) were much more likely to be authentic hits than singletons (k = 1), in agreement with previous findings. Here, we explain this observation by deriving an equation for authenticity, which reduces to the product of a library sampling bias term (exponential in k) and a sampling saturation term (exponential in ε) setting a threshold that the k-dependent bias must overcome. The equation thus quantitatively describes why each hit structure’s FDR is based on its k class, and further predicts the feasibility of intentionally populating droplets with multiple library beads, assaying the micromixtures for function, and identifying the active members by statistical deconvolution. PMID:28682059

Optimal selection of markers for validation or replication from genome-wide association studies.

PubMed

Greenwood, Celia M T; Rangrej, Jagadish; Sun, Lei

2007-07-01

With reductions in genotyping costs and the fast pace of improvements in genotyping technology, it is not uncommon for the individuals in a single study to undergo genotyping using several different platforms, where each platform may contain different numbers of markers selected via different criteria. For example, a set of cases and controls may be genotyped at markers in a small set of carefully selected candidate genes, and shortly thereafter, the same cases and controls may be used for a genome-wide single nucleotide polymorphism (SNP) association study. After such initial investigations, often, a subset of "interesting" markers is selected for validation or replication. Specifically, by validation, we refer to the investigation of associations between the selected subset of markers and the disease in independent data. However, it is not obvious how to choose the best set of markers for this validation. There may be a prior expectation that some sets of genotyping data are more likely to contain real associations. For example, it may be more likely for markers in plausible candidate genes to show disease associations than markers in a genome-wide scan. Hence, it would be desirable to select proportionally more markers from the candidate gene set. When a fixed number of markers are selected for validation, we propose an approach for identifying an optimal marker-selection configuration by basing the approach on minimizing the stratified false discovery rate. We illustrate this approach using a case-control study of colorectal cancer from Ontario, Canada, and we show that this approach leads to substantial reductions in the estimated false discovery rates in the Ontario dataset for the selected markers, as well as reductions in the expected false discovery rates for the proposed validation dataset. Copyright 2007 Wiley-Liss, Inc.

A comparative review of estimates of the proportion unchanged genes and the false discovery rate

PubMed Central

Broberg, Per

2005-01-01

Background In the analysis of microarray data one generally produces a vector of p-values that for each gene give the likelihood of obtaining equally strong evidence of change by pure chance. The distribution of these p-values is a mixture of two components corresponding to the changed genes and the unchanged ones. The focus of this article is how to estimate the proportion unchanged and the false discovery rate (FDR) and how to make inferences based on these concepts. Six published methods for estimating the proportion unchanged genes are reviewed, two alternatives are presented, and all are tested on both simulated and real data. All estimates but one make do without any parametric assumptions concerning the distributions of the p-values. Furthermore, the estimation and use of the FDR and the closely related q-value is illustrated with examples. Five published estimates of the FDR and one new are presented and tested. Implementations in R code are available. Results A simulation model based on the distribution of real microarray data plus two real data sets were used to assess the methods. The proposed alternative methods for estimating the proportion unchanged fared very well, and gave evidence of low bias and very low variance. Different methods perform well depending upon whether there are few or many regulated genes. Furthermore, the methods for estimating FDR showed a varying performance, and were sometimes misleading. The new method had a very low error. Conclusion The concept of the q-value or false discovery rate is useful in practical research, despite some theoretical and practical shortcomings. However, it seems possible to challenge the performance of the published methods, and there is likely scope for further developing the estimates of the FDR. The new methods provide the scientist with more options to choose a suitable method for any particular experiment. The article advocates the use of the conjoint information regarding false positive and negative rates as well as the proportion unchanged when identifying changed genes. PMID:16086831

A two-step hierarchical hypothesis set testing framework, with applications to gene expression data on ordered categories

PubMed Central

2014-01-01

Background In complex large-scale experiments, in addition to simultaneously considering a large number of features, multiple hypotheses are often being tested for each feature. This leads to a problem of multi-dimensional multiple testing. For example, in gene expression studies over ordered categories (such as time-course or dose-response experiments), interest is often in testing differential expression across several categories for each gene. In this paper, we consider a framework for testing multiple sets of hypothesis, which can be applied to a wide range of problems. Results We adopt the concept of the overall false discovery rate (OFDR) for controlling false discoveries on the hypothesis set level. Based on an existing procedure for identifying differentially expressed gene sets, we discuss a general two-step hierarchical hypothesis set testing procedure, which controls the overall false discovery rate under independence across hypothesis sets. In addition, we discuss the concept of the mixed-directional false discovery rate (mdFDR), and extend the general procedure to enable directional decisions for two-sided alternatives. We applied the framework to the case of microarray time-course/dose-response experiments, and proposed three procedures for testing differential expression and making multiple directional decisions for each gene. Simulation studies confirm the control of the OFDR and mdFDR by the proposed procedures under independence and positive correlations across genes. Simulation results also show that two of our new procedures achieve higher power than previous methods. Finally, the proposed methodology is applied to a microarray dose-response study, to identify 17 β-estradiol sensitive genes in breast cancer cells that are induced at low concentrations. Conclusions The framework we discuss provides a platform for multiple testing procedures covering situations involving two (or potentially more) sources of multiplicity. The framework is easy to use and adaptable to various practical settings that frequently occur in large-scale experiments. Procedures generated from the framework are shown to maintain control of the OFDR and mdFDR, quantities that are especially relevant in the case of multiple hypothesis set testing. The procedures work well in both simulations and real datasets, and are shown to have better power than existing methods. PMID:24731138

Functional Brain Connectome and Its Relation to Hoehn and Yahr Stage in Parkinson Disease.

PubMed

Suo, Xueling; Lei, Du; Li, Nannan; Cheng, Lan; Chen, Fuqin; Wang, Meiyun; Kemp, Graham J; Peng, Rong; Gong, Qiyong

2017-12-01

Purpose To use resting-state functional magnetic resonance (MR) imaging and graph theory approaches to investigate the brain functional connectome and its potential relation to disease severity in Parkinson disease (PD). Materials and Methods This case-control study was approved by the local research ethics committee, and all participants provided informed consent. There were 153 right-handed patients with PD and 81 healthy control participants recruited who were matched for age, sex, and handedness to undergo a 3-T resting-state functional MR examination. The whole-brain functional connectome was constructed by thresholding the Pearson correlation matrices of 90 brain regions, and the topologic properties were analyzed by using graph theory approaches. Nonparametric permutation tests were used to compare topologic properties, and their relationship to disease severity was assessed. Results The functional connectome in PD showed abnormalities at the global level (ie, decrease in clustering coefficient, global efficiency, and local efficiency, and increase in characteristic path length) and at the nodal level (decreased nodal centralities in the sensorimotor cortex, default mode, and temporal-occipital regions; P < .001, false discovery rate corrected). Further, the nodal centralities in left postcentral gyrus and left superior temporal gyrus correlated negatively with Unified Parkinson's Disease Rating Scale III score (P = .038, false discovery rate corrected, r = -0.198; and P = .009, false discovery rate corrected, r = -0.270, respectively) and decreased with increasing Hoehn and Yahr stage in patients with PD. Conclusion The configurations of brain functional connectome in patients with PD were perturbed and correlated with disease severity, notably with those responsible for motor functions. These results provide topologic insights into understanding the neural functional changes in relation to disease severity of PD. © RSNA, 2017 Online supplemental material is available for this article. An earlier incorrect version of this article appeared online. This article was corrected on September 11, 2017.

POWER-ENHANCED MULTIPLE DECISION FUNCTIONS CONTROLLING FAMILY-WISE ERROR AND FALSE DISCOVERY RATES.

PubMed

Peña, Edsel A; Habiger, Joshua D; Wu, Wensong

2011-02-01

Improved procedures, in terms of smaller missed discovery rates (MDR), for performing multiple hypotheses testing with weak and strong control of the family-wise error rate (FWER) or the false discovery rate (FDR) are developed and studied. The improvement over existing procedures such as the Šidák procedure for FWER control and the Benjamini-Hochberg (BH) procedure for FDR control is achieved by exploiting possible differences in the powers of the individual tests. Results signal the need to take into account the powers of the individual tests and to have multiple hypotheses decision functions which are not limited to simply using the individual p -values, as is the case, for example, with the Šidák, Bonferroni, or BH procedures. They also enhance understanding of the role of the powers of individual tests, or more precisely the receiver operating characteristic (ROC) functions of decision processes, in the search for better multiple hypotheses testing procedures. A decision-theoretic framework is utilized, and through auxiliary randomizers the procedures could be used with discrete or mixed-type data or with rank-based nonparametric tests. This is in contrast to existing p -value based procedures whose theoretical validity is contingent on each of these p -value statistics being stochastically equal to or greater than a standard uniform variable under the null hypothesis. Proposed procedures are relevant in the analysis of high-dimensional "large M , small n " data sets arising in the natural, physical, medical, economic and social sciences, whose generation and creation is accelerated by advances in high-throughput technology, notably, but not limited to, microarray technology.

False negative rates in Drosophila cell-based RNAi screens: a case study

PubMed Central

2011-01-01

Background High-throughput screening using RNAi is a powerful gene discovery method but is often complicated by false positive and false negative results. Whereas false positive results associated with RNAi reagents has been a matter of extensive study, the issue of false negatives has received less attention. Results We performed a meta-analysis of several genome-wide, cell-based Drosophila RNAi screens, together with a more focused RNAi screen, and conclude that the rate of false negative results is at least 8%. Further, we demonstrate how knowledge of the cell transcriptome can be used to resolve ambiguous results and how the number of false negative results can be reduced by using multiple, independently-tested RNAi reagents per gene. Conclusions RNAi reagents that target the same gene do not always yield consistent results due to false positives and weak or ineffective reagents. False positive results can be partially minimized by filtering with transcriptome data. RNAi libraries with multiple reagents per gene also reduce false positive and false negative outcomes when inconsistent results are disambiguated carefully. PMID:21251254

Normalization and microbial differential abundance strategies depend upon data characteristics.

PubMed

Weiss, Sophie; Xu, Zhenjiang Zech; Peddada, Shyamal; Amir, Amnon; Bittinger, Kyle; Gonzalez, Antonio; Lozupone, Catherine; Zaneveld, Jesse R; Vázquez-Baeza, Yoshiki; Birmingham, Amanda; Hyde, Embriette R; Knight, Rob

2017-03-03

Data from 16S ribosomal RNA (rRNA) amplicon sequencing present challenges to ecological and statistical interpretation. In particular, library sizes often vary over several ranges of magnitude, and the data contains many zeros. Although we are typically interested in comparing relative abundance of taxa in the ecosystem of two or more groups, we can only measure the taxon relative abundance in specimens obtained from the ecosystems. Because the comparison of taxon relative abundance in the specimen is not equivalent to the comparison of taxon relative abundance in the ecosystems, this presents a special challenge. Second, because the relative abundance of taxa in the specimen (as well as in the ecosystem) sum to 1, these are compositional data. Because the compositional data are constrained by the simplex (sum to 1) and are not unconstrained in the Euclidean space, many standard methods of analysis are not applicable. Here, we evaluate how these challenges impact the performance of existing normalization methods and differential abundance analyses. Effects on normalization: Most normalization methods enable successful clustering of samples according to biological origin when the groups differ substantially in their overall microbial composition. Rarefying more clearly clusters samples according to biological origin than other normalization techniques do for ordination metrics based on presence or absence. Alternate normalization measures are potentially vulnerable to artifacts due to library size. Effects on differential abundance testing: We build on a previous work to evaluate seven proposed statistical methods using rarefied as well as raw data. Our simulation studies suggest that the false discovery rates of many differential abundance-testing methods are not increased by rarefying itself, although of course rarefying results in a loss of sensitivity due to elimination of a portion of available data. For groups with large (~10×) differences in the average library size, rarefying lowers the false discovery rate. DESeq2, without addition of a constant, increased sensitivity on smaller datasets (<20 samples per group) but tends towards a higher false discovery rate with more samples, very uneven (~10×) library sizes, and/or compositional effects. For drawing inferences regarding taxon abundance in the ecosystem, analysis of composition of microbiomes (ANCOM) is not only very sensitive (for >20 samples per group) but also critically the only method tested that has a good control of false discovery rate. These findings guide which normalization and differential abundance techniques to use based on the data characteristics of a given study.

Resampling-Based Empirical Bayes Multiple Testing Procedures for Controlling Generalized Tail Probability and Expected Value Error Rates: Focus on the False Discovery Rate and Simulation Study

PubMed Central

Dudoit, Sandrine; Gilbert, Houston N.; van der Laan, Mark J.

2014-01-01

Summary This article proposes resampling-based empirical Bayes multiple testing procedures for controlling a broad class of Type I error rates, defined as generalized tail probability (gTP) error rates, gTP(q, g) = Pr(g(Vn, Sn) > q), and generalized expected value (gEV) error rates, gEV(g) = E[g(Vn, Sn)], for arbitrary functions g(Vn, Sn) of the numbers of false positives Vn and true positives Sn. Of particular interest are error rates based on the proportion g(Vn, Sn) = Vn/(Vn + Sn) of Type I errors among the rejected hypotheses, such as the false discovery rate (FDR), FDR = E[Vn/(Vn + Sn)]. The proposed procedures offer several advantages over existing methods. They provide Type I error control for general data generating distributions, with arbitrary dependence structures among variables. Gains in power are achieved by deriving rejection regions based on guessed sets of true null hypotheses and null test statistics randomly sampled from joint distributions that account for the dependence structure of the data. The Type I error and power properties of an FDR-controlling version of the resampling-based empirical Bayes approach are investigated and compared to those of widely-used FDR-controlling linear step-up procedures in a simulation study. The Type I error and power trade-off achieved by the empirical Bayes procedures under a variety of testing scenarios allows this approach to be competitive with or outperform the Storey and Tibshirani (2003) linear step-up procedure, as an alternative to the classical Benjamini and Hochberg (1995) procedure. PMID:18932138

28 CFR 2.30 - False information or new criminal conduct: Discovery after release.

Code of Federal Regulations, 2010 CFR

2010-07-01

... 28 Judicial Administration 1 2010-07-01 2010-07-01 false False information or new criminal conduct... Prisoners and Parolees § 2.30 False information or new criminal conduct: Discovery after release. If... willfully provided false information or misrepresented information deemed significant to his application for...

Academic drug discovery: current status and prospects.

PubMed

Everett, Jeremy R

2015-01-01

The contraction in pharmaceutical drug discovery operations in the past decade has been counter-balanced by a significant rise in the number of academic drug discovery groups. In addition, pharmaceutical companies that used to operate in completely independent, vertically integrated operations for drug discovery, are now collaborating more with each other, and with academic groups. We are in a new era of drug discovery. This review provides an overview of the current status of academic drug discovery groups, their achievements and the challenges they face, together with perspectives on ways to achieve improved outcomes. Academic groups have made important contributions to drug discovery, from its earliest days and continue to do so today. However, modern drug discovery and development is exceedingly complex, and has high failure rates, principally because human biology is complex and poorly understood. Academic drug discovery groups need to play to their strengths and not just copy what has gone before. However, there are lessons to be learnt from the experiences of the industrial drug discoverers and four areas are highlighted for attention: i) increased validation of targets; ii) elimination of false hits from high throughput screening (HTS); iii) increasing the quality of molecular probes; and iv) investing in a high-quality informatics infrastructure.

Associating mapping of stigma characteristics using the USDA rice core collection

USDA-ARS?s Scientific Manuscript database

A mini-core from the USDA rice core collection was phenotyped for nine traits of stigma and spikelet and genotyped with 109 DNA markers. Marker-trait association mapping was used to identify the regions associated with the nine traits. Resulting associations were adjusted using false discovery rate ...

Gut transcription in Helicoverpa zea is dynamically altered in response to baculovirus infection

USDA-ARS?s Scientific Manuscript database

The Helicoverpa zea transcriptome was analyzed 24 hours after H. zea larvae fed on artificial diet laced with Helicoverpa zea single nucleopolyhedrovirus (HzSNPV). Significant differential regulation of 1,139 putative genes (P<0.05 T-test with Benjamini and Hochberg False Discovery Rate) was detect...

Large Scale Mass Spectrometry-based Identifications of Enzyme-mediated Protein Methylation Are Subject to High False Discovery Rates*

PubMed Central

Hart-Smith, Gene; Yagoub, Daniel; Tay, Aidan P.; Pickford, Russell; Wilkins, Marc R.

2016-01-01

All large scale LC-MS/MS post-translational methylation site discovery experiments require methylpeptide spectrum matches (methyl-PSMs) to be identified at acceptably low false discovery rates (FDRs). To meet estimated methyl-PSM FDRs, methyl-PSM filtering criteria are often determined using the target-decoy approach. The efficacy of this methyl-PSM filtering approach has, however, yet to be thoroughly evaluated. Here, we conduct a systematic analysis of methyl-PSM FDRs across a range of sample preparation workflows (each differing in their exposure to the alcohols methanol and isopropyl alcohol) and mass spectrometric instrument platforms (each employing a different mode of MS/MS dissociation). Through 13CD3-methionine labeling (heavy-methyl SILAC) of Saccharomyces cerevisiae cells and in-depth manual data inspection, accurate lists of true positive methyl-PSMs were determined, allowing methyl-PSM FDRs to be compared with target-decoy approach-derived methyl-PSM FDR estimates. These results show that global FDR estimates produce extremely unreliable methyl-PSM filtering criteria; we demonstrate that this is an unavoidable consequence of the high number of amino acid combinations capable of producing peptide sequences that are isobaric to methylated peptides of a different sequence. Separate methyl-PSM FDR estimates were also found to be unreliable due to prevalent sources of false positive methyl-PSMs that produce high peptide identity score distributions. Incorrect methylation site localizations, peptides containing cysteinyl-S-β-propionamide, and methylated glutamic or aspartic acid residues can partially, but not wholly, account for these false positive methyl-PSMs. Together, these results indicate that the target-decoy approach is an unreliable means of estimating methyl-PSM FDRs and methyl-PSM filtering criteria. We suggest that orthogonal methylpeptide validation (e.g. heavy-methyl SILAC or its offshoots) should be considered a prerequisite for obtaining high confidence methyl-PSMs in large scale LC-MS/MS methylation site discovery experiments and make recommendations on how to reduce methyl-PSM FDRs in samples not amenable to heavy isotope labeling. Data are available via ProteomeXchange with the data identifier PXD002857. PMID:26699799

MSblender: A probabilistic approach for integrating peptide identifications from multiple database search engines.

PubMed

Kwon, Taejoon; Choi, Hyungwon; Vogel, Christine; Nesvizhskii, Alexey I; Marcotte, Edward M

2011-07-01

Shotgun proteomics using mass spectrometry is a powerful method for protein identification but suffers limited sensitivity in complex samples. Integrating peptide identifications from multiple database search engines is a promising strategy to increase the number of peptide identifications and reduce the volume of unassigned tandem mass spectra. Existing methods pool statistical significance scores such as p-values or posterior probabilities of peptide-spectrum matches (PSMs) from multiple search engines after high scoring peptides have been assigned to spectra, but these methods lack reliable control of identification error rates as data are integrated from different search engines. We developed a statistically coherent method for integrative analysis, termed MSblender. MSblender converts raw search scores from search engines into a probability score for every possible PSM and properly accounts for the correlation between search scores. The method reliably estimates false discovery rates and identifies more PSMs than any single search engine at the same false discovery rate. Increased identifications increment spectral counts for most proteins and allow quantification of proteins that would not have been quantified by individual search engines. We also demonstrate that enhanced quantification contributes to improve sensitivity in differential expression analyses.

MSblender: a probabilistic approach for integrating peptide identifications from multiple database search engines

PubMed Central

Kwon, Taejoon; Choi, Hyungwon; Vogel, Christine; Nesvizhskii, Alexey I.; Marcotte, Edward M.

2011-01-01

Shotgun proteomics using mass spectrometry is a powerful method for protein identification but suffers limited sensitivity in complex samples. Integrating peptide identifications from multiple database search engines is a promising strategy to increase the number of peptide identifications and reduce the volume of unassigned tandem mass spectra. Existing methods pool statistical significance scores such as p-values or posterior probabilities of peptide-spectrum matches (PSMs) from multiple search engines after high scoring peptides have been assigned to spectra, but these methods lack reliable control of identification error rates as data are integrated from different search engines. We developed a statistically coherent method for integrative analysis, termed MSblender. MSblender converts raw search scores from search engines into a probability score for all possible PSMs and properly accounts for the correlation between search scores. The method reliably estimates false discovery rates and identifies more PSMs than any single search engine at the same false discovery rate. Increased identifications increment spectral counts for all detected proteins and allow quantification of proteins that would not have been quantified by individual search engines. We also demonstrate that enhanced quantification contributes to improve sensitivity in differential expression analyses. PMID:21488652

Milagro Observations of Potential TeV Emitters

NASA Astrophysics Data System (ADS)

Abeysekara, Anushka; Linnemann, James

2012-03-01

We searched for point sources in Milagro sky maps at the locations in four catalogs of potential TeV emitting sources. Our candidates are selected from the Fermi 2FGL pulsars, Fermi 2FGL extragalactic sources, TeVCat extragalactic sources, and from the BL Lac TeV Candidate list published by Costamante and Ghisellini in 2002. The False Discovery Rate (FDR) statistical procedure is used to select the sources. The FDR procedure controls the fraction of false detections. Our results are presented in this talk.

Global gene expression in channel catfish after vaccination with an attenuated Edwardsiella ictaluri

USDA-ARS?s Scientific Manuscript database

To understand the global gene expression in channel catfish after immersion vaccination with an attenuated Edwardsiella ictaluri (AquaVac ESCTM), microarray analysis of 65,182 UniGene transcripts were performed. With a filter of false-discovery rate less than 0.05 and fold change greater than 2, a t...

Differential DNA methylation patterns of polycystic ovarian syndrome in whole blood of Chinese women.

PubMed

Li, Shuxia; Zhu, Dongyi; Duan, Hongmei; Ren, Anran; Glintborg, Dorte; Andersen, Marianne; Skov, Vibe; Thomassen, Mads; Kruse, Torben; Tan, Qihua

2017-03-28

As a universally common endocrinopathy in women of reproductive age, the polycystic ovarian syndrome is characterized by composite clinical phenotypes reflecting the contributions of reproductive impact of ovarian dysfunction and metabolic abnormalities with widely varying symptoms resulting from interference of the genome with the environment through integrative biological mechanisms including epigenetics. We have performed a genome-wide DNA methylation analysis on polycystic ovarian syndrome and identified a substantial number of genomic sites differentially methylated in the whole blood of PCOS patients and healthy controls (52 sites, false discovery rate < 0.05 and corresponding p value < 5.68e-06), highly consistently replicating biological pathways extensively implicated in immunity and immunity-related inflammatory disorders (false discovery rate < 0.05) that were reportedly regulated in the DNA methylome from ovarian tissue under PCOS condition. Most importantly, our genome-wide profiling focusing on PCOS patients revealed a large number of DNA methylation sites and their enriched functional pathways significantly associated with diverse clinical features (levels of prolactin, estradiol, progesterone and menstrual cycle) that could serve as novel molecular basis of the clinical heterogeneity observed in PCOS women.

Characterizing the Joint Effect of Diverse Test-Statistic Correlation Structures and Effect Size on False Discovery Rates in a Multiple-Comparison Study of Many Outcome Measures

NASA Technical Reports Server (NTRS)

Feiveson, Alan H.; Ploutz-Snyder, Robert; Fiedler, James

2011-01-01

In their 2009 Annals of Statistics paper, Gavrilov, Benjamini, and Sarkar report the results of a simulation assessing the robustness of their adaptive step-down procedure (GBS) for controlling the false discovery rate (FDR) when normally distributed test statistics are serially correlated. In this study we extend the investigation to the case of multiple comparisons involving correlated non-central t-statistics, in particular when several treatments or time periods are being compared to a control in a repeated-measures design with many dependent outcome measures. In addition, we consider several dependence structures other than serial correlation and illustrate how the FDR depends on the interaction between effect size and the type of correlation structure as indexed by Foerstner s distance metric from an identity. The relationship between the correlation matrix R of the original dependent variables and R, the correlation matrix of associated t-statistics is also studied. In general R depends not only on R, but also on sample size and the signed effect sizes for the multiple comparisons.

The IPAC Image Subtraction and Discovery Pipeline for the Intermediate Palomar Transient Factory

NASA Astrophysics Data System (ADS)

Masci, Frank J.; Laher, Russ R.; Rebbapragada, Umaa D.; Doran, Gary B.; Miller, Adam A.; Bellm, Eric; Kasliwal, Mansi; Ofek, Eran O.; Surace, Jason; Shupe, David L.; Grillmair, Carl J.; Jackson, Ed; Barlow, Tom; Yan, Lin; Cao, Yi; Cenko, S. Bradley; Storrie-Lombardi, Lisa J.; Helou, George; Prince, Thomas A.; Kulkarni, Shrinivas R.

2017-01-01

We describe the near real-time transient-source discovery engine for the intermediate Palomar Transient Factory (iPTF), currently in operations at the Infrared Processing and Analysis Center (IPAC), Caltech. We coin this system the IPAC/iPTF Discovery Engine (or IDE). We review the algorithms used for PSF-matching, image subtraction, detection, photometry, and machine-learned (ML) vetting of extracted transient candidates. We also review the performance of our ML classifier. For a limiting signal-to-noise ratio of 4 in relatively unconfused regions, bogus candidates from processing artifacts and imperfect image subtractions outnumber real transients by ≃10:1. This can be considerably higher for image data with inaccurate astrometric and/or PSF-matching solutions. Despite this occasionally high contamination rate, the ML classifier is able to identify real transients with an efficiency (or completeness) of ≃97% for a maximum tolerable false-positive rate of 1% when classifying raw candidates. All subtraction-image metrics, source features, ML probability-based real-bogus scores, contextual metadata from other surveys, and possible associations with known Solar System objects are stored in a relational database for retrieval by the various science working groups. We review our efforts in mitigating false-positives and our experience in optimizing the overall system in response to the multitude of science projects underway with iPTF.

The IPAC Image Subtraction and Discovery Pipeline for the Intermediate Palomar Transient Factory

NASA Technical Reports Server (NTRS)

Masci, Frank J.; Laher, Russ R.; Rebbapragada, Umaa D.; Doran, Gary B.; Miller, Adam A.; Bellm, Eric; Kasliwal, Mansi; Ofek, Eran O.; Surace, Jason; Shupe, David L.;

Pharmacovigilance data mining with methods based on false discovery rates: a comparative simulation study.

PubMed

Ahmed, I; Thiessard, F; Miremont-Salamé, G; Bégaud, B; Tubert-Bitter, P

2010-10-01

The early detection of adverse reactions caused by drugs that are already on the market is the prime concern of pharmacovigilance efforts; the methods in use for postmarketing surveillance are aimed at detecting signals pointing to potential safety concerns, on the basis of reports from health-care providers and from information available in various databases. Signal detection methods based on the estimation of false discovery rate (FDR) have recently been proposed. They address the limitation of arbitrary detection thresholds of the automatic methods in current use, including those last updated by the US Food and Drug Administration and the World Health Organization's Uppsala Monitoring Centre. We used two simulation procedures to compare the false-positive performances for three current methods: the reporting odds ratio (ROR), the information component (IC), the gamma Poisson shrinkage (GPS), and also for two FDR-based methods derived from the GPS model and Fisher's test. Large differences in FDR rates were associated with the signal-detection methods currently in use. These differences ranged from 0.01 to 12% in an analysis that was restricted to signals with at least three reports. The numbers of signals generated were also highly variable. Among fixed-size lists of signals, the FDR was lowered when the FDR-based approaches were used. Overall, the outcomes in both simulation studies suggest that improvement in effectiveness can be expected from use of the FDR-based GPS method.

Single nucleotide polymorphism discovery in rainbow trout by deep sequencing of a reduced representation library.

PubMed

Sánchez, Cecilia Castaño; Smith, Timothy P L; Wiedmann, Ralph T; Vallejo, Roger L; Salem, Mohamed; Yao, Jianbo; Rexroad, Caird E

2009-11-25

To enhance capabilities for genomic analyses in rainbow trout, such as genomic selection, a large suite of polymorphic markers that are amenable to high-throughput genotyping protocols must be identified. Expressed Sequence Tags (ESTs) have been used for single nucleotide polymorphism (SNP) discovery in salmonids. In those strategies, the salmonid semi-tetraploid genomes often led to assemblies of paralogous sequences and therefore resulted in a high rate of false positive SNP identification. Sequencing genomic DNA using primers identified from ESTs proved to be an effective but time consuming methodology of SNP identification in rainbow trout, therefore not suitable for high throughput SNP discovery. In this study, we employed a high-throughput strategy that used pyrosequencing technology to generate data from a reduced representation library constructed with genomic DNA pooled from 96 unrelated rainbow trout that represent the National Center for Cool and Cold Water Aquaculture (NCCCWA) broodstock population. The reduced representation library consisted of 440 bp fragments resulting from complete digestion with the restriction enzyme HaeIII; sequencing produced 2,000,000 reads providing an average 6 fold coverage of the estimated 150,000 unique genomic restriction fragments (300,000 fragment ends). Three independent data analyses identified 22,022 to 47,128 putative SNPs on 13,140 to 24,627 independent contigs. A set of 384 putative SNPs, randomly selected from the sets produced by the three analyses were genotyped on individual fish to determine the validation rate of putative SNPs among analyses, distinguish apparent SNPs that actually represent paralogous loci in the tetraploid genome, examine Mendelian segregation, and place the validated SNPs on the rainbow trout linkage map. Approximately 48% (183) of the putative SNPs were validated; 167 markers were successfully incorporated into the rainbow trout linkage map. In addition, 2% of the sequences from the validated markers were associated with rainbow trout transcripts. The use of reduced representation libraries and pyrosequencing technology proved to be an effective strategy for the discovery of a high number of putative SNPs in rainbow trout; however, modifications to the technique to decrease the false discovery rate resulting from the evolutionary recent genome duplication would be desirable.

Association Between Genetic Traits for Immune-Mediated Diseases and Alzheimer Disease.

PubMed

Yokoyama, Jennifer S; Wang, Yunpeng; Schork, Andrew J; Thompson, Wesley K; Karch, Celeste M; Cruchaga, Carlos; McEvoy, Linda K; Witoelar, Aree; Chen, Chi-Hua; Holland, Dominic; Brewer, James B; Franke, Andre; Dillon, William P; Wilson, David M; Mukherjee, Pratik; Hess, Christopher P; Miller, Zachary; Bonham, Luke W; Shen, Jeffrey; Rabinovici, Gil D; Rosen, Howard J; Miller, Bruce L; Hyman, Bradley T; Schellenberg, Gerard D; Karlsen, Tom H; Andreassen, Ole A; Dale, Anders M; Desikan, Rahul S

2016-06-01

Late-onset Alzheimer disease (AD), the most common form of dementia, places a large burden on families and society. Although epidemiological and clinical evidence suggests a relationship between inflammation and AD, their relationship is not well understood and could have implications for treatment and prevention strategies. To determine whether a subset of genes involved with increased risk of inflammation are also associated with increased risk for AD. In a genetic epidemiology study conducted in July 2015, we systematically investigated genetic overlap between AD (International Genomics of Alzheimer's Project stage 1) and Crohn disease, ulcerative colitis, rheumatoid arthritis, type 1 diabetes, celiac disease, and psoriasis using summary data from genome-wide association studies at multiple academic clinical research centers. P values and odds ratios from genome-wide association studies of more than 100 000 individuals were from previous comparisons of patients vs respective control cohorts. Diagnosis for each disorder was previously established for the parent study using consensus criteria. The primary outcome was the pleiotropic (conjunction) false discovery rate P value. Follow-up for candidate variants included neuritic plaque and neurofibrillary tangle pathology; longitudinal Alzheimer's Disease Assessment Scale cognitive subscale scores as a measure of cognitive dysfunction (Alzheimer's Disease Neuroimaging Initiative); and gene expression in AD vs control brains (Gene Expression Omnibus data). Eight single-nucleotide polymorphisms (false discovery rate P < .05) were associated with both AD and immune-mediated diseases. Of these, rs2516049 (closest gene HLA-DRB5; conjunction false discovery rate P = .04 for AD and psoriasis, 5.37 × 10-5 for AD, and 6.03 × 10-15 for psoriasis) and rs12570088 (closest gene IPMK; conjunction false discovery rate P = .009 for AD and Crohn disease, P = 5.73 × 10-6 for AD, and 6.57 × 10-5 for Crohn disease) demonstrated the same direction of allelic effect between AD and the immune-mediated diseases. Both rs2516049 and rs12570088 were significantly associated with neurofibrillary tangle pathology (P = .01352 and .03151, respectively); rs2516049 additionally correlated with longitudinal decline on Alzheimer's Disease Assessment Scale cognitive subscale scores (β [SE], 0.405 [0.190]; P = .03). Regarding gene expression, HLA-DRA and IPMK transcript expression was significantly altered in AD brains compared with control brains (HLA-DRA: β [SE], 0.155 [0.024]; P = 1.97 × 10-10; IPMK: β [SE], -0.096 [0.013]; P = 7.57 × 10-13). Our findings demonstrate genetic overlap between AD and immune-mediated diseases and suggest that immune system processes influence AD pathogenesis and progression.

Association Between Genetic Traits for Immune-Mediated Diseases and Alzheimer Disease

PubMed Central

Yokoyama, Jennifer S.; Wang, Yunpeng; Schork, Andrew J.; Thompson, Wesley K.; Karch, Celeste M.; Cruchaga, Carlos; McEvoy, Linda K.; Witoelar, Aree; Chen, Chi-Hua; Holland, Dominic; Brewer, James B.; Franke, Andre; Dillon, William P.; Wilson, David M.; Mukherjee, Pratik; Hess, Christopher P.; Miller, Zachary; Bonham, Luke W.; Shen, Jeffrey; Rabinovici, Gil D.; Rosen, Howard J.; Miller, Bruce L.; Hyman, Bradley T.; Schellenberg, Gerard D.; Karlsen, Tom H.; Andreassen, Ole A.; Dale, Anders M.; Desikan, Rahul S.

2016-01-01

IMPORTANCE Late-onset Alzheimer disease (AD), the most common form of dementia, places a large burden on families and society. Although epidemiological and clinical evidence suggests a relationship between inflammation and AD, their relationship is not well understood and could have implications for treatment and prevention strategies. OBJECTIVE To determine whether a subset of genes involved with increased risk of inflammation are also associated with increased risk for AD. DESIGN, SETTING, AND PARTICIPANTS In a genetic epidemiology study conducted in July 2015, we systematically investigated genetic overlap between AD (International Genomics of Alzheimer’s Project stage 1) and Crohn disease, ulcerative colitis, rheumatoid arthritis, type 1 diabetes, celiac disease, and psoriasis using summary data from genome-wide association studies at multiple academic clinical research centers. P values and odds ratios from genome-wide association studies of more than 100 000 individuals were from previous comparisons of patients vs respective control cohorts. Diagnosis for each disorder was previously established for the parent study using consensus criteria. MAIN OUTCOMES AND MEASURES The primary outcome was the pleiotropic (conjunction) false discovery rate P value. Follow-up for candidate variants included neuritic plaque and neurofibrillary tangle pathology; longitudinal Alzheimer’s Disease Assessment Scale cognitive subscale scores as a measure of cognitive dysfunction (Alzheimer’s Disease Neuroimaging Initiative); and gene expression in AD vs control brains (Gene Expression Omnibus data). RESULTS Eight single-nucleotide polymorphisms (false discovery rate P < .05) were associated with both AD and immune-mediated diseases. Of these, rs2516049 (closest gene HLA-DRB5; conjunction false discovery rate P = .04 for AD and psoriasis, 5.37 × 10−5 for AD, and 6.03 × 10−15 for psoriasis) and rs12570088 (closest gene IPMK; conjunction false discovery rate P = .009 for AD and Crohn disease, P = 5.73 × 10−6 for AD, and 6.57 × 10−5 for Crohn disease) demonstrated the same direction of allelic effect between AD and the immune-mediated diseases. Both rs2516049 and rs12570088 were significantly associated with neurofibrillary tangle pathology (P = .01352 and .03151, respectively); rs2516049 additionally correlated with longitudinal decline on Alzheimer’s Disease Assessment Scale cognitive subscale scores (β [SE], 0.405 [0.190]; P = .03). Regarding gene expression, HLA-DRA and IPMK transcript expression was significantly altered in AD brains compared with control brains (HLA-DRA: β [SE], 0.155 [0.024]; P = 1.97 × 10−10; IPMK: β [SE], −0.096 [0.013]; P = 7.57 × 10−13). CONCLUSIONS AND RELEVANCE Our findings demonstrate genetic overlap between AD and immune-mediated diseases and suggest that immune system processes influence AD pathogenesis and progression. PMID:27088644

Statistical interpretation of machine learning-based feature importance scores for biomarker discovery.

PubMed

Huynh-Thu, Vân Anh; Saeys, Yvan; Wehenkel, Louis; Geurts, Pierre

2012-07-01

Univariate statistical tests are widely used for biomarker discovery in bioinformatics. These procedures are simple, fast and their output is easily interpretable by biologists but they can only identify variables that provide a significant amount of information in isolation from the other variables. As biological processes are expected to involve complex interactions between variables, univariate methods thus potentially miss some informative biomarkers. Variable relevance scores provided by machine learning techniques, however, are potentially able to highlight multivariate interacting effects, but unlike the p-values returned by univariate tests, these relevance scores are usually not statistically interpretable. This lack of interpretability hampers the determination of a relevance threshold for extracting a feature subset from the rankings and also prevents the wide adoption of these methods by practicians. We evaluated several, existing and novel, procedures that extract relevant features from rankings derived from machine learning approaches. These procedures replace the relevance scores with measures that can be interpreted in a statistical way, such as p-values, false discovery rates, or family wise error rates, for which it is easier to determine a significance level. Experiments were performed on several artificial problems as well as on real microarray datasets. Although the methods differ in terms of computing times and the tradeoff, they achieve in terms of false positives and false negatives, some of them greatly help in the extraction of truly relevant biomarkers and should thus be of great practical interest for biologists and physicians. As a side conclusion, our experiments also clearly highlight that using model performance as a criterion for feature selection is often counter-productive. Python source codes of all tested methods, as well as the MATLAB scripts used for data simulation, can be found in the Supplementary Material.

cn.MOPS: mixture of Poissons for discovering copy number variations in next-generation sequencing data with a low false discovery rate

PubMed Central

Klambauer, Günter; Schwarzbauer, Karin; Mayr, Andreas; Clevert, Djork-Arné; Mitterecker, Andreas; Bodenhofer, Ulrich; Hochreiter, Sepp

2012-01-01

Quantitative analyses of next-generation sequencing (NGS) data, such as the detection of copy number variations (CNVs), remain challenging. Current methods detect CNVs as changes in the depth of coverage along chromosomes. Technological or genomic variations in the depth of coverage thus lead to a high false discovery rate (FDR), even upon correction for GC content. In the context of association studies between CNVs and disease, a high FDR means many false CNVs, thereby decreasing the discovery power of the study after correction for multiple testing. We propose ‘Copy Number estimation by a Mixture Of PoissonS’ (cn.MOPS), a data processing pipeline for CNV detection in NGS data. In contrast to previous approaches, cn.MOPS incorporates modeling of depths of coverage across samples at each genomic position. Therefore, cn.MOPS is not affected by read count variations along chromosomes. Using a Bayesian approach, cn.MOPS decomposes variations in the depth of coverage across samples into integer copy numbers and noise by means of its mixture components and Poisson distributions, respectively. The noise estimate allows for reducing the FDR by filtering out detections having high noise that are likely to be false detections. We compared cn.MOPS with the five most popular methods for CNV detection in NGS data using four benchmark datasets: (i) simulated data, (ii) NGS data from a male HapMap individual with implanted CNVs from the X chromosome, (iii) data from HapMap individuals with known CNVs, (iv) high coverage data from the 1000 Genomes Project. cn.MOPS outperformed its five competitors in terms of precision (1–FDR) and recall for both gains and losses in all benchmark data sets. The software cn.MOPS is publicly available as an R package at http://www.bioinf.jku.at/software/cnmops/ and at Bioconductor. PMID:22302147

cn.MOPS: mixture of Poissons for discovering copy number variations in next-generation sequencing data with a low false discovery rate.

PubMed

Klambauer, Günter; Schwarzbauer, Karin; Mayr, Andreas; Clevert, Djork-Arné; Mitterecker, Andreas; Bodenhofer, Ulrich; Hochreiter, Sepp

2012-05-01

Quantitative analyses of next-generation sequencing (NGS) data, such as the detection of copy number variations (CNVs), remain challenging. Current methods detect CNVs as changes in the depth of coverage along chromosomes. Technological or genomic variations in the depth of coverage thus lead to a high false discovery rate (FDR), even upon correction for GC content. In the context of association studies between CNVs and disease, a high FDR means many false CNVs, thereby decreasing the discovery power of the study after correction for multiple testing. We propose 'Copy Number estimation by a Mixture Of PoissonS' (cn.MOPS), a data processing pipeline for CNV detection in NGS data. In contrast to previous approaches, cn.MOPS incorporates modeling of depths of coverage across samples at each genomic position. Therefore, cn.MOPS is not affected by read count variations along chromosomes. Using a Bayesian approach, cn.MOPS decomposes variations in the depth of coverage across samples into integer copy numbers and noise by means of its mixture components and Poisson distributions, respectively. The noise estimate allows for reducing the FDR by filtering out detections having high noise that are likely to be false detections. We compared cn.MOPS with the five most popular methods for CNV detection in NGS data using four benchmark datasets: (i) simulated data, (ii) NGS data from a male HapMap individual with implanted CNVs from the X chromosome, (iii) data from HapMap individuals with known CNVs, (iv) high coverage data from the 1000 Genomes Project. cn.MOPS outperformed its five competitors in terms of precision (1-FDR) and recall for both gains and losses in all benchmark data sets. The software cn.MOPS is publicly available as an R package at http://www.bioinf.jku.at/software/cnmops/ and at Bioconductor.

An effect size filter improves the reproducibility in spectral counting-based comparative proteomics.

PubMed

Gregori, Josep; Villarreal, Laura; Sánchez, Alex; Baselga, José; Villanueva, Josep

2013-12-16

The microarray community has shown that the low reproducibility observed in gene expression-based biomarker discovery studies is partially due to relying solely on p-values to get the lists of differentially expressed genes. Their conclusions recommended complementing the p-value cutoff with the use of effect-size criteria. The aim of this work was to evaluate the influence of such an effect-size filter on spectral counting-based comparative proteomic analysis. The results proved that the filter increased the number of true positives and decreased the number of false positives and the false discovery rate of the dataset. These results were confirmed by simulation experiments where the effect size filter was used to evaluate systematically variable fractions of differentially expressed proteins. Our results suggest that relaxing the p-value cut-off followed by a post-test filter based on effect size and signal level thresholds can increase the reproducibility of statistical results obtained in comparative proteomic analysis. Based on our work, we recommend using a filter consisting of a minimum absolute log2 fold change of 0.8 and a minimum signal of 2-4 SpC on the most abundant condition for the general practice of comparative proteomics. The implementation of feature filtering approaches could improve proteomic biomarker discovery initiatives by increasing the reproducibility of the results obtained among independent laboratories and MS platforms. Quality control analysis of microarray-based gene expression studies pointed out that the low reproducibility observed in the lists of differentially expressed genes could be partially attributed to the fact that these lists are generated relying solely on p-values. Our study has established that the implementation of an effect size post-test filter improves the statistical results of spectral count-based quantitative proteomics. The results proved that the filter increased the number of true positives whereas decreased the false positives and the false discovery rate of the datasets. The results presented here prove that a post-test filter applying a reasonable effect size and signal level thresholds helps to increase the reproducibility of statistical results in comparative proteomic analysis. Furthermore, the implementation of feature filtering approaches could improve proteomic biomarker discovery initiatives by increasing the reproducibility of results obtained among independent laboratories and MS platforms. This article is part of a Special Issue entitled: Standardization and Quality Control in Proteomics. Copyright © 2013 Elsevier B.V. All rights reserved.

14 CFR 406.143 - Discovery.

Code of Federal Regulations, 2014 CFR

2014-01-01

... 14 Aeronautics and Space 4 2014-01-01 2014-01-01 false Discovery. 406.143 Section 406.143... Transportation Adjudications § 406.143 Discovery. (a) Initiation of discovery. Any party may initiate discovery... after a complaint has been filed. (b) Methods of discovery. The following methods of discovery are...

14 CFR 406.143 - Discovery.

Code of Federal Regulations, 2011 CFR

2011-01-01

... 14 Aeronautics and Space 4 2011-01-01 2011-01-01 false Discovery. 406.143 Section 406.143... Transportation Adjudications § 406.143 Discovery. (a) Initiation of discovery. Any party may initiate discovery... after a complaint has been filed. (b) Methods of discovery. The following methods of discovery are...

14 CFR 406.143 - Discovery.

Code of Federal Regulations, 2012 CFR

2012-01-01

... 14 Aeronautics and Space 4 2012-01-01 2012-01-01 false Discovery. 406.143 Section 406.143... Transportation Adjudications § 406.143 Discovery. (a) Initiation of discovery. Any party may initiate discovery... after a complaint has been filed. (b) Methods of discovery. The following methods of discovery are...

14 CFR 406.143 - Discovery.

Code of Federal Regulations, 2013 CFR

2013-01-01

... 14 Aeronautics and Space 4 2013-01-01 2013-01-01 false Discovery. 406.143 Section 406.143... Transportation Adjudications § 406.143 Discovery. (a) Initiation of discovery. Any party may initiate discovery... after a complaint has been filed. (b) Methods of discovery. The following methods of discovery are...

14 CFR 406.143 - Discovery.

Code of Federal Regulations, 2010 CFR

2010-01-01

... 14 Aeronautics and Space 4 2010-01-01 2010-01-01 false Discovery. 406.143 Section 406.143... Transportation Adjudications § 406.143 Discovery. (a) Initiation of discovery. Any party may initiate discovery... after a complaint has been filed. (b) Methods of discovery. The following methods of discovery are...

Examining Measurement Invariance and Differential Item Functioning with Discrete Latent Construct Indicators: A Note on a Multiple Testing Procedure

ERIC Educational Resources Information Center

Raykov, Tenko; Dimitrov, Dimiter M.; Marcoulides, George A.; Li, Tatyana; Menold, Natalja

2018-01-01

A latent variable modeling method for studying measurement invariance when evaluating latent constructs with multiple binary or binary scored items with no guessing is outlined. The approach extends the continuous indicator procedure described by Raykov and colleagues, utilizes similarly the false discovery rate approach to multiple testing, and…

ADEPT, a dynamic next generation sequencing data error-detection program with trimming

DOE Office of Scientific and Technical Information (OSTI.GOV)

Feng, Shihai; Lo, Chien-Chi; Li, Po-E

Illumina is the most widely used next generation sequencing technology and produces millions of short reads that contain errors. These sequencing errors constitute a major problem in applications such as de novo genome assembly, metagenomics analysis and single nucleotide polymorphism discovery. In this study, we present ADEPT, a dynamic error detection method, based on the quality scores of each nucleotide and its neighboring nucleotides, together with their positions within the read and compares this to the position-specific quality score distribution of all bases within the sequencing run. This method greatly improves upon other available methods in terms of the truemore » positive rate of error discovery without affecting the false positive rate, particularly within the middle of reads. We conclude that ADEPT is the only tool to date that dynamically assesses errors within reads by comparing position-specific and neighboring base quality scores with the distribution of quality scores for the dataset being analyzed. The result is a method that is less prone to position-dependent under-prediction, which is one of the most prominent issues in error prediction. The outcome is that ADEPT improves upon prior efforts in identifying true errors, primarily within the middle of reads, while reducing the false positive rate.« less

ADEPT, a dynamic next generation sequencing data error-detection program with trimming

DOE PAGES

Feng, Shihai; Lo, Chien-Chi; Li, Po-E; ...

2016-02-29

Illumina is the most widely used next generation sequencing technology and produces millions of short reads that contain errors. These sequencing errors constitute a major problem in applications such as de novo genome assembly, metagenomics analysis and single nucleotide polymorphism discovery. In this study, we present ADEPT, a dynamic error detection method, based on the quality scores of each nucleotide and its neighboring nucleotides, together with their positions within the read and compares this to the position-specific quality score distribution of all bases within the sequencing run. This method greatly improves upon other available methods in terms of the truemore » positive rate of error discovery without affecting the false positive rate, particularly within the middle of reads. We conclude that ADEPT is the only tool to date that dynamically assesses errors within reads by comparing position-specific and neighboring base quality scores with the distribution of quality scores for the dataset being analyzed. The result is a method that is less prone to position-dependent under-prediction, which is one of the most prominent issues in error prediction. The outcome is that ADEPT improves upon prior efforts in identifying true errors, primarily within the middle of reads, while reducing the false positive rate.« less

39 CFR 952.21 - Discovery.

Code of Federal Regulations, 2014 CFR

2014-07-01

... 39 Postal Service 1 2014-07-01 2014-07-01 false Discovery. 952.21 Section 952.21 Postal Service... AND LOTTERY ORDERS § 952.21 Discovery. (a) Voluntary discovery. The parties are encouraged to engage in voluntary discovery procedures. In connection with any deposition or other discovery procedure...

39 CFR 952.21 - Discovery.

Code of Federal Regulations, 2013 CFR

2013-07-01

... 39 Postal Service 1 2013-07-01 2013-07-01 false Discovery. 952.21 Section 952.21 Postal Service... AND LOTTERY ORDERS § 952.21 Discovery. (a) Voluntary discovery. The parties are encouraged to engage in voluntary discovery procedures. In connection with any deposition or other discovery procedure...

39 CFR 952.21 - Discovery.

Code of Federal Regulations, 2012 CFR

2012-07-01

... 39 Postal Service 1 2012-07-01 2012-07-01 false Discovery. 952.21 Section 952.21 Postal Service... AND LOTTERY ORDERS § 952.21 Discovery. (a) Voluntary discovery. The parties are encouraged to engage in voluntary discovery procedures. In connection with any deposition or other discovery procedure...

Experimental Null Method to Guide the Development of Technical Procedures and to Control False-Positive Discovery in Quantitative Proteomics.

PubMed

Shen, Xiaomeng; Hu, Qiang; Li, Jun; Wang, Jianmin; Qu, Jun

2015-10-02

Comprehensive and accurate evaluation of data quality and false-positive biomarker discovery is critical to direct the method development/optimization for quantitative proteomics, which nonetheless remains challenging largely due to the high complexity and unique features of proteomic data. Here we describe an experimental null (EN) method to address this need. Because the method experimentally measures the null distribution (either technical or biological replicates) using the same proteomic samples, the same procedures and the same batch as the case-vs-contol experiment, it correctly reflects the collective effects of technical variability (e.g., variation/bias in sample preparation, LC-MS analysis, and data processing) and project-specific features (e.g., characteristics of the proteome and biological variation) on the performances of quantitative analysis. To show a proof of concept, we employed the EN method to assess the quantitative accuracy and precision and the ability to quantify subtle ratio changes between groups using different experimental and data-processing approaches and in various cellular and tissue proteomes. It was found that choices of quantitative features, sample size, experimental design, data-processing strategies, and quality of chromatographic separation can profoundly affect quantitative precision and accuracy of label-free quantification. The EN method was also demonstrated as a practical tool to determine the optimal experimental parameters and rational ratio cutoff for reliable protein quantification in specific proteomic experiments, for example, to identify the necessary number of technical/biological replicates per group that affords sufficient power for discovery. Furthermore, we assessed the ability of EN method to estimate levels of false-positives in the discovery of altered proteins, using two concocted sample sets mimicking proteomic profiling using technical and biological replicates, respectively, where the true-positives/negatives are known and span a wide concentration range. It was observed that the EN method correctly reflects the null distribution in a proteomic system and accurately measures false altered proteins discovery rate (FADR). In summary, the EN method provides a straightforward, practical, and accurate alternative to statistics-based approaches for the development and evaluation of proteomic experiments and can be universally adapted to various types of quantitative techniques.

30 CFR 44.24 - Discovery.

Code of Federal Regulations, 2014 CFR

2014-07-01

... 30 Mineral Resources 1 2014-07-01 2014-07-01 false Discovery. 44.24 Section 44.24 Mineral... Discovery. Parties shall be governed in their conduct of discovery by appropriate provisions of the Federal... discovery. Alternative periods of time for discovery may be prescribed by the presiding administrative law...

29 CFR 2700.56 - Discovery; general.

Code of Federal Regulations, 2011 CFR

2011-07-01

... 29 Labor 9 2011-07-01 2011-07-01 false Discovery; general. 2700.56 Section 2700.56 Labor... Hearings § 2700.56 Discovery; general. (a) Discovery methods. Parties may obtain discovery by one or more... upon property for inspecting, copying, photographing, and gathering information. (b) Scope of discovery...

30 CFR 44.24 - Discovery.

Code of Federal Regulations, 2012 CFR

2012-07-01

... 30 Mineral Resources 1 2012-07-01 2012-07-01 false Discovery. 44.24 Section 44.24 Mineral... Discovery. Parties shall be governed in their conduct of discovery by appropriate provisions of the Federal... discovery. Alternative periods of time for discovery may be prescribed by the presiding administrative law...

30 CFR 44.24 - Discovery.

Code of Federal Regulations, 2011 CFR

2011-07-01

... 30 Mineral Resources 1 2011-07-01 2011-07-01 false Discovery. 44.24 Section 44.24 Mineral... Discovery. Parties shall be governed in their conduct of discovery by appropriate provisions of the Federal... discovery. Alternative periods of time for discovery may be prescribed by the presiding administrative law...

24 CFR 180.500 - Discovery.

Code of Federal Regulations, 2013 CFR

2013-04-01

... 24 Housing and Urban Development 1 2013-04-01 2013-04-01 false Discovery. 180.500 Section 180.500... OPPORTUNITY CONSOLIDATED HUD HEARING PROCEDURES FOR CIVIL RIGHTS MATTERS Discovery § 180.500 Discovery. (a) In general. This subpart governs discovery in aid of administrative proceedings under this part. Discovery in...

24 CFR 180.500 - Discovery.

Code of Federal Regulations, 2014 CFR

2014-04-01

... 24 Housing and Urban Development 1 2014-04-01 2014-04-01 false Discovery. 180.500 Section 180.500... OPPORTUNITY CONSOLIDATED HUD HEARING PROCEDURES FOR CIVIL RIGHTS MATTERS Discovery § 180.500 Discovery. (a) In general. This subpart governs discovery in aid of administrative proceedings under this part. Discovery in...

19 CFR 356.20 - Discovery.

Code of Federal Regulations, 2014 CFR

2014-04-01

... 19 Customs Duties 3 2014-04-01 2014-04-01 false Discovery. 356.20 Section 356.20 Customs Duties... § 356.20 Discovery. (a) Voluntary discovery. All parties are encouraged to engage in voluntary discovery... sanctions proceeding. (b) Limitations on discovery. The administrative law judge shall place such limits...

24 CFR 180.500 - Discovery.

Code of Federal Regulations, 2012 CFR

2012-04-01

... 24 Housing and Urban Development 1 2012-04-01 2012-04-01 false Discovery. 180.500 Section 180.500... OPPORTUNITY CONSOLIDATED HUD HEARING PROCEDURES FOR CIVIL RIGHTS MATTERS Discovery § 180.500 Discovery. (a) In general. This subpart governs discovery in aid of administrative proceedings under this part. Discovery in...

29 CFR 2700.56 - Discovery; general.

Code of Federal Regulations, 2012 CFR

2012-07-01

... 29 Labor 9 2012-07-01 2012-07-01 false Discovery; general. 2700.56 Section 2700.56 Labor... Hearings § 2700.56 Discovery; general. (a) Discovery methods. Parties may obtain discovery by one or more... upon property for inspecting, copying, photographing, and gathering information. (b) Scope of discovery...

19 CFR 356.20 - Discovery.

Code of Federal Regulations, 2013 CFR

2013-04-01

... 19 Customs Duties 3 2013-04-01 2013-04-01 false Discovery. 356.20 Section 356.20 Customs Duties... § 356.20 Discovery. (a) Voluntary discovery. All parties are encouraged to engage in voluntary discovery... sanctions proceeding. (b) Limitations on discovery. The administrative law judge shall place such limits...

19 CFR 356.20 - Discovery.

Code of Federal Regulations, 2012 CFR

2012-04-01

... 19 Customs Duties 3 2012-04-01 2012-04-01 false Discovery. 356.20 Section 356.20 Customs Duties... § 356.20 Discovery. (a) Voluntary discovery. All parties are encouraged to engage in voluntary discovery... sanctions proceeding. (b) Limitations on discovery. The administrative law judge shall place such limits...

29 CFR 2700.56 - Discovery; general.

Code of Federal Regulations, 2014 CFR

2014-07-01

... 29 Labor 9 2014-07-01 2014-07-01 false Discovery; general. 2700.56 Section 2700.56 Labor... Hearings § 2700.56 Discovery; general. (a) Discovery methods. Parties may obtain discovery by one or more... upon property for inspecting, copying, photographing, and gathering information. (b) Scope of discovery...

30 CFR 44.24 - Discovery.

Code of Federal Regulations, 2013 CFR

2013-07-01

... 30 Mineral Resources 1 2013-07-01 2013-07-01 false Discovery. 44.24 Section 44.24 Mineral... Discovery. Parties shall be governed in their conduct of discovery by appropriate provisions of the Federal... discovery. Alternative periods of time for discovery may be prescribed by the presiding administrative law...

19 CFR 356.20 - Discovery.

Code of Federal Regulations, 2011 CFR

2011-04-01

... 19 Customs Duties 3 2011-04-01 2011-04-01 false Discovery. 356.20 Section 356.20 Customs Duties... § 356.20 Discovery. (a) Voluntary discovery. All parties are encouraged to engage in voluntary discovery... sanctions proceeding. (b) Limitations on discovery. The administrative law judge shall place such limits...

24 CFR 180.500 - Discovery.

Code of Federal Regulations, 2011 CFR

2011-04-01

... 24 Housing and Urban Development 1 2011-04-01 2011-04-01 false Discovery. 180.500 Section 180.500... OPPORTUNITY CONSOLIDATED HUD HEARING PROCEDURES FOR CIVIL RIGHTS MATTERS Discovery § 180.500 Discovery. (a) In general. This subpart governs discovery in aid of administrative proceedings under this part. Discovery in...

24 CFR 180.500 - Discovery.

Code of Federal Regulations, 2010 CFR

2010-04-01

... 24 Housing and Urban Development 1 2010-04-01 2010-04-01 false Discovery. 180.500 Section 180.500... OPPORTUNITY CONSOLIDATED HUD HEARING PROCEDURES FOR CIVIL RIGHTS MATTERS Discovery § 180.500 Discovery. (a) In general. This subpart governs discovery in aid of administrative proceedings under this part. Discovery in...

30 CFR 44.24 - Discovery.

Code of Federal Regulations, 2010 CFR

2010-07-01

... 30 Mineral Resources 1 2010-07-01 2010-07-01 false Discovery. 44.24 Section 44.24 Mineral... Discovery. Parties shall be governed in their conduct of discovery by appropriate provisions of the Federal... discovery. Alternative periods of time for discovery may be prescribed by the presiding administrative law...

29 CFR 2700.56 - Discovery; general.

Code of Federal Regulations, 2010 CFR

2010-07-01

... 29 Labor 9 2010-07-01 2010-07-01 false Discovery; general. 2700.56 Section 2700.56 Labor... Hearings § 2700.56 Discovery; general. (a) Discovery methods. Parties may obtain discovery by one or more... upon property for inspecting, copying, photographing, and gathering information. (b) Scope of discovery...

19 CFR 356.20 - Discovery.

Code of Federal Regulations, 2010 CFR

2010-04-01

... 19 Customs Duties 3 2010-04-01 2010-04-01 false Discovery. 356.20 Section 356.20 Customs Duties... § 356.20 Discovery. (a) Voluntary discovery. All parties are encouraged to engage in voluntary discovery... sanctions proceeding. (b) Limitations on discovery. The administrative law judge shall place such limits...

Designing biomedical proteomics experiments: state-of-the-art and future perspectives.

PubMed

Maes, Evelyne; Kelchtermans, Pieter; Bittremieux, Wout; De Grave, Kurt; Degroeve, Sven; Hooyberghs, Jef; Mertens, Inge; Baggerman, Geert; Ramon, Jan; Laukens, Kris; Martens, Lennart; Valkenborg, Dirk

2016-05-01

With the current expanded technical capabilities to perform mass spectrometry-based biomedical proteomics experiments, an improved focus on the design of experiments is crucial. As it is clear that ignoring the importance of a good design leads to an unprecedented rate of false discoveries which would poison our results, more and more tools are developed to help researchers designing proteomic experiments. In this review, we apply statistical thinking to go through the entire proteomics workflow for biomarker discovery and validation and relate the considerations that should be made at the level of hypothesis building, technology selection, experimental design and the optimization of the experimental parameters.

Improving sensitivity in proteome studies by analysis of false discovery rates for multiple search engines

PubMed Central

Jones, Andrew R.; Siepen, Jennifer A.; Hubbard, Simon J.; Paton, Norman W.

2010-01-01

Tandem mass spectrometry, run in combination with liquid chromatography (LC-MS/MS), can generate large numbers of peptide and protein identifications, for which a variety of database search engines are available. Distinguishing correct identifications from false positives is far from trivial because all data sets are noisy, and tend to be too large for manual inspection, therefore probabilistic methods must be employed to balance the trade-off between sensitivity and specificity. Decoy databases are becoming widely used to place statistical confidence in results sets, allowing the false discovery rate (FDR) to be estimated. It has previously been demonstrated that different MS search engines produce different peptide identification sets, and as such, employing more than one search engine could result in an increased number of peptides being identified. However, such efforts are hindered by the lack of a single scoring framework employed by all search engines. We have developed a search engine independent scoring framework based on FDR which allows peptide identifications from different search engines to be combined, called the FDRScore. We observe that peptide identifications made by three search engines are infrequently false positives, and identifications made by only a single search engine, even with a strong score from the source search engine, are significantly more likely to be false positives. We have developed a second score based on the FDR within peptide identifications grouped according to the set of search engines that have made the identification, called the combined FDRScore. We demonstrate by searching large publicly available data sets that the combined FDRScore can differentiate between between correct and incorrect peptide identifications with high accuracy, allowing on average 35% more peptide identifications to be made at a fixed FDR than using a single search engine. PMID:19253293

Avoiding false discoveries in association studies.

PubMed

Sabatti, Chiara

2007-01-01

We consider the problem of controlling false discoveries in association studies. We assume that the design of the study is adequate so that the "false discoveries" are potentially only because of random chance, not to confounding or other flaws. Under this premise, we review the statistical framework for hypothesis testing and correction for multiple comparisons. We consider in detail the currently accepted strategies in linkage analysis. We then examine the underlying similarities and differences between linkage and association studies and document some of the most recent methodological developments for association mapping.

22 CFR 224.21 - Discovery.

Code of Federal Regulations, 2013 CFR

2013-04-01

... 22 Foreign Relations 1 2013-04-01 2013-04-01 false Discovery. 224.21 Section 224.21 Foreign....21 Discovery. (a) The following types of discovery are authorized: (1) Requests for production of... parties, discovery is available only as ordered by the ALJ. The ALJ shall regulate the timing of discovery...

15 CFR 25.21 - Discovery.

Code of Federal Regulations, 2013 CFR

2013-01-01

... 15 Commerce and Foreign Trade 1 2013-01-01 2013-01-01 false Discovery. 25.21 Section 25.21... Discovery. (a) The following types of discovery are authorized: (1) Requests for production of documents for..., discovery is available only as ordered by the ALJ. The ALJ shall regulate the timing of discovery. (d...

37 CFR 42.224 - Discovery.

Code of Federal Regulations, 2013 CFR

2013-07-01

... 37 Patents, Trademarks, and Copyrights 1 2013-07-01 2013-07-01 false Discovery. 42.224 Section 42... Post-Grant Review § 42.224 Discovery. Notwithstanding the discovery provisions of subpart A: (a) Requests for additional discovery may be granted upon a showing of good cause as to why the discovery is...

15 CFR 25.21 - Discovery.

Code of Federal Regulations, 2012 CFR

2012-01-01

... 15 Commerce and Foreign Trade 1 2012-01-01 2012-01-01 false Discovery. 25.21 Section 25.21... Discovery. (a) The following types of discovery are authorized: (1) Requests for production of documents for..., discovery is available only as ordered by the ALJ. The ALJ shall regulate the timing of discovery. (d...

15 CFR 25.21 - Discovery.

Code of Federal Regulations, 2014 CFR

2014-01-01

... 15 Commerce and Foreign Trade 1 2014-01-01 2014-01-01 false Discovery. 25.21 Section 25.21... Discovery. (a) The following types of discovery are authorized: (1) Requests for production of documents for..., discovery is available only as ordered by the ALJ. The ALJ shall regulate the timing of discovery. (d...

4 CFR 28.43 - Compelling discovery.

Code of Federal Regulations, 2011 CFR

2011-01-01

... 4 Accounts 1 2011-01-01 2011-01-01 false Compelling discovery. 28.43 Section 28.43 Accounts... Procedures Discovery § 28.43 Compelling discovery. (a) Motion for an order compelling discovery. Motions for orders compelling discovery shall be submitted to the administrative judge as set forth at § 28.42(c)(2...

19 CFR 207.109 - Discovery.

Code of Federal Regulations, 2014 CFR

2014-04-01

... 19 Customs Duties 3 2014-04-01 2014-04-01 false Discovery. 207.109 Section 207.109 Customs Duties... and Committee Proceedings § 207.109 Discovery. (a) Discovery methods. All parties may obtain discovery under such terms and limitations as the administrative law judge may order. Discovery may be by one or...

5 CFR 185.122 - Discovery.

Code of Federal Regulations, 2012 CFR

2012-01-01

... 5 Administrative Personnel 1 2012-01-01 2012-01-01 false Discovery. 185.122 Section 185.122... § 185.122 Discovery. (a) The following types of discovery are authorized: (1) Requests for production of..., discovery is available only as ordered by the ALJ. The ALJ shall regulate the timing of discovery. (d...

37 CFR 42.224 - Discovery.

Code of Federal Regulations, 2014 CFR

2014-07-01

... 37 Patents, Trademarks, and Copyrights 1 2014-07-01 2014-07-01 false Discovery. 42.224 Section 42... Post-Grant Review § 42.224 Discovery. Notwithstanding the discovery provisions of subpart A: (a) Requests for additional discovery may be granted upon a showing of good cause as to why the discovery is...

15 CFR 25.21 - Discovery.

Code of Federal Regulations, 2011 CFR

2011-01-01

... 15 Commerce and Foreign Trade 1 2011-01-01 2011-01-01 false Discovery. 25.21 Section 25.21... Discovery. (a) The following types of discovery are authorized: (1) Requests for production of documents for..., discovery is available only as ordered by the ALJ. The ALJ shall regulate the timing of discovery. (d...

16 CFR 3.31A - Expert discovery.

Code of Federal Regulations, 2013 CFR

2013-01-01

... 16 Commercial Practices 1 2013-01-01 2013-01-01 false Expert discovery. 3.31A Section 3.31A... PRACTICE FOR ADJUDICATIVE PROCEEDINGS Discovery; Compulsory Process § 3.31A Expert discovery. (a) The... later than 1 day after the close of fact discovery, meaning the close of discovery except for...

22 CFR 224.21 - Discovery.

Code of Federal Regulations, 2011 CFR

2011-04-01

... 22 Foreign Relations 1 2011-04-01 2011-04-01 false Discovery. 224.21 Section 224.21 Foreign....21 Discovery. (a) The following types of discovery are authorized: (1) Requests for production of... parties, discovery is available only as ordered by the ALJ. The ALJ shall regulate the timing of discovery...

19 CFR 207.109 - Discovery.

Code of Federal Regulations, 2011 CFR

2011-04-01

... 19 Customs Duties 3 2011-04-01 2011-04-01 false Discovery. 207.109 Section 207.109 Customs Duties... and Committee Proceedings § 207.109 Discovery. (a) Discovery methods. All parties may obtain discovery under such terms and limitations as the administrative law judge may order. Discovery may be by one or...

22 CFR 224.21 - Discovery.

Code of Federal Regulations, 2012 CFR

2012-04-01

... 22 Foreign Relations 1 2012-04-01 2012-04-01 false Discovery. 224.21 Section 224.21 Foreign....21 Discovery. (a) The following types of discovery are authorized: (1) Requests for production of... parties, discovery is available only as ordered by the ALJ. The ALJ shall regulate the timing of discovery...

16 CFR 3.31A - Expert discovery.

Code of Federal Regulations, 2011 CFR

2011-01-01

... 16 Commercial Practices 1 2011-01-01 2011-01-01 false Expert discovery. 3.31A Section 3.31A... PRACTICE FOR ADJUDICATIVE PROCEEDINGS Discovery; Compulsory Process § 3.31A Expert discovery. (a) The... later than 1 day after the close of fact discovery, meaning the close of discovery except for...

19 CFR 207.109 - Discovery.

Code of Federal Regulations, 2013 CFR

2013-04-01

... 19 Customs Duties 3 2013-04-01 2013-04-01 false Discovery. 207.109 Section 207.109 Customs Duties... and Committee Proceedings § 207.109 Discovery. (a) Discovery methods. All parties may obtain discovery under such terms and limitations as the administrative law judge may order. Discovery may be by one or...

5 CFR 185.122 - Discovery.

Code of Federal Regulations, 2011 CFR

2011-01-01

... 5 Administrative Personnel 1 2011-01-01 2011-01-01 false Discovery. 185.122 Section 185.122... § 185.122 Discovery. (a) The following types of discovery are authorized: (1) Requests for production of..., discovery is available only as ordered by the ALJ. The ALJ shall regulate the timing of discovery. (d...

5 CFR 185.122 - Discovery.

Code of Federal Regulations, 2013 CFR

2013-01-01

... 5 Administrative Personnel 1 2013-01-01 2013-01-01 false Discovery. 185.122 Section 185.122... § 185.122 Discovery. (a) The following types of discovery are authorized: (1) Requests for production of..., discovery is available only as ordered by the ALJ. The ALJ shall regulate the timing of discovery. (d...

5 CFR 185.122 - Discovery.

Code of Federal Regulations, 2014 CFR

2014-01-01

... 5 Administrative Personnel 1 2014-01-01 2014-01-01 false Discovery. 185.122 Section 185.122... § 185.122 Discovery. (a) The following types of discovery are authorized: (1) Requests for production of..., discovery is available only as ordered by the ALJ. The ALJ shall regulate the timing of discovery. (d...

22 CFR 224.21 - Discovery.

Code of Federal Regulations, 2014 CFR

2014-04-01

... 22 Foreign Relations 1 2014-04-01 2014-04-01 false Discovery. 224.21 Section 224.21 Foreign....21 Discovery. (a) The following types of discovery are authorized: (1) Requests for production of... parties, discovery is available only as ordered by the ALJ. The ALJ shall regulate the timing of discovery...

19 CFR 207.109 - Discovery.

Code of Federal Regulations, 2012 CFR

2012-04-01

... 19 Customs Duties 3 2012-04-01 2012-04-01 false Discovery. 207.109 Section 207.109 Customs Duties... and Committee Proceedings § 207.109 Discovery. (a) Discovery methods. All parties may obtain discovery under such terms and limitations as the administrative law judge may order. Discovery may be by one or...

16 CFR 3.31A - Expert discovery.

Code of Federal Regulations, 2010 CFR

2010-01-01

... 16 Commercial Practices 1 2010-01-01 2010-01-01 false Expert discovery. 3.31A Section 3.31A... PRACTICE FOR ADJUDICATIVE PROCEEDINGS Discovery; Compulsory Process § 3.31A Expert discovery. (a) The... later than 1 day after the close of fact discovery, meaning the close of discovery except for...

15 CFR 25.21 - Discovery.

Code of Federal Regulations, 2010 CFR

2010-01-01

... 15 Commerce and Foreign Trade 1 2010-01-01 2010-01-01 false Discovery. 25.21 Section 25.21... Discovery. (a) The following types of discovery are authorized: (1) Requests for production of documents for..., discovery is available only as ordered by the ALJ. The ALJ shall regulate the timing of discovery. (d...

19 CFR 207.109 - Discovery.

Code of Federal Regulations, 2010 CFR

2010-04-01

... 19 Customs Duties 3 2010-04-01 2010-04-01 false Discovery. 207.109 Section 207.109 Customs Duties... and Committee Proceedings § 207.109 Discovery. (a) Discovery methods. All parties may obtain discovery under such terms and limitations as the administrative law judge may order. Discovery may be by one or...

22 CFR 224.21 - Discovery.

Code of Federal Regulations, 2010 CFR

2010-04-01

... 22 Foreign Relations 1 2010-04-01 2010-04-01 false Discovery. 224.21 Section 224.21 Foreign....21 Discovery. (a) The following types of discovery are authorized: (1) Requests for production of... parties, discovery is available only as ordered by the ALJ. The ALJ shall regulate the timing of discovery...

Examining the Missing Completely at Random Mechanism in Incomplete Data Sets: A Multiple Testing Approach

ERIC Educational Resources Information Center

Raykov, Tenko; Lichtenberg, Peter A.; Paulson, Daniel

2012-01-01

A multiple testing procedure for examining implications of the missing completely at random (MCAR) mechanism in incomplete data sets is discussed. The approach uses the false discovery rate concept and is concerned with testing group differences on a set of variables. The method can be used for ascertaining violations of MCAR and disproving this…

[The problem of small "n" and big "P" in neuropsycho-pharmacology, or how to keep the rate of false discoveries under control].

PubMed

Petschner, Péter; Bagdy, György; Tóthfalusi, Laszló

2015-03-01

One of the characteristics of many methods used in neuropsychopharmacology is that a large number of parameters (P) are measured in relatively few subjects (n). Functional magnetic resonance imaging, electroencephalography (EEG) and genomic studies are typical examples. For example one microarray chip can contain thousands of probes. Therefore, in studies using microarray chips, P may be several thousand-fold larger than n. Statistical analysis of such studies is a challenging task and they are refereed to in the statistical literature such as the small "n" big "P" problem. The problem has many facets including the controversies associated with multiple hypothesis testing. A typical scenario in this context is, when two or more groups are compared by the individual attributes. If the increased classification error due to the multiple testing is neglected, then several highly significant differences will be discovered. But in reality, some of these significant differences are coincidental, not reproducible findings. Several methods were proposed to solve this problem. In this review we discuss two of the proposed solutions, algorithms to compare sets and statistical hypothesis tests controlling the false discovery rate.

COMPASS: a suite of pre- and post-search proteomics software tools for OMSSA

PubMed Central

Wenger, Craig D.; Phanstiel, Douglas H.; Lee, M. Violet; Bailey, Derek J.; Coon, Joshua J.

2011-01-01

Here we present the Coon OMSSA Proteomic Analysis Software Suite (COMPASS): a free and open-source software pipeline for high-throughput analysis of proteomics data, designed around the Open Mass Spectrometry Search Algorithm. We detail a synergistic set of tools for protein database generation, spectral reduction, peptide false discovery rate analysis, peptide quantitation via isobaric labeling, protein parsimony and protein false discovery rate analysis, and protein quantitation. We strive for maximum ease of use, utilizing graphical user interfaces and working with data files in the original instrument vendor format. Results are stored in plain text comma-separated values files, which are easy to view and manipulate with a text editor or spreadsheet program. We illustrate the operation and efficacy of COMPASS through the use of two LC–MS/MS datasets. The first is a dataset of a highly annotated mixture of standard proteins and manually validated contaminants that exhibits the identification workflow. The second is a dataset of yeast peptides, labeled with isobaric stable isotope tags and mixed in known ratios, to demonstrate the quantitative workflow. For these two datasets, COMPASS performs equivalently or better than the current de facto standard, the Trans-Proteomic Pipeline. PMID:21298793

How to talk about protein‐level false discovery rates in shotgun proteomics

PubMed Central

The, Matthew; Tasnim, Ayesha

2016-01-01

A frequently sought output from a shotgun proteomics experiment is a list of proteins that we believe to have been present in the analyzed sample before proteolytic digestion. The standard technique to control for errors in such lists is to enforce a preset threshold for the false discovery rate (FDR). Many consider protein‐level FDRs a difficult and vague concept, as the measurement entities, spectra, are manifestations of peptides and not proteins. Here, we argue that this confusion is unnecessary and provide a framework on how to think about protein‐level FDRs, starting from its basic principle: the null hypothesis. Specifically, we point out that two competing null hypotheses are used concurrently in today's protein inference methods, which has gone unnoticed by many. Using simulations of a shotgun proteomics experiment, we show how confusing one null hypothesis for the other can lead to serious discrepancies in the FDR. Furthermore, we demonstrate how the same simulations can be used to verify FDR estimates of protein inference methods. In particular, we show that, for a simple protein inference method, decoy models can be used to accurately estimate protein‐level FDRs for both competing null hypotheses. PMID:27503675

Better cancer biomarker discovery through better study design.

PubMed

Rundle, Andrew; Ahsan, Habibul; Vineis, Paolo

2012-12-01

High-throughput laboratory technologies coupled with sophisticated bioinformatics algorithms have tremendous potential for discovering novel biomarkers, or profiles of biomarkers, that could serve as predictors of disease risk, response to treatment or prognosis. We discuss methodological issues in wedding high-throughput approaches for biomarker discovery with the case-control study designs typically used in biomarker discovery studies, especially focusing on nested case-control designs. We review principles for nested case-control study design in relation to biomarker discovery studies and describe how the efficiency of biomarker discovery can be effected by study design choices. We develop a simulated prostate cancer cohort data set and a series of biomarker discovery case-control studies nested within the cohort to illustrate how study design choices can influence biomarker discovery process. Common elements of nested case-control design, incidence density sampling and matching of controls to cases are not typically factored correctly into biomarker discovery analyses, inducing bias in the discovery process. We illustrate how incidence density sampling and matching of controls to cases reduce the apparent specificity of truly valid biomarkers 'discovered' in a nested case-control study. We also propose and demonstrate a new case-control matching protocol, we call 'antimatching', that improves the efficiency of biomarker discovery studies. For a valid, but as yet undiscovered, biomarker(s) disjunctions between correctly designed epidemiologic studies and the practice of biomarker discovery reduce the likelihood that true biomarker(s) will be discovered and increases the false-positive discovery rate. © 2012 The Authors. European Journal of Clinical Investigation © 2012 Stichting European Society for Clinical Investigation Journal Foundation.

4 CFR 28.42 - Discovery procedures and protective orders.

Code of Federal Regulations, 2010 CFR

2010-01-01

... 4 Accounts 1 2010-01-01 2010-01-01 false Discovery procedures and protective orders. 28.42 Section 28.42 Accounts GOVERNMENT ACCOUNTABILITY OFFICE GENERAL PROCEDURES GOVERNMENT ACCOUNTABILITY OFFICE... ACCOUNTABILITY OFFICE Procedures Discovery § 28.42 Discovery procedures and protective orders. (a) Discovery from...

37 CFR 11.52 - Discovery.

Code of Federal Regulations, 2013 CFR

2013-07-01

... 37 Patents, Trademarks, and Copyrights 1 2013-07-01 2013-07-01 false Discovery. 11.52 Section 11... Disciplinary Proceedings; Jurisdiction, Sanctions, Investigations, and Proceedings § 11.52 Discovery. Discovery... establishes that discovery is reasonable and relevant, the hearing officer, under such conditions as he or she...

37 CFR 11.52 - Discovery.

Code of Federal Regulations, 2012 CFR

2012-07-01

... 37 Patents, Trademarks, and Copyrights 1 2012-07-01 2012-07-01 false Discovery. 11.52 Section 11... Disciplinary Proceedings; Jurisdiction, Sanctions, Investigations, and Proceedings § 11.52 Discovery. Discovery... establishes that discovery is reasonable and relevant, the hearing officer, under such conditions as he or she...

19 CFR 354.10 - Discovery.

Code of Federal Regulations, 2014 CFR

2014-04-01

... 19 Customs Duties 3 2014-04-01 2014-04-01 false Discovery. 354.10 Section 354.10 Customs Duties... ANTIDUMPING OR COUNTERVAILING DUTY ADMINISTRATIVE PROTECTIVE ORDER § 354.10 Discovery. (a) Voluntary discovery. All parties are encouraged to engage in voluntary discovery procedures regarding any matter, not...

19 CFR 354.10 - Discovery.

Code of Federal Regulations, 2011 CFR

2011-04-01

... 19 Customs Duties 3 2011-04-01 2011-04-01 false Discovery. 354.10 Section 354.10 Customs Duties... ANTIDUMPING OR COUNTERVAILING DUTY ADMINISTRATIVE PROTECTIVE ORDER § 354.10 Discovery. (a) Voluntary discovery. All parties are encouraged to engage in voluntary discovery procedures regarding any matter, not...

36 CFR 1150.63 - Discovery.

Code of Federal Regulations, 2014 CFR

2014-07-01

... 36 Parks, Forests, and Public Property 3 2014-07-01 2014-07-01 false Discovery. 1150.63 Section... PRACTICE AND PROCEDURES FOR COMPLIANCE HEARINGS Prehearing Conferences and Discovery § 1150.63 Discovery. (a) Parties are encouraged to engage in voluntary discovery procedures. For good cause shown under...

37 CFR 11.52 - Discovery.

Code of Federal Regulations, 2011 CFR

2011-07-01

... 37 Patents, Trademarks, and Copyrights 1 2011-07-01 2011-07-01 false Discovery. 11.52 Section 11... Disciplinary Proceedings; Jurisdiction, Sanctions, Investigations, and Proceedings § 11.52 Discovery. Discovery... establishes that discovery is reasonable and relevant, the hearing officer, under such conditions as he or she...

36 CFR 1150.63 - Discovery.

Code of Federal Regulations, 2012 CFR

2012-07-01

... 36 Parks, Forests, and Public Property 3 2012-07-01 2012-07-01 false Discovery. 1150.63 Section... PRACTICE AND PROCEDURES FOR COMPLIANCE HEARINGS Prehearing Conferences and Discovery § 1150.63 Discovery. (a) Parties are encouraged to engage in voluntary discovery procedures. For good cause shown under...

36 CFR 1150.63 - Discovery.

Code of Federal Regulations, 2011 CFR

2011-07-01

... 36 Parks, Forests, and Public Property 3 2011-07-01 2011-07-01 false Discovery. 1150.63 Section... PRACTICE AND PROCEDURES FOR COMPLIANCE HEARINGS Prehearing Conferences and Discovery § 1150.63 Discovery. (a) Parties are encouraged to engage in voluntary discovery procedures. For good cause shown under...

19 CFR 354.10 - Discovery.

Code of Federal Regulations, 2013 CFR

2013-04-01

... 19 Customs Duties 3 2013-04-01 2013-04-01 false Discovery. 354.10 Section 354.10 Customs Duties... ANTIDUMPING OR COUNTERVAILING DUTY ADMINISTRATIVE PROTECTIVE ORDER § 354.10 Discovery. (a) Voluntary discovery. All parties are encouraged to engage in voluntary discovery procedures regarding any matter, not...

37 CFR 11.52 - Discovery.

Code of Federal Regulations, 2014 CFR

2014-07-01

... 37 Patents, Trademarks, and Copyrights 1 2014-07-01 2014-07-01 false Discovery. 11.52 Section 11... Disciplinary Proceedings; Jurisdiction, Sanctions, Investigations, and Proceedings § 11.52 Discovery. Discovery... establishes that discovery is reasonable and relevant, the hearing officer, under such conditions as he or she...

19 CFR 354.10 - Discovery.

Code of Federal Regulations, 2012 CFR

2012-04-01

... 19 Customs Duties 3 2012-04-01 2012-04-01 false Discovery. 354.10 Section 354.10 Customs Duties... ANTIDUMPING OR COUNTERVAILING DUTY ADMINISTRATIVE PROTECTIVE ORDER § 354.10 Discovery. (a) Voluntary discovery. All parties are encouraged to engage in voluntary discovery procedures regarding any matter, not...

37 CFR 11.52 - Discovery.

Code of Federal Regulations, 2010 CFR

2010-07-01

... 37 Patents, Trademarks, and Copyrights 1 2010-07-01 2010-07-01 false Discovery. 11.52 Section 11... Disciplinary Proceedings; Jurisdiction, Sanctions, Investigations, and Proceedings § 11.52 Discovery. Discovery... establishes that discovery is reasonable and relevant, the hearing officer, under such conditions as he or she...

36 CFR 1150.63 - Discovery.

Code of Federal Regulations, 2010 CFR

2010-07-01

... 36 Parks, Forests, and Public Property 3 2010-07-01 2010-07-01 false Discovery. 1150.63 Section... PRACTICE AND PROCEDURES FOR COMPLIANCE HEARINGS Prehearing Conferences and Discovery § 1150.63 Discovery. (a) Parties are encouraged to engage in voluntary discovery procedures. For good cause shown under...

19 CFR 354.10 - Discovery.

Code of Federal Regulations, 2010 CFR

2010-04-01

... 19 Customs Duties 3 2010-04-01 2010-04-01 false Discovery. 354.10 Section 354.10 Customs Duties... ANTIDUMPING OR COUNTERVAILING DUTY ADMINISTRATIVE PROTECTIVE ORDER § 354.10 Discovery. (a) Voluntary discovery. All parties are encouraged to engage in voluntary discovery procedures regarding any matter, not...

39 CFR 963.14 - Discovery.

Code of Federal Regulations, 2012 CFR

2012-07-01

... 39 Postal Service 1 2012-07-01 2012-07-01 false Discovery. 963.14 Section 963.14 Postal Service... PANDERING ADVERTISEMENTS STATUTE, 39 U.S.C. 3008 § 963.14 Discovery. Discovery is to be conducted on a... such discovery as he or she deems reasonable and necessary. Discovery may include one or more of the...

39 CFR 963.14 - Discovery.

Code of Federal Regulations, 2013 CFR

2013-07-01

... 39 Postal Service 1 2013-07-01 2013-07-01 false Discovery. 963.14 Section 963.14 Postal Service... PANDERING ADVERTISEMENTS STATUTE, 39 U.S.C. 3008 § 963.14 Discovery. Discovery is to be conducted on a... such discovery as he or she deems reasonable and necessary. Discovery may include one or more of the...

39 CFR 963.14 - Discovery.

Code of Federal Regulations, 2014 CFR

2014-07-01

... 39 Postal Service 1 2014-07-01 2014-07-01 false Discovery. 963.14 Section 963.14 Postal Service... PANDERING ADVERTISEMENTS STATUTE, 39 U.S.C. 3008 § 963.14 Discovery. Discovery is to be conducted on a... such discovery as he or she deems reasonable and necessary. Discovery may include one or more of the...

39 CFR 963.14 - Discovery.

Code of Federal Regulations, 2011 CFR

2011-07-01

... 39 Postal Service 1 2011-07-01 2011-07-01 false Discovery. 963.14 Section 963.14 Postal Service... PANDERING ADVERTISEMENTS STATUTE, 39 U.S.C. 3008 § 963.14 Discovery. Discovery is to be conducted on a... such discovery as he or she deems reasonable and necessary. Discovery may include one or more of the...

39 CFR 963.14 - Discovery.

Code of Federal Regulations, 2010 CFR

2010-07-01

... 39 Postal Service 1 2010-07-01 2010-07-01 false Discovery. 963.14 Section 963.14 Postal Service... PANDERING ADVERTISEMENTS STATUTE, 39 U.S.C. 3008 § 963.14 Discovery. Discovery is to be conducted on a... such discovery as he or she deems reasonable and necessary. Discovery may include one or more of the...

29 CFR 1955.32 - Discovery.

Code of Federal Regulations, 2011 CFR

2011-07-01

... 29 Labor 9 2011-07-01 2011-07-01 false Discovery. 1955.32 Section 1955.32 Labor Regulations...) PROCEDURES FOR WITHDRAWAL OF APPROVAL OF STATE PLANS Preliminary Conference and Discovery § 1955.32 Discovery... allow discovery by any other appropriate procedure, such as by interrogatories upon a party or request...

49 CFR 1503.633 - Discovery.

Code of Federal Regulations, 2012 CFR

2012-10-01

... 49 Transportation 9 2012-10-01 2012-10-01 false Discovery. 1503.633 Section 1503.633... Rules of Practice in TSA Civil Penalty Actions § 1503.633 Discovery. (a) Initiation of discovery. Any party may initiate discovery described in this section, without the consent or approval of the ALJ, at...

24 CFR 26.42 - Discovery.

Code of Federal Regulations, 2011 CFR

2011-04-01

... 24 Housing and Urban Development 1 2011-04-01 2011-04-01 false Discovery. 26.42 Section 26.42... PROCEDURES Hearings Pursuant to the Administrative Procedure Act Discovery § 26.42 Discovery. (a) General. The parties are encouraged to engage in voluntary discovery procedures, which may commence at any time...

49 CFR 1503.633 - Discovery.

Code of Federal Regulations, 2014 CFR

2014-10-01

... 49 Transportation 9 2014-10-01 2014-10-01 false Discovery. 1503.633 Section 1503.633... Rules of Practice in TSA Civil Penalty Actions § 1503.633 Discovery. (a) Initiation of discovery. Any party may initiate discovery described in this section, without the consent or approval of the ALJ, at...

40 CFR 27.21 - Discovery.

Code of Federal Regulations, 2012 CFR

2012-07-01

... 40 Protection of Environment 1 2012-07-01 2012-07-01 false Discovery. 27.21 Section 27.21... Discovery. (a) The following types of discovery are authorized: (1) Requests for production of documents for..., discovery is available only as ordered by the presiding officer. The presiding officer shall regulate the...

24 CFR 26.42 - Discovery.

Code of Federal Regulations, 2014 CFR

2014-04-01

... 24 Housing and Urban Development 1 2014-04-01 2014-04-01 false Discovery. 26.42 Section 26.42... PROCEDURES Hearings Pursuant to the Administrative Procedure Act Discovery § 26.42 Discovery. (a) General. The parties are encouraged to engage in voluntary discovery procedures, which may commence at any time...

28 CFR 76.21 - Discovery.

Code of Federal Regulations, 2013 CFR

2013-07-01

... 28 Judicial Administration 2 2013-07-01 2013-07-01 false Discovery. 76.21 Section 76.21 Judicial... POSSESSION OF CERTAIN CONTROLLED SUBSTANCES § 76.21 Discovery. (a) Scope. Discovery under this part covers... as a general guide for discovery practices in proceedings before the Judge. However, unless otherwise...

14 CFR 16.213 - Discovery.

Code of Federal Regulations, 2011 CFR

2011-01-01

... 14 Aeronautics and Space 1 2011-01-01 2011-01-01 false Discovery. 16.213 Section 16.213... PRACTICE FOR FEDERALLY-ASSISTED AIRPORT ENFORCEMENT PROCEEDINGS Hearings § 16.213 Discovery. (a) Discovery... discovery permitted by this section if a party shows that— (1) The information requested is cumulative or...

29 CFR 1955.32 - Discovery.

Code of Federal Regulations, 2014 CFR

2014-07-01

... 29 Labor 9 2014-07-01 2014-07-01 false Discovery. 1955.32 Section 1955.32 Labor Regulations...) PROCEDURES FOR WITHDRAWAL OF APPROVAL OF STATE PLANS Preliminary Conference and Discovery § 1955.32 Discovery... allow discovery by any other appropriate procedure, such as by interrogatories upon a party or request...

24 CFR 26.42 - Discovery.

Code of Federal Regulations, 2013 CFR

2013-04-01

... 24 Housing and Urban Development 1 2013-04-01 2013-04-01 false Discovery. 26.42 Section 26.42... PROCEDURES Hearings Pursuant to the Administrative Procedure Act Discovery § 26.42 Discovery. (a) General. The parties are encouraged to engage in voluntary discovery procedures, which may commence at any time...

14 CFR 16.213 - Discovery.

Code of Federal Regulations, 2012 CFR

2012-01-01

... 14 Aeronautics and Space 1 2012-01-01 2012-01-01 false Discovery. 16.213 Section 16.213... PRACTICE FOR FEDERALLY-ASSISTED AIRPORT ENFORCEMENT PROCEEDINGS Hearings § 16.213 Discovery. (a) Discovery... discovery permitted by this section if a party shows that— (1) The information requested is cumulative or...

29 CFR 1955.32 - Discovery.

Code of Federal Regulations, 2013 CFR

2013-07-01

... 29 Labor 9 2013-07-01 2013-07-01 false Discovery. 1955.32 Section 1955.32 Labor Regulations...) PROCEDURES FOR WITHDRAWAL OF APPROVAL OF STATE PLANS Preliminary Conference and Discovery § 1955.32 Discovery... allow discovery by any other appropriate procedure, such as by interrogatories upon a party or request...

40 CFR 27.21 - Discovery.

Code of Federal Regulations, 2014 CFR

2014-07-01

... 40 Protection of Environment 1 2014-07-01 2014-07-01 false Discovery. 27.21 Section 27.21... Discovery. (a) The following types of discovery are authorized: (1) Requests for production of documents for..., discovery is available only as ordered by the presiding officer. The presiding officer shall regulate the...

22 CFR 128.6 - Discovery.

Code of Federal Regulations, 2011 CFR

2011-04-01

... 22 Foreign Relations 1 2011-04-01 2011-04-01 false Discovery. 128.6 Section 128.6 Foreign... Discovery. (a) Discovery by the respondent. The respondent, through the Administrative Law Judge, may... discovery if the interests of national security or foreign policy so require, or if necessary to comply with...

40 CFR 27.21 - Discovery.

Code of Federal Regulations, 2013 CFR

2013-07-01

... 40 Protection of Environment 1 2013-07-01 2013-07-01 false Discovery. 27.21 Section 27.21... Discovery. (a) The following types of discovery are authorized: (1) Requests for production of documents for..., discovery is available only as ordered by the presiding officer. The presiding officer shall regulate the...

15 CFR 719.10 - Discovery.

Code of Federal Regulations, 2013 CFR

2013-01-01

... 15 Commerce and Foreign Trade 2 2013-01-01 2013-01-01 false Discovery. 719.10 Section 719.10... Discovery. (a) General. The parties are encouraged to engage in voluntary discovery regarding any matter... the Federal Rules of Civil Procedure relating to discovery apply to the extent consistent with this...

49 CFR 1503.633 - Discovery.

Code of Federal Regulations, 2011 CFR

2011-10-01

... 49 Transportation 9 2011-10-01 2011-10-01 false Discovery. 1503.633 Section 1503.633... Rules of Practice in TSA Civil Penalty Actions § 1503.633 Discovery. (a) Initiation of discovery. Any party may initiate discovery described in this section, without the consent or approval of the ALJ, at...

22 CFR 128.6 - Discovery.

Code of Federal Regulations, 2013 CFR

2013-04-01

... 22 Foreign Relations 1 2013-04-01 2013-04-01 false Discovery. 128.6 Section 128.6 Foreign... Discovery. (a) Discovery by the respondent. The respondent, through the Administrative Law Judge, may... discovery if the interests of national security or foreign policy so require, or if necessary to comply with...

40 CFR 27.21 - Discovery.

Code of Federal Regulations, 2011 CFR

2011-07-01

... 40 Protection of Environment 1 2011-07-01 2011-07-01 false Discovery. 27.21 Section 27.21... Discovery. (a) The following types of discovery are authorized: (1) Requests for production of documents for..., discovery is available only as ordered by the presiding officer. The presiding officer shall regulate the...

22 CFR 128.6 - Discovery.

Code of Federal Regulations, 2012 CFR

2012-04-01

... 22 Foreign Relations 1 2012-04-01 2012-04-01 false Discovery. 128.6 Section 128.6 Foreign... Discovery. (a) Discovery by the respondent. The respondent, through the Administrative Law Judge, may... discovery if the interests of national security or foreign policy so require, or if necessary to comply with...

49 CFR 1503.633 - Discovery.

Code of Federal Regulations, 2013 CFR

2013-10-01

... 49 Transportation 9 2013-10-01 2013-10-01 false Discovery. 1503.633 Section 1503.633... Rules of Practice in TSA Civil Penalty Actions § 1503.633 Discovery. (a) Initiation of discovery. Any party may initiate discovery described in this section, without the consent or approval of the ALJ, at...

24 CFR 26.42 - Discovery.

Code of Federal Regulations, 2012 CFR

2012-04-01

... 24 Housing and Urban Development 1 2012-04-01 2012-04-01 false Discovery. 26.42 Section 26.42... PROCEDURES Hearings Pursuant to the Administrative Procedure Act Discovery § 26.42 Discovery. (a) General. The parties are encouraged to engage in voluntary discovery procedures, which may commence at any time...

15 CFR 719.10 - Discovery.

Code of Federal Regulations, 2012 CFR

2012-01-01

... 15 Commerce and Foreign Trade 2 2012-01-01 2012-01-01 false Discovery. 719.10 Section 719.10... Discovery. (a) General. The parties are encouraged to engage in voluntary discovery regarding any matter... the Federal Rules of Civil Procedure relating to discovery apply to the extent consistent with this...

22 CFR 128.6 - Discovery.

Code of Federal Regulations, 2014 CFR

2014-04-01

... 22 Foreign Relations 1 2014-04-01 2014-04-01 false Discovery. 128.6 Section 128.6 Foreign... Discovery. (a) Discovery by the respondent. The respondent, through the Administrative Law Judge, may... discovery if the interests of national security or foreign policy so require, or if necessary to comply with...

29 CFR 1955.32 - Discovery.

Code of Federal Regulations, 2012 CFR

2012-07-01

... 29 Labor 9 2012-07-01 2012-07-01 false Discovery. 1955.32 Section 1955.32 Labor Regulations...) PROCEDURES FOR WITHDRAWAL OF APPROVAL OF STATE PLANS Preliminary Conference and Discovery § 1955.32 Discovery... allow discovery by any other appropriate procedure, such as by interrogatories upon a party or request...

14 CFR 16.213 - Discovery.

Code of Federal Regulations, 2013 CFR

2013-01-01

... 14 Aeronautics and Space 1 2013-01-01 2013-01-01 false Discovery. 16.213 Section 16.213... PRACTICE FOR FEDERALLY-ASSISTED AIRPORT ENFORCEMENT PROCEEDINGS Hearings § 16.213 Discovery. (a) Discovery... discovery permitted by this section if a party shows that— (1) The information requested is cumulative or...

28 CFR 76.21 - Discovery.

Code of Federal Regulations, 2012 CFR

2012-07-01

... 28 Judicial Administration 2 2012-07-01 2012-07-01 false Discovery. 76.21 Section 76.21 Judicial... POSSESSION OF CERTAIN CONTROLLED SUBSTANCES § 76.21 Discovery. (a) Scope. Discovery under this part covers... as a general guide for discovery practices in proceedings before the Judge. However, unless otherwise...

15 CFR 719.10 - Discovery.

Code of Federal Regulations, 2014 CFR

2014-01-01

... 15 Commerce and Foreign Trade 2 2014-01-01 2014-01-01 false Discovery. 719.10 Section 719.10... Discovery. (a) General. The parties are encouraged to engage in voluntary discovery regarding any matter... the Federal Rules of Civil Procedure relating to discovery apply to the extent consistent with this...

14 CFR 16.213 - Discovery.

Code of Federal Regulations, 2014 CFR

2014-01-01

... 14 Aeronautics and Space 1 2014-01-01 2014-01-01 false Discovery. 16.213 Section 16.213... PRACTICE FOR FEDERALLY-ASSISTED AIRPORT ENFORCEMENT PROCEEDINGS Hearings § 16.213 Discovery. (a) Discovery... discovery permitted by this section if a party shows that— (1) The information requested is cumulative or...

28 CFR 76.21 - Discovery.

Code of Federal Regulations, 2014 CFR

2014-07-01

... 28 Judicial Administration 2 2014-07-01 2014-07-01 false Discovery. 76.21 Section 76.21 Judicial... POSSESSION OF CERTAIN CONTROLLED SUBSTANCES § 76.21 Discovery. (a) Scope. Discovery under this part covers... as a general guide for discovery practices in proceedings before the Judge. However, unless otherwise...

28 CFR 76.21 - Discovery.

Code of Federal Regulations, 2011 CFR

2011-07-01

... 28 Judicial Administration 2 2011-07-01 2011-07-01 false Discovery. 76.21 Section 76.21 Judicial... POSSESSION OF CERTAIN CONTROLLED SUBSTANCES § 76.21 Discovery. (a) Scope. Discovery under this part covers... as a general guide for discovery practices in proceedings before the Judge. However, unless otherwise...

28 CFR 76.21 - Discovery.

Code of Federal Regulations, 2010 CFR

2010-07-01

... 28 Judicial Administration 2 2010-07-01 2010-07-01 false Discovery. 76.21 Section 76.21 Judicial... POSSESSION OF CERTAIN CONTROLLED SUBSTANCES § 76.21 Discovery. (a) Scope. Discovery under this part covers... as a general guide for discovery practices in proceedings before the Judge. However, unless otherwise...

49 CFR 1503.633 - Discovery.

Code of Federal Regulations, 2010 CFR

2010-10-01

... 49 Transportation 9 2010-10-01 2010-10-01 false Discovery. 1503.633 Section 1503.633... Rules of Practice in TSA Civil Penalty Actions § 1503.633 Discovery. (a) Initiation of discovery. Any party may initiate discovery described in this section, without the consent or approval of the ALJ, at...

24 CFR 26.42 - Discovery.

Code of Federal Regulations, 2010 CFR

2010-04-01

... 24 Housing and Urban Development 1 2010-04-01 2010-04-01 false Discovery. 26.42 Section 26.42... PROCEDURES Hearings Pursuant to the Administrative Procedure Act Discovery § 26.42 Discovery. (a) General. The parties are encouraged to engage in voluntary discovery procedures, which may commence at any time...

29 CFR 1955.32 - Discovery.

Code of Federal Regulations, 2010 CFR

2010-07-01

... 29 Labor 9 2010-07-01 2010-07-01 false Discovery. 1955.32 Section 1955.32 Labor Regulations...) PROCEDURES FOR WITHDRAWAL OF APPROVAL OF STATE PLANS Preliminary Conference and Discovery § 1955.32 Discovery... allow discovery by any other appropriate procedure, such as by interrogatories upon a party or request...

22 CFR 128.6 - Discovery.

Code of Federal Regulations, 2010 CFR

2010-04-01

... 22 Foreign Relations 1 2010-04-01 2010-04-01 false Discovery. 128.6 Section 128.6 Foreign... Discovery. (a) Discovery by the respondent. The respondent, through the Administrative Law Judge, may... discovery if the interests of national security or foreign policy so require, or if necessary to comply with...

15 CFR 719.10 - Discovery.

Code of Federal Regulations, 2010 CFR

2010-01-01

... 15 Commerce and Foreign Trade 2 2010-01-01 2010-01-01 false Discovery. 719.10 Section 719.10... Discovery. (a) General. The parties are encouraged to engage in voluntary discovery regarding any matter... the Federal Rules of Civil Procedure relating to discovery apply to the extent consistent with this...

14 CFR 16.213 - Discovery.

Code of Federal Regulations, 2010 CFR

2010-01-01

... 14 Aeronautics and Space 1 2010-01-01 2010-01-01 false Discovery. 16.213 Section 16.213... PRACTICE FOR FEDERALLY-ASSISTED AIRPORT ENFORCEMENT PROCEEDINGS Hearings § 16.213 Discovery. (a) Discovery... discovery permitted by this section if a party shows that— (1) The information requested is cumulative or...

40 CFR 27.21 - Discovery.

Code of Federal Regulations, 2010 CFR

2010-07-01

... 40 Protection of Environment 1 2010-07-01 2010-07-01 false Discovery. 27.21 Section 27.21... Discovery. (a) The following types of discovery are authorized: (1) Requests for production of documents for..., discovery is available only as ordered by the presiding officer. The presiding officer shall regulate the...

43 CFR 4.1130 - Discovery methods.

Code of Federal Regulations, 2013 CFR

2013-10-01

... 43 Public Lands: Interior 1 2013-10-01 2013-10-01 false Discovery methods. 4.1130 Section 4.1130... Special Rules Applicable to Surface Coal Mining Hearings and Appeals Discovery § 4.1130 Discovery methods. Parties may obtain discovery by one or more of the following methods— (a) Depositions upon oral...

43 CFR 4.1130 - Discovery methods.

Code of Federal Regulations, 2010 CFR

2010-10-01

... 43 Public Lands: Interior 1 2010-10-01 2010-10-01 false Discovery methods. 4.1130 Section 4.1130... Special Rules Applicable to Surface Coal Mining Hearings and Appeals Discovery § 4.1130 Discovery methods. Parties may obtain discovery by one or more of the following methods— (a) Depositions upon oral...

43 CFR 4.1130 - Discovery methods.

Code of Federal Regulations, 2011 CFR

2011-10-01

... 43 Public Lands: Interior 1 2011-10-01 2011-10-01 false Discovery methods. 4.1130 Section 4.1130... Special Rules Applicable to Surface Coal Mining Hearings and Appeals Discovery § 4.1130 Discovery methods. Parties may obtain discovery by one or more of the following methods— (a) Depositions upon oral...

43 CFR 4.1130 - Discovery methods.

Code of Federal Regulations, 2014 CFR

2014-10-01

... 43 Public Lands: Interior 1 2014-10-01 2014-10-01 false Discovery methods. 4.1130 Section 4.1130... Special Rules Applicable to Surface Coal Mining Hearings and Appeals Discovery § 4.1130 Discovery methods. Parties may obtain discovery by one or more of the following methods— (a) Depositions upon oral...

10 CFR 2.705 - Discovery-additional methods.

Code of Federal Regulations, 2010 CFR

2010-01-01

... 10 Energy 1 2010-01-01 2010-01-01 false Discovery-additional methods. 2.705 Section 2.705 Energy... Rules for Formal Adjudications § 2.705 Discovery-additional methods. (a) Discovery methods. Parties may obtain discovery by one or more of the following methods: depositions upon oral examination or written...

39 CFR 955.15 - Discovery.

Code of Federal Regulations, 2014 CFR

2014-07-01

... 39 Postal Service 1 2014-07-01 2014-07-01 false Discovery. 955.15 Section 955.15 Postal Service... APPEALS § 955.15 Discovery. (a) The parties are encouraged to engage in voluntary discovery procedures. In connection with any deposition or other discovery procedure, the Board may issue any order which justice...

42 CFR 426.432 - Discovery.

Code of Federal Regulations, 2014 CFR

2014-10-01

... 42 Public Health 3 2014-10-01 2014-10-01 false Discovery. 426.432 Section 426.432 Public Health... an LCD § 426.432 Discovery. (a) General rule. If the ALJ orders discovery, the ALJ must establish a reasonable timeframe for discovery. (b) Protective order—(1) Request for a protective order. Any party...

15 CFR 280.210 - Discovery.

Code of Federal Regulations, 2011 CFR

2011-01-01

... 15 Commerce and Foreign Trade 1 2011-01-01 2011-01-01 false Discovery. 280.210 Section 280.210... Enforcement § 280.210 Discovery. (a) General. The parties are encouraged to engage in voluntary discovery... provisions of the Federal Rules of Civil Procedure relating to discovery apply to the extent consistent with...

14 CFR 1264.120 - Discovery.

Code of Federal Regulations, 2012 CFR

2012-01-01

... 14 Aeronautics and Space 5 2012-01-01 2012-01-01 false Discovery. 1264.120 Section 1264.120... PENALTIES ACT OF 1986 § 1264.120 Discovery. (a) The following types of discovery are authorized: (1..., discovery is available only as ordered by the presiding officer. The presiding officer shall regulate the...

31 CFR 10.71 - Discovery.

Code of Federal Regulations, 2013 CFR

2013-07-01

... 31 Money and Finance: Treasury 1 2013-07-01 2013-07-01 false Discovery. 10.71 Section 10.71 Money... SERVICE Rules Applicable to Disciplinary Proceedings § 10.71 Discovery. (a) In general. Discovery may be... relevance, materiality and reasonableness of the requested discovery and subject to the requirements of § 10...

49 CFR 1121.2 - Discovery.

Code of Federal Regulations, 2014 CFR

2014-10-01

... 49 Transportation 8 2014-10-01 2014-10-01 false Discovery. 1121.2 Section 1121.2 Transportation... TRANSPORTATION RULES OF PRACTICE RAIL EXEMPTION PROCEDURES § 1121.2 Discovery. Discovery shall follow the procedures set forth at 49 CFR part 1114, subpart B. Discovery may begin upon the filing of the petition for...

10 CFR 13.21 - Discovery.

Code of Federal Regulations, 2011 CFR

2011-01-01

... 10 Energy 1 2011-01-01 2011-01-01 false Discovery. 13.21 Section 13.21 Energy NUCLEAR REGULATORY COMMISSION PROGRAM FRAUD CIVIL REMEDIES § 13.21 Discovery. (a) The following types of discovery are...) Unless mutually agreed to by the parties, discovery is available only as ordered by the ALJ. The ALJ...

15 CFR 280.210 - Discovery.

Code of Federal Regulations, 2012 CFR

2012-01-01

... 15 Commerce and Foreign Trade 1 2012-01-01 2012-01-01 false Discovery. 280.210 Section 280.210... Enforcement § 280.210 Discovery. (a) General. The parties are encouraged to engage in voluntary discovery... provisions of the Federal Rules of Civil Procedure relating to discovery apply to the extent consistent with...

49 CFR 604.38 - Discovery.

Code of Federal Regulations, 2011 CFR

2011-10-01

... 49 Transportation 7 2011-10-01 2011-10-01 false Discovery. 604.38 Section 604.38 Transportation... TRANSPORTATION CHARTER SERVICE Hearings. § 604.38 Discovery. (a) Permissible forms of discovery shall be within the discretion of the PO. (b) The PO shall limit the frequency and extent of discovery permitted by...

10 CFR 13.21 - Discovery.

Code of Federal Regulations, 2013 CFR

2013-01-01

... 10 Energy 1 2013-01-01 2013-01-01 false Discovery. 13.21 Section 13.21 Energy NUCLEAR REGULATORY COMMISSION PROGRAM FRAUD CIVIL REMEDIES § 13.21 Discovery. (a) The following types of discovery are...) Unless mutually agreed to by the parties, discovery is available only as ordered by the ALJ. The ALJ...

40 CFR 164.51 - Other discovery.

Code of Federal Regulations, 2014 CFR

2014-07-01

... 40 Protection of Environment 24 2014-07-01 2014-07-01 false Other discovery. 164.51 Section 164.51... (Other Than Expedited Hearings) Prehearing Procedures and Discovery § 164.51 Other discovery. (a) General. Except as so provided by § 164.50(b) supra, further discovery, under this subpart, shall be permitted...

14 CFR 1264.120 - Discovery.

Code of Federal Regulations, 2013 CFR

2013-01-01

... 14 Aeronautics and Space 5 2013-01-01 2013-01-01 false Discovery. 1264.120 Section 1264.120... PENALTIES ACT OF 1986 § 1264.120 Discovery. (a) The following types of discovery are authorized: (1..., discovery is available only as ordered by the presiding officer. The presiding officer shall regulate the...

38 CFR 42.21 - Discovery.

Code of Federal Regulations, 2012 CFR

2012-07-01

... 38 Pensions, Bonuses, and Veterans' Relief 2 2012-07-01 2012-07-01 false Discovery. 42.21 Section... IMPLEMENTING THE PROGRAM FRAUD CIVIL REMEDIES ACT § 42.21 Discovery. (a) The following types of discovery are... creation of a document. (c) Unless mutually agreed to by the parties, discovery is available only as...

39 CFR 955.15 - Discovery.

Code of Federal Regulations, 2011 CFR

2011-07-01

... 39 Postal Service 1 2011-07-01 2011-07-01 false Discovery. 955.15 Section 955.15 Postal Service... APPEALS § 955.15 Discovery. (a) The parties are encouraged to engage in voluntary discovery procedures. In connection with any deposition or other discovery procedure, the Board may issue any order which justice...

49 CFR 1121.2 - Discovery.

Code of Federal Regulations, 2013 CFR

2013-10-01

... 49 Transportation 8 2013-10-01 2013-10-01 false Discovery. 1121.2 Section 1121.2 Transportation... TRANSPORTATION RULES OF PRACTICE RAIL EXEMPTION PROCEDURES § 1121.2 Discovery. Discovery shall follow the procedures set forth at 49 CFR part 1114, subpart B. Discovery may begin upon the filing of the petition for...

24 CFR 26.18 - Discovery.

Code of Federal Regulations, 2012 CFR

2012-04-01

... 24 Housing and Urban Development 1 2012-04-01 2012-04-01 false Discovery. 26.18 Section 26.18... PROCEDURES Hearings Before Hearing Officers Discovery § 26.18 Discovery. (a) General. The parties are encouraged to engage in voluntary discovery procedures, which may commence at any time after an answer has...

22 CFR 521.21 - Discovery.

Code of Federal Regulations, 2014 CFR

2014-04-01

... 22 Foreign Relations 2 2014-04-01 2014-04-01 false Discovery. 521.21 Section 521.21 Foreign... Discovery. (a) The following types of discovery are authorized: (1) Requests for production of documents for... interpreted to require the creation of a document. (c) Unless mutually agreed to by the parties, discovery is...

49 CFR 386.37 - Discovery.

Code of Federal Regulations, 2014 CFR

2014-10-01

... 49 Transportation 5 2014-10-01 2014-10-01 false Discovery. 386.37 Section 386.37 Transportation... and Hearings § 386.37 Discovery. (a) Parties may obtain discovery by one or more of the following...; and requests for admission. (b) Discovery may not commence until the matter is pending before the...

31 CFR 10.71 - Discovery.

Code of Federal Regulations, 2011 CFR

2011-07-01

... 31 Money and Finance: Treasury 1 2011-07-01 2011-07-01 false Discovery. 10.71 Section 10.71 Money... SERVICE Rules Applicable to Disciplinary Proceedings § 10.71 Discovery. (a) In general. Discovery may be... relevance, materiality and reasonableness of the requested discovery and subject to the requirements of § 10...

15 CFR 766.9 - Discovery.

Code of Federal Regulations, 2012 CFR

2012-01-01

... 15 Commerce and Foreign Trade 2 2012-01-01 2012-01-01 false Discovery. 766.9 Section 766.9... PROCEEDINGS § 766.9 Discovery. (a) General. The parties are encouraged to engage in voluntary discovery... provisions of the Federal Rules of Civil Procedure relating to discovery apply to the extent consistent with...

39 CFR 955.15 - Discovery.

Code of Federal Regulations, 2013 CFR

2013-07-01

... 39 Postal Service 1 2013-07-01 2013-07-01 false Discovery. 955.15 Section 955.15 Postal Service... APPEALS § 955.15 Discovery. (a) The parties are encouraged to engage in voluntary discovery procedures. In connection with any deposition or other discovery procedure, the Board may issue any order which justice...

49 CFR 1121.2 - Discovery.

Code of Federal Regulations, 2012 CFR

2012-10-01

... 49 Transportation 8 2012-10-01 2012-10-01 false Discovery. 1121.2 Section 1121.2 Transportation... TRANSPORTATION RULES OF PRACTICE RAIL EXEMPTION PROCEDURES § 1121.2 Discovery. Discovery shall follow the procedures set forth at 49 CFR part 1114, subpart B. Discovery may begin upon the filing of the petition for...

24 CFR 26.18 - Discovery.

Code of Federal Regulations, 2013 CFR

2013-04-01

... 24 Housing and Urban Development 1 2013-04-01 2013-04-01 false Discovery. 26.18 Section 26.18... PROCEDURES Hearings Before Hearing Officers Discovery § 26.18 Discovery. (a) General. The parties are encouraged to engage in voluntary discovery procedures, which may commence at any time after an answer has...

49 CFR 1121.2 - Discovery.

Code of Federal Regulations, 2011 CFR

2011-10-01

... 49 Transportation 8 2011-10-01 2011-10-01 false Discovery. 1121.2 Section 1121.2 Transportation... TRANSPORTATION RULES OF PRACTICE RAIL EXEMPTION PROCEDURES § 1121.2 Discovery. Discovery shall follow the procedures set forth at 49 CFR part 1114, subpart B. Discovery may begin upon the filing of the petition for...

42 CFR 426.432 - Discovery.

Code of Federal Regulations, 2012 CFR

2012-10-01

... 42 Public Health 3 2012-10-01 2012-10-01 false Discovery. 426.432 Section 426.432 Public Health... an LCD § 426.432 Discovery. (a) General rule. If the ALJ orders discovery, the ALJ must establish a reasonable timeframe for discovery. (b) Protective order—(1) Request for a protective order. Any party...

37 CFR 41.150 - Discovery.

Code of Federal Regulations, 2013 CFR

2013-07-01

... 37 Patents, Trademarks, and Copyrights 1 2013-07-01 2013-07-01 false Discovery. 41.150 Section 41... COMMERCE PRACTICE BEFORE THE PATENT TRIAL AND APPEAL BOARD Contested Cases § 41.150 Discovery. (a) Limited discovery. A party is not entitled to discovery except as authorized in this subpart. The parties may agree...

10 CFR 13.21 - Discovery.

Code of Federal Regulations, 2012 CFR

2012-01-01

... 10 Energy 1 2012-01-01 2012-01-01 false Discovery. 13.21 Section 13.21 Energy NUCLEAR REGULATORY COMMISSION PROGRAM FRAUD CIVIL REMEDIES § 13.21 Discovery. (a) The following types of discovery are...) Unless mutually agreed to by the parties, discovery is available only as ordered by the ALJ. The ALJ...

12 CFR 263.53 - Discovery depositions.

Code of Federal Regulations, 2014 CFR

2014-01-01

... 12 Banks and Banking 4 2014-01-01 2014-01-01 false Discovery depositions. 263.53 Section 263.53... Discovery depositions. (a) In general. In addition to the discovery permitted in subpart A of this part, limited discovery by means of depositions shall be allowed for individuals with knowledge of facts...

39 CFR 955.15 - Discovery.

Code of Federal Regulations, 2012 CFR

2012-07-01

... 39 Postal Service 1 2012-07-01 2012-07-01 false Discovery. 955.15 Section 955.15 Postal Service... APPEALS § 955.15 Discovery. (a) The parties are encouraged to engage in voluntary discovery procedures. In connection with any deposition or other discovery procedure, the Board may issue any order which justice...

43 CFR 35.21 - Discovery.

Code of Federal Regulations, 2014 CFR

2014-10-01

... 43 Public Lands: Interior 1 2014-10-01 2014-10-01 false Discovery. 35.21 Section 35.21 Public... AND STATEMENTS § 35.21 Discovery. (a) The following types of discovery are authorized: (1) Requests...) Unless mutually agreed to by the parties, discovery is available only as ordered by the ALJ. The ALJ...

43 CFR 35.21 - Discovery.

Code of Federal Regulations, 2013 CFR

2013-10-01

... 43 Public Lands: Interior 1 2013-10-01 2013-10-01 false Discovery. 35.21 Section 35.21 Public... AND STATEMENTS § 35.21 Discovery. (a) The following types of discovery are authorized: (1) Requests...) Unless mutually agreed to by the parties, discovery is available only as ordered by the ALJ. The ALJ...

15 CFR 766.9 - Discovery.

Code of Federal Regulations, 2011 CFR

2011-01-01

... 15 Commerce and Foreign Trade 2 2011-01-01 2011-01-01 false Discovery. 766.9 Section 766.9... PROCEEDINGS § 766.9 Discovery. (a) General. The parties are encouraged to engage in voluntary discovery... provisions of the Federal Rules of Civil Procedure relating to discovery apply to the extent consistent with...

37 CFR 41.150 - Discovery.

Code of Federal Regulations, 2011 CFR

2011-07-01

... 37 Patents, Trademarks, and Copyrights 1 2011-07-01 2011-07-01 false Discovery. 41.150 Section 41... COMMERCE PRACTICE BEFORE THE BOARD OF PATENT APPEALS AND INTERFERENCES Contested Cases § 41.150 Discovery. (a) Limited discovery. A party is not entitled to discovery except as authorized in this subpart. The...

49 CFR 386.37 - Discovery.

Code of Federal Regulations, 2013 CFR

2013-10-01

... 49 Transportation 5 2013-10-01 2013-10-01 false Discovery. 386.37 Section 386.37 Transportation... and Hearings § 386.37 Discovery. (a) Parties may obtain discovery by one or more of the following...; and requests for admission. (b) Discovery may not commence until the matter is pending before the...

43 CFR 35.21 - Discovery.

Code of Federal Regulations, 2011 CFR

2011-10-01

... 43 Public Lands: Interior 1 2011-10-01 2011-10-01 false Discovery. 35.21 Section 35.21 Public... AND STATEMENTS § 35.21 Discovery. (a) The following types of discovery are authorized: (1) Requests...) Unless mutually agreed to by the parties, discovery is available only as ordered by the ALJ. The ALJ...

14 CFR 13.220 - Discovery.

Code of Federal Regulations, 2013 CFR

2013-01-01

... 14 Aeronautics and Space 1 2013-01-01 2013-01-01 false Discovery. 13.220 Section 13.220... INVESTIGATIVE AND ENFORCEMENT PROCEDURES Rules of Practice in FAA Civil Penalty Actions § 13.220 Discovery. (a) Initiation of discovery. Any party may initiate discovery described in this section, without the consent or...

31 CFR 10.71 - Discovery.

Code of Federal Regulations, 2012 CFR

2012-07-01

... 31 Money and Finance: Treasury 1 2012-07-01 2012-07-01 false Discovery. 10.71 Section 10.71 Money... SERVICE Rules Applicable to Disciplinary Proceedings § 10.71 Discovery. (a) In general. Discovery may be... relevance, materiality and reasonableness of the requested discovery and subject to the requirements of § 10...

49 CFR 386.37 - Discovery.

Code of Federal Regulations, 2012 CFR

2012-10-01

... 49 Transportation 5 2012-10-01 2012-10-01 false Discovery. 386.37 Section 386.37 Transportation... and Hearings § 386.37 Discovery. (a) Parties may obtain discovery by one or more of the following...; and requests for admission. (b) Discovery may not commence until the matter is pending before the...

15 CFR 280.210 - Discovery.

Code of Federal Regulations, 2013 CFR

2013-01-01

... 15 Commerce and Foreign Trade 1 2013-01-01 2013-01-01 false Discovery. 280.210 Section 280.210... Enforcement § 280.210 Discovery. (a) General. The parties are encouraged to engage in voluntary discovery... provisions of the Federal Rules of Civil Procedure relating to discovery apply to the extent consistent with...

24 CFR 26.18 - Discovery.

Code of Federal Regulations, 2011 CFR

2011-04-01

... 24 Housing and Urban Development 1 2011-04-01 2011-04-01 false Discovery. 26.18 Section 26.18... PROCEDURES Hearings Before Hearing Officers Discovery § 26.18 Discovery. (a) General. The parties are encouraged to engage in voluntary discovery procedures, which may commence at any time after an answer has...

38 CFR 42.21 - Discovery.

Code of Federal Regulations, 2011 CFR

2011-07-01

... 38 Pensions, Bonuses, and Veterans' Relief 2 2011-07-01 2011-07-01 false Discovery. 42.21 Section... IMPLEMENTING THE PROGRAM FRAUD CIVIL REMEDIES ACT § 42.21 Discovery. (a) The following types of discovery are... creation of a document. (c) Unless mutually agreed to by the parties, discovery is available only as...

15 CFR 766.9 - Discovery.

Code of Federal Regulations, 2014 CFR

2014-01-01

... 15 Commerce and Foreign Trade 2 2014-01-01 2014-01-01 false Discovery. 766.9 Section 766.9... PROCEEDINGS § 766.9 Discovery. (a) General. The parties are encouraged to engage in voluntary discovery... provisions of the Federal Rules of Civil Procedure relating to discovery apply to the extent consistent with...

14 CFR 13.220 - Discovery.

Code of Federal Regulations, 2011 CFR

2011-01-01

... 14 Aeronautics and Space 1 2011-01-01 2011-01-01 false Discovery. 13.220 Section 13.220... INVESTIGATIVE AND ENFORCEMENT PROCEDURES Rules of Practice in FAA Civil Penalty Actions § 13.220 Discovery. (a) Initiation of discovery. Any party may initiate discovery described in this section, without the consent or...

42 CFR 426.532 - Discovery.

Code of Federal Regulations, 2012 CFR

2012-10-01

... 42 Public Health 3 2012-10-01 2012-10-01 false Discovery. 426.532 Section 426.532 Public Health... an NCD § 426.532 Discovery. (a) General rule. If the Board orders discovery, the Board must establish a reasonable timeframe for discovery. (b) Protective order—(1) Request for a protective order. Any...

49 CFR 386.37 - Discovery.

Code of Federal Regulations, 2011 CFR

2011-10-01

... 49 Transportation 5 2011-10-01 2011-10-01 false Discovery. 386.37 Section 386.37 Transportation... and Hearings § 386.37 Discovery. (a) Parties may obtain discovery by one or more of the following...; and requests for admission. (b) Discovery may not commence until the matter is pending before the...

31 CFR 10.71 - Discovery.

Code of Federal Regulations, 2014 CFR

2014-07-01

... 31 Money and Finance: Treasury 1 2014-07-01 2014-07-01 false Discovery. 10.71 Section 10.71 Money... SERVICE Rules Applicable to Disciplinary Proceedings § 10.71 Discovery. (a) In general. Discovery may be... relevance, materiality and reasonableness of the requested discovery and subject to the requirements of § 10...

40 CFR 164.51 - Other discovery.

Code of Federal Regulations, 2011 CFR

2011-07-01

... 40 Protection of Environment 24 2011-07-01 2011-07-01 false Other discovery. 164.51 Section 164.51... (Other Than Expedited Hearings) Prehearing Procedures and Discovery § 164.51 Other discovery. (a) General. Except as so provided by § 164.50(b) supra, further discovery, under this subpart, shall be permitted...

14 CFR 13.220 - Discovery.

Code of Federal Regulations, 2012 CFR

2012-01-01

... 14 Aeronautics and Space 1 2012-01-01 2012-01-01 false Discovery. 13.220 Section 13.220... INVESTIGATIVE AND ENFORCEMENT PROCEDURES Rules of Practice in FAA Civil Penalty Actions § 13.220 Discovery. (a) Initiation of discovery. Any party may initiate discovery described in this section, without the consent or...

37 CFR 41.150 - Discovery.

Code of Federal Regulations, 2014 CFR

2014-07-01

... 37 Patents, Trademarks, and Copyrights 1 2014-07-01 2014-07-01 false Discovery. 41.150 Section 41... COMMERCE PRACTICE BEFORE THE PATENT TRIAL AND APPEAL BOARD Contested Cases § 41.150 Discovery. (a) Limited discovery. A party is not entitled to discovery except as authorized in this subpart. The parties may agree...

49 CFR 604.38 - Discovery.

Code of Federal Regulations, 2013 CFR

2013-10-01

... 49 Transportation 7 2013-10-01 2013-10-01 false Discovery. 604.38 Section 604.38 Transportation... TRANSPORTATION CHARTER SERVICE Hearings § 604.38 Discovery. (a) Permissible forms of discovery shall be within the discretion of the PO. (b) The PO shall limit the frequency and extent of discovery permitted by...

49 CFR 604.38 - Discovery.

Code of Federal Regulations, 2014 CFR

2014-10-01

... 49 Transportation 7 2014-10-01 2014-10-01 false Discovery. 604.38 Section 604.38 Transportation... TRANSPORTATION CHARTER SERVICE Hearings § 604.38 Discovery. (a) Permissible forms of discovery shall be within the discretion of the PO. (b) The PO shall limit the frequency and extent of discovery permitted by...

15 CFR 280.210 - Discovery.

Code of Federal Regulations, 2014 CFR

2014-01-01

... 15 Commerce and Foreign Trade 1 2014-01-01 2014-01-01 false Discovery. 280.210 Section 280.210... Enforcement § 280.210 Discovery. (a) General. The parties are encouraged to engage in voluntary discovery... provisions of the Federal Rules of Civil Procedure relating to discovery apply to the extent consistent with...

10 CFR 13.21 - Discovery.

Code of Federal Regulations, 2014 CFR

2014-01-01

... 10 Energy 1 2014-01-01 2014-01-01 false Discovery. 13.21 Section 13.21 Energy NUCLEAR REGULATORY COMMISSION PROGRAM FRAUD CIVIL REMEDIES § 13.21 Discovery. (a) The following types of discovery are...) Unless mutually agreed to by the parties, discovery is available only as ordered by the ALJ. The ALJ...

14 CFR 13.220 - Discovery.

Code of Federal Regulations, 2014 CFR

2014-01-01

... 14 Aeronautics and Space 1 2014-01-01 2014-01-01 false Discovery. 13.220 Section 13.220... INVESTIGATIVE AND ENFORCEMENT PROCEDURES Rules of Practice in FAA Civil Penalty Actions § 13.220 Discovery. (a) Initiation of discovery. Any party may initiate discovery described in this section, without the consent or...

24 CFR 26.18 - Discovery.

Code of Federal Regulations, 2014 CFR

2014-04-01

... 24 Housing and Urban Development 1 2014-04-01 2014-04-01 false Discovery. 26.18 Section 26.18... PROCEDURES Hearings Before Hearing Officers Discovery § 26.18 Discovery. (a) General. The parties are encouraged to engage in voluntary discovery procedures, which may commence at any time after an answer has...

12 CFR 263.53 - Discovery depositions.

Code of Federal Regulations, 2012 CFR

2012-01-01

... 12 Banks and Banking 4 2012-01-01 2012-01-01 false Discovery depositions. 263.53 Section 263.53... Discovery depositions. (a) In general. In addition to the discovery permitted in subpart A of this part, limited discovery by means of depositions shall be allowed for individuals with knowledge of facts...

38 CFR 42.21 - Discovery.

Code of Federal Regulations, 2014 CFR

2014-07-01

... 38 Pensions, Bonuses, and Veterans' Relief 2 2014-07-01 2014-07-01 false Discovery. 42.21 Section... IMPLEMENTING THE PROGRAM FRAUD CIVIL REMEDIES ACT § 42.21 Discovery. (a) The following types of discovery are... creation of a document. (c) Unless mutually agreed to by the parties, discovery is available only as...

15 CFR 766.9 - Discovery.

Code of Federal Regulations, 2013 CFR

2013-01-01

... 15 Commerce and Foreign Trade 2 2013-01-01 2013-01-01 false Discovery. 766.9 Section 766.9... PROCEEDINGS § 766.9 Discovery. (a) General. The parties are encouraged to engage in voluntary discovery... provisions of the Federal Rules of Civil Procedure relating to discovery apply to the extent consistent with...

49 CFR 604.38 - Discovery.

Code of Federal Regulations, 2012 CFR

2012-10-01

... 49 Transportation 7 2012-10-01 2012-10-01 false Discovery. 604.38 Section 604.38 Transportation... TRANSPORTATION CHARTER SERVICE Hearings § 604.38 Discovery. (a) Permissible forms of discovery shall be within the discretion of the PO. (b) The PO shall limit the frequency and extent of discovery permitted by...

37 CFR 41.150 - Discovery.

Code of Federal Regulations, 2012 CFR

2012-07-01

... 37 Patents, Trademarks, and Copyrights 1 2012-07-01 2012-07-01 false Discovery. 41.150 Section 41... COMMERCE PRACTICE BEFORE THE BOARD OF PATENT APPEALS AND INTERFERENCES Contested Cases § 41.150 Discovery. (a) Limited discovery. A party is not entitled to discovery except as authorized in this subpart. The...

38 CFR 42.21 - Discovery.

Code of Federal Regulations, 2013 CFR

2013-07-01

... 38 Pensions, Bonuses, and Veterans' Relief 2 2013-07-01 2013-07-01 false Discovery. 42.21 Section... IMPLEMENTING THE PROGRAM FRAUD CIVIL REMEDIES ACT § 42.21 Discovery. (a) The following types of discovery are... creation of a document. (c) Unless mutually agreed to by the parties, discovery is available only as...

42 CFR 426.532 - Discovery.

Code of Federal Regulations, 2014 CFR

2014-10-01

... 42 Public Health 3 2014-10-01 2014-10-01 false Discovery. 426.532 Section 426.532 Public Health... an NCD § 426.532 Discovery. (a) General rule. If the Board orders discovery, the Board must establish a reasonable timeframe for discovery. (b) Protective order—(1) Request for a protective order. Any...

37 CFR 41.150 - Discovery.

Code of Federal Regulations, 2010 CFR

2010-07-01

... 37 Patents, Trademarks, and Copyrights 1 2010-07-01 2010-07-01 false Discovery. 41.150 Section 41... COMMERCE PRACTICE BEFORE THE BOARD OF PATENT APPEALS AND INTERFERENCES Contested Cases § 41.150 Discovery. (a) Limited discovery. A party is not entitled to discovery except as authorized in this subpart. The...

39 CFR 955.15 - Discovery.

Code of Federal Regulations, 2010 CFR

2010-07-01

... 39 Postal Service 1 2010-07-01 2010-07-01 false Discovery. 955.15 Section 955.15 Postal Service... APPEALS § 955.15 Discovery. (a) The parties are encouraged to engage in voluntary discovery procedures. In connection with any deposition or other discovery procedure, the Board may issue any order which justice...

24 CFR 26.18 - Discovery.

Code of Federal Regulations, 2010 CFR

2010-04-01

... 24 Housing and Urban Development 1 2010-04-01 2010-04-01 false Discovery. 26.18 Section 26.18... PROCEDURES Hearings Before Hearing Officers Discovery § 26.18 Discovery. (a) General. The parties are encouraged to engage in voluntary discovery procedures, which may commence at any time after an answer has...

49 CFR 604.38 - Discovery.

Code of Federal Regulations, 2010 CFR

2010-10-01

... 49 Transportation 7 2010-10-01 2010-10-01 false Discovery. 604.38 Section 604.38 Transportation... TRANSPORTATION CHARTER SERVICE Hearings. § 604.38 Discovery. (a) Permissible forms of discovery shall be within the discretion of the PO. (b) The PO shall limit the frequency and extent of discovery permitted by...

43 CFR 35.21 - Discovery.

Code of Federal Regulations, 2010 CFR

2010-10-01

... 43 Public Lands: Interior 1 2010-10-01 2010-10-01 false Discovery. 35.21 Section 35.21 Public... AND STATEMENTS § 35.21 Discovery. (a) The following types of discovery are authorized: (1) Requests...) Unless mutually agreed to by the parties, discovery is available only as ordered by the ALJ. The ALJ...

15 CFR 766.9 - Discovery.

Code of Federal Regulations, 2010 CFR

2010-01-01

... 15 Commerce and Foreign Trade 2 2010-01-01 2010-01-01 false Discovery. 766.9 Section 766.9... PROCEEDINGS § 766.9 Discovery. (a) General. The parties are encouraged to engage in voluntary discovery... provisions of the Federal Rules of Civil Procedure relating to discovery apply to the extent consistent with...

42 CFR 426.432 - Discovery.

Code of Federal Regulations, 2010 CFR

2010-10-01

... 42 Public Health 3 2010-10-01 2010-10-01 false Discovery. 426.432 Section 426.432 Public Health... § 426.432 Discovery. (a) General rule. If the ALJ orders discovery, the ALJ must establish a reasonable timeframe for discovery. (b) Protective order—(1) Request for a protective order. Any party receiving a...

10 CFR 13.21 - Discovery.

Code of Federal Regulations, 2010 CFR

2010-01-01

... 10 Energy 1 2010-01-01 2010-01-01 false Discovery. 13.21 Section 13.21 Energy NUCLEAR REGULATORY COMMISSION PROGRAM FRAUD CIVIL REMEDIES § 13.21 Discovery. (a) The following types of discovery are...) Unless mutually agreed to by the parties, discovery is available only as ordered by the ALJ. The ALJ...

49 CFR 1121.2 - Discovery.

Code of Federal Regulations, 2010 CFR

2010-10-01

... 49 Transportation 8 2010-10-01 2010-10-01 false Discovery. 1121.2 Section 1121.2 Transportation... TRANSPORTATION RULES OF PRACTICE RAIL EXEMPTION PROCEDURES § 1121.2 Discovery. Discovery shall follow the procedures set forth at 49 CFR part 1114, subpart B. Discovery may begin upon the filing of the petition for...

42 CFR 426.532 - Discovery.

Code of Federal Regulations, 2010 CFR

2010-10-01

... 42 Public Health 3 2010-10-01 2010-10-01 false Discovery. 426.532 Section 426.532 Public Health... § 426.532 Discovery. (a) General rule. If the Board orders discovery, the Board must establish a reasonable timeframe for discovery. (b) Protective order—(1) Request for a protective order. Any party...

14 CFR 13.220 - Discovery.

Code of Federal Regulations, 2010 CFR

2010-01-01

... 14 Aeronautics and Space 1 2010-01-01 2010-01-01 false Discovery. 13.220 Section 13.220... INVESTIGATIVE AND ENFORCEMENT PROCEDURES Rules of Practice in FAA Civil Penalty Actions § 13.220 Discovery. (a) Initiation of discovery. Any party may initiate discovery described in this section, without the consent or...

38 CFR 42.21 - Discovery.

Code of Federal Regulations, 2010 CFR

2010-07-01

... 38 Pensions, Bonuses, and Veterans' Relief 2 2010-07-01 2010-07-01 false Discovery. 42.21 Section... IMPLEMENTING THE PROGRAM FRAUD CIVIL REMEDIES ACT § 42.21 Discovery. (a) The following types of discovery are... creation of a document. (c) Unless mutually agreed to by the parties, discovery is available only as...

14 CFR 1264.120 - Discovery.

Code of Federal Regulations, 2010 CFR

2010-01-01

... 14 Aeronautics and Space 5 2010-01-01 2010-01-01 false Discovery. 1264.120 Section 1264.120... PENALTIES ACT OF 1986 § 1264.120 Discovery. (a) The following types of discovery are authorized: (1..., discovery is available only as ordered by the presiding officer. The presiding officer shall regulate the...

12 CFR 1081.210 - Expert discovery.

Code of Federal Regulations, 2012 CFR

2012-01-01

... 12 Banks and Banking 8 2012-01-01 2012-01-01 false Expert discovery. 1081.210 Section 1081.210... Initiation of Proceedings and Prehearing Rules § 1081.210 Expert discovery. (a) At a date set by the hearing... discovery in appropriate cases. ...

Cloud-based solution to identify statistically significant MS peaks differentiating sample categories.

PubMed

Ji, Jun; Ling, Jeffrey; Jiang, Helen; Wen, Qiaojun; Whitin, John C; Tian, Lu; Cohen, Harvey J; Ling, Xuefeng B

2013-03-23

Mass spectrometry (MS) has evolved to become the primary high throughput tool for proteomics based biomarker discovery. Until now, multiple challenges in protein MS data analysis remain: large-scale and complex data set management; MS peak identification, indexing; and high dimensional peak differential analysis with the concurrent statistical tests based false discovery rate (FDR). "Turnkey" solutions are needed for biomarker investigations to rapidly process MS data sets to identify statistically significant peaks for subsequent validation. Here we present an efficient and effective solution, which provides experimental biologists easy access to "cloud" computing capabilities to analyze MS data. The web portal can be accessed at http://transmed.stanford.edu/ssa/. Presented web application supplies large scale MS data online uploading and analysis with a simple user interface. This bioinformatic tool will facilitate the discovery of the potential protein biomarkers using MS.

Evaluation of Second-Level Inference in fMRI Analysis

PubMed Central

Roels, Sanne P.; Loeys, Tom; Moerkerke, Beatrijs

2016-01-01

We investigate the impact of decisions in the second-level (i.e., over subjects) inferential process in functional magnetic resonance imaging on (1) the balance between false positives and false negatives and on (2) the data-analytical stability, both proxies for the reproducibility of results. Second-level analysis based on a mass univariate approach typically consists of 3 phases. First, one proceeds via a general linear model for a test image that consists of pooled information from different subjects. We evaluate models that take into account first-level (within-subjects) variability and models that do not take into account this variability. Second, one proceeds via inference based on parametrical assumptions or via permutation-based inference. Third, we evaluate 3 commonly used procedures to address the multiple testing problem: familywise error rate correction, False Discovery Rate (FDR) correction, and a two-step procedure with minimal cluster size. Based on a simulation study and real data we find that the two-step procedure with minimal cluster size results in most stable results, followed by the familywise error rate correction. The FDR results in most variable results, for both permutation-based inference and parametrical inference. Modeling the subject-specific variability yields a better balance between false positives and false negatives when using parametric inference. PMID:26819578

Genome-wide association screens for Achilles tendon and ACL tears and tendinopathy

PubMed Central

Roos, Thomas R.; Roos, Andrew K.; Kleimeyer, John P.; Ahmed, Marwa A.; Goodlin, Gabrielle T.; Fredericson, Michael; Ioannidis, John P. A.; Avins, Andrew L.; Dragoo, Jason L.

2017-01-01

Achilles tendinopathy or rupture and anterior cruciate ligament (ACL) rupture are substantial injuries affecting athletes, associated with delayed recovery or inability to return to competition. To identify genetic markers that might be used to predict risk for these injuries, we performed genome-wide association screens for these injuries using data from the Genetic Epidemiology Research on Adult Health and Aging (GERA) cohort consisting of 102,979 individuals. We did not find any single nucleotide polymorphisms (SNPs) associated with either of these injuries with a p-value that was genome-wide significant (p<5x10-8). We found, however, four and three polymorphisms with p-values that were borderline significant (p<10−6) for Achilles tendon injury and ACL rupture, respectively. We then tested SNPs previously reported to be associated with either Achilles tendon injury or ACL rupture. None showed an association in our cohort with a false discovery rate of less than 5%. We obtained, however, moderate to weak evidence for replication in one case; specifically, rs4919510 in MIR608 had a p-value of 5.1x10-3 for association with Achilles tendon injury, corresponding to a 7% chance of false replication. Finally, we tested 2855 SNPs in 90 candidate genes for musculoskeletal injury, but did not find any that showed a significant association below a false discovery rate of 5%. We provide data containing summary statistics for the entire genome, which will be useful for future genetic studies on these injuries. PMID:28358823

46 CFR 502.201 - General provisions governing discovery.

Code of Federal Regulations, 2010 CFR

2010-10-01

... 46 Shipping 9 2010-10-01 2010-10-01 false General provisions governing discovery. 502.201 Section... AND PROCEDURE Depositions, Written Interrogatories, and Discovery § 502.201 General provisions governing discovery. (a) Applicability. The procedures described in this subpart are available in all...

29 CFR 2200.208 - Discovery.

Code of Federal Regulations, 2011 CFR

2011-07-01

... 29 Labor 9 2011-07-01 2011-07-01 false Discovery. 2200.208 Section 2200.208 Labor Regulations Relating to Labor (Continued) OCCUPATIONAL SAFETY AND HEALTH REVIEW COMMISSION RULES OF PROCEDURE Simplified Proceedings § 2200.208 Discovery. Discovery, including requests for admissions, will only be...

49 CFR 209.313 - Discovery.

Code of Federal Regulations, 2012 CFR

2012-10-01

... 49 Transportation 4 2012-10-01 2012-10-01 false Discovery. 209.313 Section 209.313 Transportation... TRANSPORTATION RAILROAD SAFETY ENFORCEMENT PROCEDURES Disqualification Procedures § 209.313 Discovery. (a... parties. Discovery is designed to enable a party to obtain relevant information needed for preparation of...

47 CFR 65.105 - Discovery.

Code of Federal Regulations, 2011 CFR

2011-10-01

... 47 Telecommunication 3 2011-10-01 2011-10-01 false Discovery. 65.105 Section 65.105... OF RETURN PRESCRIPTION PROCEDURES AND METHODOLOGIES Procedures § 65.105 Discovery. (a) Participants... evidence. (c) Discovery requests pursuant to § 65.105(b), including written interrogatories, shall be filed...

49 CFR 209.313 - Discovery.

Code of Federal Regulations, 2011 CFR

2011-10-01

... 49 Transportation 4 2011-10-01 2011-10-01 false Discovery. 209.313 Section 209.313 Transportation... TRANSPORTATION RAILROAD SAFETY ENFORCEMENT PROCEDURES Disqualification Procedures § 209.313 Discovery. (a... parties. Discovery is designed to enable a party to obtain relevant information needed for preparation of...

47 CFR 65.105 - Discovery.

Code of Federal Regulations, 2014 CFR

2014-10-01

... 47 Telecommunication 3 2014-10-01 2014-10-01 false Discovery. 65.105 Section 65.105... OF RETURN PRESCRIPTION PROCEDURES AND METHODOLOGIES Procedures § 65.105 Discovery. (a) Participants... evidence. (c) Discovery requests pursuant to § 65.105(b), including written interrogatories, shall be filed...

49 CFR 209.313 - Discovery.

Code of Federal Regulations, 2013 CFR

2013-10-01

... 49 Transportation 4 2013-10-01 2013-10-01 false Discovery. 209.313 Section 209.313 Transportation... TRANSPORTATION RAILROAD SAFETY ENFORCEMENT PROCEDURES Disqualification Procedures § 209.313 Discovery. (a... parties. Discovery is designed to enable a party to obtain relevant information needed for preparation of...

29 CFR 2200.208 - Discovery.

Code of Federal Regulations, 2014 CFR

2014-07-01

... 29 Labor 9 2014-07-01 2014-07-01 false Discovery. 2200.208 Section 2200.208 Labor Regulations Relating to Labor (Continued) OCCUPATIONAL SAFETY AND HEALTH REVIEW COMMISSION RULES OF PROCEDURE Simplified Proceedings § 2200.208 Discovery. Discovery, including requests for admissions, will only be...

47 CFR 65.105 - Discovery.

Code of Federal Regulations, 2013 CFR

2013-10-01

... 47 Telecommunication 3 2013-10-01 2013-10-01 false Discovery. 65.105 Section 65.105... OF RETURN PRESCRIPTION PROCEDURES AND METHODOLOGIES Procedures § 65.105 Discovery. (a) Participants... evidence. (c) Discovery requests pursuant to § 65.105(b), including written interrogatories, shall be filed...

29 CFR 2200.208 - Discovery.

Code of Federal Regulations, 2012 CFR

2012-07-01

... 29 Labor 9 2012-07-01 2012-07-01 false Discovery. 2200.208 Section 2200.208 Labor Regulations Relating to Labor (Continued) OCCUPATIONAL SAFETY AND HEALTH REVIEW COMMISSION RULES OF PROCEDURE Simplified Proceedings § 2200.208 Discovery. Discovery, including requests for admissions, will only be...

29 CFR 2200.208 - Discovery.

Code of Federal Regulations, 2013 CFR

2013-07-01

... 29 Labor 9 2013-07-01 2013-07-01 false Discovery. 2200.208 Section 2200.208 Labor Regulations Relating to Labor (Continued) OCCUPATIONAL SAFETY AND HEALTH REVIEW COMMISSION RULES OF PROCEDURE Simplified Proceedings § 2200.208 Discovery. Discovery, including requests for admissions, will only be...

12 CFR 1081.210 - Expert discovery.

Code of Federal Regulations, 2013 CFR

2013-01-01

... 12 Banks and Banking 8 2013-01-01 2013-01-01 false Expert discovery. 1081.210 Section 1081.210... Initiation of Proceedings and Prehearing Rules § 1081.210 Expert discovery. (a) At a date set by the hearing... requirement of expert discovery in appropriate cases. ...

49 CFR 209.313 - Discovery.

Code of Federal Regulations, 2014 CFR

2014-10-01

... 49 Transportation 4 2014-10-01 2014-10-01 false Discovery. 209.313 Section 209.313 Transportation... TRANSPORTATION RAILROAD SAFETY ENFORCEMENT PROCEDURES Disqualification Procedures § 209.313 Discovery. (a... parties. Discovery is designed to enable a party to obtain relevant information needed for preparation of...

47 CFR 65.105 - Discovery.

Code of Federal Regulations, 2012 CFR

2012-10-01

... 47 Telecommunication 3 2012-10-01 2012-10-01 false Discovery. 65.105 Section 65.105... OF RETURN PRESCRIPTION PROCEDURES AND METHODOLOGIES Procedures § 65.105 Discovery. (a) Participants... evidence. (c) Discovery requests pursuant to § 65.105(b), including written interrogatories, shall be filed...

49 CFR 209.313 - Discovery.

Code of Federal Regulations, 2010 CFR

2010-10-01

... 49 Transportation 4 2010-10-01 2010-10-01 false Discovery. 209.313 Section 209.313 Transportation... TRANSPORTATION RAILROAD SAFETY ENFORCEMENT PROCEDURES Disqualification Procedures § 209.313 Discovery. (a... parties. Discovery is designed to enable a party to obtain relevant information needed for preparation of...

29 CFR 2200.208 - Discovery.

Code of Federal Regulations, 2010 CFR

2010-07-01

... 29 Labor 9 2010-07-01 2010-07-01 false Discovery. 2200.208 Section 2200.208 Labor Regulations Relating to Labor (Continued) OCCUPATIONAL SAFETY AND HEALTH REVIEW COMMISSION RULES OF PROCEDURE Simplified Proceedings § 2200.208 Discovery. Discovery, including requests for admissions, will only be...

47 CFR 65.105 - Discovery.

Code of Federal Regulations, 2010 CFR

2010-10-01

... 47 Telecommunication 3 2010-10-01 2010-10-01 false Discovery. 65.105 Section 65.105... OF RETURN PRESCRIPTION PROCEDURES AND METHODOLOGIES Procedures § 65.105 Discovery. (a) Participants... evidence. (c) Discovery requests pursuant to § 65.105(b), including written interrogatories, shall be filed...

12 CFR 509.24 - Scope of document discovery.

Code of Federal Regulations, 2010 CFR

2010-01-01

... 12 Banks and Banking 5 2010-01-01 2010-01-01 false Scope of document discovery. 509.24 Section 509... discovery. (a) Limits on discovery. (1) Subject to the limitations set out in paragraphs (b), (c), and (d) of this section, a party to a proceeding under this subpart may obtain document discovery by serving...

12 CFR 747.24 - Scope of document discovery.

Code of Federal Regulations, 2010 CFR

2010-01-01

... act of Congress, or the principles of common law provide. (d) Time limits. All discovery, including... 12 Banks and Banking 6 2010-01-01 2010-01-01 false Scope of document discovery. 747.24 Section 747... of Practice and Procedure § 747.24 Scope of document discovery. (a) Limits on discovery. (1) Subject...

31 CFR 16.21 - Discovery.

Code of Federal Regulations, 2012 CFR

2012-07-01

... 31 Money and Finance: Treasury 1 2012-07-01 2012-07-01 false Discovery. 16.21 Section 16.21 Money... FRAUD CIVIL REMEDIES ACT OF 1986 § 16.21 Discovery. (a) The following types of discovery are authorized... to require the creation of a document. (c) Unless mutually agreed to by the parties, discovery is...

31 CFR 16.21 - Discovery.

Code of Federal Regulations, 2013 CFR

2013-07-01

... 31 Money and Finance: Treasury 1 2013-07-01 2013-07-01 false Discovery. 16.21 Section 16.21 Money... FRAUD CIVIL REMEDIES ACT OF 1986 § 16.21 Discovery. (a) The following types of discovery are authorized... to require the creation of a document. (c) Unless mutually agreed to by the parties, discovery is...

13 CFR 134.213 - Discovery.

Code of Federal Regulations, 2014 CFR

2014-01-01

... 13 Business Credit and Assistance 1 2014-01-01 2014-01-01 false Discovery. 134.213 Section 134.213... OFFICE OF HEARINGS AND APPEALS Rules of Practice § 134.213 Discovery. (a) Motion. A party may obtain discovery only upon motion, and for good cause shown. (b) Forms. The forms of discovery which a Judge can...

31 CFR 16.21 - Discovery.

Code of Federal Regulations, 2014 CFR

2014-07-01

... 31 Money and Finance: Treasury 1 2014-07-01 2014-07-01 false Discovery. 16.21 Section 16.21 Money... FRAUD CIVIL REMEDIES ACT OF 1986 § 16.21 Discovery. (a) The following types of discovery are authorized... to require the creation of a document. (c) Unless mutually agreed to by the parties, discovery is...

13 CFR 134.213 - Discovery.

Code of Federal Regulations, 2013 CFR

2013-01-01

... 13 Business Credit and Assistance 1 2013-01-01 2013-01-01 false Discovery. 134.213 Section 134.213... OFFICE OF HEARINGS AND APPEALS Rules of Practice § 134.213 Discovery. (a) Motion. A party may obtain discovery only upon motion, and for good cause shown. (b) Forms. The forms of discovery which a Judge can...

13 CFR 134.213 - Discovery.

Code of Federal Regulations, 2011 CFR

2011-01-01

... 13 Business Credit and Assistance 1 2011-01-01 2011-01-01 false Discovery. 134.213 Section 134.213... OFFICE OF HEARINGS AND APPEALS Rules of Practice § 134.213 Discovery. (a) Motion. A party may obtain discovery only upon motion, and for good cause shown. (b) Forms. The forms of discovery which a Judge can...

13 CFR 134.213 - Discovery.

Code of Federal Regulations, 2012 CFR

2012-01-01

... 13 Business Credit and Assistance 1 2012-01-01 2012-01-01 false Discovery. 134.213 Section 134.213... OFFICE OF HEARINGS AND APPEALS Rules of Practice § 134.213 Discovery. (a) Motion. A party may obtain discovery only upon motion, and for good cause shown. (b) Forms. The forms of discovery which a Judge can...

14 CFR § 1264.120 - Discovery.

Code of Federal Regulations, 2014 CFR

2014-01-01

... 14 Aeronautics and Space 5 2014-01-01 2014-01-01 false Discovery. § 1264.120 Section § 1264.120... PENALTIES ACT OF 1986 § 1264.120 Discovery. (a) The following types of discovery are authorized: (1..., discovery is available only as ordered by the presiding officer. The presiding officer shall regulate the...

31 CFR 16.21 - Discovery.

Code of Federal Regulations, 2011 CFR

2011-07-01

... 31 Money and Finance: Treasury 1 2011-07-01 2011-07-01 false Discovery. 16.21 Section 16.21 Money... FRAUD CIVIL REMEDIES ACT OF 1986 § 16.21 Discovery. (a) The following types of discovery are authorized... to require the creation of a document. (c) Unless mutually agreed to by the parties, discovery is...

13 CFR 134.213 - Discovery.

Code of Federal Regulations, 2010 CFR

2010-01-01

... 13 Business Credit and Assistance 1 2010-01-01 2010-01-01 false Discovery. 134.213 Section 134.213... OFFICE OF HEARINGS AND APPEALS Rules of Practice for Most Cases § 134.213 Discovery. (a) Motion. A party may obtain discovery only upon motion, and for good cause shown. (b) Forms. The forms of discovery...

31 CFR 16.21 - Discovery.

Code of Federal Regulations, 2010 CFR

2010-07-01

... 31 Money and Finance: Treasury 1 2010-07-01 2010-07-01 false Discovery. 16.21 Section 16.21 Money... FRAUD CIVIL REMEDIES ACT OF 1986 § 16.21 Discovery. (a) The following types of discovery are authorized... to require the creation of a document. (c) Unless mutually agreed to by the parties, discovery is...

Empirical extensions of the lasso penalty to reduce the false discovery rate in high-dimensional Cox regression models.

PubMed

Ternès, Nils; Rotolo, Federico; Michiels, Stefan

2016-07-10

Correct selection of prognostic biomarkers among multiple candidates is becoming increasingly challenging as the dimensionality of biological data becomes higher. Therefore, minimizing the false discovery rate (FDR) is of primary importance, while a low false negative rate (FNR) is a complementary measure. The lasso is a popular selection method in Cox regression, but its results depend heavily on the penalty parameter λ. Usually, λ is chosen using maximum cross-validated log-likelihood (max-cvl). However, this method has often a very high FDR. We review methods for a more conservative choice of λ. We propose an empirical extension of the cvl by adding a penalization term, which trades off between the goodness-of-fit and the parsimony of the model, leading to the selection of fewer biomarkers and, as we show, to the reduction of the FDR without large increase in FNR. We conducted a simulation study considering null and moderately sparse alternative scenarios and compared our approach with the standard lasso and 10 other competitors: Akaike information criterion (AIC), corrected AIC, Bayesian information criterion (BIC), extended BIC, Hannan and Quinn information criterion (HQIC), risk information criterion (RIC), one-standard-error rule, adaptive lasso, stability selection, and percentile lasso. Our extension achieved the best compromise across all the scenarios between a reduction of the FDR and a limited raise of the FNR, followed by the AIC, the RIC, and the adaptive lasso, which performed well in some settings. We illustrate the methods using gene expression data of 523 breast cancer patients. In conclusion, we propose to apply our extension to the lasso whenever a stringent FDR with a limited FNR is targeted. Copyright © 2016 John Wiley & Sons, Ltd. Copyright © 2016 John Wiley & Sons, Ltd.

Statistical detection of EEG synchrony using empirical bayesian inference.

PubMed

Singh, Archana K; Asoh, Hideki; Takeda, Yuji; Phillips, Steven

2015-01-01

There is growing interest in understanding how the brain utilizes synchronized oscillatory activity to integrate information across functionally connected regions. Computing phase-locking values (PLV) between EEG signals is a popular method for quantifying such synchronizations and elucidating their role in cognitive tasks. However, high-dimensionality in PLV data incurs a serious multiple testing problem. Standard multiple testing methods in neuroimaging research (e.g., false discovery rate, FDR) suffer severe loss of power, because they fail to exploit complex dependence structure between hypotheses that vary in spectral, temporal and spatial dimension. Previously, we showed that a hierarchical FDR and optimal discovery procedures could be effectively applied for PLV analysis to provide better power than FDR. In this article, we revisit the multiple comparison problem from a new Empirical Bayes perspective and propose the application of the local FDR method (locFDR; Efron, 2001) for PLV synchrony analysis to compute FDR as a posterior probability that an observed statistic belongs to a null hypothesis. We demonstrate the application of Efron's Empirical Bayes approach for PLV synchrony analysis for the first time. We use simulations to validate the specificity and sensitivity of locFDR and a real EEG dataset from a visual search study for experimental validation. We also compare locFDR with hierarchical FDR and optimal discovery procedures in both simulation and experimental analyses. Our simulation results showed that the locFDR can effectively control false positives without compromising on the power of PLV synchrony inference. Our results from the application locFDR on experiment data detected more significant discoveries than our previously proposed methods whereas the standard FDR method failed to detect any significant discoveries.

15 CFR 785.8 - Discovery.

Code of Federal Regulations, 2011 CFR

2011-01-01

... 15 Commerce and Foreign Trade 2 2011-01-01 2011-01-01 false Discovery. 785.8 Section 785.8... INDUSTRY AND SECURITY, DEPARTMENT OF COMMERCE ADDITIONAL PROTOCOL REGULATIONS ENFORCEMENT § 785.8 Discovery. (a) General. The parties are encouraged to engage in voluntary discovery regarding any matter, not...

49 CFR 31.21 - Discovery.

Code of Federal Regulations, 2013 CFR

2013-10-01

... 49 Transportation 1 2013-10-01 2013-10-01 false Discovery. 31.21 Section 31.21 Transportation Office of the Secretary of Transportation PROGRAM FRAUD CIVIL REMEDIES § 31.21 Discovery. (a) The following types of discovery are authorized: (1) Requests for production of documents for inspection and...

37 CFR 2.120 - Discovery.

Code of Federal Regulations, 2013 CFR

2013-07-01

... 37 Patents, Trademarks, and Copyrights 1 2013-07-01 2013-07-01 false Discovery. 2.120 Section 2... COMMERCE RULES OF PRACTICE IN TRADEMARK CASES Procedure in Inter Partes Proceedings § 2.120 Discovery. (a... to disclosure and discovery shall apply in opposition, cancellation, interference and concurrent use...

37 CFR 2.120 - Discovery.

Code of Federal Regulations, 2011 CFR

2011-07-01

... 37 Patents, Trademarks, and Copyrights 1 2011-07-01 2011-07-01 false Discovery. 2.120 Section 2... COMMERCE RULES OF PRACTICE IN TRADEMARK CASES Procedure in Inter Partes Proceedings § 2.120 Discovery. (a... to disclosure and discovery shall apply in opposition, cancellation, interference and concurrent use...

37 CFR 2.120 - Discovery.

Code of Federal Regulations, 2014 CFR

2014-07-01

... 37 Patents, Trademarks, and Copyrights 1 2014-07-01 2014-07-01 false Discovery. 2.120 Section 2... COMMERCE RULES OF PRACTICE IN TRADEMARK CASES Procedure in Inter Partes Proceedings § 2.120 Discovery. (a... to disclosure and discovery shall apply in opposition, cancellation, interference and concurrent use...

49 CFR 31.21 - Discovery.

Code of Federal Regulations, 2012 CFR

2012-10-01

... 49 Transportation 1 2012-10-01 2012-10-01 false Discovery. 31.21 Section 31.21 Transportation Office of the Secretary of Transportation PROGRAM FRAUD CIVIL REMEDIES § 31.21 Discovery. (a) The following types of discovery are authorized: (1) Requests for production of documents for inspection and...

37 CFR 2.120 - Discovery.

Code of Federal Regulations, 2012 CFR

2012-07-01

... 37 Patents, Trademarks, and Copyrights 1 2012-07-01 2012-07-01 false Discovery. 2.120 Section 2... COMMERCE RULES OF PRACTICE IN TRADEMARK CASES Procedure in Inter Partes Proceedings § 2.120 Discovery. (a... to disclosure and discovery shall apply in opposition, cancellation, interference and concurrent use...

49 CFR 31.21 - Discovery.

Code of Federal Regulations, 2011 CFR

2011-10-01

... 49 Transportation 1 2011-10-01 2011-10-01 false Discovery. 31.21 Section 31.21 Transportation Office of the Secretary of Transportation PROGRAM FRAUD CIVIL REMEDIES § 31.21 Discovery. (a) The following types of discovery are authorized: (1) Requests for production of documents for inspection and...

15 CFR 785.8 - Discovery.

Code of Federal Regulations, 2012 CFR

2012-01-01

... 15 Commerce and Foreign Trade 2 2012-01-01 2012-01-01 false Discovery. 785.8 Section 785.8... INDUSTRY AND SECURITY, DEPARTMENT OF COMMERCE ADDITIONAL PROTOCOL REGULATIONS ENFORCEMENT § 785.8 Discovery. (a) General. The parties are encouraged to engage in voluntary discovery regarding any matter, not...

15 CFR 785.8 - Discovery.

Code of Federal Regulations, 2013 CFR

2013-01-01

... 15 Commerce and Foreign Trade 2 2013-01-01 2013-01-01 false Discovery. 785.8 Section 785.8... INDUSTRY AND SECURITY, DEPARTMENT OF COMMERCE ADDITIONAL PROTOCOL REGULATIONS ENFORCEMENT § 785.8 Discovery. (a) General. The parties are encouraged to engage in voluntary discovery regarding any matter, not...

15 CFR 785.8 - Discovery.

Code of Federal Regulations, 2014 CFR

2014-01-01

... 15 Commerce and Foreign Trade 2 2014-01-01 2014-01-01 false Discovery. 785.8 Section 785.8... INDUSTRY AND SECURITY, DEPARTMENT OF COMMERCE ADDITIONAL PROTOCOL REGULATIONS ENFORCEMENT § 785.8 Discovery. (a) General. The parties are encouraged to engage in voluntary discovery regarding any matter, not...

49 CFR 31.21 - Discovery.

Code of Federal Regulations, 2014 CFR

2014-10-01

... 49 Transportation 1 2014-10-01 2014-10-01 false Discovery. 31.21 Section 31.21 Transportation Office of the Secretary of Transportation PROGRAM FRAUD CIVIL REMEDIES § 31.21 Discovery. (a) The following types of discovery are authorized: (1) Requests for production of documents for inspection and...

15 CFR 785.8 - Discovery.

Code of Federal Regulations, 2010 CFR

2010-01-01

... 15 Commerce and Foreign Trade 2 2010-01-01 2010-01-01 false Discovery. 785.8 Section 785.8... INDUSTRY AND SECURITY, DEPARTMENT OF COMMERCE ADDITIONAL PROTOCOL REGULATIONS ENFORCEMENT § 785.8 Discovery. (a) General. The parties are encouraged to engage in voluntary discovery regarding any matter, not...

37 CFR 2.120 - Discovery.

Code of Federal Regulations, 2010 CFR

2010-07-01

... 37 Patents, Trademarks, and Copyrights 1 2010-07-01 2010-07-01 false Discovery. 2.120 Section 2... COMMERCE RULES OF PRACTICE IN TRADEMARK CASES Procedure in Inter Partes Proceedings § 2.120 Discovery. (a... to disclosure and discovery shall apply in opposition, cancellation, interference and concurrent use...

15 CFR 280.210 - Discovery.

Code of Federal Regulations, 2010 CFR

2010-01-01

... 15 Commerce and Foreign Trade 1 2010-01-01 2010-01-01 false Discovery. 280.210 Section 280.210... STANDARDS AND TECHNOLOGY, DEPARTMENT OF COMMERCE ACCREDITATION AND ASSESSMENT PROGRAMS FASTENER QUALITY Enforcement § 280.210 Discovery. (a) General. The parties are encouraged to engage in voluntary discovery...

43 CFR 4.115 - Discovery-depositions.

Code of Federal Regulations, 2010 CFR

2010-10-01

... 43 Public Lands: Interior 1 2010-10-01 2010-10-01 false Discovery-depositions. 4.115 Section 4.115... Discovery—depositions. (a) General policy and protective orders. The parties are encouraged to engage in voluntary discovery procedures. In connection with any deposition or other discovery procedure, the board...

48 CFR 6302.18 - Discovery-depositions (Rule 18).

Code of Federal Regulations, 2011 CFR

2011-10-01

... 48 Federal Acquisition Regulations System 7 2011-10-01 2011-10-01 false Discovery-depositions... BOARD OF CONTRACT APPEALS RULES OF PROCEDURE 6302.18 Discovery-depositions (Rule 18). (a) General policy... connection with any deposition or other discovery procedure, the Board may make any order which justice...

48 CFR 6302.18 - Discovery-depositions (Rule 18).

Code of Federal Regulations, 2010 CFR

2010-10-01

... 48 Federal Acquisition Regulations System 7 2010-10-01 2010-10-01 false Discovery-depositions... BOARD OF CONTRACT APPEALS RULES OF PROCEDURE 6302.18 Discovery-depositions (Rule 18). (a) General policy... connection with any deposition or other discovery procedure, the Board may make any order which justice...

45 CFR 79.21 - Discovery.

Code of Federal Regulations, 2010 CFR

2010-10-01

... 45 Public Welfare 1 2010-10-01 2010-10-01 false Discovery. 79.21 Section 79.21 Public Welfare DEPARTMENT OF HEALTH AND HUMAN SERVICES GENERAL ADMINISTRATION PROGRAM FRAUD CIVIL REMEDIES § 79.21 Discovery. (a) The following types of discovery are authorized: (1) Requests for production of documents for...

46 CFR 550.502 - Discovery.

Code of Federal Regulations, 2011 CFR

2011-10-01

... 46 Shipping 9 2011-10-01 2011-10-01 false Discovery. 550.502 Section 550.502 Shipping FEDERAL... Proceedings § 550.502 Discovery. The Commission may authorize a party to a proceeding to use depositions, written interrogatories, and discovery procedures that, to the extent practicable, are in conformity with...

46 CFR 550.502 - Discovery.

Code of Federal Regulations, 2014 CFR

2014-10-01

... 46 Shipping 9 2014-10-01 2014-10-01 false Discovery. 550.502 Section 550.502 Shipping FEDERAL... Proceedings § 550.502 Discovery. The Commission may authorize a party to a proceeding to use depositions, written interrogatories, and discovery procedures that, to the extent practicable, are in conformity with...

29 CFR 2700.107 - Discovery.

Code of Federal Regulations, 2013 CFR

2013-07-01

... 29 Labor 9 2013-07-01 2013-07-01 false Discovery. 2700.107 Section 2700.107 Labor Regulations Relating to Labor (Continued) FEDERAL MINE SAFETY AND HEALTH REVIEW COMMISSION PROCEDURAL RULES Simplified Proceedings § 2700.107 Discovery. Discovery is not permitted except as ordered by the Administrative Law Judge. ...

29 CFR 2700.107 - Discovery.

Code of Federal Regulations, 2014 CFR

2014-07-01

... 29 Labor 9 2014-07-01 2014-07-01 false Discovery. 2700.107 Section 2700.107 Labor Regulations Relating to Labor (Continued) FEDERAL MINE SAFETY AND HEALTH REVIEW COMMISSION PROCEDURAL RULES Simplified Proceedings § 2700.107 Discovery. Discovery is not permitted except as ordered by the Administrative Law Judge. ...

22 CFR 35.21 - Discovery.

Code of Federal Regulations, 2014 CFR

2014-04-01

... 22 Foreign Relations 1 2014-04-01 2014-04-01 false Discovery. 35.21 Section 35.21 Foreign Relations DEPARTMENT OF STATE CLAIMS AND STOLEN PROPERTY PROGRAM FRAUD CIVIL REMEDIES § 35.21 Discovery. (a) The following types of discovery are authorized: (1) Requests for production of documents for...

10 CFR 1013.21 - Discovery.

Code of Federal Regulations, 2012 CFR

2012-01-01

... 10 Energy 4 2012-01-01 2012-01-01 false Discovery. 1013.21 Section 1013.21 Energy DEPARTMENT OF ENERGY (GENERAL PROVISIONS) PROGRAM FRAUD CIVIL REMEDIES AND PROCEDURES § 1013.21 Discovery. (a) The following types of discovery are authorized: (1) Requests for production of documents for inspection and...

45 CFR 79.21 - Discovery.

Code of Federal Regulations, 2014 CFR

2014-10-01

... 45 Public Welfare 1 2014-10-01 2014-10-01 false Discovery. 79.21 Section 79.21 Public Welfare Department of Health and Human Services GENERAL ADMINISTRATION PROGRAM FRAUD CIVIL REMEDIES § 79.21 Discovery. (a) The following types of discovery are authorized: (1) Requests for production of documents for...

45 CFR 96.65 - Discovery.

Code of Federal Regulations, 2011 CFR

2011-10-01

... 45 Public Welfare 1 2011-10-01 2011-10-01 false Discovery. 96.65 Section 96.65 Public Welfare DEPARTMENT OF HEALTH AND HUMAN SERVICES GENERAL ADMINISTRATION BLOCK GRANTS Hearing Procedure § 96.65 Discovery. The use of interrogatories, depositions, and other forms of discovery shall not be allowed. ...

28 CFR 71.21 - Discovery.

Code of Federal Regulations, 2011 CFR

2011-07-01

... 28 Judicial Administration 2 2011-07-01 2011-07-01 false Discovery. 71.21 Section 71.21 Judicial... REMEDIES ACT OF 1986 Implementation for Actions Initiated by the Department of Justice § 71.21 Discovery. (a) The following types of discovery are authorized: (1) Requests for production of documents for...

29 CFR 2700.107 - Discovery.

Code of Federal Regulations, 2011 CFR

2011-07-01

... 29 Labor 9 2011-07-01 2011-07-01 false Discovery. 2700.107 Section 2700.107 Labor Regulations Relating to Labor (Continued) FEDERAL MINE SAFETY AND HEALTH REVIEW COMMISSION PROCEDURAL RULES Simplified Proceedings § 2700.107 Discovery. Discovery is not permitted except as ordered by the Administrative Law Judge. ...

10 CFR 1013.21 - Discovery.

Code of Federal Regulations, 2013 CFR

2013-01-01

... 10 Energy 4 2013-01-01 2013-01-01 false Discovery. 1013.21 Section 1013.21 Energy DEPARTMENT OF ENERGY (GENERAL PROVISIONS) PROGRAM FRAUD CIVIL REMEDIES AND PROCEDURES § 1013.21 Discovery. (a) The following types of discovery are authorized: (1) Requests for production of documents for inspection and...

22 CFR 35.21 - Discovery.

Code of Federal Regulations, 2013 CFR

2013-04-01

... 22 Foreign Relations 1 2013-04-01 2013-04-01 false Discovery. 35.21 Section 35.21 Foreign Relations DEPARTMENT OF STATE CLAIMS AND STOLEN PROPERTY PROGRAM FRAUD CIVIL REMEDIES § 35.21 Discovery. (a) The following types of discovery are authorized: (1) Requests for production of documents for...

12 CFR 19.170 - Discovery depositions.

Code of Federal Regulations, 2012 CFR

2012-01-01

... 12 Banks and Banking 1 2012-01-01 2012-01-01 false Discovery depositions. 19.170 Section 19.170 Banks and Banking COMPTROLLER OF THE CURRENCY, DEPARTMENT OF THE TREASURY RULES OF PRACTICE AND PROCEDURE Discovery Depositions and Subpoenas § 19.170 Discovery depositions. (a) General rule. In any...

10 CFR 1013.21 - Discovery.

Code of Federal Regulations, 2011 CFR

2011-01-01

... 10 Energy 4 2011-01-01 2011-01-01 false Discovery. 1013.21 Section 1013.21 Energy DEPARTMENT OF ENERGY (GENERAL PROVISIONS) PROGRAM FRAUD CIVIL REMEDIES AND PROCEDURES § 1013.21 Discovery. (a) The following types of discovery are authorized: (1) Requests for production of documents for inspection and...

45 CFR 96.65 - Discovery.

Code of Federal Regulations, 2014 CFR

2014-10-01

... 45 Public Welfare 1 2014-10-01 2014-10-01 false Discovery. 96.65 Section 96.65 Public Welfare Department of Health and Human Services GENERAL ADMINISTRATION BLOCK GRANTS Hearing Procedure § 96.65 Discovery. The use of interrogatories, depositions, and other forms of discovery shall not be allowed. ...

45 CFR 99.23 - Discovery.

Code of Federal Regulations, 2014 CFR

2014-10-01

... 45 Public Welfare 1 2014-10-01 2014-10-01 false Discovery. 99.23 Section 99.23 Public Welfare... DEVELOPMENT FUND Hearing Procedures § 99.23 Discovery. The Department, the Lead Agency, and any individuals or groups recognized as parties shall have the right to conduct discovery (including depositions) against...

45 CFR 79.21 - Discovery.

Code of Federal Regulations, 2013 CFR

2013-10-01

... 45 Public Welfare 1 2013-10-01 2013-10-01 false Discovery. 79.21 Section 79.21 Public Welfare DEPARTMENT OF HEALTH AND HUMAN SERVICES GENERAL ADMINISTRATION PROGRAM FRAUD CIVIL REMEDIES § 79.21 Discovery. (a) The following types of discovery are authorized: (1) Requests for production of documents for...

37 CFR 42.51 - Discovery.

Code of Federal Regulations, 2014 CFR

2014-07-01

... 37 Patents, Trademarks, and Copyrights 1 2014-07-01 2014-07-01 false Discovery. 42.51 Section 42... Production § 42.51 Discovery. (a) Mandatory initial disclosures. (1) With agreement. Parties may agree to mandatory discovery requiring the initial disclosures set forth in the Office Patent Trial Practice Guide...

47 CFR 1.729 - Discovery.

Code of Federal Regulations, 2011 CFR

2011-10-01

... 47 Telecommunication 1 2011-10-01 2011-10-01 false Discovery. 1.729 Section 1.729..., and Reports Involving Common Carriers Formal Complaints § 1.729 Discovery. (a) Subject to paragraph (i... seek discovery of any non-privileged matter that is relevant to the material facts in dispute in the...

37 CFR 42.51 - Discovery.

Code of Federal Regulations, 2013 CFR

2013-07-01

... 37 Patents, Trademarks, and Copyrights 1 2013-07-01 2013-07-01 false Discovery. 42.51 Section 42... Production § 42.51 Discovery. (a) Mandatory initial disclosures. (1) With agreement. Parties may agree to mandatory discovery requiring the initial disclosures set forth in the Office Patent Trial Practice Guide...

45 CFR 96.65 - Discovery.

Code of Federal Regulations, 2013 CFR

2013-10-01

... 45 Public Welfare 1 2013-10-01 2013-10-01 false Discovery. 96.65 Section 96.65 Public Welfare DEPARTMENT OF HEALTH AND HUMAN SERVICES GENERAL ADMINISTRATION BLOCK GRANTS Hearing Procedure § 96.65 Discovery. The use of interrogatories, depositions, and other forms of discovery shall not be allowed. ...

28 CFR 71.21 - Discovery.

Code of Federal Regulations, 2012 CFR

2012-07-01

... 28 Judicial Administration 2 2012-07-01 2012-07-01 false Discovery. 71.21 Section 71.21 Judicial... REMEDIES ACT OF 1986 Implementation for Actions Initiated by the Department of Justice § 71.21 Discovery. (a) The following types of discovery are authorized: (1) Requests for production of documents for...

13 CFR 134.310 - Discovery.

Code of Federal Regulations, 2014 CFR

2014-01-01

... 13 Business Credit and Assistance 1 2014-01-01 2014-01-01 false Discovery. 134.310 Section 134.310 Business Credit and Assistance SMALL BUSINESS ADMINISTRATION RULES OF PROCEDURE GOVERNING CASES BEFORE THE... Designations § 134.310 Discovery. Discovery will not be permitted in appeals from size determinations or NAICS...

10 CFR 1013.21 - Discovery.

Code of Federal Regulations, 2014 CFR

2014-01-01

... 10 Energy 4 2014-01-01 2014-01-01 false Discovery. 1013.21 Section 1013.21 Energy DEPARTMENT OF ENERGY (GENERAL PROVISIONS) PROGRAM FRAUD CIVIL REMEDIES AND PROCEDURES § 1013.21 Discovery. (a) The following types of discovery are authorized: (1) Requests for production of documents for inspection and...

7 CFR 1.322 - Discovery.

Code of Federal Regulations, 2013 CFR

2013-01-01

... 7 Agriculture 1 2013-01-01 2013-01-01 false Discovery. 1.322 Section 1.322 Agriculture Office of... Under the Program Fraud Civil Remedies Act of 1986 § 1.322 Discovery. (a) The following types of discovery are authorized: (1) Requests for production, inspection and photocopying of documents; (2...

13 CFR 134.310 - Discovery.

Code of Federal Regulations, 2012 CFR

2012-01-01

... 13 Business Credit and Assistance 1 2012-01-01 2012-01-01 false Discovery. 134.310 Section 134.310 Business Credit and Assistance SMALL BUSINESS ADMINISTRATION RULES OF PROCEDURE GOVERNING CASES BEFORE THE... Designations § 134.310 Discovery. Discovery will not be permitted in appeals from size determinations or NAICS...

47 CFR 1.729 - Discovery.

Code of Federal Regulations, 2012 CFR

2012-10-01

... 47 Telecommunication 1 2012-10-01 2012-10-01 false Discovery. 1.729 Section 1.729..., and Reports Involving Common Carriers Formal Complaints § 1.729 Discovery. (a) Subject to paragraph (i... seek discovery of any non-privileged matter that is relevant to the material facts in dispute in the...

45 CFR 79.21 - Discovery.

Code of Federal Regulations, 2011 CFR

2011-10-01

... 45 Public Welfare 1 2011-10-01 2011-10-01 false Discovery. 79.21 Section 79.21 Public Welfare DEPARTMENT OF HEALTH AND HUMAN SERVICES GENERAL ADMINISTRATION PROGRAM FRAUD CIVIL REMEDIES § 79.21 Discovery. (a) The following types of discovery are authorized: (1) Requests for production of documents for...

7 CFR 1.322 - Discovery.

Code of Federal Regulations, 2014 CFR

2014-01-01

... 7 Agriculture 1 2014-01-01 2014-01-01 false Discovery. 1.322 Section 1.322 Agriculture Office of... Under the Program Fraud Civil Remedies Act of 1986 § 1.322 Discovery. (a) The following types of discovery are authorized: (1) Requests for production, inspection and photocopying of documents; (2...

47 CFR 1.729 - Discovery.

Code of Federal Regulations, 2013 CFR

2013-10-01

... 47 Telecommunication 1 2013-10-01 2013-10-01 false Discovery. 1.729 Section 1.729..., and Reports Involving Common Carriers Formal Complaints § 1.729 Discovery. (a) Subject to paragraph (i... seek discovery of any non-privileged matter that is relevant to the material facts in dispute in the...

45 CFR 79.21 - Discovery.

Code of Federal Regulations, 2012 CFR

2012-10-01

... 45 Public Welfare 1 2012-10-01 2012-10-01 false Discovery. 79.21 Section 79.21 Public Welfare DEPARTMENT OF HEALTH AND HUMAN SERVICES GENERAL ADMINISTRATION PROGRAM FRAUD CIVIL REMEDIES § 79.21 Discovery. (a) The following types of discovery are authorized: (1) Requests for production of documents for...

28 CFR 71.21 - Discovery.

Code of Federal Regulations, 2013 CFR

2013-07-01

... 28 Judicial Administration 2 2013-07-01 2013-07-01 false Discovery. 71.21 Section 71.21 Judicial... REMEDIES ACT OF 1986 Implementation for Actions Initiated by the Department of Justice § 71.21 Discovery. (a) The following types of discovery are authorized: (1) Requests for production of documents for...

7 CFR 1.322 - Discovery.

Code of Federal Regulations, 2011 CFR

2011-01-01

... 7 Agriculture 1 2011-01-01 2011-01-01 false Discovery. 1.322 Section 1.322 Agriculture Office of... Under the Program Fraud Civil Remedies Act of 1986 § 1.322 Discovery. (a) The following types of discovery are authorized: (1) Requests for production, inspection and photocopying of documents; (2...

22 CFR 35.21 - Discovery.

Code of Federal Regulations, 2011 CFR

2011-04-01

... 22 Foreign Relations 1 2011-04-01 2011-04-01 false Discovery. 35.21 Section 35.21 Foreign Relations DEPARTMENT OF STATE CLAIMS AND STOLEN PROPERTY PROGRAM FRAUD CIVIL REMEDIES § 35.21 Discovery. (a) The following types of discovery are authorized: (1) Requests for production of documents for...

45 CFR 96.65 - Discovery.

Code of Federal Regulations, 2012 CFR

2012-10-01

... 45 Public Welfare 1 2012-10-01 2012-10-01 false Discovery. 96.65 Section 96.65 Public Welfare DEPARTMENT OF HEALTH AND HUMAN SERVICES GENERAL ADMINISTRATION BLOCK GRANTS Hearing Procedure § 96.65 Discovery. The use of interrogatories, depositions, and other forms of discovery shall not be allowed. ...

46 CFR 550.502 - Discovery.

Code of Federal Regulations, 2012 CFR

2012-10-01

... 46 Shipping 9 2012-10-01 2012-10-01 false Discovery. 550.502 Section 550.502 Shipping FEDERAL... Proceedings § 550.502 Discovery. The Commission may authorize a party to a proceeding to use depositions, written interrogatories, and discovery procedures that, to the extent practicable, are in conformity with...

7 CFR 1.322 - Discovery.

Code of Federal Regulations, 2012 CFR

2012-01-01

... 7 Agriculture 1 2012-01-01 2012-01-01 false Discovery. 1.322 Section 1.322 Agriculture Office of... Under the Program Fraud Civil Remedies Act of 1986 § 1.322 Discovery. (a) The following types of discovery are authorized: (1) Requests for production, inspection and photocopying of documents; (2...

29 CFR 2700.107 - Discovery.

Code of Federal Regulations, 2012 CFR

2012-07-01

... 29 Labor 9 2012-07-01 2012-07-01 false Discovery. 2700.107 Section 2700.107 Labor Regulations Relating to Labor (Continued) FEDERAL MINE SAFETY AND HEALTH REVIEW COMMISSION PROCEDURAL RULES Simplified Proceedings § 2700.107 Discovery. Discovery is not permitted except as ordered by the Administrative Law Judge. ...

45 CFR 99.23 - Discovery.

Code of Federal Regulations, 2012 CFR

2012-10-01

... 45 Public Welfare 1 2012-10-01 2012-10-01 false Discovery. 99.23 Section 99.23 Public Welfare... DEVELOPMENT FUND Hearing Procedures § 99.23 Discovery. The Department, the Lead Agency, and any individuals or groups recognized as parties shall have the right to conduct discovery (including depositions) against...

13 CFR 134.310 - Discovery.

Code of Federal Regulations, 2013 CFR

2013-01-01

... 13 Business Credit and Assistance 1 2013-01-01 2013-01-01 false Discovery. 134.310 Section 134.310 Business Credit and Assistance SMALL BUSINESS ADMINISTRATION RULES OF PROCEDURE GOVERNING CASES BEFORE THE... Designations § 134.310 Discovery. Discovery will not be permitted in appeals from size determinations or NAICS...

45 CFR 99.23 - Discovery.

Code of Federal Regulations, 2011 CFR

2011-10-01

... 45 Public Welfare 1 2011-10-01 2011-10-01 false Discovery. 99.23 Section 99.23 Public Welfare... DEVELOPMENT FUND Hearing Procedures § 99.23 Discovery. The Department, the Lead Agency, and any individuals or groups recognized as parties shall have the right to conduct discovery (including depositions) against...

13 CFR 134.310 - Discovery.

Code of Federal Regulations, 2011 CFR

2011-01-01

... 13 Business Credit and Assistance 1 2011-01-01 2011-01-01 false Discovery. 134.310 Section 134.310 Business Credit and Assistance SMALL BUSINESS ADMINISTRATION RULES OF PROCEDURE GOVERNING CASES BEFORE THE... Designations § 134.310 Discovery. Discovery will not be permitted in appeals from size determinations or NAICS...

28 CFR 71.21 - Discovery.

Code of Federal Regulations, 2014 CFR

2014-07-01

... 28 Judicial Administration 2 2014-07-01 2014-07-01 false Discovery. 71.21 Section 71.21 Judicial... REMEDIES ACT OF 1986 Implementation for Actions Initiated by the Department of Justice § 71.21 Discovery. (a) The following types of discovery are authorized: (1) Requests for production of documents for...

47 CFR 1.729 - Discovery.

Code of Federal Regulations, 2014 CFR

2014-10-01

... 47 Telecommunication 1 2014-10-01 2014-10-01 false Discovery. 1.729 Section 1.729..., and Reports Involving Common Carriers Formal Complaints § 1.729 Discovery. (a) Subject to paragraph (i... seek discovery of any non-privileged matter that is relevant to the material facts in dispute in the...

22 CFR 35.21 - Discovery.

Code of Federal Regulations, 2012 CFR

2012-04-01

... 22 Foreign Relations 1 2012-04-01 2012-04-01 false Discovery. 35.21 Section 35.21 Foreign Relations DEPARTMENT OF STATE CLAIMS AND STOLEN PROPERTY PROGRAM FRAUD CIVIL REMEDIES § 35.21 Discovery. (a) The following types of discovery are authorized: (1) Requests for production of documents for...

46 CFR 550.502 - Discovery.

Code of Federal Regulations, 2013 CFR

2013-10-01

... 46 Shipping 9 2013-10-01 2013-10-01 false Discovery. 550.502 Section 550.502 Shipping FEDERAL... Proceedings § 550.502 Discovery. The Commission may authorize a party to a proceeding to use depositions, written interrogatories, and discovery procedures that, to the extent practicable, are in conformity with...

45 CFR 99.23 - Discovery.

Code of Federal Regulations, 2013 CFR

2013-10-01

... 45 Public Welfare 1 2013-10-01 2013-10-01 false Discovery. 99.23 Section 99.23 Public Welfare... DEVELOPMENT FUND Hearing Procedures § 99.23 Discovery. The Department, the Lead Agency, and any individuals or groups recognized as parties shall have the right to conduct discovery (including depositions) against...

45 CFR 96.65 - Discovery.

Code of Federal Regulations, 2010 CFR

2010-10-01

... 45 Public Welfare 1 2010-10-01 2010-10-01 false Discovery. 96.65 Section 96.65 Public Welfare DEPARTMENT OF HEALTH AND HUMAN SERVICES GENERAL ADMINISTRATION BLOCK GRANTS Hearing Procedure § 96.65 Discovery. The use of interrogatories, depositions, and other forms of discovery shall not be allowed. ...

46 CFR 550.502 - Discovery.

Code of Federal Regulations, 2010 CFR

2010-10-01

... 46 Shipping 9 2010-10-01 2010-10-01 false Discovery. 550.502 Section 550.502 Shipping FEDERAL... Proceedings § 550.502 Discovery. The Commission may authorize a party to a proceeding to use depositions, written interrogatories, and discovery procedures that, to the extent practicable, are in conformity with...

22 CFR 35.21 - Discovery.

Code of Federal Regulations, 2010 CFR

2010-04-01

... 22 Foreign Relations 1 2010-04-01 2010-04-01 false Discovery. 35.21 Section 35.21 Foreign Relations DEPARTMENT OF STATE CLAIMS AND STOLEN PROPERTY PROGRAM FRAUD CIVIL REMEDIES § 35.21 Discovery. (a) The following types of discovery are authorized: (1) Requests for production of documents for...

10 CFR 1013.21 - Discovery.

Code of Federal Regulations, 2010 CFR

2010-01-01

... 10 Energy 4 2010-01-01 2010-01-01 false Discovery. 1013.21 Section 1013.21 Energy DEPARTMENT OF ENERGY (GENERAL PROVISIONS) PROGRAM FRAUD CIVIL REMEDIES AND PROCEDURES § 1013.21 Discovery. (a) The following types of discovery are authorized: (1) Requests for production of documents for inspection and...

7 CFR 1.322 - Discovery.

Code of Federal Regulations, 2010 CFR

2010-01-01

... 7 Agriculture 1 2010-01-01 2010-01-01 false Discovery. 1.322 Section 1.322 Agriculture Office of... Under the Program Fraud Civil Remedies Act of 1986 § 1.322 Discovery. (a) The following types of discovery are authorized: (1) Requests for production, inspection and photocopying of documents; (2...

45 CFR 99.23 - Discovery.

Code of Federal Regulations, 2010 CFR

2010-10-01

... 45 Public Welfare 1 2010-10-01 2010-10-01 false Discovery. 99.23 Section 99.23 Public Welfare... DEVELOPMENT FUND Hearing Procedures § 99.23 Discovery. The Department, the Lead Agency, and any individuals or groups recognized as parties shall have the right to conduct discovery (including depositions) against...

28 CFR 71.21 - Discovery.

Code of Federal Regulations, 2010 CFR

2010-07-01

... 28 Judicial Administration 2 2010-07-01 2010-07-01 false Discovery. 71.21 Section 71.21 Judicial... REMEDIES ACT OF 1986 Implementation for Actions Initiated by the Department of Justice § 71.21 Discovery. (a) The following types of discovery are authorized: (1) Requests for production of documents for...

13 CFR 134.310 - Discovery.

Code of Federal Regulations, 2010 CFR

2010-01-01

... 13 Business Credit and Assistance 1 2010-01-01 2010-01-01 false Discovery. 134.310 Section 134.310 Business Credit and Assistance SMALL BUSINESS ADMINISTRATION RULES OF PROCEDURE GOVERNING CASES BEFORE THE... Designations § 134.310 Discovery. Discovery will not be permitted in appeals from size determinations or NAICS...

Improved False Discovery Rate Estimation Procedure for Shotgun Proteomics.

PubMed

Keich, Uri; Kertesz-Farkas, Attila; Noble, William Stafford

2015-08-07

Interpreting the potentially vast number of hypotheses generated by a shotgun proteomics experiment requires a valid and accurate procedure for assigning statistical confidence estimates to identified tandem mass spectra. Despite the crucial role such procedures play in most high-throughput proteomics experiments, the scientific literature has not reached a consensus about the best confidence estimation methodology. In this work, we evaluate, using theoretical and empirical analysis, four previously proposed protocols for estimating the false discovery rate (FDR) associated with a set of identified tandem mass spectra: two variants of the target-decoy competition protocol (TDC) of Elias and Gygi and two variants of the separate target-decoy search protocol of Käll et al. Our analysis reveals significant biases in the two separate target-decoy search protocols. Moreover, the one TDC protocol that provides an unbiased FDR estimate among the target PSMs does so at the cost of forfeiting a random subset of high-scoring spectrum identifications. We therefore propose the mix-max procedure to provide unbiased, accurate FDR estimates in the presence of well-calibrated scores. The method avoids biases associated with the two separate target-decoy search protocols and also avoids the propensity for target-decoy competition to discard a random subset of high-scoring target identifications.

Improving sensitivity in proteome studies by analysis of false discovery rates for multiple search engines.

PubMed

Jones, Andrew R; Siepen, Jennifer A; Hubbard, Simon J; Paton, Norman W

2009-03-01

LC-MS experiments can generate large quantities of data, for which a variety of database search engines are available to make peptide and protein identifications. Decoy databases are becoming widely used to place statistical confidence in result sets, allowing the false discovery rate (FDR) to be estimated. Different search engines produce different identification sets so employing more than one search engine could result in an increased number of peptides (and proteins) being identified, if an appropriate mechanism for combining data can be defined. We have developed a search engine independent score, based on FDR, which allows peptide identifications from different search engines to be combined, called the FDR Score. The results demonstrate that the observed FDR is significantly different when analysing the set of identifications made by all three search engines, by each pair of search engines or by a single search engine. Our algorithm assigns identifications to groups according to the set of search engines that have made the identification, and re-assigns the score (combined FDR Score). The combined FDR Score can differentiate between correct and incorrect peptide identifications with high accuracy, allowing on average 35% more peptide identifications to be made at a fixed FDR than using a single search engine.

SPIRE: Systematic protein investigative research environment.

PubMed

Kolker, Eugene; Higdon, Roger; Morgan, Phil; Sedensky, Margaret; Welch, Dean; Bauman, Andrew; Stewart, Elizabeth; Haynes, Winston; Broomall, William; Kolker, Natali

2011-12-10

The SPIRE (Systematic Protein Investigative Research Environment) provides web-based experiment-specific mass spectrometry (MS) proteomics analysis (https://www.proteinspire.org). Its emphasis is on usability and integration of the best analytic tools. SPIRE provides an easy to use web-interface and generates results in both interactive and simple data formats. In contrast to run-based approaches, SPIRE conducts the analysis based on the experimental design. It employs novel methods to generate false discovery rates and local false discovery rates (FDR, LFDR) and integrates the best and complementary open-source search and data analysis methods. The SPIRE approach of integrating X!Tandem, OMSSA and SpectraST can produce an increase in protein IDs (52-88%) over current combinations of scoring and single search engines while also providing accurate multi-faceted error estimation. One of SPIRE's primary assets is combining the results with data on protein function, pathways and protein expression from model organisms. We demonstrate some of SPIRE's capabilities by analyzing mitochondrial proteins from the wild type and 3 mutants of C. elegans. SPIRE also connects results to publically available proteomics data through its Model Organism Protein Expression Database (MOPED). SPIRE can also provide analysis and annotation for user supplied protein ID and expression data. Copyright © 2011. Published by Elsevier B.V.

Improved False Discovery Rate Estimation Procedure for Shotgun Proteomics

PubMed Central

2016-01-01

Interpreting the potentially vast number of hypotheses generated by a shotgun proteomics experiment requires a valid and accurate procedure for assigning statistical confidence estimates to identified tandem mass spectra. Despite the crucial role such procedures play in most high-throughput proteomics experiments, the scientific literature has not reached a consensus about the best confidence estimation methodology. In this work, we evaluate, using theoretical and empirical analysis, four previously proposed protocols for estimating the false discovery rate (FDR) associated with a set of identified tandem mass spectra: two variants of the target-decoy competition protocol (TDC) of Elias and Gygi and two variants of the separate target-decoy search protocol of Käll et al. Our analysis reveals significant biases in the two separate target-decoy search protocols. Moreover, the one TDC protocol that provides an unbiased FDR estimate among the target PSMs does so at the cost of forfeiting a random subset of high-scoring spectrum identifications. We therefore propose the mix-max procedure to provide unbiased, accurate FDR estimates in the presence of well-calibrated scores. The method avoids biases associated with the two separate target-decoy search protocols and also avoids the propensity for target-decoy competition to discard a random subset of high-scoring target identifications. PMID:26152888

How to talk about protein-level false discovery rates in shotgun proteomics.

PubMed

The, Matthew; Tasnim, Ayesha; Käll, Lukas

2016-09-01

A frequently sought output from a shotgun proteomics experiment is a list of proteins that we believe to have been present in the analyzed sample before proteolytic digestion. The standard technique to control for errors in such lists is to enforce a preset threshold for the false discovery rate (FDR). Many consider protein-level FDRs a difficult and vague concept, as the measurement entities, spectra, are manifestations of peptides and not proteins. Here, we argue that this confusion is unnecessary and provide a framework on how to think about protein-level FDRs, starting from its basic principle: the null hypothesis. Specifically, we point out that two competing null hypotheses are used concurrently in today's protein inference methods, which has gone unnoticed by many. Using simulations of a shotgun proteomics experiment, we show how confusing one null hypothesis for the other can lead to serious discrepancies in the FDR. Furthermore, we demonstrate how the same simulations can be used to verify FDR estimates of protein inference methods. In particular, we show that, for a simple protein inference method, decoy models can be used to accurately estimate protein-level FDRs for both competing null hypotheses. © 2016 The Authors. Proteomics Published by Wiley-VCH Verlag GmbH & Co. KGaA, Weinheim.

Developments in SPR Fragment Screening.

PubMed

Chavanieu, Alain; Pugnière, Martine

2016-01-01

Fragment-based approaches have played an increasing role alongside high-throughput screening in drug discovery for 15 years. The label-free biosensor technology based on surface plasmon resonance (SPR) is now sensitive and informative enough to serve during primary screens and validation steps. In this review, the authors discuss the role of SPR in fragment screening. After a brief description of the underlying principles of the technique and main device developments, they evaluate the advantages and adaptations of SPR for fragment-based drug discovery. SPR can also be applied to challenging targets such as membrane receptors and enzymes. The high-level of immobilization of the protein target and its stability are key points for a relevant screening that can be optimized using oriented immobilized proteins and regenerable sensors. Furthermore, to decrease the rate of false negatives, a selectivity test may be performed in parallel on the main target bearing the binding site mutated or blocked with a low-off-rate ligand. Fragment-based drug design, integrated in a rational workflow led by SPR, will thus have a predominant role for the next wave of drug discovery which could be greatly enhanced by new improvements in SPR devices.

29 CFR 18.13 - Discovery methods.

Code of Federal Regulations, 2013 CFR

2013-07-01

... 29 Labor 1 2013-07-01 2013-07-01 false Discovery methods. 18.13 Section 18.13 Labor Office of the... ADMINISTRATIVE LAW JUDGES General § 18.13 Discovery methods. Parties may obtain discovery by one or more of the following methods: Depositions upon oral examination or written questions; written interrogatories...

29 CFR 18.13 - Discovery methods.

Code of Federal Regulations, 2011 CFR

2011-07-01

... 29 Labor 1 2011-07-01 2011-07-01 false Discovery methods. 18.13 Section 18.13 Labor Office of the... ADMINISTRATIVE LAW JUDGES General § 18.13 Discovery methods. Parties may obtain discovery by one or more of the following methods: Depositions upon oral examination or written questions; written interrogatories...

29 CFR 18.13 - Discovery methods.

Code of Federal Regulations, 2012 CFR

2012-07-01

... 29 Labor 1 2012-07-01 2012-07-01 false Discovery methods. 18.13 Section 18.13 Labor Office of the... ADMINISTRATIVE LAW JUDGES General § 18.13 Discovery methods. Parties may obtain discovery by one or more of the following methods: Depositions upon oral examination or written questions; written interrogatories...

12 CFR 263.53 - Discovery depositions.

Code of Federal Regulations, 2011 CFR

2011-01-01

... 12 Banks and Banking 3 2011-01-01 2011-01-01 false Discovery depositions. 263.53 Section 263.53... depositions. (a) In general. In addition to the discovery permitted in subpart A of this part, limited discovery by means of depositions shall be allowed for individuals with knowledge of facts material to the...

12 CFR 19.170 - Discovery depositions.

Code of Federal Regulations, 2010 CFR

2010-01-01

... 12 Banks and Banking 1 2010-01-01 2010-01-01 false Discovery depositions. 19.170 Section 19.170... PROCEDURE Discovery Depositions and Subpoenas § 19.170 Discovery depositions. (a) General rule. In any... deposition of an expert, or of a person, including another party, who has direct knowledge of matters that...

12 CFR 19.170 - Discovery depositions.

Code of Federal Regulations, 2011 CFR

2011-01-01

... 12 Banks and Banking 1 2011-01-01 2011-01-01 false Discovery depositions. 19.170 Section 19.170... PROCEDURE Discovery Depositions and Subpoenas § 19.170 Discovery depositions. (a) General rule. In any... deposition of an expert, or of a person, including another party, who has direct knowledge of matters that...

12 CFR 263.53 - Discovery depositions.

Code of Federal Regulations, 2010 CFR

2010-01-01

... 12 Banks and Banking 3 2010-01-01 2010-01-01 false Discovery depositions. 263.53 Section 263.53... depositions. (a) In general. In addition to the discovery permitted in subpart A of this part, limited discovery by means of depositions shall be allowed for individuals with knowledge of facts material to the...

42 CFR 405.1821 - Prehearing discovery and other proceedings prior to the intermediary hearing.

Code of Federal Regulations, 2010 CFR

2010-10-01

... 42 Public Health 2 2010-10-01 2010-10-01 false Prehearing discovery and other proceedings prior to... AND DISABLED Provider Reimbursement Determinations and Appeals § 405.1821 Prehearing discovery and other proceedings prior to the intermediary hearing. (a) Discovery rule: Time limits. (1) Limited...

45 CFR 1386.103 - Discovery.

Code of Federal Regulations, 2014 CFR

2014-10-01

... 45 Public Welfare 4 2014-10-01 2014-10-01 false Discovery. 1386.103 Section 1386.103 Public... Hearing Procedures § 1386.103 Discovery. The Department and any party named in the Notice issued pursuant to § 1386.90 has the right to conduct discovery (including depositions) against opposing parties as...

34 CFR 33.21 - Discovery.

Code of Federal Regulations, 2013 CFR

2013-07-01

... 34 Education 1 2013-07-01 2013-07-01 false Discovery. 33.21 Section 33.21 Education Office of the Secretary, Department of Education PROGRAM FRAUD CIVIL REMEDIES ACT § 33.21 Discovery. (a) The following types of discovery are authorized: (1) Requests for production of documents for inspection and copying...

34 CFR 33.21 - Discovery.

Code of Federal Regulations, 2012 CFR

2012-07-01

... 34 Education 1 2012-07-01 2012-07-01 false Discovery. 33.21 Section 33.21 Education Office of the Secretary, Department of Education PROGRAM FRAUD CIVIL REMEDIES ACT § 33.21 Discovery. (a) The following types of discovery are authorized: (1) Requests for production of documents for inspection and copying...

42 CFR 405.1037 - Discovery.

Code of Federal Regulations, 2012 CFR

2012-10-01

... 42 Public Health 2 2012-10-01 2012-10-01 false Discovery. 405.1037 Section 405.1037 Public Health... Appeals Under Original Medicare (Part A and Part B) Alj Hearings § 405.1037 Discovery. (a) General rules. (1) Discovery is permissible only when CMS or its contractor elects to participate in an ALJ hearing...

29 CFR 1905.25 - Discovery.

Code of Federal Regulations, 2012 CFR

2012-07-01

... 29 Labor 5 2012-07-01 2012-07-01 false Discovery. 1905.25 Section 1905.25 Labor Regulations... OCCUPATIONAL SAFETY AND HEALTH ACT OF 1970 Hearings § 1905.25 Discovery. (a) Depositions. (1) For reasons of... discovery. Whenever appropriate to a just disposition of any issue in a hearing, the presiding hearing...

34 CFR 81.16 - Discovery.

Code of Federal Regulations, 2014 CFR

2014-07-01

... 34 Education 1 2014-07-01 2014-07-01 false Discovery. 81.16 Section 81.16 Education Office of the... Discovery. (a) The parties to a case are encouraged to exchange relevant documents and information voluntarily. (b) The ALJ, at a party's request, may order compulsory discovery described in paragraph (c) of...

29 CFR 22.21 - Discovery.

Code of Federal Regulations, 2012 CFR

2012-07-01

... 29 Labor 1 2012-07-01 2012-07-01 false Discovery. 22.21 Section 22.21 Labor Office of the Secretary of Labor PROGRAM FRAUD CIVIL REMEDIES ACT OF 1986 § 22.21 Discovery. (a) The following types of discovery are authorized: (1) Requests for production of documents for inspection and copying; (2) Requests...

34 CFR 33.21 - Discovery.

Code of Federal Regulations, 2014 CFR

2014-07-01

... 34 Education 1 2014-07-01 2014-07-01 false Discovery. 33.21 Section 33.21 Education Office of the Secretary, Department of Education PROGRAM FRAUD CIVIL REMEDIES ACT § 33.21 Discovery. (a) The following types of discovery are authorized: (1) Requests for production of documents for inspection and copying...

6 CFR 13.21 - Discovery.

Code of Federal Regulations, 2014 CFR

2014-01-01

... 6 Domestic Security 1 2014-01-01 2014-01-01 false Discovery. 13.21 Section 13.21 Domestic Security DEPARTMENT OF HOMELAND SECURITY, OFFICE OF THE SECRETARY PROGRAM FRAUD CIVIL REMEDIES § 13.21 Discovery. (a) In general. (1) The following types of discovery are authorized: (i) Requests for production of...

28 CFR 18.7 - Discovery.

Code of Federal Regulations, 2014 CFR

2014-07-01

... 28 Judicial Administration 1 2014-07-01 2014-07-01 false Discovery. 18.7 Section 18.7 Judicial Administration DEPARTMENT OF JUSTICE OFFICE OF JUSTICE PROGRAMS HEARING AND APPEAL PROCEDURES § 18.7 Discovery.... Such order may be entered upon a showing that the deposition is necessary for discovery purposes, and...

28 CFR 18.7 - Discovery.

Code of Federal Regulations, 2012 CFR

2012-07-01

... 28 Judicial Administration 1 2012-07-01 2012-07-01 false Discovery. 18.7 Section 18.7 Judicial Administration DEPARTMENT OF JUSTICE OFFICE OF JUSTICE PROGRAMS HEARING AND APPEAL PROCEDURES § 18.7 Discovery.... Such order may be entered upon a showing that the deposition is necessary for discovery purposes, and...

6 CFR 13.21 - Discovery.

Code of Federal Regulations, 2011 CFR

2011-01-01

... 6 Domestic Security 1 2011-01-01 2011-01-01 false Discovery. 13.21 Section 13.21 Domestic Security DEPARTMENT OF HOMELAND SECURITY, OFFICE OF THE SECRETARY PROGRAM FRAUD CIVIL REMEDIES § 13.21 Discovery. (a) In general. (1) The following types of discovery are authorized: (i) Requests for production of...

7 CFR 283.12 - Discovery.

Code of Federal Regulations, 2011 CFR

2011-01-01

... 7 Agriculture 4 2011-01-01 2011-01-01 false Discovery. 283.12 Section 283.12 Agriculture... of $50,000 or More § 283.12 Discovery. (a) Dispositions—(1) Motion for taking deposition. Only upon a... exist if the information sought appears reasonably calculated to lead to the discovery of admissible...

29 CFR 1905.25 - Discovery.

Code of Federal Regulations, 2014 CFR

2014-07-01

... 29 Labor 5 2014-07-01 2014-07-01 false Discovery. 1905.25 Section 1905.25 Labor Regulations... OCCUPATIONAL SAFETY AND HEALTH ACT OF 1970 Hearings § 1905.25 Discovery. (a) Depositions. (1) For reasons of... discovery. Whenever appropriate to a just disposition of any issue in a hearing, the presiding hearing...

20 CFR 355.21 - Discovery.

Code of Federal Regulations, 2011 CFR

2011-04-01

... 20 Employees' Benefits 1 2011-04-01 2011-04-01 false Discovery. 355.21 Section 355.21 Employees... UNDER THE PROGRAM FRAUD CIVIL REMEDIES ACT OF 1986 § 355.21 Discovery. (a) The following types of discovery are authorized: (1) Requests for production of documents for inspection and copying; (2) Requests...

42 CFR 430.86 - Discovery.

Code of Federal Regulations, 2013 CFR

2013-10-01

... 42 Public Health 4 2013-10-01 2013-10-01 false Discovery. 430.86 Section 430.86 Public Health... Plans and Practice to Federal Requirements § 430.86 Discovery. CMS and any party named in the notice issued under § 430.70 has the right to conduct discovery (including depositions) against opposing parties...

41 CFR 105-70.021 - Discovery.

Code of Federal Regulations, 2013 CFR

2013-07-01

... 41 Public Contracts and Property Management 3 2013-07-01 2013-07-01 false Discovery. 105-70.021...-IMPLEMENTATION OF THE PROGRAM FRAUD CIVIL REMEDIES ACT OF 1986 § 105-70.021 Discovery. (a) The following types of discovery are authorized: (1) Requests for production of documents for inspection and copying; (2) Requests...

10 CFR 590.305 - Informal discovery.

Code of Federal Regulations, 2012 CFR

2012-01-01

... 10 Energy 4 2012-01-01 2012-01-01 false Informal discovery. 590.305 Section 590.305 Energy... WITH RESPECT TO THE IMPORT AND EXPORT OF NATURAL GAS Procedures § 590.305 Informal discovery. The parties to a proceeding may conduct discovery through use of procedures such as written interrogatories or...

45 CFR 156.935 - Discovery.

Code of Federal Regulations, 2014 CFR

2014-10-01

... 45 Public Welfare 1 2014-10-01 2014-10-01 false Discovery. 156.935 Section 156.935 Public Welfare... QHP Issuer Sanctions in Federally-Facilitated Exchanges § 156.935 Discovery. (a) The parties must identify any need for discovery from the opposing party as soon as possible, but no later than the time for...

47 CFR 14.47 - Discovery.

Code of Federal Regulations, 2014 CFR

2014-10-01

... 47 Telecommunication 1 2014-10-01 2014-10-01 false Discovery. 14.47 Section 14.47... Discovery. (a) A complainant may file with the Commission and serve on a defendant, concurrently with its... to this procedure may be used to seek discovery of any non-privileged matter that is relevant to the...

45 CFR 150.435 - Discovery.

Code of Federal Regulations, 2014 CFR

2014-10-01

... 45 Public Welfare 1 2014-10-01 2014-10-01 false Discovery. 150.435 Section 150.435 Public Welfare... AND INDIVIDUAL INSURANCE MARKETS Administrative Hearings § 150.435 Discovery. (a) The parties must identify any need for discovery from the opposing party as soon as possible, but no later than the time for...

45 CFR 1386.103 - Discovery.

Code of Federal Regulations, 2012 CFR

2012-10-01

... 45 Public Welfare 4 2012-10-01 2012-10-01 false Discovery. 1386.103 Section 1386.103 Public... Hearing Procedures § 1386.103 Discovery. The Department and any party named in the Notice issued pursuant to § 1386.90 has the right to conduct discovery (including depositions) against opposing parties as...

42 CFR 405.1037 - Discovery.

Code of Federal Regulations, 2014 CFR

2014-10-01

... 42 Public Health 2 2014-10-01 2014-10-01 false Discovery. 405.1037 Section 405.1037 Public Health... Appeals Under Original Medicare (Part A and Part B) Alj Hearings § 405.1037 Discovery. (a) General rules. (1) Discovery is permissible only when CMS or its contractor elects to participate in an ALJ hearing...

12 CFR 308.520 - Discovery.

Code of Federal Regulations, 2013 CFR

2013-01-01

... 12 Banks and Banking 5 2013-01-01 2013-01-01 false Discovery. 308.520 Section 308.520 Banks and... PROCEDURE Program Fraud Civil Remedies and Procedures § 308.520 Discovery. (a) The following types of discovery are authorized: (1) Requests for production of documents for inspection and copying; (2) Requests...

42 CFR 405.1037 - Discovery.

Code of Federal Regulations, 2011 CFR

2011-10-01

... 42 Public Health 2 2011-10-01 2011-10-01 false Discovery. 405.1037 Section 405.1037 Public Health... Appeals Under Original Medicare (Part A and Part B) Alj Hearings § 405.1037 Discovery. (a) General rules. (1) Discovery is permissible only when CMS or its contractor elects to participate in an ALJ hearing...

29 CFR 1905.25 - Discovery.

Code of Federal Regulations, 2011 CFR

2011-07-01

... 29 Labor 5 2011-07-01 2011-07-01 false Discovery. 1905.25 Section 1905.25 Labor Regulations... OCCUPATIONAL SAFETY AND HEALTH ACT OF 1970 Hearings § 1905.25 Discovery. (a) Depositions. (1) For reasons of... discovery. Whenever appropriate to a just disposition of any issue in a hearing, the presiding hearing...

28 CFR 18.7 - Discovery.

Code of Federal Regulations, 2013 CFR

2013-07-01

... 28 Judicial Administration 1 2013-07-01 2013-07-01 false Discovery. 18.7 Section 18.7 Judicial Administration DEPARTMENT OF JUSTICE OFFICE OF JUSTICE PROGRAMS HEARING AND APPEAL PROCEDURES § 18.7 Discovery.... Such order may be entered upon a showing that the deposition is necessary for discovery purposes, and...

41 CFR 60-30.33 - Discovery.

Code of Federal Regulations, 2013 CFR

2013-07-01

... 41 Public Contracts and Property Management 1 2013-07-01 2013-07-01 false Discovery. 60-30.33... 11246 Expedited Hearing Procedures § 60-30.33 Discovery. (a) Any party may serve requests for admissions... with § 60-30.8, the Administrative Law Judge may allow the taking of depositions. Other discovery will...

42 CFR 430.86 - Discovery.

Code of Federal Regulations, 2011 CFR

2011-10-01

... 42 Public Health 4 2011-10-01 2011-10-01 false Discovery. 430.86 Section 430.86 Public Health... Plans and Practice to Federal Requirements § 430.86 Discovery. CMS and any party named in the notice issued under § 430.70 has the right to conduct discovery (including depositions) against opposing parties...

12 CFR 308.520 - Discovery.

Code of Federal Regulations, 2012 CFR

2012-01-01

... 12 Banks and Banking 5 2012-01-01 2012-01-01 false Discovery. 308.520 Section 308.520 Banks and... PROCEDURE Program Fraud Civil Remedies and Procedures § 308.520 Discovery. (a) The following types of discovery are authorized: (1) Requests for production of documents for inspection and copying; (2) Requests...

6 CFR 13.21 - Discovery.

Code of Federal Regulations, 2012 CFR

2012-01-01

... 6 Domestic Security 1 2012-01-01 2012-01-01 false Discovery. 13.21 Section 13.21 Domestic Security DEPARTMENT OF HOMELAND SECURITY, OFFICE OF THE SECRETARY PROGRAM FRAUD CIVIL REMEDIES § 13.21 Discovery. (a) In general. (1) The following types of discovery are authorized: (i) Requests for production of...

10 CFR 2.336 - General discovery.

Code of Federal Regulations, 2011 CFR

2011-01-01

... 10 Energy 1 2011-01-01 2011-01-01 false General discovery. 2.336 Section 2.336 Energy NUCLEAR... Hearings § 2.336 General discovery. (a) Except for proceedings conducted under subparts G and J of this... discovery provisions in subpart G of this part against the offending party, for the offending party's...

29 CFR 22.21 - Discovery.

Code of Federal Regulations, 2013 CFR

2013-07-01

... 29 Labor 1 2013-07-01 2013-07-01 false Discovery. 22.21 Section 22.21 Labor Office of the Secretary of Labor PROGRAM FRAUD CIVIL REMEDIES ACT OF 1986 § 22.21 Discovery. (a) The following types of discovery are authorized: (1) Requests for production of documents for inspection and copying; (2) Requests...

45 CFR 150.435 - Discovery.

Code of Federal Regulations, 2013 CFR

2013-10-01

... 45 Public Welfare 1 2013-10-01 2013-10-01 false Discovery. 150.435 Section 150.435 Public Welfare... AND INDIVIDUAL INSURANCE MARKETS Administrative Hearings § 150.435 Discovery. (a) The parties must identify any need for discovery from the opposing party as soon as possible, but no later than the time for...

7 CFR 283.12 - Discovery.

Code of Federal Regulations, 2012 CFR

2012-01-01

... 7 Agriculture 4 2012-01-01 2012-01-01 false Discovery. 283.12 Section 283.12 Agriculture... of $50,000 or More § 283.12 Discovery. (a) Dispositions—(1) Motion for taking deposition. Only upon a... exist if the information sought appears reasonably calculated to lead to the discovery of admissible...

7 CFR 283.12 - Discovery.

Code of Federal Regulations, 2013 CFR

2013-01-01

... 7 Agriculture 4 2013-01-01 2013-01-01 false Discovery. 283.12 Section 283.12 Agriculture... of $50,000 or More § 283.12 Discovery. (a) Dispositions—(1) Motion for taking deposition. Only upon a... exist if the information sought appears reasonably calculated to lead to the discovery of admissible...

10 CFR 2.336 - General discovery.

Code of Federal Regulations, 2014 CFR

2014-01-01

... 10 Energy 1 2014-01-01 2014-01-01 false General discovery. 2.336 Section 2.336 Energy NUCLEAR... Officer Powers, and General Hearing Management for NRC Adjudicatory Hearings § 2.336 General discovery. (a... proposed action, or the use of the discovery provisions in subpart G of this part against the offending...

45 CFR 1386.103 - Discovery.

Code of Federal Regulations, 2013 CFR

2013-10-01

... 45 Public Welfare 4 2013-10-01 2013-10-01 false Discovery. 1386.103 Section 1386.103 Public... Hearing Procedures § 1386.103 Discovery. The Department and any party named in the Notice issued pursuant to § 1386.90 has the right to conduct discovery (including depositions) against opposing parties as...

34 CFR 33.21 - Discovery.

Code of Federal Regulations, 2011 CFR

2011-07-01

... 34 Education 1 2011-07-01 2011-07-01 false Discovery. 33.21 Section 33.21 Education Office of the Secretary, Department of Education PROGRAM FRAUD CIVIL REMEDIES ACT § 33.21 Discovery. (a) The following types of discovery are authorized: (1) Requests for production of documents for inspection and copying...

41 CFR 60-30.33 - Discovery.

Code of Federal Regulations, 2014 CFR

2014-07-01

... 41 Public Contracts and Property Management 1 2014-07-01 2014-07-01 false Discovery. 60-30.33... 11246 Expedited Hearing Procedures § 60-30.33 Discovery. (a) Any party may serve requests for admissions... with § 60-30.8, the Administrative Law Judge may allow the taking of depositions. Other discovery will...

28 CFR 18.7 - Discovery.

Code of Federal Regulations, 2011 CFR

2011-07-01

... 28 Judicial Administration 1 2011-07-01 2011-07-01 false Discovery. 18.7 Section 18.7 Judicial Administration DEPARTMENT OF JUSTICE OFFICE OF JUSTICE PROGRAMS HEARING AND APPEAL PROCEDURES § 18.7 Discovery.... Such order may be entered upon a showing that the deposition is necessary for discovery purposes, and...

20 CFR 355.21 - Discovery.

Code of Federal Regulations, 2012 CFR

2012-04-01

... 20 Employees' Benefits 1 2012-04-01 2012-04-01 false Discovery. 355.21 Section 355.21 Employees... UNDER THE PROGRAM FRAUD CIVIL REMEDIES ACT OF 1986 § 355.21 Discovery. (a) The following types of discovery are authorized: (1) Requests for production of documents for inspection and copying; (2) Requests...

42 CFR 405.1037 - Discovery.

Code of Federal Regulations, 2013 CFR

2013-10-01

... 42 Public Health 2 2013-10-01 2013-10-01 false Discovery. 405.1037 Section 405.1037 Public Health... Appeals Under Original Medicare (Part A and Part B) Alj Hearings § 405.1037 Discovery. (a) General rules. (1) Discovery is permissible only when CMS or its contractor elects to participate in an ALJ hearing...

47 CFR 14.47 - Discovery.

Code of Federal Regulations, 2012 CFR

2012-10-01

... 47 Telecommunication 1 2012-10-01 2012-10-01 false Discovery. 14.47 Section 14.47... Discovery. (a) A complainant may file with the Commission and serve on a defendant, concurrently with its... to this procedure may be used to seek discovery of any non-privileged matter that is relevant to the...

10 CFR 590.305 - Informal discovery.

Code of Federal Regulations, 2011 CFR

2011-01-01

... 10 Energy 4 2011-01-01 2011-01-01 false Informal discovery. 590.305 Section 590.305 Energy... WITH RESPECT TO THE IMPORT AND EXPORT OF NATURAL GAS Procedures § 590.305 Informal discovery. The parties to a proceeding may conduct discovery through use of procedures such as written interrogatories or...

29 CFR 1905.25 - Discovery.

Code of Federal Regulations, 2013 CFR

2013-07-01

... 29 Labor 5 2013-07-01 2013-07-01 false Discovery. 1905.25 Section 1905.25 Labor Regulations... OCCUPATIONAL SAFETY AND HEALTH ACT OF 1970 Hearings § 1905.25 Discovery. (a) Depositions. (1) For reasons of... discovery. Whenever appropriate to a just disposition of any issue in a hearing, the presiding hearing...

12 CFR 308.520 - Discovery.

Code of Federal Regulations, 2014 CFR

2014-01-01

... 12 Banks and Banking 5 2014-01-01 2014-01-01 false Discovery. 308.520 Section 308.520 Banks and... PROCEDURE Program Fraud Civil Remedies and Procedures § 308.520 Discovery. (a) The following types of discovery are authorized: (1) Requests for production of documents for inspection and copying; (2) Requests...

45 CFR 1386.103 - Discovery.

Code of Federal Regulations, 2011 CFR

2011-10-01

... 45 Public Welfare 4 2011-10-01 2011-10-01 false Discovery. 1386.103 Section 1386.103 Public... Hearing Procedures § 1386.103 Discovery. The Department and any party named in the Notice issued pursuant to § 1386.90 has the right to conduct discovery (including depositions) against opposing parties as...

10 CFR 2.336 - General discovery.

Code of Federal Regulations, 2013 CFR

2013-01-01

... 10 Energy 1 2013-01-01 2013-01-01 false General discovery. 2.336 Section 2.336 Energy NUCLEAR... Officer Powers, and General Hearing Management for NRC Adjudicatory Hearings § 2.336 General discovery. (a... proposed action, or the use of the discovery provisions in subpart G of this part against the offending...

41 CFR 105-70.021 - Discovery.

Code of Federal Regulations, 2011 CFR

2011-01-01

... 41 Public Contracts and Property Management 3 2011-01-01 2011-01-01 false Discovery. 105-70.021...-IMPLEMENTATION OF THE PROGRAM FRAUD CIVIL REMEDIES ACT OF 1986 § 105-70.021 Discovery. (a) The following types of discovery are authorized: (1) Requests for production of documents for inspection and copying; (2) Requests...

34 CFR 81.16 - Discovery.

Code of Federal Regulations, 2012 CFR

2012-07-01

... 34 Education 1 2012-07-01 2012-07-01 false Discovery. 81.16 Section 81.16 Education Office of the... Discovery. (a) The parties to a case are encouraged to exchange relevant documents and information voluntarily. (b) The ALJ, at a party's request, may order compulsory discovery described in paragraph (c) of...

7 CFR 283.12 - Discovery.

Code of Federal Regulations, 2014 CFR

2014-01-01

... 7 Agriculture 4 2014-01-01 2014-01-01 false Discovery. 283.12 Section 283.12 Agriculture... of $50,000 or More § 283.12 Discovery. (a) Dispositions—(1) Motion for taking deposition. Only upon a... exist if the information sought appears reasonably calculated to lead to the discovery of admissible...

47 CFR 14.47 - Discovery.

Code of Federal Regulations, 2013 CFR

2013-10-01

... 47 Telecommunication 1 2013-10-01 2013-10-01 false Discovery. 14.47 Section 14.47... Discovery. (a) A complainant may file with the Commission and serve on a defendant, concurrently with its... to this procedure may be used to seek discovery of any non-privileged matter that is relevant to the...

41 CFR 105-70.021 - Discovery.

Code of Federal Regulations, 2014 CFR

2014-01-01

... 41 Public Contracts and Property Management 3 2014-01-01 2014-01-01 false Discovery. 105-70.021...-IMPLEMENTATION OF THE PROGRAM FRAUD CIVIL REMEDIES ACT OF 1986 § 105-70.021 Discovery. (a) The following types of discovery are authorized: (1) Requests for production of documents for inspection and copying; (2) Requests...

6 CFR 13.21 - Discovery.

Code of Federal Regulations, 2013 CFR

2013-01-01

... 6 Domestic Security 1 2013-01-01 2013-01-01 false Discovery. 13.21 Section 13.21 Domestic Security DEPARTMENT OF HOMELAND SECURITY, OFFICE OF THE SECRETARY PROGRAM FRAUD CIVIL REMEDIES § 13.21 Discovery. (a) In general. (1) The following types of discovery are authorized: (i) Requests for production of...

41 CFR 105-70.021 - Discovery.

Code of Federal Regulations, 2012 CFR

2012-01-01

... 41 Public Contracts and Property Management 3 2012-01-01 2012-01-01 false Discovery. 105-70.021...-IMPLEMENTATION OF THE PROGRAM FRAUD CIVIL REMEDIES ACT OF 1986 § 105-70.021 Discovery. (a) The following types of discovery are authorized: (1) Requests for production of documents for inspection and copying; (2) Requests...

29 CFR 22.21 - Discovery.

Code of Federal Regulations, 2011 CFR

2011-07-01

... 29 Labor 1 2011-07-01 2011-07-01 false Discovery. 22.21 Section 22.21 Labor Office of the Secretary of Labor PROGRAM FRAUD CIVIL REMEDIES ACT OF 1986 § 22.21 Discovery. (a) The following types of discovery are authorized: (1) Requests for production of documents for inspection and copying; (2) Requests...

34 CFR 81.16 - Discovery.

Code of Federal Regulations, 2013 CFR

2013-07-01

... 34 Education 1 2013-07-01 2013-07-01 false Discovery. 81.16 Section 81.16 Education Office of the... Discovery. (a) The parties to a case are encouraged to exchange relevant documents and information voluntarily. (b) The ALJ, at a party's request, may order compulsory discovery described in paragraph (c) of...

34 CFR 81.16 - Discovery.

Code of Federal Regulations, 2011 CFR

2011-07-01

... 34 Education 1 2011-07-01 2011-07-01 false Discovery. 81.16 Section 81.16 Education Office of the... Discovery. (a) The parties to a case are encouraged to exchange relevant documents and information voluntarily. (b) The ALJ, at a party's request, may order compulsory discovery described in paragraph (c) of...

45 CFR 150.435 - Discovery.

Code of Federal Regulations, 2012 CFR

2012-10-01

... 45 Public Welfare 1 2012-10-01 2012-10-01 false Discovery. 150.435 Section 150.435 Public Welfare... AND INDIVIDUAL INSURANCE MARKETS Administrative Hearings § 150.435 Discovery. (a) The parties must identify any need for discovery from the opposing party as soon as possible, but no later than the time for...

12 CFR 308.520 - Discovery.

Code of Federal Regulations, 2011 CFR

2011-01-01

... 12 Banks and Banking 4 2011-01-01 2011-01-01 false Discovery. 308.520 Section 308.520 Banks and... PROCEDURE Program Fraud Civil Remedies and Procedures § 308.520 Discovery. (a) The following types of discovery are authorized: (1) Requests for production of documents for inspection and copying; (2) Requests...

20 CFR 355.21 - Discovery.

Code of Federal Regulations, 2010 CFR

2010-04-01

... 20 Employees' Benefits 1 2010-04-01 2010-04-01 false Discovery. 355.21 Section 355.21 Employees... UNDER THE PROGRAM FRAUD CIVIL REMEDIES ACT OF 1986 § 355.21 Discovery. (a) The following types of discovery are authorized: (1) Requests for production of documents for inspection and copying; (2) Requests...

20 CFR 498.207 - Discovery.

Code of Federal Regulations, 2010 CFR

2010-04-01

... 20 Employees' Benefits 2 2010-04-01 2010-04-01 false Discovery. 498.207 Section 498.207 Employees... § 498.207 Discovery. (a) For the purpose of inspection and copying, a party may make a request to...) Any form of discovery other than that permitted under paragraph (a) of this section, such as requests...

45 CFR 150.435 - Discovery.

Code of Federal Regulations, 2010 CFR

2010-10-01

... 45 Public Welfare 1 2010-10-01 2010-10-01 false Discovery. 150.435 Section 150.435 Public Welfare... AND INDIVIDUAL INSURANCE MARKETS Administrative Hearings § 150.435 Discovery. (a) The parties must identify any need for discovery from the opposing party as soon as possible, but no later than the time for...

42 CFR 1005.7 - Discovery.

Code of Federal Regulations, 2010 CFR

2010-10-01

... 42 Public Health 5 2010-10-01 2010-10-01 false Discovery. 1005.7 Section 1005.7 Public Health... OF EXCLUSIONS, CIVIL MONEY PENALTIES AND ASSESSMENTS § 1005.7 Discovery. (a) A party may make a... and any forms of discovery, other than those permitted under paragraph (a) of this section, are not...

34 CFR 81.16 - Discovery.

Code of Federal Regulations, 2010 CFR

2010-07-01

... 34 Education 1 2010-07-01 2010-07-01 false Discovery. 81.16 Section 81.16 Education Office of the... Discovery. (a) The parties to a case are encouraged to exchange relevant documents and information voluntarily. (b) The ALJ, at a party's request, may order compulsory discovery described in paragraph (c) of...

42 CFR 430.86 - Discovery.

Code of Federal Regulations, 2010 CFR

2010-10-01

... 42 Public Health 4 2010-10-01 2010-10-01 false Discovery. 430.86 Section 430.86 Public Health... Plans and Practice to Federal Requirements § 430.86 Discovery. CMS and any party named in the notice issued under § 430.70 has the right to conduct discovery (including depositions) against opposing parties...

12 CFR 1780.26 - Discovery.

Code of Federal Regulations, 2010 CFR

2010-01-01

... 12 Banks and Banking 7 2010-01-01 2010-01-01 false Discovery. 1780.26 Section 1780.26 Banks and... OF PRACTICE AND PROCEDURE RULES OF PRACTICE AND PROCEDURE Prehearing Proceedings § 1780.26 Discovery. (a) Limits on discovery. Subject to the limitations set out in paragraphs (b), (d), and (e) of this...

28 CFR 18.7 - Discovery.

Code of Federal Regulations, 2010 CFR

2010-07-01

... 28 Judicial Administration 1 2010-07-01 2010-07-01 false Discovery. 18.7 Section 18.7 Judicial Administration DEPARTMENT OF JUSTICE OFFICE OF JUSTICE PROGRAMS HEARING AND APPEAL PROCEDURES § 18.7 Discovery.... Such order may be entered upon a showing that the deposition is necessary for discovery purposes, and...

34 CFR 33.21 - Discovery.

Code of Federal Regulations, 2010 CFR

2010-07-01

... 34 Education 1 2010-07-01 2010-07-01 false Discovery. 33.21 Section 33.21 Education Office of the Secretary, Department of Education PROGRAM FRAUD CIVIL REMEDIES ACT § 33.21 Discovery. (a) The following types of discovery are authorized: (1) Requests for production of documents for inspection and copying...

45 CFR 160.516 - Discovery.

Code of Federal Regulations, 2010 CFR

2010-10-01

... 45 Public Welfare 1 2010-10-01 2010-10-01 false Discovery. 160.516 Section 160.516 Public Welfare... ADMINISTRATIVE REQUIREMENTS Procedures for Hearings § 160.516 Discovery. (a) A party may make a request to... forms of discovery, other than those permitted under paragraph (a) of this section, are not authorized...

42 CFR 405.1037 - Discovery.

Code of Federal Regulations, 2010 CFR

2010-10-01

... 42 Public Health 2 2010-10-01 2010-10-01 false Discovery. 405.1037 Section 405.1037 Public Health... Appeals Under Original Medicare (Part A and Part B) Alj Hearings § 405.1037 Discovery. (a) General rules. (1) Discovery is permissible only when CMS or its contractor elects to participate in an ALJ hearing...

12 CFR 308.520 - Discovery.

Code of Federal Regulations, 2010 CFR

2010-01-01

... 12 Banks and Banking 4 2010-01-01 2010-01-01 false Discovery. 308.520 Section 308.520 Banks and... PROCEDURE Program Fraud Civil Remedies and Procedures § 308.520 Discovery. (a) The following types of discovery are authorized: (1) Requests for production of documents for inspection and copying; (2) Requests...

10 CFR 2.336 - General discovery.

Code of Federal Regulations, 2010 CFR

2010-01-01

... 10 Energy 1 2010-01-01 2010-01-01 false General discovery. 2.336 Section 2.336 Energy NUCLEAR... Hearings § 2.336 General discovery. (a) Except for proceedings conducted under subparts G and J of this... discovery provisions in subpart G of this part against the offending party, for the offending party's...

29 CFR 1905.25 - Discovery.

Code of Federal Regulations, 2010 CFR

2010-07-01

... 29 Labor 5 2010-07-01 2010-07-01 false Discovery. 1905.25 Section 1905.25 Labor Regulations... OCCUPATIONAL SAFETY AND HEALTH ACT OF 1970 Hearings § 1905.25 Discovery. (a) Depositions. (1) For reasons of... discovery. Whenever appropriate to a just disposition of any issue in a hearing, the presiding hearing...

An Azulene-Based Discovery Experiment: Challenging Students to Watch for the "False Assumption"

ERIC Educational Resources Information Center

Garner, Charles M.

2005-01-01

A discovery-based experiment is developed depending on a "false assumption" that the students mistakenly assume they know the structure of a reaction product and are forced to reconcile observations that are inconsistent with this assumption. This experiment involves the chemistry of azulenes, an interesting class of intensely colored aromatic…

The Large Synoptic Survey Telescope as a Near-Earth Object discovery machine

NASA Astrophysics Data System (ADS)

Jones, R. Lynne; Slater, Colin T.; Moeyens, Joachim; Allen, Lori; Axelrod, Tim; Cook, Kem; Ivezić, Željko; Jurić, Mario; Myers, Jonathan; Petry, Catherine E.

2018-03-01

Using the most recent prototypes, design, and as-built system information, we test and quantify the capability of the Large Synoptic Survey Telescope (LSST) to discover Potentially Hazardous Asteroids (PHAs) and Near-Earth Objects (NEOs). We empirically estimate an expected upper limit to the false detection rate in LSST image differencing, using measurements on DECam data and prototype LSST software and find it to be about 450 deg-2. We show that this rate is already tractable with current prototype of the LSST Moving Object Processing System (MOPS) by processing a 30-day simulation consistent with measured false detection rates. We proceed to evaluate the performance of the LSST baseline survey strategy for PHAs and NEOs using a high-fidelity simulated survey pointing history. We find that LSST alone, using its baseline survey strategy, will detect 66% of the PHA and 61% of the NEO population objects brighter than H = 22 , with the uncertainty in the estimate of ± 5 percentage points. By generating and examining variations on the baseline survey strategy, we show it is possible to further improve the discovery yields. In particular, we find that extending the LSST survey by two additional years and doubling the MOPS search window increases the completeness for PHAs to 86% (including those discovered by contemporaneous surveys) without jeopardizing other LSST science goals (77% for NEOs). This equates to reducing the undiscovered population of PHAs by additional 26% (15% for NEOs), relative to the baseline survey.

False discovery rates in spectral identification.

PubMed

Jeong, Kyowon; Kim, Sangtae; Bandeira, Nuno

2012-01-01

Automated database search engines are one of the fundamental engines of high-throughput proteomics enabling daily identifications of hundreds of thousands of peptides and proteins from tandem mass (MS/MS) spectrometry data. Nevertheless, this automation also makes it humanly impossible to manually validate the vast lists of resulting identifications from such high-throughput searches. This challenge is usually addressed by using a Target-Decoy Approach (TDA) to impose an empirical False Discovery Rate (FDR) at a pre-determined threshold x% with the expectation that at most x% of the returned identifications would be false positives. But despite the fundamental importance of FDR estimates in ensuring the utility of large lists of identifications, there is surprisingly little consensus on exactly how TDA should be applied to minimize the chances of biased FDR estimates. In fact, since less rigorous TDA/FDR estimates tend to result in more identifications (at higher 'true' FDR), there is often little incentive to enforce strict TDA/FDR procedures in studies where the major metric of success is the size of the list of identifications and there are no follow up studies imposing hard cost constraints on the number of reported false positives. Here we address the problem of the accuracy of TDA estimates of empirical FDR. Using MS/MS spectra from samples where we were able to define a factual FDR estimator of 'true' FDR we evaluate several popular variants of the TDA procedure in a variety of database search contexts. We show that the fraction of false identifications can sometimes be over 10× higher than reported and may be unavoidably high for certain types of searches. In addition, we further report that the two-pass search strategy seems the most promising database search strategy. While unavoidably constrained by the particulars of any specific evaluation dataset, our observations support a series of recommendations towards maximizing the number of resulting identifications while controlling database searches with robust and reproducible TDA estimation of empirical FDR.

12 CFR 308.24 - Scope of document discovery.

Code of Federal Regulations, 2010 CFR

2010-01-01

... 12 Banks and Banking 4 2010-01-01 2010-01-01 false Scope of document discovery. 308.24 Section 308... PRACTICE AND PROCEDURE Uniform Rules of Practice and Procedure § 308.24 Scope of document discovery. (a) Limits on discovery. (1) Subject to the limitations set out in paragraphs (b), (c), and (d) of this...

40 CFR 209.22 - Other discovery.

Code of Federal Regulations, 2013 CFR

2013-07-01

... 40 Protection of Environment 26 2013-07-01 2013-07-01 false Other discovery. 209.22 Section 209.22... Orders Issued Under Section 11(d) of the Noise Control Act § 209.22 Other discovery. (a) Further discovery under this section shall be undertaken only upon order of the administrative law judge or upon...

10 CFR 205.198 - Discovery.

Code of Federal Regulations, 2013 CFR

2013-01-01

... 10 Energy 3 2013-01-01 2013-01-01 false Discovery. 205.198 Section 205.198 Energy DEPARTMENT OF... of Proposed Disallowance, and Order of Disallowance § 205.198 Discovery. (a) If a person intends to file a Motion for Discovery, he must file it at the same time that he files his Statement of Objections...

12 CFR 308.107 - Document discovery.

Code of Federal Regulations, 2014 CFR

2014-01-01

... 12 Banks and Banking 5 2014-01-01 2014-01-01 false Document discovery. 308.107 Section 308.107... PRACTICE AND PROCEDURE General Rules of Procedure § 308.107 Document discovery. (a) Parties to proceedings set forth at § 308.01 of the Uniform Rules and as provided in the Local Rules may obtain discovery...

10 CFR 205.198 - Discovery.

Code of Federal Regulations, 2012 CFR

2012-01-01

... 10 Energy 3 2012-01-01 2012-01-01 false Discovery. 205.198 Section 205.198 Energy DEPARTMENT OF... of Proposed Disallowance, and Order of Disallowance § 205.198 Discovery. (a) If a person intends to file a Motion for Discovery, he must file it at the same time that he files his Statement of Objections...

10 CFR 205.198 - Discovery.

Code of Federal Regulations, 2014 CFR

2014-01-01

... 10 Energy 3 2014-01-01 2014-01-01 false Discovery. 205.198 Section 205.198 Energy DEPARTMENT OF... of Proposed Disallowance, and Order of Disallowance § 205.198 Discovery. (a) If a person intends to file a Motion for Discovery, he must file it at the same time that he files his Statement of Objections...

10 CFR 205.198 - Discovery.

Code of Federal Regulations, 2011 CFR

2011-01-01

... 10 Energy 3 2011-01-01 2011-01-01 false Discovery. 205.198 Section 205.198 Energy DEPARTMENT OF... of Proposed Disallowance, and Order of Disallowance § 205.198 Discovery. (a) If a person intends to file a Motion for Discovery, he must file it at the same time that he files his Statement of Objections...

12 CFR 908.46 - Discovery.

Code of Federal Regulations, 2011 CFR

2011-01-01

... 12 Banks and Banking 7 2011-01-01 2011-01-01 false Discovery. 908.46 Section 908.46 Banks and... PRACTICE AND PROCEDURE IN HEARINGS ON THE RECORD Pre-Hearing Proceedings § 908.46 Discovery. (a) Limits on discovery. Subject to the limitations set out in paragraphs (b), (d), and (e) of this section, any party to...

12 CFR 308.107 - Document discovery.

Code of Federal Regulations, 2011 CFR

2011-01-01

... 12 Banks and Banking 4 2011-01-01 2011-01-01 false Document discovery. 308.107 Section 308.107... PRACTICE AND PROCEDURE General Rules of Procedure § 308.107 Document discovery. (a) Parties to proceedings set forth at § 308.01 of the Uniform Rules and as provided in the Local Rules may obtain discovery...

45 CFR 213.23a - Discovery.

Code of Federal Regulations, 2012 CFR

2012-10-01

... 45 Public Welfare 2 2012-10-01 2012-10-01 false Discovery. 213.23a Section 213.23a Public Welfare... Discovery. The Department and any party named in the notice issued pursuant to § 213.11 shall have the right to conduct discovery (including depositions) against opposing parties. Rules 26-37 of the Federal...

12 CFR 308.107 - Document discovery.

Code of Federal Regulations, 2012 CFR

2012-01-01

... 12 Banks and Banking 5 2012-01-01 2012-01-01 false Document discovery. 308.107 Section 308.107... PRACTICE AND PROCEDURE General Rules of Procedure § 308.107 Document discovery. (a) Parties to proceedings set forth at § 308.01 of the Uniform Rules and as provided in the Local Rules may obtain discovery...

12 CFR 308.107 - Document discovery.

Code of Federal Regulations, 2013 CFR

2013-01-01

... 12 Banks and Banking 5 2013-01-01 2013-01-01 false Document discovery. 308.107 Section 308.107... PRACTICE AND PROCEDURE General Rules of Procedure § 308.107 Document discovery. (a) Parties to proceedings set forth at § 308.01 of the Uniform Rules and as provided in the Local Rules may obtain discovery...

40 CFR 209.22 - Other discovery.

Code of Federal Regulations, 2014 CFR

2014-07-01

... 40 Protection of Environment 25 2014-07-01 2014-07-01 false Other discovery. 209.22 Section 209.22... Orders Issued Under Section 11(d) of the Noise Control Act § 209.22 Other discovery. (a) Further discovery under this section shall be undertaken only upon order of the administrative law judge or upon...