A practical guide to methods controlling false discoveries in computational biology

Korthauer, Keegan; Kimes, Patrick K.; Duvallet, Claire; Reyes, Alejandro; Subramanian, Ayshwarya; Teng, Mingxiang; Shukla, Chinmay; Alm, Eric J.; Hicks, Stephanie C.

doi:10.1186/s13059-019-1716-1

A practical guide to methods controlling false discoveries in computational biology

Journal Article · Tue Jun 04 00:00:00 EDT 2019 · Genome Biology (Online)

DOI:https://doi.org/10.1186/s13059-019-1716-1· OSTI ID:1618920

Korthauer, Keegan; Kimes, Patrick K.; Duvallet, Claire; Reyes, Alejandro; Subramanian, Ayshwarya; Teng, Mingxiang; Shukla, Chinmay; Alm, Eric J.;

Not Available

View Journal Article

Sponsoring Organization:: USDOE

Grant/Contract Number:: AC02-05CH11231

OSTI ID:: 1618920

Alternate ID(s):: OSTI ID: 1626945

Journal Information:: Genome Biology (Online), Journal Name: Genome Biology (Online) Journal Issue: 1 Vol. 20; ISSN 1474-760X

Publisher:: Springer Science + Business MediaCopyright Statement

Country of Publication:: United Kingdom

Language:: English

References (59)

Multiple hypothesis testing in genomics Goeman, Jelle J.; Solari, Aldo Statistics in Medicine, Vol. 33, Issue 11 https://doi.org/10.1002/sim.6082	journal	January 2014
Thresholding of Statistical Maps in Functional Neuroimaging Using the False Discovery Rate Genovese, Christopher R.; Lazar, Nicole A.; Nichols, Thomas NeuroImage, Vol. 15, Issue 4 https://doi.org/10.1006/nimg.2001.1037	journal	April 2002
Human Genetics Shape the Gut Microbiome Goodrich, Julia K.; Waters, Jillian L.; Poole, Angela C. Cell, Vol. 159, Issue 4 https://doi.org/10.1016/j.cell.2014.09.053	journal	November 2014
Single-Cell RNA-Seq Analysis of Infiltrating Neoplastic Cells at the Migrating Front of Human Glioblastoma Darmanis, Spyros; Sloan, Steven A.; Croote, Derek Cell Reports, Vol. 21, Issue 5 https://doi.org/10.1016/j.celrep.2017.10.030	journal	October 2017
Measuring Signaling and RNA-Seq in the Same Cell Links Gene Expression to Dynamic Patterns of NF-κB Activation Lane, Keara; Van Valen, David; DeFelice, Mialy M. Cell Systems, Vol. 4, Issue 4 https://doi.org/10.1016/j.cels.2017.03.010	journal	April 2017
Technical trading revisited: False discoveries, persistence tests, and transaction costs Bajgrowicz, Pierre; Scaillet, Olivier Journal of Financial Economics, Vol. 106, Issue 3 https://doi.org/10.1016/j.jfineco.2012.06.001	journal	December 2012
Identification of Regulatory Networks in HSCs and Their Immediate Progeny via Integrated Proteome, Transcriptome, and DNA Methylome Analysis Cabezas-Wallscheid, Nina; Klimmeck, Daniel; Hansson, Jenny Cell Stem Cell, Vol. 15, Issue 4 https://doi.org/10.1016/j.stem.2014.07.005	journal	October 2014
False Discovery Rates and Related Statistical Concepts in Mass Spectrometry-Based Proteomics Choi, Hyungwon; Nesvizhskii, Alexey I. Journal of Proteome Research, Vol. 7, Issue 1 https://doi.org/10.1021/pr700747q	journal	January 2008
An integrated encyclopedia of DNA elements in the human genome No authors listed Nature, Vol. 489, Issue 7414, p. 57-74 https://doi.org/10.1038/nature11247	journal	September 2012
A global reference for human genetic variation Consortium, The 1000 Genomes Project; Auton, Adam; Abecasis, Gonçalo R. Nature, Vol. 526, Issue 7571, p. 68-74 https://doi.org/10.1038/nature15393	journal	January 2015
Reproducible RNA-seq analysis using recount2 Collado-Torres, Leonardo; Nellore, Abhinav; Kammers, Kai Nature Biotechnology, Vol. 35, Issue 4 https://doi.org/10.1038/nbt.3838	journal	April 2017
Large-scale association analysis identifies new risk loci for coronary artery disease Deloukas, Panos; Kanoni, Stavroula; Willenborg, Christina Nature Genetics, Vol. 45, Issue 1 https://doi.org/10.1038/ng.2480	journal	December 2012
Association analyses of 249,796 individuals reveal 18 new loci associated with body mass index Speliotes, Elizabeth K.; Willer, Cristen J.; Berndt, Sonja I. Nature Genetics, Vol. 42, Issue 11 https://doi.org/10.1038/ng.686	journal	October 2010
iCOBRA: open, reproducible, standardized and live method benchmarking Soneson, Charlotte; Robinson, Mark D. Nature Methods, Vol. 13, Issue 4 https://doi.org/10.1038/nmeth.3805	journal	March 2016
Data-driven hypothesis weighting increases detection power in genome-scale multiple testing Ignatiadis, Nikolaos; Klaus, Bernd; Zaugg, Judith B. Nature Methods, Vol. 13, Issue 7 https://doi.org/10.1038/nmeth.3885	journal	May 2016
Bias, robustness and scalability in single-cell differential expression analysis Soneson, Charlotte; Robinson, Mark D. Nature Methods, Vol. 15, Issue 4 https://doi.org/10.1038/nmeth.4612	journal	February 2018
QIIME allows analysis of high-throughput community sequencing data Caporaso, J. Gregory; Kuczynski, Justin; Stombaugh, Jesse Nature Methods, Vol. 7, Issue 5 https://doi.org/10.1038/nmeth.f.303	journal	April 2010
TALEN-based knockout library for human microRNAs Kim, Young-Kook; Wee, Gabbine; Park, Joha Nature Structural & Molecular Biology, Vol. 20, Issue 12 https://doi.org/10.1038/nsmb.2701	journal	November 2013
Meta-analysis of gut microbiome studies identifies disease-specific and shared responses Duvallet, Claire; Gibbons, Sean M.; Gurry, Thomas Nature Communications, Vol. 8, Issue 1 https://doi.org/10.1038/s41467-017-01973-8	journal	December 2017
Gene set enrichment analysis: A knowledge-based approach for interpreting genome-wide expression profiles Subramanian, A.; Tamayo, P.; Mootha, V. K. Proceedings of the National Academy of Sciences, Vol. 102, Issue 43, p. 15545-15550 https://doi.org/10.1073/pnas.0506580102	journal	September 2005
Independent filtering increases detection power for high-throughput experiments Bourgon, R.; Gentleman, R.; Huber, W. Proceedings of the National Academy of Sciences, Vol. 107, Issue 21 https://doi.org/10.1073/pnas.0914005107	journal	May 2010
Multiple Comparisons among Means Dunn, Olive Jean Journal of the American Statistical Association, Vol. 56, Issue 293 https://doi.org/10.1080/01621459.1961.10482090	journal	March 1961
False Discovery Rate Regression: An Application to Neural Synchrony Detection in Primary Visual Cortex Scott, James G.; Kelly, Ryan C.; Smith, Matthew A. Journal of the American Statistical Association, Vol. 110, Issue 510 https://doi.org/10.1080/01621459.2014.990973	journal	April 2015
PLINK: A Tool Set for Whole-Genome Association and Population-Based Linkage Analyses Purcell, Shaun; Neale, Benjamin; Todd-Brown, Kathe The American Journal of Human Genetics, Vol. 81, Issue 3 https://doi.org/10.1086/519795	journal	September 2007
edgeR: a Bioconductor package for differential expression analysis of digital gene expression data Robinson, M. D.; McCarthy, D. J.; Smyth, G. K. Bioinformatics, Vol. 26, Issue 1 https://doi.org/10.1093/bioinformatics/btp616	journal	November 2009
Search and clustering orders of magnitude faster than BLAST Edgar, Robert C. Bioinformatics, Vol. 26, Issue 19, p. 2460-2461 https://doi.org/10.1093/bioinformatics/btq461	journal	August 2010
PEAR: a fast and accurate Illumina Paired-End reAd mergeR Zhang, J.; Kobert, K.; Flouri, T. Bioinformatics, Vol. 30, Issue 5 https://doi.org/10.1093/bioinformatics/btt593	journal	October 2013
Polyester : simulating RNA-seq datasets with differential transcript expression Frazee, Alyssa C.; Jaffe, Andrew E.; Langmead, Ben Bioinformatics, Vol. 31, Issue 17 https://doi.org/10.1093/bioinformatics/btv272	journal	April 2015
Statistical models for RNA-seq data derived from a two-condition 48-replicate experiment Gierliński, Marek; Cole, Christian; Schofield, Pietà Bioinformatics, Vol. 31, Issue 22 https://doi.org/10.1093/bioinformatics/btv425	journal	July 2015
Reproducible and replicable comparisons using SummarizedBenchmark Kimes, Patrick K.; Reyes, Alejandro Bioinformatics, Vol. 35, Issue 1 https://doi.org/10.1093/bioinformatics/bty627	journal	July 2018
A stagewise rejective multiple test procedure based on a modified Bonferroni test Hommel, G. Biometrika, Vol. 75, Issue 2 https://doi.org/10.1093/biomet/75.2.383	journal	January 1988
A sharper Bonferroni procedure for multiple tests of significance Hochberg, Yosef Biometrika, Vol. 75, Issue 4 https://doi.org/10.1093/biomet/75.4.800	journal	January 1988
Genome-wide and single-cell analyses reveal a context dependent relationship between CBP recruitment and gene expression Kasper, Lawryn H.; Qu, Chunxu; Obenauer, John C. Nucleic Acids Research, Vol. 42, Issue 18 https://doi.org/10.1093/nar/gku827	journal	September 2014
limma powers differential expression analyses for RNA-sequencing and microarray studies Ritchie, Matthew E.; Phipson, Belinda; Wu, Di Nucleic Acids Research, Vol. 43, Issue 7 https://doi.org/10.1093/nar/gkv007	journal	January 2015
csaw: a Bioconductor package for differential binding analysis of ChIP-seq data using sliding windows Lun, Aaron T. L.; Smyth, Gordon K. Nucleic Acids Research, Vol. 44, Issue 5 https://doi.org/10.1093/nar/gkv1191	journal	November 2015
Alternative start and termination sites of transcription drive most transcript isoform differences across human tissues Reyes, Alejandro; Huber, Wolfgang Nucleic Acids Research, Vol. 46, Issue 2 https://doi.org/10.1093/nar/gkx1165	journal	November 2017
Fast gene set enrichment analysis Korotkevich, Gennady; Sukhov, Vladimir; Sergushichev, Alexey https://doi.org/10.1101/060012	preprint	February 2019
A direct approach to false discovery rates Storey, John D. Journal of the Royal Statistical Society: Series B (Statistical Methodology), Vol. 64, Issue 3 https://doi.org/10.1111/1467-9868.00346	journal	August 2002
Discovering the false discovery rate: False Discovery Rate Benjamini, Yoav Journal of the Royal Statistical Society: Series B (Statistical Methodology), Vol. 72, Issue 4 https://doi.org/10.1111/j.1467-9868.2010.00746.x	journal	August 2010
AdaPT: an interactive procedure for multiple testing with side information Lei, Lihua; Fithian, William Journal of the Royal Statistical Society: Series B (Statistical Methodology), Vol. 80, Issue 4 https://doi.org/10.1111/rssb.12274	journal	June 2018
The human transcriptome across tissues and individuals Mele, M.; Ferreira, P. G.; Reverter, F. Science, Vol. 348, Issue 6235 https://doi.org/10.1126/science.aaa0355	journal	May 2015
Natural Bacterial Communities Serve as Quantitative Geochemical Biosensors Smith, Mark B.; Rocha, Andrea M.; Smillie, Chris S. mBio, Vol. 6, Issue 3 https://doi.org/10.1128/mBio.00326-15	journal	May 2015
Microbiome Data Distinguish Patients with Clostridium difficile Infection and Non-C. difficile-Associated Diarrhea from Healthy Controls Schubert, Alyxandria M.; Rogers, Mary A. M.; Ring, Cathrin mBio, Vol. 5, Issue 3 https://doi.org/10.1128/mBio.01021-14	journal	May 2014
Multiple Hypothesis Testing Shaffer, J. P. Annual Review of Psychology, Vol. 46, Issue 1 https://doi.org/10.1146/annurev.ps.46.020195.003021	journal	January 1995
The False Discovery Rate: A Key Concept in Large-Scale Genetic Studies Chen, James J.; Robeson, Paula K.; Schell, Michael J. Cancer Control, Vol. 17, Issue 1 https://doi.org/10.1177/107327481001700108	journal	January 2010
Gene ontology analysis for RNA-seq: accounting for selection bias Young, Matthew D.; Wakefield, Matthew J.; Smyth, Gordon K. Genome Biology, Vol. 11, Issue 2 https://doi.org/10.1186/gb-2010-11-2-r14	journal	January 2010
Moderated estimation of fold change and dispersion for RNA-seq data with DESeq2 Love, Michael I.; Huber, Wolfgang; Anders, Simon Genome Biology, Vol. 15, Issue 12 https://doi.org/10.1186/s13059-014-0550-8	journal	December 2014
MAST: a flexible statistical framework for assessing transcriptional changes and characterizing heterogeneity in single-cell RNA sequencing data Finak, Greg; McDavid, Andrew; Yajima, Masanao Genome Biology, Vol. 16, Issue 1 https://doi.org/10.1186/s13059-015-0844-5	journal	December 2015
A statistical approach for identifying differential distributions in single-cell RNA-seq experiments Korthauer, Keegan D.; Chu, Li-Fang; Newton, Michael A. Genome Biology, Vol. 17, Issue 1 https://doi.org/10.1186/s13059-016-1077-y	journal	October 2016
Microbiota-based model improves the sensitivity of fecal immunochemical test for detecting colonic lesions Baxter, Nielson T.; Ruffin, Mack T.; Rogers, Mary A. M. Genome Medicine, Vol. 8, Issue 1 https://doi.org/10.1186/s13073-016-0290-3	journal	April 2016
Simultaneous Testing of Grouped Hypotheses: Finding Needles in Multiple Haystacks Cai, T. Tony; Sun, Wenguang Journal of the American Statistical Association, Vol. 104, Issue 488 https://doi.org/10.1198/jasa.2009.tm08415	journal	December 2009
Microarrays, Empirical Bayes and the Two-Groups Model Efron, Bradley Statistical Science, Vol. 23, Issue 1 https://doi.org/10.1214/07-STS236	journal	February 2008
Multiple Hypothesis Testing in Microarray Experiments Dudoit, Sandrine; Shaffer, Juliet Popper; Block, Jennifer C. Statistical Science, Vol. 18, Issue 1 https://doi.org/10.1214/ss/1056397487	journal	February 2003
From reads to regions: a Bioconductor workflow to detect differential binding in ChIP-seq data Lun, Aaron T. L.; Smyth, Gordon K. F1000Research, Vol. 4 https://doi.org/10.12688/f1000research.7016.1	journal	January 2015
Controlling the rate of Type I error over a large set of statistical tests Keselman, H. J.; Cribbie, Robert; Holland, Burt British Journal of Mathematical and Statistical Psychology, Vol. 55, Issue 1 https://doi.org/10.1348/000711002159680	journal	May 2002
Non-Invasive Mapping of the Gastrointestinal Microbiota Identifies Children with Inflammatory Bowel Disease Papa, Eliseo; Docktor, Michael; Smillie, Christopher PLoS ONE, Vol. 7, Issue 6 https://doi.org/10.1371/journal.pone.0039242	journal	June 2012
On the Adaptive Control of the False Discovery Rate in Multiple Testing With Independent Statistics Benjamini, Yoav; Hochberg, Yosef Journal of Educational and Behavioral Statistics, Vol. 25, Issue 1 https://doi.org/10.3102/10769986025001060	journal	March 2000
Otu Table: Ecosystems And Networks Integrated With Genes And Molecular Assemblies (Enigma) Duvallet, Claire Zenodo https://doi.org/10.5281/zenodo.1455793	dataset	January 2018
Count Rna-Seq Data Used For Benchmarking Fdr Control Methods Reyes, Alejandro Zenodo https://doi.org/10.5281/zenodo.1475409	dataset	January 2018

Similar Records

A field guide to cultivating computational biology

Journal Article · Thu Oct 07 00:00:00 EDT 2021 · PLoS Biology (Online) · OSTI ID:1830208

Computational Biology for Drug Discovery and Characterization

Technical Report · Mon Feb 23 23:00:00 EST 2009 · OSTI ID:948962

A practical guide to methods controlling false discoveries in computational biology

Citation Formats

References (59)

Similar Records

Related Subjects