Evaluation of the reproducibility of amplicon sequencing with Illumina MiSeq platform

Wen, Chongqing; Wu, Liyou; Qin, Yujia; Van Nostrand, Joy D.; Ning, Daliang; Sun, Bo; Xue, Kai; Liu, Feifei; Deng, Ye; Liang, Yuting; Zhou, Jizhong

doi:10.1371/journal.pone.0176716

Title: Evaluation of the reproducibility of amplicon sequencing with Illumina MiSeq platform

Journal Article · Fri Apr 28 00:00:00 EDT 2017 · PLoS ONE

DOI:https://doi.org/10.1371/journal.pone.0176716· OSTI ID:1353514

Wen, Chongqing;

; Qin, Yujia; Van Nostrand, Joy D.; Ning, Daliang; Sun, Bo; Xue, Kai; Liu, Feifei; Deng, Ye; Liang, Yuting; Zhou, Jizhong

Illumina's MiSeq has become the dominant platform for gene amplicon sequencing in microbial ecology studies; however, various technical concerns, such as reproducibility, still exist. To assess reproducibility, 16S rRNA gene amplicons from 18 soil samples of a reciprocal transplantation experiment were sequenced on an Illumina MiSeq. The V4 region of 16S rRNA gene from each sample was sequenced in triplicate with each replicate having a unique barcode. The average OTU overlap, without considering sequence abundance, at a rarefaction level of 10,323 sequences was 33.4±2.1% and 20.2±1.7% between two and among three technical replicates, respectively. When OTU sequence abundance was considered, the average sequence abundance weighted OTU overlap was 85.6±1.6% and 81.2±2.1% for two and three replicates, respectively. Removing singletons significantly increased the overlap for both (~1-3%, p<0.001). Increasing the sequencing depth to 160,000 reads by deep sequencing increased OTU overlap both when sequence abundance was considered (95%) and when not (44%). However, if singletons were not removed the overlap between two technical replicates (not considering sequence abundance) plateaus at 39% with 30,000 sequences. Diversity measures were not affected by the low overlap as α-diversities were similar among technical replicates while β-diversities (Bray-Curtis) were much smaller among technical replicates than among treatment replicates (e.g., 0.269 vs. 0.374). Higher diversity coverage, but lower OTU overlap, was observed when replicates were sequenced in separate runs. Detrended correspondence analysis indicated that while there was considerable variation among technical replicates, the reproducibility was sufficient for detecting treatment effects for the samples examined. These results suggest that although there is variation among technical replicates, amplicon sequencing on MiSeq is useful for analyzing microbial community structure if used appropriately and with caution. For example, including technical replicates, removing spurious sequences and unrepresentative OTUs, using a clustering method with a high stringency for OTU generation, estimating treatment effects at higher taxonomic levels, and adapting the unique molecular identifier (UMI) and other newly developed methods to lower PCR and sequencing error and to identify true low abundance rare species all can increase reproducibility.

View Journal Article

Cite

Export

Save

Research Organization:: Lawrence Berkeley National Laboratory (LBNL), Berkeley, CA (United States)

Sponsoring Organization:: USDOE Office of Science (SC)

Grant/Contract Number:: SC0010715; AC02-05CH11231; SC0004601

OSTI ID:: 1353514

Alternate ID(s):: OSTI ID: 1379641

Journal Information:: PLoS ONE, Journal Name: PLoS ONE Vol. 12 Journal Issue: 4; ISSN 1932-6203

Publisher:: Public Library of ScienceCopyright Statement

Country of Publication:: United States

Language:: English

Citation Metrics:

Cited by: 74 works

Citation information provided by
Web of Science

References (71)

A Mathematical Theory of Communication Shannon, C. E. Bell System Technical Journal, Vol. 27, Issue 3 https://doi.org/10.1002/j.1538-7305.1948.tb01338.x	journal	July 1948
Btrim: A fast, lightweight adapter and quality trimming program for next-generation sequencing technologies Kong, Yong Genomics, Vol. 98, Issue 2 https://doi.org/10.1016/j.ygeno.2011.05.009	journal	August 2011
Pyrosequencing Reveals the Microbial Communities in the Red Sea Sponge Carteriospongia foliascens and Their Impressive Shifts in Abnormal Tissues Gao, Zhao-Ming; Wang, Yong; Lee, On On Microbial Ecology, Vol. 68, Issue 3 https://doi.org/10.1007/s00248-014-0419-0	journal	April 2014
UCHIME improves sensitivity and speed of chimera detection Edgar, Robert C.; Haas, Brian J.; Clemente, Jose C. Bioinformatics, Vol. 27, Issue 16 https://doi.org/10.1093/bioinformatics/btr381	journal	June 2011
DNA recovery from soils of diverse composition. Zhou, J.; Bruns, M. A.; Tiedje, J. M. Applied and environmental microbiology, Vol. 62, Issue 2 https://doi.org/10.1128/AEM.62.2.316-322.1996	journal	January 1996
Microbial diversity in the deep sea and the underexplored "rare biosphere" Sogin, M. L.; Morrison, H. G.; Huber, J. A. Proceedings of the National Academy of Sciences, Vol. 103, Issue 32 https://doi.org/10.1073/pnas.0605127103	journal	July 2006
Greengenes, a Chimera-Checked 16S rRNA Gene Database and Workbench Compatible with ARB DeSantis, T. Z.; Hugenholtz, P.; Larsen, N. Applied and Environmental Microbiology, Vol. 72, Issue 7, p. 5069-5072 https://doi.org/10.1128/AEM.03006-05	journal	July 2006
Patchiness of deep-sea benthic Foraminifera across the Southern Ocean: Insights from high-throughput DNA sequencing Lejzerowicz, Franck; Esling, Philippe; Pawlowski, Jan Deep Sea Research Part II: Topical Studies in Oceanography, Vol. 108 https://doi.org/10.1016/j.dsr2.2014.07.018	journal	October 2014
Bugs, Stool, and the Irritable Bowel Syndrome: Too Much Is as Bad as Too Little? Talley, Nicholas J.; Fodor, Anthony A. Gastroenterology, Vol. 141, Issue 5 https://doi.org/10.1053/j.gastro.2011.09.019	journal	November 2011
High-throughput sequencing shows inconsistent results with a microscope-based analysis of the soil prokaryotic community Ushio, Masayuki; Makoto, Kobayashi; Klaminder, Jonatan Soil Biology and Biochemistry, Vol. 76 https://doi.org/10.1016/j.soilbio.2014.05.010	journal	September 2014
Random Sampling Process Leads to Overestimation of β-Diversity of Microbial Communities Zhou, Jizhong; Jiang, Yi-Huei; Deng, Ye mBio, Vol. 4, Issue 3 https://doi.org/10.1128/mBio.00324-13	journal	June 2013
Accurate multiplexing and filtering for high-throughput amplicon-sequencing Esling, Philippe; Lejzerowicz, Franck; Pawlowski, Jan Nucleic Acids Research, Vol. 43, Issue 5 https://doi.org/10.1093/nar/gkv107	journal	February 2015
High-Throughput Metagenomic Technologies for Complex Microbial Community Analysis: Open and Closed Formats Zhou, Jizhong; He, Zhili; Yang, Yunfeng mBio, Vol. 6, Issue 1 https://doi.org/10.1128/mBio.02288-14	journal	January 2015
Using ecological diversity measures with bacterial communities Hill, Tom C. J.; Walsh, Kerry A.; Harris, James A. FEMS Microbiology Ecology, Vol. 43, Issue 1 https://doi.org/10.1111/j.1574-6941.2003.tb01040.x	journal	February 2003
The interactive effects of soil transplant into colder regions and cropping on soil microbiology and biogeochemistry: Effects of northward soil transplant and cropping Liu, Shanshan; Wang, Feng; Xue, Kai Environmental Microbiology, Vol. 17, Issue 3 https://doi.org/10.1111/1462-2920.12398	journal	February 2014
UMI-4C for quantitative and targeted chromosomal contact profiling Schwartzman, Omer; Mukamel, Zohar; Oded-Elkayam, Noa Nature Methods, Vol. 13, Issue 8 https://doi.org/10.1038/nmeth.3922	journal	July 2016
Practical innovations for high-throughput amplicon sequencing Lundberg, Derek S.; Yourstone, Scott; Mieczkowski, Piotr Nature Methods, Vol. 10, Issue 10 https://doi.org/10.1038/nmeth.2634	journal	September 2013
Reproducibility of pyrosequencing data for biodiversity assessment in complex communities Zhan, Aibin; He, Song; Brown, Emily A. Methods in Ecology and Evolution, Vol. 5, Issue 9 https://doi.org/10.1111/2041-210X.12230	journal	July 2014
Phylogenetic identification and in situ detection of individual microbial cells without cultivation. Amann, R. I.; Ludwig, W.; Schleifer, K. H. Microbiological reviews, Vol. 59, Issue 1 https://doi.org/10.1128/MMBR.59.1.143-169.1995	journal	January 1995
Rare taxa have potential to make metabolic contributions in enhanced biological phosphorus removal ecosystems: EBPR microbiome activity and dynamics Lawson, Christopher E.; Strachan, Blake J.; Hanson, Niels W. Environmental Microbiology, Vol. 17, Issue 12 https://doi.org/10.1111/1462-2920.12875	journal	May 2015
Reproducibility and quantitation of amplicon sequencing-based detection Zhou, Jizhong; Wu, Liyou; Deng, Ye The ISME Journal, Vol. 5, Issue 8 https://doi.org/10.1038/ismej.2011.11	journal	February 2011
Naive Bayesian Classifier for Rapid Assignment of rRNA Sequences into the New Bacterial Taxonomy Wang, Q.; Garrity, G. M.; Tiedje, J. M. Applied and Environmental Microbiology, Vol. 73, Issue 16 https://doi.org/10.1128/AEM.00062-07	journal	June 2007
Global patterns of 16S rRNA diversity at a depth of millions of sequences per sample Caporaso, J. G.; Lauber, C. L.; Walters, W. A. Proceedings of the National Academy of Sciences, Vol. 108, Issue Supplement_1 https://doi.org/10.1073/pnas.1000080107	journal	June 2010
Barcoding bias in high-throughput multiplex sequencing of miRNA Alon, S.; Vigneault, F.; Eminaga, S. Genome Research, Vol. 21, Issue 9 https://doi.org/10.1101/gr.121715.111	journal	July 2011
Comparison of direct boiling method with commercial kits for extracting fecal microbiome DNA by Illumina sequencing of 16S rRNA tags Peng, Xin; Yu, Ke-Qiang; Deng, Guan-Hua Journal of Microbiological Methods, Vol. 95, Issue 3 https://doi.org/10.1016/j.mimet.2013.07.015	journal	December 2013
Rare biosphere exploration using high-throughput sequencing: research progress and perspectives Zhan, Aibin; MacIsaac, Hugh J. Conservation Genetics, Vol. 16, Issue 3 https://doi.org/10.1007/s10592-014-0678-9	journal	November 2014
Low sequencing efforts bias analyses of shared taxa in microbial communities Lemos, Leandro N.; Fulthorpe, Roberta R.; Roesch, Luiz F. W. Folia Microbiologica, Vol. 57, Issue 5 https://doi.org/10.1007/s12223-012-0155-0	journal	May 2012
Sequence Depth, Not PCR Replication, Improves Ecological Inference from Next Generation DNA Sequencing Smith, Dylan P.; Peay, Kabir G. PLoS ONE, Vol. 9, Issue 2 https://doi.org/10.1371/journal.pone.0090234	journal	February 2014
FLASH: fast length adjustment of short reads to improve genome assemblies Magoc, T.; Salzberg, S. L. Bioinformatics, Vol. 27, Issue 21 https://doi.org/10.1093/bioinformatics/btr507	journal	September 2011
Comparative metagenomic and rRNA microbial diversity characterization using archaeal and bacterial synthetic communities: Metagenomic and rRNA diversity characterization Shakya, Migun; Quince, Christopher; Campbell, James H. Environmental Microbiology, Vol. 15, Issue 6 https://doi.org/10.1111/1462-2920.12086	journal	February 2013
Alterations in the Colonic Microbiota in Response to Osmotic Diarrhea Gorkiewicz, Gregor; Thallinger, Gerhard G.; Trajanoski, Slave PLoS ONE, Vol. 8, Issue 2 https://doi.org/10.1371/journal.pone.0055817	journal	February 2013
Depth shapes α- and β-diversities of microbial eukaryotes in surficial sediments of coastal ecosystems: Diversity and biogeography of benthic microeukaryotes Gong, Jun; Shi, Fei; Ma, Bin Environmental Microbiology, Vol. 17, Issue 10 https://doi.org/10.1111/1462-2920.12763	journal	February 2015
Search and clustering orders of magnitude faster than BLAST Edgar, Robert C. Bioinformatics, Vol. 26, Issue 19, p. 2460-2461 https://doi.org/10.1093/bioinformatics/btq461	journal	August 2010
Experimental factors affecting PCR-based estimates of microbial species richness and evenness Engelbrektson, Anna; Kunin, Victor; Wrighton, Kelly C. The ISME Journal, Vol. 4, Issue 5 https://doi.org/10.1038/ismej.2009.153	journal	January 2010
Multivariate dispersion as a measure of beta diversity Anderson, Marti J.; Ellingsen, Kari E.; McArdle, Brian H. Ecology Letters, Vol. 9, Issue 6 https://doi.org/10.1111/j.1461-0248.2006.00926.x	journal	June 2006
Distance-Based Tests for Homogeneity of Multivariate Dispersions Anderson, Marti J. Biometrics, Vol. 62, Issue 1 https://doi.org/10.1111/j.1541-0420.2005.00440.x	journal	October 2005
Wrinkles in the rare biosphere: pyrosequencing errors can lead to artificial inflation of diversity estimates Kunin, Victor; Engelbrektson, Anna; Ochman, Howard Environmental Microbiology, Vol. 12, Issue 1 https://doi.org/10.1111/j.1462-2920.2009.02051.x	journal	January 2010
PicoGreen quantitation of DNA: effective evaluation of samples pre- or post-PCR Ahn, S. Nucleic Acids Research, Vol. 24, Issue 13 https://doi.org/10.1093/nar/24.13.2623	journal	July 1996
UPARSE: highly accurate OTU sequences from microbial amplicon reads Edgar, Robert C. Nature Methods, Vol. 10, Issue 10 https://doi.org/10.1038/nmeth.2604	journal	August 2013
Simultaneous assessment of the macrobiome and microbiome in a bulk sample of tropical arthropods through DNA metasystematics Gibson, J.; Shokralla, S.; Porter, T. M. Proceedings of the National Academy of Sciences, Vol. 111, Issue 22 https://doi.org/10.1073/pnas.1406468111	journal	May 2014
Toward accurate molecular identification of species in complex environmental samples: testing the performance of sequence filtering and clustering methods Flynn, Jullien M.; Brown, Emily A.; Chain, Frédéric J. J. Ecology and Evolution, Vol. 5, Issue 11 https://doi.org/10.1002/ece3.1497	journal	May 2015
Dynamics of Seawater Bacterial Communities in a Shellfish Hatchery Powell, S. M.; Chapman, C. C.; Bermudes, M. Microbial Ecology, Vol. 66, Issue 2 https://doi.org/10.1007/s00248-013-0183-6	journal	January 2013
Analysis, Optimization and Verification of Illumina-Generated 16S rRNA Gene Amplicon Surveys Nelson, Michael C.; Morrison, Hilary G.; Benjamino, Jacquelynn PLoS ONE, Vol. 9, Issue 4 https://doi.org/10.1371/journal.pone.0094249	journal	April 2014
Estimating the Population Size for Capture-Recapture Data with Unequal Catchability Chao, Anne Biometrics, Vol. 43, Issue 4 https://doi.org/10.2307/2531532	journal	December 1987
Intracellular Diversity of the V4 and V9 Regions of the 18S rRNA in Marine Protists (Radiolarians) Assessed by High-Throughput Sequencing Decelle, Johan; Romac, Sarah; Sasaki, Eriko PLoS ONE, Vol. 9, Issue 8 https://doi.org/10.1371/journal.pone.0104297	journal	August 2014
MICROBIOLOGY: Exploring Microbial Diversity--A Vast Below Curtis, T. P. Science, Vol. 309, Issue 5739 https://doi.org/10.1126/science.1118176	journal	August 2005
PCR Biases Distort Bacterial and Archaeal Community Structure in Pyrosequencing Datasets Pinto, Ameet J.; Raskin, Lutgarde; Bertilsson, Stefan PLoS ONE, Vol. 7, Issue 8, Article No. e43093 https://doi.org/10.1371/journal.pone.0043093	journal	August 2012
Quantitative single-cell RNA-seq with unique molecular identifiers Islam, Saiful; Zeisel, Amit; Joost, Simon Nature Methods, Vol. 11, Issue 2 https://doi.org/10.1038/nmeth.2772	journal	December 2013
The measurement of diversity in different types of biological collections Pielou, E. C. Journal of Theoretical Biology, Vol. 13 https://doi.org/10.1016/0022-5193(66)90013-0	journal	December 1966
Introducing mothur: Open-Source, Platform-Independent, Community-Supported Software for Describing and Comparing Microbial Communities Schloss, P. D.; Westcott, S. L.; Ryabin, T. Applied and Environmental Microbiology, Vol. 75, Issue 23, p. 7537-7541 https://doi.org/10.1128/AEM.01541-09	journal	October 2009
Crop monoculture rather than agriculture reduces the spatial turnover of soil bacterial communities at a regional scale: Reduced turnover of soil bacterial communities Figuerola, Eva L. M.; Guerrero, Leandro D.; Türkowsky, Dominique Environmental Microbiology, Vol. 17, Issue 3 https://doi.org/10.1111/1462-2920.12497	journal	June 2014
Long-term soil transplant simulating climate change with latitude significantly alters microbial temporal turnover Liang, Yuting; Jiang, Yuji; Wang, Feng The ISME Journal, Vol. 9, Issue 12 https://doi.org/10.1038/ismej.2015.78	journal	May 2015
Barcoded Primers Used in Multiplex Amplicon Pyrosequencing Bias Amplification Berry, David; Ben Mahfoudh, Karim; Wagner, Michael Applied and Environmental Microbiology, Vol. 77, Issue 21 https://doi.org/10.1128/AEM.05220-11	journal	September 2011
Illumina-based analysis of microbial community diversity Degnan, Patrick H.; Ochman, Howard The ISME Journal, Vol. 6, Issue 1 https://doi.org/10.1038/ismej.2011.74	journal	June 2011
High-Throughput Sequencing: A Roadmap Toward Community Ecology Poisot, Timothée; Péquin, Bérangère; Gravel, Dominique Ecology and Evolution, Vol. 3, Issue 4 https://doi.org/10.1002/ece3.508	journal	March 2013
Multiple Range and Multiple F Tests Duncan, David B. Biometrics, Vol. 11, Issue 1 https://doi.org/10.2307/3001478	journal	March 1955
Detrended correspondence analysis: An improved ordination technique Hill, M. O.; Gauch, H. G. Vegetatio, Vol. 42, Issue 1-3 https://doi.org/10.1007/BF00048870	journal	October 1980
High-throughput DNA sequencing errors are reduced by orders of magnitude using circle sequencing Lou, D. I.; Hussmann, J. A.; McBee, R. M. Proceedings of the National Academy of Sciences, Vol. 110, Issue 49 https://doi.org/10.1073/pnas.1319590110	journal	November 2013
Microbial Community Composition and Diversity via 16S rRNA Gene Amplicons: Evaluating the Illumina Platform Sinclair, Lucas; Osman, Omneya Ahmed; Bertilsson, Stefan PLOS ONE, Vol. 10, Issue 2 https://doi.org/10.1371/journal.pone.0116955	journal	February 2015
Genome sequencing in microfabricated high-density picolitre reactors Margulies, Marcel; Egholm, Michael; Altman, William E. Nature, Vol. 437, Issue 7057, p. 376-380 https://doi.org/10.1038/nature03959	journal	July 2005
Error-correcting barcoded primers for pyrosequencing hundreds of samples in multiplex Hamady, Micah; Walker, Jeffrey J.; Harris, J. Kirk Nature Methods, Vol. 5, Issue 3, p. 235-237 https://doi.org/10.1038/nmeth.1184	journal	February 2008
Microbial Population Structures in the Deep Marine Biosphere Huber, J. A.; Mark Welch, D. B.; Morrison, H. G. Science, Vol. 318, Issue 5847 https://doi.org/10.1126/science.1146689	journal	October 2007
Comparison of two next-generation sequencing technologies for resolving highly complex microbiota composition using tandem variable 16S rRNA gene regions Claesson, Marcus J.; Wang, Qiong; O'Sullivan, Orla Nucleic Acids Research, Vol. 38, Issue 22 https://doi.org/10.1093/nar/gkq873	journal	September 2010
Soil genomics Singh, Brajesh K.; Campbell, Colin D.; Sorenson, Soren J. Nature Reviews Microbiology, Vol. 7, Issue 10 https://doi.org/10.1038/nrmicro2119-c1	journal	August 2009
Performance Comparison of Illumina and Ion Torrent Next-Generation Sequencing Platforms for 16S rRNA-Based Bacterial Community Profiling Salipante, Stephen J.; Kawashima, Toana; Rosenthal, Christopher Applied and Environmental Microbiology, Vol. 80, Issue 24 https://doi.org/10.1128/AEM.02206-14	journal	September 2014
Ultra-high-throughput microbial community analysis on the Illumina HiSeq and MiSeq platforms Caporaso, J. Gregory; Lauber, Christian L.; Walters, William A. The ISME Journal, Vol. 6, Issue 8 https://doi.org/10.1038/ismej.2012.8	journal	March 2012
Actinobacterial Nitrate Reducers and Proteobacterial Denitrifiers Are Abundant in N ₂ O-Metabolizing Palsa Peat Palmer, Katharina; Horn, Marcus A. Applied and Environmental Microbiology, Vol. 78, Issue 16 https://doi.org/10.1128/AEM.00810-12	journal	June 2012
Evaluating Bias of Illumina-Based Bacterial 16S rRNA Gene Profiles Kennedy, Katherine; Hall, Michael W.; Lynch, Michael D. J. Applied and Environmental Microbiology, Vol. 80, Issue 18 https://doi.org/10.1128/AEM.01451-14	journal	July 2014
The microbiota of high-moisture mozzarella cheese produced with different acidification methods Guidone, Angela; Zotta, Teresa; Matera, Attilio International Journal of Food Microbiology, Vol. 216 https://doi.org/10.1016/j.ijfoodmicro.2015.09.002	journal	January 2016
Microbial responses to southward and northward Cambisol soil transplant Wang, Mengmeng; Liu, Shanshan; Wang, Feng MicrobiologyOpen, Vol. 4, Issue 6 https://doi.org/10.1002/mbo3.302	journal	October 2015
Counting absolute numbers of molecules using unique molecular identifiers Kivioja, Teemu; Vähärautio, Anna; Karlsson, Kasper Nature Methods, Vol. 9, Issue 1 https://doi.org/10.1038/nmeth.1778	journal	November 2011

Similar Records

Size Matters: Assessing Optimum Soil Sample Size for Fungal and Bacterial Community Structure Analyses Using High Throughput Sequencing of rRNA Gene Amplicons

Journal Article · Thu Jun 02 00:00:00 EDT 2016 · Frontiers in Microbiology · OSTI ID:1353514

Penton, C. Ryan; Gupta, Vadakattu V. S. R.; Yu, Julian; +1 more

Short-Read Assembly of Full-Length 16S Amplicons Reveals Bacterial Diversity in Subsurface Sediments

Journal Article · Wed Feb 06 00:00:00 EST 2013 · PLoS ONE · OSTI ID:1353514

Miller, Christopher S.; Handley, Kim M.; Wrighton, Kelly C.; +4 more

Parallelized, Aerobic, Single Carbon-Source Enrichments from Different Natural Environments Contain Divergent Microbial Communities

Journal Article · Tue Nov 28 00:00:00 EST 2017 · Frontiers in Microbiology · OSTI ID:1353514

Flynn, Theodore M.; Koval, Jason C.; Greenwald, Stephanie M.; +3 more

Related Subjects

59 BASIC BIOLOGICAL SCIENCES
60 APPLIED LIFE SCIENCES

Title: Evaluation of the reproducibility of amplicon sequencing with Illumina MiSeq platform

Citation Formats

References (71)

Similar Records

Related Subjects