Evaluation of the reproducibility of amplicon sequencing with Illumina MiSeq platform
Abstract
Illumina's MiSeq has become the dominant platform for gene amplicon sequencing in microbial ecology studies; however, various technical concerns, such as reproducibility, still exist. To assess reproducibility, 16S rRNA gene amplicons from 18 soil samples of a reciprocal transplantation experiment were sequenced on an Illumina MiSeq. The V4 region of 16S rRNA gene from each sample was sequenced in triplicate with each replicate having a unique barcode. The average OTU overlap, without considering sequence abundance, at a rarefaction level of 10,323 sequences was 33.4±2.1% and 20.2±1.7% between two and among three technical replicates, respectively. When OTU sequence abundance was considered, the average sequence abundance weighted OTU overlap was 85.6±1.6% and 81.2±2.1% for two and three replicates, respectively. Removing singletons significantly increased the overlap for both (~1-3%, p<0.001). Increasing the sequencing depth to 160,000 reads by deep sequencing increased OTU overlap both when sequence abundance was considered (95%) and when not (44%). However, if singletons were not removed the overlap between two technical replicates (not considering sequence abundance) plateaus at 39% with 30,000 sequences. Diversity measures were not affected by the low overlap as α-diversities were similar among technical replicates while β-diversities (Bray-Curtis) were much smaller among technical replicates than amongmore »
- Publication Date:
- Research Org.:
- Lawrence Berkeley National Laboratory (LBNL), Berkeley, CA (United States)
- Sponsoring Org.:
- USDOE Office of Science (SC)
- OSTI Identifier:
- 1353514
- Alternate Identifier(s):
- OSTI ID: 1379641
- Grant/Contract Number:
- SC0010715; AC02-05CH11231; SC0004601
- Resource Type:
- Published Article
- Journal Name:
- PLoS ONE
- Additional Journal Information:
- Journal Name: PLoS ONE Journal Volume: 12 Journal Issue: 4; Journal ID: ISSN 1932-6203
- Publisher:
- Public Library of Science
- Country of Publication:
- United States
- Language:
- English
- Subject:
- 59 BASIC BIOLOGICAL SCIENCES; 60 APPLIED LIFE SCIENCES
Citation Formats
Wen, Chongqing, Wu, Liyou, Qin, Yujia, Van Nostrand, Joy D., Ning, Daliang, Sun, Bo, Xue, Kai, Liu, Feifei, Deng, Ye, Liang, Yuting, and Zhou, Jizhong. Evaluation of the reproducibility of amplicon sequencing with Illumina MiSeq platform. United States: N. p., 2017.
Web. doi:10.1371/journal.pone.0176716.
Wen, Chongqing, Wu, Liyou, Qin, Yujia, Van Nostrand, Joy D., Ning, Daliang, Sun, Bo, Xue, Kai, Liu, Feifei, Deng, Ye, Liang, Yuting, & Zhou, Jizhong. Evaluation of the reproducibility of amplicon sequencing with Illumina MiSeq platform. United States. https://doi.org/10.1371/journal.pone.0176716
Wen, Chongqing, Wu, Liyou, Qin, Yujia, Van Nostrand, Joy D., Ning, Daliang, Sun, Bo, Xue, Kai, Liu, Feifei, Deng, Ye, Liang, Yuting, and Zhou, Jizhong. Fri .
"Evaluation of the reproducibility of amplicon sequencing with Illumina MiSeq platform". United States. https://doi.org/10.1371/journal.pone.0176716.
@article{osti_1353514,
title = {Evaluation of the reproducibility of amplicon sequencing with Illumina MiSeq platform},
author = {Wen, Chongqing and Wu, Liyou and Qin, Yujia and Van Nostrand, Joy D. and Ning, Daliang and Sun, Bo and Xue, Kai and Liu, Feifei and Deng, Ye and Liang, Yuting and Zhou, Jizhong},
abstractNote = {Illumina's MiSeq has become the dominant platform for gene amplicon sequencing in microbial ecology studies; however, various technical concerns, such as reproducibility, still exist. To assess reproducibility, 16S rRNA gene amplicons from 18 soil samples of a reciprocal transplantation experiment were sequenced on an Illumina MiSeq. The V4 region of 16S rRNA gene from each sample was sequenced in triplicate with each replicate having a unique barcode. The average OTU overlap, without considering sequence abundance, at a rarefaction level of 10,323 sequences was 33.4±2.1% and 20.2±1.7% between two and among three technical replicates, respectively. When OTU sequence abundance was considered, the average sequence abundance weighted OTU overlap was 85.6±1.6% and 81.2±2.1% for two and three replicates, respectively. Removing singletons significantly increased the overlap for both (~1-3%, p<0.001). Increasing the sequencing depth to 160,000 reads by deep sequencing increased OTU overlap both when sequence abundance was considered (95%) and when not (44%). However, if singletons were not removed the overlap between two technical replicates (not considering sequence abundance) plateaus at 39% with 30,000 sequences. Diversity measures were not affected by the low overlap as α-diversities were similar among technical replicates while β-diversities (Bray-Curtis) were much smaller among technical replicates than among treatment replicates (e.g., 0.269 vs. 0.374). Higher diversity coverage, but lower OTU overlap, was observed when replicates were sequenced in separate runs. Detrended correspondence analysis indicated that while there was considerable variation among technical replicates, the reproducibility was sufficient for detecting treatment effects for the samples examined. These results suggest that although there is variation among technical replicates, amplicon sequencing on MiSeq is useful for analyzing microbial community structure if used appropriately and with caution. For example, including technical replicates, removing spurious sequences and unrepresentative OTUs, using a clustering method with a high stringency for OTU generation, estimating treatment effects at higher taxonomic levels, and adapting the unique molecular identifier (UMI) and other newly developed methods to lower PCR and sequencing error and to identify true low abundance rare species all can increase reproducibility.},
doi = {10.1371/journal.pone.0176716},
journal = {PLoS ONE},
number = 4,
volume = 12,
place = {United States},
year = {Fri Apr 28 00:00:00 EDT 2017},
month = {Fri Apr 28 00:00:00 EDT 2017}
}
Free Publicly Available Full Text
Publisher's Version of Record
https://doi.org/10.1371/journal.pone.0176716
https://doi.org/10.1371/journal.pone.0176716
Other availability
Search WorldCat to find libraries that may hold this journal
Cited by: 74 works
Citation information provided by
Web of Science
Web of Science
Save to My Library
You must Sign In or Create an Account in order to save documents to your library.
Works referenced in this record:
A Mathematical Theory of Communication
journal, July 1948
- Shannon, C. E.
- Bell System Technical Journal, Vol. 27, Issue 3
Btrim: A fast, lightweight adapter and quality trimming program for next-generation sequencing technologies
journal, August 2011
- Kong, Yong
- Genomics, Vol. 98, Issue 2
Pyrosequencing Reveals the Microbial Communities in the Red Sea Sponge Carteriospongia foliascens and Their Impressive Shifts in Abnormal Tissues
journal, April 2014
- Gao, Zhao-Ming; Wang, Yong; Lee, On On
- Microbial Ecology, Vol. 68, Issue 3
UCHIME improves sensitivity and speed of chimera detection
journal, June 2011
- Edgar, Robert C.; Haas, Brian J.; Clemente, Jose C.
- Bioinformatics, Vol. 27, Issue 16
DNA recovery from soils of diverse composition.
journal, January 1996
- Zhou, J.; Bruns, M. A.; Tiedje, J. M.
- Applied and environmental microbiology, Vol. 62, Issue 2
Microbial diversity in the deep sea and the underexplored "rare biosphere"
journal, July 2006
- Sogin, M. L.; Morrison, H. G.; Huber, J. A.
- Proceedings of the National Academy of Sciences, Vol. 103, Issue 32
Greengenes, a Chimera-Checked 16S rRNA Gene Database and Workbench Compatible with ARB
journal, July 2006
- DeSantis, T. Z.; Hugenholtz, P.; Larsen, N.
- Applied and Environmental Microbiology, Vol. 72, Issue 7, p. 5069-5072
Patchiness of deep-sea benthic Foraminifera across the Southern Ocean: Insights from high-throughput DNA sequencing
journal, October 2014
- Lejzerowicz, Franck; Esling, Philippe; Pawlowski, Jan
- Deep Sea Research Part II: Topical Studies in Oceanography, Vol. 108
Bugs, Stool, and the Irritable Bowel Syndrome: Too Much Is as Bad as Too Little?
journal, November 2011
- Talley, Nicholas J.; Fodor, Anthony A.
- Gastroenterology, Vol. 141, Issue 5
High-throughput sequencing shows inconsistent results with a microscope-based analysis of the soil prokaryotic community
journal, September 2014
- Ushio, Masayuki; Makoto, Kobayashi; Klaminder, Jonatan
- Soil Biology and Biochemistry, Vol. 76
Random Sampling Process Leads to Overestimation of β-Diversity of Microbial Communities
journal, June 2013
- Zhou, Jizhong; Jiang, Yi-Huei; Deng, Ye
- mBio, Vol. 4, Issue 3
Accurate multiplexing and filtering for high-throughput amplicon-sequencing
journal, February 2015
- Esling, Philippe; Lejzerowicz, Franck; Pawlowski, Jan
- Nucleic Acids Research, Vol. 43, Issue 5
High-Throughput Metagenomic Technologies for Complex Microbial Community Analysis: Open and Closed Formats
journal, January 2015
- Zhou, Jizhong; He, Zhili; Yang, Yunfeng
- mBio, Vol. 6, Issue 1
Using ecological diversity measures with bacterial communities
journal, February 2003
- Hill, Tom C. J.; Walsh, Kerry A.; Harris, James A.
- FEMS Microbiology Ecology, Vol. 43, Issue 1
The interactive effects of soil transplant into colder regions and cropping on soil microbiology and biogeochemistry: Effects of northward soil transplant and cropping
journal, February 2014
- Liu, Shanshan; Wang, Feng; Xue, Kai
- Environmental Microbiology, Vol. 17, Issue 3
UMI-4C for quantitative and targeted chromosomal contact profiling
journal, July 2016
- Schwartzman, Omer; Mukamel, Zohar; Oded-Elkayam, Noa
- Nature Methods, Vol. 13, Issue 8
Practical innovations for high-throughput amplicon sequencing
journal, September 2013
- Lundberg, Derek S.; Yourstone, Scott; Mieczkowski, Piotr
- Nature Methods, Vol. 10, Issue 10
Reproducibility of pyrosequencing data for biodiversity assessment in complex communities
journal, July 2014
- Zhan, Aibin; He, Song; Brown, Emily A.
- Methods in Ecology and Evolution, Vol. 5, Issue 9
Phylogenetic identification and in situ detection of individual microbial cells without cultivation.
journal, January 1995
- Amann, R. I.; Ludwig, W.; Schleifer, K. H.
- Microbiological reviews, Vol. 59, Issue 1
Rare taxa have potential to make metabolic contributions in enhanced biological phosphorus removal ecosystems: EBPR microbiome activity and dynamics
journal, May 2015
- Lawson, Christopher E.; Strachan, Blake J.; Hanson, Niels W.
- Environmental Microbiology, Vol. 17, Issue 12
Reproducibility and quantitation of amplicon sequencing-based detection
journal, February 2011
- Zhou, Jizhong; Wu, Liyou; Deng, Ye
- The ISME Journal, Vol. 5, Issue 8
Naive Bayesian Classifier for Rapid Assignment of rRNA Sequences into the New Bacterial Taxonomy
journal, June 2007
- Wang, Q.; Garrity, G. M.; Tiedje, J. M.
- Applied and Environmental Microbiology, Vol. 73, Issue 16
Global patterns of 16S rRNA diversity at a depth of millions of sequences per sample
journal, June 2010
- Caporaso, J. G.; Lauber, C. L.; Walters, W. A.
- Proceedings of the National Academy of Sciences, Vol. 108, Issue Supplement_1
Barcoding bias in high-throughput multiplex sequencing of miRNA
journal, July 2011
- Alon, S.; Vigneault, F.; Eminaga, S.
- Genome Research, Vol. 21, Issue 9
Comparison of direct boiling method with commercial kits for extracting fecal microbiome DNA by Illumina sequencing of 16S rRNA tags
journal, December 2013
- Peng, Xin; Yu, Ke-Qiang; Deng, Guan-Hua
- Journal of Microbiological Methods, Vol. 95, Issue 3
Rare biosphere exploration using high-throughput sequencing: research progress and perspectives
journal, November 2014
- Zhan, Aibin; MacIsaac, Hugh J.
- Conservation Genetics, Vol. 16, Issue 3
Low sequencing efforts bias analyses of shared taxa in microbial communities
journal, May 2012
- Lemos, Leandro N.; Fulthorpe, Roberta R.; Roesch, Luiz F. W.
- Folia Microbiologica, Vol. 57, Issue 5
Sequence Depth, Not PCR Replication, Improves Ecological Inference from Next Generation DNA Sequencing
journal, February 2014
- Smith, Dylan P.; Peay, Kabir G.
- PLoS ONE, Vol. 9, Issue 2
FLASH: fast length adjustment of short reads to improve genome assemblies
journal, September 2011
- Magoc, T.; Salzberg, S. L.
- Bioinformatics, Vol. 27, Issue 21
Comparative metagenomic and rRNA microbial diversity characterization using archaeal and bacterial synthetic communities: Metagenomic and rRNA diversity characterization
journal, February 2013
- Shakya, Migun; Quince, Christopher; Campbell, James H.
- Environmental Microbiology, Vol. 15, Issue 6
Alterations in the Colonic Microbiota in Response to Osmotic Diarrhea
journal, February 2013
- Gorkiewicz, Gregor; Thallinger, Gerhard G.; Trajanoski, Slave
- PLoS ONE, Vol. 8, Issue 2
Depth shapes α- and β-diversities of microbial eukaryotes in surficial sediments of coastal ecosystems: Diversity and biogeography of benthic microeukaryotes
journal, February 2015
- Gong, Jun; Shi, Fei; Ma, Bin
- Environmental Microbiology, Vol. 17, Issue 10
Search and clustering orders of magnitude faster than BLAST
journal, August 2010
- Edgar, Robert C.
- Bioinformatics, Vol. 26, Issue 19, p. 2460-2461
Experimental factors affecting PCR-based estimates of microbial species richness and evenness
journal, January 2010
- Engelbrektson, Anna; Kunin, Victor; Wrighton, Kelly C.
- The ISME Journal, Vol. 4, Issue 5
Multivariate dispersion as a measure of beta diversity
journal, June 2006
- Anderson, Marti J.; Ellingsen, Kari E.; McArdle, Brian H.
- Ecology Letters, Vol. 9, Issue 6
Distance-Based Tests for Homogeneity of Multivariate Dispersions
journal, October 2005
- Anderson, Marti J.
- Biometrics, Vol. 62, Issue 1
Wrinkles in the rare biosphere: pyrosequencing errors can lead to artificial inflation of diversity estimates
journal, January 2010
- Kunin, Victor; Engelbrektson, Anna; Ochman, Howard
- Environmental Microbiology, Vol. 12, Issue 1
PicoGreen quantitation of DNA: effective evaluation of samples pre- or post-PCR
journal, July 1996
- Ahn, S.
- Nucleic Acids Research, Vol. 24, Issue 13
UPARSE: highly accurate OTU sequences from microbial amplicon reads
journal, August 2013
- Edgar, Robert C.
- Nature Methods, Vol. 10, Issue 10
Simultaneous assessment of the macrobiome and microbiome in a bulk sample of tropical arthropods through DNA metasystematics
journal, May 2014
- Gibson, J.; Shokralla, S.; Porter, T. M.
- Proceedings of the National Academy of Sciences, Vol. 111, Issue 22
Toward accurate molecular identification of species in complex environmental samples: testing the performance of sequence filtering and clustering methods
journal, May 2015
- Flynn, Jullien M.; Brown, Emily A.; Chain, Frédéric J. J.
- Ecology and Evolution, Vol. 5, Issue 11
Dynamics of Seawater Bacterial Communities in a Shellfish Hatchery
journal, January 2013
- Powell, S. M.; Chapman, C. C.; Bermudes, M.
- Microbial Ecology, Vol. 66, Issue 2
Analysis, Optimization and Verification of Illumina-Generated 16S rRNA Gene Amplicon Surveys
journal, April 2014
- Nelson, Michael C.; Morrison, Hilary G.; Benjamino, Jacquelynn
- PLoS ONE, Vol. 9, Issue 4
Estimating the Population Size for Capture-Recapture Data with Unequal Catchability
journal, December 1987
- Chao, Anne
- Biometrics, Vol. 43, Issue 4
Intracellular Diversity of the V4 and V9 Regions of the 18S rRNA in Marine Protists (Radiolarians) Assessed by High-Throughput Sequencing
journal, August 2014
- Decelle, Johan; Romac, Sarah; Sasaki, Eriko
- PLoS ONE, Vol. 9, Issue 8
MICROBIOLOGY: Exploring Microbial Diversity--A Vast Below
journal, August 2005
- Curtis, T. P.
- Science, Vol. 309, Issue 5739
PCR Biases Distort Bacterial and Archaeal Community Structure in Pyrosequencing Datasets
journal, August 2012
- Pinto, Ameet J.; Raskin, Lutgarde; Bertilsson, Stefan
- PLoS ONE, Vol. 7, Issue 8, Article No. e43093
Quantitative single-cell RNA-seq with unique molecular identifiers
journal, December 2013
- Islam, Saiful; Zeisel, Amit; Joost, Simon
- Nature Methods, Vol. 11, Issue 2
The measurement of diversity in different types of biological collections
journal, December 1966
- Pielou, E. C.
- Journal of Theoretical Biology, Vol. 13
Introducing mothur: Open-Source, Platform-Independent, Community-Supported Software for Describing and Comparing Microbial Communities
journal, October 2009
- Schloss, P. D.; Westcott, S. L.; Ryabin, T.
- Applied and Environmental Microbiology, Vol. 75, Issue 23, p. 7537-7541
Crop monoculture rather than agriculture reduces the spatial turnover of soil bacterial communities at a regional scale: Reduced turnover of soil bacterial communities
journal, June 2014
- Figuerola, Eva L. M.; Guerrero, Leandro D.; Türkowsky, Dominique
- Environmental Microbiology, Vol. 17, Issue 3
Long-term soil transplant simulating climate change with latitude significantly alters microbial temporal turnover
journal, May 2015
- Liang, Yuting; Jiang, Yuji; Wang, Feng
- The ISME Journal, Vol. 9, Issue 12
Barcoded Primers Used in Multiplex Amplicon Pyrosequencing Bias Amplification
journal, September 2011
- Berry, David; Ben Mahfoudh, Karim; Wagner, Michael
- Applied and Environmental Microbiology, Vol. 77, Issue 21
Illumina-based analysis of microbial community diversity
journal, June 2011
- Degnan, Patrick H.; Ochman, Howard
- The ISME Journal, Vol. 6, Issue 1
High-Throughput Sequencing: A Roadmap Toward Community Ecology
journal, March 2013
- Poisot, Timothée; Péquin, Bérangère; Gravel, Dominique
- Ecology and Evolution, Vol. 3, Issue 4
Multiple Range and Multiple F Tests
journal, March 1955
- Duncan, David B.
- Biometrics, Vol. 11, Issue 1
Detrended correspondence analysis: An improved ordination technique
journal, October 1980
- Hill, M. O.; Gauch, H. G.
- Vegetatio, Vol. 42, Issue 1-3
High-throughput DNA sequencing errors are reduced by orders of magnitude using circle sequencing
journal, November 2013
- Lou, D. I.; Hussmann, J. A.; McBee, R. M.
- Proceedings of the National Academy of Sciences, Vol. 110, Issue 49
Microbial Community Composition and Diversity via 16S rRNA Gene Amplicons: Evaluating the Illumina Platform
journal, February 2015
- Sinclair, Lucas; Osman, Omneya Ahmed; Bertilsson, Stefan
- PLOS ONE, Vol. 10, Issue 2
Genome sequencing in microfabricated high-density picolitre reactors
journal, July 2005
- Margulies, Marcel; Egholm, Michael; Altman, William E.
- Nature, Vol. 437, Issue 7057, p. 376-380
Error-correcting barcoded primers for pyrosequencing hundreds of samples in multiplex
journal, February 2008
- Hamady, Micah; Walker, Jeffrey J.; Harris, J. Kirk
- Nature Methods, Vol. 5, Issue 3, p. 235-237
Microbial Population Structures in the Deep Marine Biosphere
journal, October 2007
- Huber, J. A.; Mark Welch, D. B.; Morrison, H. G.
- Science, Vol. 318, Issue 5847
Comparison of two next-generation sequencing technologies for resolving highly complex microbiota composition using tandem variable 16S rRNA gene regions
journal, September 2010
- Claesson, Marcus J.; Wang, Qiong; O'Sullivan, Orla
- Nucleic Acids Research, Vol. 38, Issue 22
Soil genomics
journal, August 2009
- Singh, Brajesh K.; Campbell, Colin D.; Sorenson, Soren J.
- Nature Reviews Microbiology, Vol. 7, Issue 10
Performance Comparison of Illumina and Ion Torrent Next-Generation Sequencing Platforms for 16S rRNA-Based Bacterial Community Profiling
journal, September 2014
- Salipante, Stephen J.; Kawashima, Toana; Rosenthal, Christopher
- Applied and Environmental Microbiology, Vol. 80, Issue 24
Ultra-high-throughput microbial community analysis on the Illumina HiSeq and MiSeq platforms
journal, March 2012
- Caporaso, J. Gregory; Lauber, Christian L.; Walters, William A.
- The ISME Journal, Vol. 6, Issue 8
Actinobacterial Nitrate Reducers and Proteobacterial Denitrifiers Are Abundant in N 2 O-Metabolizing Palsa Peat
journal, June 2012
- Palmer, Katharina; Horn, Marcus A.
- Applied and Environmental Microbiology, Vol. 78, Issue 16
Evaluating Bias of Illumina-Based Bacterial 16S rRNA Gene Profiles
journal, July 2014
- Kennedy, Katherine; Hall, Michael W.; Lynch, Michael D. J.
- Applied and Environmental Microbiology, Vol. 80, Issue 18
The microbiota of high-moisture mozzarella cheese produced with different acidification methods
journal, January 2016
- Guidone, Angela; Zotta, Teresa; Matera, Attilio
- International Journal of Food Microbiology, Vol. 216
Microbial responses to southward and northward Cambisol soil transplant
journal, October 2015
- Wang, Mengmeng; Liu, Shanshan; Wang, Feng
- MicrobiologyOpen, Vol. 4, Issue 6
Counting absolute numbers of molecules using unique molecular identifiers
journal, November 2011
- Kivioja, Teemu; Vähärautio, Anna; Karlsson, Kasper
- Nature Methods, Vol. 9, Issue 1