Modeling SARS-CoV-2 proteins in the CASP-commons experiment

Kryshtafovych, Andriy; Moult, John; Billings, Wendy M.; Della Corte, Dennis; Fidelis, Krzysztof; Kwon, Sohee; Olechnovič, Kliment; Seok, Chaok; Venclovas, Česlovas; Won, Jonghun

doi:10.1002/prot.26231

Modeling SARS-CoV-2 proteins in the CASP-commons experiment

Journal Article · Mon Aug 30 00:00:00 EDT 2021 · Proteins

DOI:https://doi.org/10.1002/prot.26231· OSTI ID:1976381

^[1]; ^[2]; Billings, Wendy M. ^[3]; ^[3]; ^[4]; Kwon, Sohee ^[5]; ^[6]; ^[5]; ^[6]; Won, Jonghun ^[5]

University of California, Davis, CA (United States); OSTI
University of Maryland, College Park, MD (United States)
Brigham Young University, Provo, UT (United States)
University of California, Davis, CA (United States)
Seoul National University, Seoul (Korea, Republic of)
Vilnius University (Lithuania)

Critical Assessment of Structure Prediction (CASP) is an organization aimed at advancing the state of the art in computing protein structure from sequence. In the spring of 2020, CASP launched a community project to compute the structures of the most structurally challenging proteins coded for in the SARS-CoV-2 genome. Forty-seven research groups submitted over 3000 three-dimensional models and 700 sets of accuracy estimates on 10 proteins. The resulting models were released to the public. CASP community members also worked together to provide estimates of local and global accuracy and identify structure-based domain boundaries for some proteins. Subsequently, two of these structures (ORF3a and ORF8) have been solved experimentally, allowing assessment of both model quality and the accuracy estimates. Models from the AlphaFold2 group were found to have good agreement with the experimental structures, with main chain GDT_TS accuracy scores ranging from 63 (a correct topology) to 87 (competitive with experiment).

View Accepted Manuscript (DOE)

Research Organization:: Donald Danforth Plant Science Center, St. Louis, MO (United States); Georgia Institute of Technology, Atlanta, GA (United States)

Sponsoring Organization:: USDOE Office of Science (SC); National Institutes of Health (NIH); National Research Foundation of Korea (NRF); Research Council of Lithuania; National Science Foundation (NSF); Biotechnology and Biological Science Research Council; Biotechnology and Biological Sciences Research Council (BBSRC); National Science Centre (NCN)

Contributing Organization:: CASP‐COVID participants

Grant/Contract Number:: SC0020400; SC0021303

OSTI ID:: 1976381

Alternate ID(s):: OSTI ID: 1824727

Journal Information:: Proteins, Journal Name: Proteins Journal Issue: 12 Vol. 89; ISSN 0887-3585

Publisher:: WileyCopyright Statement

Country of Publication:: United States

Language:: English

References (50)

Processing and evaluation of predictions in CASP4 Zemla, Adam; Venclovas, ?eslovas; Moult, John Proteins: Structure, Function, and Genetics, Vol. 45, Issue S5 https://doi.org/10.1002/prot.10052	journal	January 2001
CASP6 data processing and automatic evaluation at the protein structure prediction center Kryshtafovych, Andriy; Milostan, Maciej; Szajkowski, Lukasz Proteins: Structure, Function, and Bioinformatics, Vol. 61, Issue S7 https://doi.org/10.1002/prot.20718	journal	January 2005
New tools and expanded data analysis capabilities at the protein structure prediction center Kryshtafovych, Andriy; Prlic, Andreas; Dmytriv, Zinoviy Proteins: Structure, Function, and Bioinformatics, Vol. 69, Issue S8 https://doi.org/10.1002/prot.21653	journal	January 2007
Protein structure prediction center in CASP8: Update on CASP Operations Kryshtafovych, Andriy; Krysko, Oleh; Daniluk, Pawel Proteins: Structure, Function, and Bioinformatics, Vol. 77, Issue S9 https://doi.org/10.1002/prot.22517	journal	January 2009
Evaluation of CASP8 model quality predictions Cozzetto, Domenico; Kryshtafovych, Andriy; Tramontano, Anna Proteins: Structure, Function, and Bioinformatics, Vol. 77, Issue S9 https://doi.org/10.1002/prot.22534	journal	January 2009
Evaluation of template-based models in CASP8 with standard measures Cozzetto, Domenico; Kryshtafovych, Andriy; Fidelis, Krzysztof Proteins: Structure, Function, and Bioinformatics, Vol. 77, Issue S9 https://doi.org/10.1002/prot.22561	journal	January 2009
Assessment of template based protein structure predictions in CASP9 Mariani, Valerio; Kiefer, Florian; Schmidt, Tobias Proteins: Structure, Function, and Bioinformatics, Vol. 79, Issue S10 https://doi.org/10.1002/prot.23177	journal	January 2011
Evaluation of model quality predictions in CASP9: Evaluation of Model Quality Predictions in CASP9 Kryshtafovych, Andriy; Fidelis, Krzysztof; Tramontano, Anna Proteins: Structure, Function, and Bioinformatics, Vol. 79, Issue S10 https://doi.org/10.1002/prot.23180	journal	January 2011
Critical assessment of methods of protein structure prediction (CASP)-round IX Moult, John; Fidelis, Krzysztof; Kryshtafovych, Andriy Proteins: Structure, Function, and Bioinformatics, Vol. 79, Issue S10 https://doi.org/10.1002/prot.23200	journal	January 2011
CAD-score: A new contact area difference-based function for evaluation of protein structural models Olechnovič, Kliment; Kulberkytė, Eleonora; Venclovas, Česlovas Proteins: Structure, Function, and Bioinformatics, Vol. 81, Issue 1 https://doi.org/10.1002/prot.24172	journal	September 2012
Assessment of the assessment: Evaluation of the model quality estimates in CASP10: Model Quality Assessment Kryshtafovych, Andriy; Barbato, Alessandro; Fidelis, Krzysztof Proteins: Structure, Function, and Bioinformatics, Vol. 82 https://doi.org/10.1002/prot.24347	journal	August 2013
CASP prediction center infrastructure and evaluation measures in CASP10 and CASP ROLL: CASP Prediction Center Kryshtafovych, Andriy; Monastyrskyy, Bohdan; Fidelis, Krzysztof Proteins: Structure, Function, and Bioinformatics, Vol. 82 https://doi.org/10.1002/prot.24399	journal	October 2013
Critical assessment of methods of protein structure prediction (CASP) - round x: Critical Assessment of Structure Prediction Moult, John; Fidelis, Krzysztof; Kryshtafovych, Andriy Proteins: Structure, Function, and Bioinformatics, Vol. 82 https://doi.org/10.1002/prot.24452	journal	December 2013
Assessment of template-based protein structure predictions in CASP10: CASP10 TBM Assessment Huang, Yuanpeng J.; Mao, Binchen; Aramini, James M. Proteins: Structure, Function, and Bioinformatics, Vol. 82 https://doi.org/10.1002/prot.24488	journal	January 2014
Methods of model accuracy estimation can help selecting the best models from decoy sets: Assessment of model accuracy estimations in CASP11: Estimation of Model Accuracy Kryshtafovych, Andriy; Barbato, Alessandro; Monastyrskyy, Bohdan Proteins: Structure, Function, and Bioinformatics, Vol. 84 https://doi.org/10.1002/prot.24919	journal	September 2015
CASP11 statistics and the prediction center evaluation system: Prediction Center in CASP11 Kryshtafovych, Andriy; Monastyrskyy, Bohdan; Fidelis, Krzysztof Proteins: Structure, Function, and Bioinformatics, Vol. 84 https://doi.org/10.1002/prot.25005	journal	March 2016
Assessment of template-based modeling of protein structure in CASP11: Template-based Modeling Assessment in CASP11 Modi, Vivek; Xu, Qifang; Adhikari, Sam Proteins: Structure, Function, and Bioinformatics, Vol. 84 https://doi.org/10.1002/prot.25049	journal	June 2016
Cover Image, Volume 84, Issue S1 Moult, John; Fidelis, Krzysztof; Kryshtafovych, Andriy Proteins: Structure, Function, and Bioinformatics, Vol. 84 https://doi.org/10.1002/prot.25151	journal	September 2016
Assessment of model accuracy estimations in CASP12 Kryshtafovych, Andriy; Monastyrskyy, Bohdan; Fidelis, Krzysztof Proteins: Structure, Function, and Bioinformatics, Vol. 86 https://doi.org/10.1002/prot.25371	journal	September 2017
Protein structure prediction using Rosetta in CASP12 Ovchinnikov, Sergey; Park, Hahnbeom; Kim, David E. Proteins: Structure, Function, and Bioinformatics, Vol. 86 https://doi.org/10.1002/prot.25390	journal	October 2017
Assessment of protein assembly prediction in CASP12 Lafita, Aleix; Bliven, Spencer; Kryshtafovych, Andriy Proteins: Structure, Function, and Bioinformatics, Vol. 86 https://doi.org/10.1002/prot.25408	journal	November 2017
Assessment of the model refinement category in CASP12 Hovan, Ladislav; Oleinikovas, Vladimiras; Yalinca, Havva Proteins: Structure, Function, and Bioinformatics, Vol. 86 https://doi.org/10.1002/prot.25409	journal	November 2017
Critical assessment of methods of protein structure prediction (CASP)-Round XII Moult, John; Fidelis, Krzysztof; Kryshtafovych, Andriy Proteins: Structure, Function, and Bioinformatics, Vol. 86 https://doi.org/10.1002/prot.25415	journal	December 2017
Assessment of hard target modeling in CASP12 reveals an emerging role of alignment-based contact prediction methods Abriata, Luciano A.; Tamò, Giorgio E.; Monastyrskyy, Bohdan Proteins: Structure, Function, and Bioinformatics, Vol. 86 https://doi.org/10.1002/prot.25423	journal	November 2017
Evaluation of the template-based modeling in CASP12 Kryshtafovych, Andriy; Monastyrskyy, Bohdan; Fidelis, Krzysztof Proteins: Structure, Function, and Bioinformatics, Vol. 86 https://doi.org/10.1002/prot.25425	journal	December 2017
Protein tertiary structure modeling driven by deep learning and contact distance prediction in CASP13 Hou, Jie; Wu, Tianqi; Cao, Renzhi Proteins: Structure, Function, and Bioinformatics, Vol. 87, Issue 12 https://doi.org/10.1002/prot.25697	journal	April 2019
Driven to near‐experimental accuracy by refinement via molecular dynamics simulations Heo, Lim; Arbour, Collin F.; Feig, Michael Proteins: Structure, Function, and Bioinformatics, Vol. 87, Issue 12 https://doi.org/10.1002/prot.25759	journal	June 2019
Estimation of model accuracy in CASP13 Cheng, Jianlin; Choe, Myong‐Ho; Elofsson, Arne Proteins: Structure, Function, and Bioinformatics, Vol. 87, Issue 12 https://doi.org/10.1002/prot.25767	journal	July 2019
Structural modeling of protein complexes: Current capabilities and challenges Dapkūnas, Justas; Olechnovič, Kliment; Venclovas, Česlovas Proteins: Structure, Function, and Bioinformatics, Vol. 87, Issue 12 https://doi.org/10.1002/prot.25774	journal	July 2019
High‐accuracy refinement using Rosetta in CASP13 Park, Hahnbeom; Lee, Gyu Rie; Kim, David E. Proteins: Structure, Function, and Bioinformatics, Vol. 87, Issue 12 https://doi.org/10.1002/prot.25784	journal	August 2019
A further leap of improvement in tertiary structure prediction in CASP13 prompts new routes for future assessments Abriata, Luciano A.; Tamò, Giorgio E.; Dal Peraro, Matteo Proteins: Structure, Function, and Bioinformatics, Vol. 87, Issue 12 https://doi.org/10.1002/prot.25787	journal	August 2019
Deep‐learning contact‐map guided protein structure prediction in CASP13 Zheng, Wei; Li, Yang; Zhang, Chengxin Proteins: Structure, Function, and Bioinformatics, Vol. 87, Issue 12 https://doi.org/10.1002/prot.25792	journal	August 2019
Evaluation of model refinement in CASP13 Read, Randy J.; Sammito, Massimo D.; Kryshtafovych, Andriy Proteins: Structure, Function, and Bioinformatics, Vol. 87, Issue 12 https://doi.org/10.1002/prot.25794	journal	August 2019
Assessment of protein assembly prediction in CASP13 Guzenko, Dmytro; Lafita, Aleix; Monastyrskyy, Bohdan Proteins: Structure, Function, and Bioinformatics, Vol. 87, Issue 12 https://doi.org/10.1002/prot.25795	journal	August 2019
Evaluation of template‐based modeling in CASP13 Croll, Tristan I.; Sammito, Massimo D.; Kryshtafovych, Andriy Proteins: Structure, Function, and Bioinformatics, Vol. 87, Issue 12 https://doi.org/10.1002/prot.25800	journal	August 2019
Assessment of protein model structure accuracy estimation in CASP13: Challenges in the era of deep learning Won, Jonghun; Baek, Minkyung; Monastyrskyy, Bohdan Proteins: Structure, Function, and Bioinformatics, Vol. 87, Issue 12 https://doi.org/10.1002/prot.25804	journal	August 2019
Critical assessment of methods of protein structure prediction (CASP)—Round XIII Kryshtafovych, Andriy; Schwede, Torsten; Topf, Maya Proteins: Structure, Function, and Bioinformatics, Vol. 87, Issue 12 https://doi.org/10.1002/prot.25823	journal	August 2019
Protein structure prediction using multiple deep neural networks in the 13th Critical Assessment of Protein Structure Prediction (CASP13) Senior, Andrew W.; Evans, Richard; Jumper, John Proteins: Structure, Function, and Bioinformatics, Vol. 87, Issue 12 https://doi.org/10.1002/prot.25834	journal	August 2019
High‐accuracy protein structure prediction in CASP14 Pereira, Joana; Simpkin, Adam J.; Hartmann, Marcus D. Proteins: Structure, Function, and Bioinformatics, Vol. 89, Issue 12 https://doi.org/10.1002/prot.26171	journal	July 2021
Assessment of protein model structure accuracy estimation in CASP14 : Old and new challenges Kwon, Sohee; Won, Jonghun; Kryshtafovych, Andriy Proteins: Structure, Function, and Bioinformatics, Vol. 89, Issue 12 https://doi.org/10.1002/prot.26192	journal	August 2021
Applying and improving AlphaFold at CASP14 Jumper, John; Evans, Richard; Pritzel, Alexander Proteins: Structure, Function, and Bioinformatics, Vol. 89, Issue 12 https://doi.org/10.1002/prot.26257	journal	November 2021
A new coronavirus associated with human respiratory disease in China Wu, Fan; Zhao, Su; Yu, Bin Nature, Vol. 579, Issue 7798 https://doi.org/10.1038/s41586-020-2008-3	journal	February 2020
SignalP 5.0 improves signal peptide predictions using deep neural networks Almagro Armenteros, José Juan; Tsirigos, Konstantinos D.; Sønderby, Casper Kaae Nature Biotechnology, Vol. 37, Issue 4 https://doi.org/10.1038/s41587-019-0036-z	journal	February 2019
The DISOPRED server for the prediction of protein disorder Ward, J. J.; McGuffin, L. J.; Bryson, K. Bioinformatics, Vol. 20, Issue 13 https://doi.org/10.1093/bioinformatics/bth195	journal	March 2004
lDDT: a local superposition-free score for comparing protein structures and models using distance difference tests Mariani, Valerio; Biasini, Marco; Barbato, Alessandro Bioinformatics, Vol. 29, Issue 21 https://doi.org/10.1093/bioinformatics/btt473	journal	August 2013
LGA: a method for finding 3D similarities in protein structures Zemla, A. Nucleic Acids Research, Vol. 31, Issue 13 https://doi.org/10.1093/nar/gkg571	journal	July 2003
Advantages of combined transmembrane topology and signal peptide prediction--the Phobius web server Kall, L.; Krogh, A.; Sonnhammer, E. L. L. Nucleic Acids Research, Vol. 35, Issue Web Server https://doi.org/10.1093/nar/gkm256	journal	May 2007
Pcons.net: protein structure prediction meta server Wallner, B.; Larsson, P.; Elofsson, A. Nucleic Acids Research, Vol. 35, Issue Web Server https://doi.org/10.1093/nar/gkm319	journal	May 2007
The PSIPRED Protein Analysis Workbench: 20 years on Buchan, Daniel W. A.; Jones, David T. Nucleic Acids Research, Vol. 47, Issue W1 https://doi.org/10.1093/nar/gkz297	journal	April 2019
HH-suite3 for fast remote homology detection and deep protein annotation Steinegger, Martin; Meier, Markus; Mirdita, Milot BMC Bioinformatics, Vol. 20, Issue 1 https://doi.org/10.1186/s12859-019-3019-7	journal	September 2019

Similar Records

Structure of SARS-CoV-2 ORF8, a rapidly evolving immune evasion protein

Journal Article · Tue Dec 22 23:00:00 EST 2020 · Proceedings of the National Academy of Sciences of the United States of America · OSTI ID:1815732

Atypical Divergence of SARS-CoV-2 Orf8 from Orf7a within the Coronavirus Lineage Suggests Potential Stealthy Viral Strategies in Immune Evasion

Journal Article · Mon Feb 22 23:00:00 EST 2021 · mBio · OSTI ID:1798766

Related Subjects

59 BASIC BIOLOGICAL SCIENCES
CASP
COVID
EMA
SARS-CoV-2
model accuracy
protein structure prediction

Modeling SARS-CoV-2 proteins in the CASP-commons experiment

Citation Formats

References (50)

Similar Records

Related Subjects