High-performance conjugate-gradient benchmark: A new metric for ranking high-performance computing systems

Dongarra, Jack; Heroux, Michael A.; Luszczek, Piotr

doi:10.1177/1094342015593158

High-performance conjugate-gradient benchmark: A new metric for ranking high-performance computing systems

Journal Article · 17 August 2015 · International Journal of High Performance Computing Applications

DOI:https://doi.org/10.1177/1094342015593158· OSTI ID:1361299

Dongarra, Jack ^[1]; Heroux, Michael A. ^[2]; Luszczek, Piotr ^[3]

Univ. of Tennessee, Knoxville, TN (United States). Dept. of Electrical Engineering and Computer Science; Oak Ridge National Lab. (ORNL), Oak Ridge, TN (United States). Computer Science and Mathematics Division
Sandia National Lab. (SNL-NM), Albuquerque, NM (United States). Scalable Algorithm Dept.
Univ. of Tennessee, Knoxville, TN (United States). Dept. of Electrical Engineering and Computer Science

Here, we describe a new high-performance conjugate-gradient (HPCG) benchmark. HPCG is composed of computations and data-access patterns commonly found in scientific applications. HPCG strives for a better correlation to existing codes from the computational science domain and to be representative of their performance. Furthermore, HPCG is meant to help drive the computer system design and implementation in directions that will better impact future performance improvement.

View Accepted Manuscript (DOE)

Research Organization:: Oak Ridge National Laboratory (ORNL), Oak Ridge, TN (United States). Oak Ridge Leadership Computing Facility (OLCF); Oak Ridge National Laboratory (ORNL), Oak Ridge, TN (United States)

Sponsoring Organization:: DOE Office of Science; USDOE

Grant/Contract Number:: AC05-00OR22725

OSTI ID:: 1361299

Alternate ID(s):: OSTI ID: 1429716

Journal Information:: International Journal of High Performance Computing Applications, Journal Name: International Journal of High Performance Computing Applications Journal Issue: 1 Vol. 30; ISSN 1094-3420

Publisher:: SAGECopyright Statement

Country of Publication:: United States

Language:: English

References (18)

The LINPACK Benchmark: past, present and future Dongarra, Jack J.; Luszczek, Piotr; Petitet, Antoine Concurrency and Computation: Practice and Experience, Vol. 15, Issue 9 https://doi.org/10.1002/cpe.728	journal	January 2003
Optimizing a Conjugate Gradient Solver with Non-Blocking Collective Operations Hoefler, Torsten; Gottschling, Peter; Rehm, Wolfgang Recent Advances in Parallel Virtual Machine and Message Passing Interface https://doi.org/10.1007/11846802_52	book	January 2006
Multitasking the conjugate gradient method on the CRAY X-MP/48 Meurant, Gérard Parallel Computing, Vol. 5, Issue 3 https://doi.org/10.1016/0167-8191(87)90037-8	journal	November 1987
s-step iterative methods for symmetric linear systems Chronopoulos, A. T.; Gear, C. W. Journal of Computational and Applied Mathematics, Vol. 25, Issue 2 https://doi.org/10.1016/0377-0427(89)90045-9	journal	February 1989
Optimizing a conjugate gradient solver with non-blocking collective operations Hoefler, Torsten; Gottschling, Peter; Lumsdaine, Andrew Parallel Computing, Vol. 33, Issue 9 https://doi.org/10.1016/j.parco.2007.06.006	journal	September 2007
Partial Differential Equations Co, Tomas B. Methods of Applied Mathematics for Engineers and Scientists https://doi.org/10.1017/cbo9781139021821.014	book	June 2013
Partial Differential Equations Wloka, J. Cambridge University Press https://doi.org/10.1017/cbo9781139171755	journal	January 2012
OSKI: A library of automatically tuned sparse matrix kernels Vuduc, Richard; Demmel, James W.; Yelick, Katherine A. Journal of Physics: Conference Series, Vol. 16 https://doi.org/10.1088/1742-6596/16/1/071	journal	January 2005
Iterative Methods for Sparse Linear Systems Saad, Yousef https://doi.org/10.1137/1.9780898718003	book	January 2003
Partial Differential Equations Mattheij, R. M. M.; Rienstra, S. W.; Boonkkamp, J. H. M. ten Thije Mathematical Modeling and Computation https://doi.org/10.1137/1.9780898718270	book	January 2005
Efficient sparse matrix-vector multiplication on x86-based many-core processors Liu, Xing; Smelyanskiy, Mikhail; Chow, Edmond Proceedings of the 27th international ACM conference on International conference on supercomputing - ICS '13 https://doi.org/10.1145/2464996.2465013	conference	January 2013
An Iterative Solver Benchmark Dongarra, Jack; Eijkhout, Victor; Vorst, Henk van der Scientific Programming, Vol. 9, Issue 4 https://doi.org/10.1155/2001/527931	journal	January 2001
Sparsity: Optimization Framework for Sparse Matrix Kernels Im, Eun-Jin; Yelick, Katherine; Vuduc, Richard The International Journal of High Performance Computing Applications, Vol. 18, Issue 1 https://doi.org/10.1177/1094342004041296	journal	February 2004
Partial Differential Equations Henner, Victor; Belozerova, Tatyana; Nepomnyashchy, Alexander Chapman and Hall/CRC https://doi.org/10.1201/9780429440908	book	November 2019
Partial Differential Equations Oberwolfach, Mathematisches Forschungsinstitut Mathematisches Forschungsinstitut Oberwolfach https://doi.org/10.14760/owr-2015-36	text	January 2015
Reducing communication costs in the conjugate gradient algorithm on distributed memory multiprocessors D`Azevedo, E. F.; Romine, C. H. https://doi.org/10.2172/10176473	report	September 1992
Reducing communication costs in the conjugate gradient algorithm on distributed memory multiprocessors D'Azevedo, E. F.; Romine, C. H. https://doi.org/10.2172/7172467	report	September 1992
PREPARING FOR EXASCALE: ORNL Leadership Computing Application Requirements and Strategy Joubert, Wayne; Kothe, Douglas B.; Nam, Hai Ah https://doi.org/10.2172/974637	report	December 2009

Cited By (21)

Validating quantum computers using randomized model circuits Cross, Andrew W.; Bishop, Lev S.; Sheldon, Sarah Physical Review A, Vol. 100, Issue 3 https://doi.org/10.1103/physreva.100.032328	journal	September 2019
Performance Evaluation of Deep Learning Tools in Docker Containers Xu, Pengfei; Shi, Shaohuai; Chu, Xiaowen 2017 3rd International Conference on Big Data Computing and Communications (BIGCOM) https://doi.org/10.1109/bigcom.2017.32	conference	August 2017
Fast and Faithful Performance Prediction of MPI Applications: the HPL Case Study Cornebize, Tom; Legrand, Arnaud; Heinrich, Franz C. 2019 IEEE International Conference on Cluster Computing (CLUSTER) https://doi.org/10.1109/cluster.2019.8891011	conference	September 2019
Simulation-Based Performance Prediction of HPC Applications: A Case Study of HPL Xu, Gen; Ibeid, Huda; Jiang, Xin 2020 IEEE/ACM International Workshop on HPC User Support Tools (HUST) and Workshop on Programming and Performance Visualization Tools (ProTools) https://doi.org/10.1109/hustprotools51951.2020.00016	conference	November 2020
AIBench Training: Balanced Industry-Standard AI Training Benchmarking Tang, Fei; Gao, Wanling; Zhan, Jianfeng 2021 IEEE International Symposium on Performance Analysis of Systems and Software (ISPASS) https://doi.org/10.1109/ispass51385.2021.00014	conference	March 2021
Analyzing the Effect of Local Rounding Error Propagation on the Maximal Attainable Accuracy of the Pipelined Conjugate Gradient Method Cools, Siegfried; Yetkin, Emrullah Fatih; Agullo, Emmanuel SIAM Journal on Matrix Analysis and Applications, Vol. 39, Issue 1 https://doi.org/10.1137/17m1117872	journal	January 2018
The communication-hiding pipelined BiCGStab method for the parallel solution of large unsymmetric linear systems Cools, Siegfried; Vanroose, Wim arXiv https://doi.org/10.48550/arxiv.1612.01395	text	January 2016
Numerically Stable Variants of the Communication-hiding Pipelined Conjugate Gradients Algorithm for the Parallel Solution of Large Scale Symmetric Linear Systems Cools, Siegfried; Vanroose, Wim arXiv https://doi.org/10.48550/arxiv.1706.05988	text	January 2017
The Communication-Hiding Conjugate Gradient Method with Deep Pipelines Cornelis, Jeffrey; Cools, Siegfried; Vanroose, Wim arXiv https://doi.org/10.48550/arxiv.1801.04728	preprint	January 2018
Numerical analysis of the maximal attainable accuracy in communication hiding pipelined Conjugate Gradient methods Cools, Siegfried arXiv https://doi.org/10.48550/arxiv.1804.02962	preprint	January 2018
Numerically Stable Recurrence Relations for the Communication Hiding Pipelined Conjugate Gradient Method Cools, Siegfried; Cornelis, Jeffrey; Vanroose, Wim arXiv https://doi.org/10.48550/arxiv.1902.03100	preprint	January 2019
Shall numerical astrophysics step into the era of Exascale computing? Taffoni, Giuliano; Murante, Giuseppe; Tornatore, Luca arXiv https://doi.org/10.48550/arxiv.1904.11720	preprint	January 2019
Improving strong scaling of the Conjugate Gradient method for solving large linear systems using global reduction pipelining Cools, Siegfried; Cornelis, Jeffrey; Ghysels, Pieter arXiv https://doi.org/10.48550/arxiv.1905.06850	preprint	January 2019
Investigating Applications on the A64FX Jackson, Adrian; Weiland, Michèle; Brown, Nick arXiv https://doi.org/10.48550/arxiv.2009.11806	preprint	January 2020
Investigating power capping toward energy-efficient scientific applications: Investigating Power Capping toward Energy-Efficient Scientific Applications Haidar, Azzam; Jagode, Heike; Vaccaro, Phil Concurrency and Computation: Practice and Experience, Vol. 31, Issue 6 https://doi.org/10.1002/cpe.4485	journal	March 2018
Solving a trillion unknowns per second with HPGMG on Sunway TaihuLight Ma, Wenjing; Ao, Yulong; Yang, Chao Cluster Computing, Vol. 23, Issue 2 https://doi.org/10.1007/s10586-019-02938-w	journal	May 2019
On the cost of iterative computations Carson, Erin; Strakoš, Zdeněk Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences, Vol. 378, Issue 2166 https://doi.org/10.1098/rsta.2019.0050	journal	January 2020
Representative paths analysis Tallent, Nathan R.; Kerbyson, Darren J.; Hoisie, Adolfy SC '17: The International Conference for High Performance Computing, Networking, Storage and Analysis, Proceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis https://doi.org/10.1145/3126908.3126962	conference	November 2017
Evaluating the Arm Ecosystem for High Performance Computing Jackson, Adrian; Turner, Andrew; Weiland, Michèle PASC '19: Platform for Advanced Scientific Computing Conference, Proceedings of the Platform for Advanced Scientific Computing Conference https://doi.org/10.1145/3324989.3325722	conference	June 2019
Evaluating the Arm Ecosystem for High Performance Computing Jackson, Adrian; Turner, Andrew; Weiland, Michele arXiv https://doi.org/10.48550/arxiv.1904.04250	preprint	January 2019
CPMIP: measurements of real computational performance of Earth system models in CMIP6 Balaji, Venkatramani; Maisonnave, Eric; Zadeh, Niki Geoscientific Model Development, Vol. 10, Issue 1 https://doi.org/10.5194/gmd-10-19-2017	journal	January 2017

Similar Records

Toward a New Metric for Ranking High Performance Computing Systems

Technical Report · 2013 · OSTI ID:1089988

HPCG Benchmark Technical Specification

Technical Report · 2013 · OSTI ID:1113870

Related Subjects

97 MATHEMATICS AND COMPUTING

High-performance conjugate-gradient benchmark: A new metric for ranking high-performance computing systems

Citation Formats

References (18)

Cited By (21)

Similar Records

Related Subjects