Output Performance Study on a Production Petascale Filesystem

Xie, Bing; Chase, Jeffrey; Dillow, David; Klasky, Scott A.; Lofstead, Jay; Oral, H Sarp; Podhorszki, Norbert

doi:10.1007/978-3-319-67630-2_16

Output Performance Study on a Production Petascale Filesystem

Conference · 01 June 2017

DOI:https://doi.org/10.1007/978-3-319-67630-2_16· OSTI ID:1399522

Xie, Bing ^[1]; Chase, Jeffrey ^[1]; Dillow, David ^[2]; ^[3]; Lofstead, Jay ^[4]; ^[3]; ^[3]

Duke University
None
ORNL
Sandia National Laboratories (SNL)

View Conference

Research Organization:: Oak Ridge National Lab. (ORNL), Oak Ridge, TN (United States). Oak Ridge Leadership Computing Facility (OLCF)

Sponsoring Organization:: USDOE Office of Science (SC), Advanced Scientific Computing Research (ASCR)

DOE Contract Number:: AC05-00OR22725

OSTI ID:: 1399522

Resource Relation:: Journal Volume: 10524; Conference: HPC I/O in the Data Center Workshop (HPC-IODC) - Frankfurt, , Germany - 6/22/2017 8:00:00 AM-

Country of Publication:: United States

Language:: English

References (16)

Characterizing output bottlenecks in a supercomputer No authors listed 2012 SC - International Conference for High Performance Computing, Networking, Storage and Analysis, 2012 International Conference for High Performance Computing, Networking, Storage and Analysis https://doi.org/10.1109/SC.2012.28		November 2012
Characterizing and predicting the I/O performance of HPC applications using a parameterized synthetic benchmark No authors listed 2008 SC - International Conference for High Performance Computing, Networking, Storage and Analysis https://doi.org/10.1109/SC.2008.5222721		November 2008
Understanding and Improving Computational Science Storage Access through Continuous Characterization No authors listed ACM Transactions on Storage https://doi.org/10.1145/2027066.2027068		October 2011
A non-staggered, conservative, , finite-volume scheme for 3D implicit extended magnetohydrodynamics in curvilinear geometries No authors listed Computer Physics Communications https://doi.org/10.1016/j.cpc.2004.08.005		November 2004
I/O performance challenges at leadership scale No authors listed Proceedings of the Conference on High Performance Computing Networking, Storage and Analysis - SC '09 https://doi.org/10.1145/1654059.1654100		January 2009
24/7 Characterization of petascale I/O workloads No authors listed 2009 IEEE International Conference on Cluster Computing and Workshops https://doi.org/10.1109/CLUSTR.2009.5289150		August 2009
Input/output characteristics of scalable parallel applications No authors listed Proceedings of the 1995 ACM/IEEE conference on Supercomputing (CDROM) - Supercomputing '95 https://doi.org/10.1145/224170.224396		January 1995
A Multiplatform Study of I/O Behavior on Petascale Supercomputers No authors listed Proceedings of the 24th International Symposium on High-Performance Parallel and Distributed Computing - HPDC '15 https://doi.org/10.1145/2749246.2749269		January 2015
Workload characterization of a leadership class storage cluster No authors listed 2010 5th Petascale Data Storage Workshop (PDSW), 2010 5th Petascale Data Storage Workshop (PDSW '10) https://doi.org/10.1109/PDSW.2010.5668066		November 2010
Scalable Earthquake Simulation on Petascale Supercomputers No authors listed 2010 SC - International Conference for High Performance Computing, Networking, Storage and Analysis, 2010 ACM/IEEE International Conference for High Performance Computing, Networking, Storage and Analysis https://doi.org/10.1109/SC.2010.45		November 2010
A study of I/O behavior of Perfect benchmarks on a multiprocessor No authors listed [1990] Proceedings. The 17th Annual International Symposium on Computer Architecture https://doi.org/10.1109/ISCA.1990.134541		January 1990
File-access characteristics of parallel scientific workloads No authors listed IEEE Transactions on Parallel and Distributed Systems https://doi.org/10.1109/71.539739		January 1996
Predicting Output Performance of a Petascale Supercomputer No authors listed Proceedings of the 26th International Symposium on High-Performance Parallel and Distributed Computing - HPDC '17 https://doi.org/10.1145/3078597.3078614		January 2017
Architectural requirements of parallel scientific applications with explicit communication No authors listed Proceedings of the 20th annual international symposium on Computer architecture - ISCA '93 https://doi.org/10.1145/165123.165124		January 1993
Adaptable, metadata rich IO methods for portable high performance IO No authors listed Distributed Processing (IPDPS), 2009 IEEE International Symposium on Parallel & Distributed Processing https://doi.org/10.1109/IPDPS.2009.5161052		May 2009
Parallel I/O performance: From events to ensembles No authors listed 2010 IEEE International Symposium on Parallel & Distributed Processing (IPDPS) https://doi.org/10.1109/IPDPS.2010.5470424		April 2010

Similar Records

Predicting Output Performance of a Petascale Supercomputer

Conference · 2017 · OSTI ID:1400181

Xie, Bing; Huang, Yezhou; Chase, Jeffrey; +4 more

Predicting Output Performance of a Petascale Supercomputer.

Conference · 2017 · OSTI ID:1463440

Xie, Bing; Huang, Yezhou; Chase, Jeffrey; +4 more

Applying Machine Learning to Understand Write Performance of Large-scale Parallel Filesystems

Conference · 2019 · OSTI ID:1606822

Xie, Bing; Tan, Zilong; Carns, Philip; +6 more

Output Performance Study on a Production Petascale Filesystem

Citation Formats

References (16)

Similar Records

Related Subjects