Architecture and method for a burst buffer using flash technology

Tzelnic, Percy; Faibish, Sorin; Gupta, Uday K.; Bent, John; Grider, Gary Alan; Chen, Hsing-bung

Title: Architecture and method for a burst buffer using flash technology

Patent · Tue Mar 15 00:00:00 EDT 2016

OSTI ID:1243041

Tzelnic, Percy; Faibish, Sorin; Gupta, Uday K.; Bent, John; Grider, Gary Alan; Chen, Hsing-bung

A parallel supercomputing cluster includes compute nodes interconnected in a mesh of data links for executing an MPI job, and solid-state storage nodes each linked to a respective group of the compute nodes for receiving checkpoint data from the respective compute nodes, and magnetic disk storage linked to each of the solid-state storage nodes for asynchronous migration of the checkpoint data from the solid-state storage nodes to the magnetic disk storage. Each solid-state storage node presents a file system interface to the MPI job, and multiple MPI processes of the MPI job write the checkpoint data to a shared file in the solid-state storage in a strided fashion, and the solid-state storage node asynchronously migrates the checkpoint data from the shared file in the solid-state storage to the magnetic disk storage and writes the checkpoint data to the magnetic disk storage in a sequential fashion.

View Patent

Cite

Export

Save

Research Organization:: Los Alamos National Laboratory (LANL), Los Alamos, NM (United States)

Sponsoring Organization:: USDOE

DOE Contract Number:: AC52-06NA25396

Assignee:: EMC Corporation (Hopkinton, MA) Los Alamos National Security, LLC (Los Alamos, NM)

Patent Number(s):: 9,286,261

Application Number:: 13/676,000

OSTI ID:: 1243041

Resource Relation:: Patent File Date: 2012 Nov 13

Country of Publication:: United States

Language:: English

References (69)

DASH-IO: an empirical study of flash-based IO for HPC He, Jiahua; Bennett, Jeffrey; Snavely, Allan Proceedings of the 2010 TeraGrid Conference on - TG '10, Article No. 10 https://doi.org/10.1145/1838574.1838584	conference	January 2010
...and eat it too: high read performance in write-optimized HPC I/O middleware file formats Polte, Milo; Wingate, Meghan; Wolf, Matthew Proceedings of the 4th Annual Workshop on Petascale Data Storage - PDSW '09 https://doi.org/10.1145/1713072.1713079	conference	January 2009
Enhancing Checkpoint Performance with Staging IO and SSD Ouyang, Xiangyong; Marcarelli, Sonya; Panda, Dhabaleswar K. 2010 International Workshop on Storage Network Architecture and Parallel I/Os (SNAPI) https://doi.org/10.1109/SNAPI.2010.10	conference	May 2010
PLFS: a checkpoint filesystem for parallel applications Bent, John; Gibson, Garth; Grider, Gary https://doi.org/10.1145/1654059.1654081	conference	January 2009
An abstract-device interface for implementing portable parallel-I/O interfaces Thakur, R.; Gropp, W.; Lusk, E. Proceedings of 6th Symposium on the Frontiers of Massively Parallel Computation (Frontiers '96) https://doi.org/10.1109/FMPC.1996.558080	conference	January 1996
Evaluation of active storage strategies for the lustre parallel file system Piernas, Juan; Nieplocha, Jarek; Felix, Evan J. Proceedings of the 2007 ACM/IEEE conference on Supercomputing - SC '07 https://doi.org/10.1145/1362622.1362660	conference	January 2007
A Cost-Effective, High Bandwidth Server I/O network Architecture for Cluster Systems Chen, Hsing-bung; Grider, Gary; Fields, Parks 2007 IEEE International Parallel and Distributed Processing Symposium https://doi.org/10.1109/IPDPS.2007.370221	conference	March 2007
Integration Experiences and Performance Studies of A COTS Parallel Archive System Chen, Hsing-bung; Grider, Gary; Scott, Cody 2010 IEEE International Conference on Cluster Computing (CLUSTER) https://doi.org/10.1109/CLUSTER.2010.23	conference	September 2010
PaScal-- A New Parallel and Scalable Server IO Networking Infrastructure for Supporting Global Storage/File Systems in Large-size Linux Clusters Grider, G.; Nunez, J. 2006 IEEE International Performance Computing and Communications Conference https://doi.org/10.1109/.2006.1629424	conference	January 2006
Flexibility, manageability, and performance in a Grid storage appliance Bent, J.; Venkataramani, V.; LeRoy, N. Proceedings 11th IEEE International Symposium on High Performance Distributed Computing https://doi.org/10.1109/HPDC.2002.1029898	conference	January 2002
Distributed-and-split data-control extension to SCSI for scalable storage area networks Birk, Y.; Bishara, N. Proceedings 10th Symposium on High Performance Interconnects https://doi.org/10.1109/CONECT.2002.1039260	conference	January 2002
Pageserver: High-Performance SSD-Based Checkpointing of Transactional Distributed Memory Gerhold, Steffen; Kaemmer, Nico; Weggerle, Alexander 2010 Second International Conference on Computer Engineering and Applications https://doi.org/10.1109/ICCEA.2010.53	conference	March 2010
Hybrid checkpointing using emerging nonvolatile memories for future exascale systems Dong, Xiangyu; Xie, Yuan; Muralimanohar, Naveen ACM Transactions on Architecture and Code Optimization, Vol. 8, Issue 2 https://doi.org/10.1145/1970386.1970387	journal	July 2011
Evaluating the benefits of an extended memory hierarchy for parallel streamline algorithms Camp, David; Childs, Hank; Chourasia, Amit 2011 IEEE Symposium on Large Data Analysis and Visualization (LDAV) https://doi.org/10.1109/LDAV.2011.6092318	conference	October 2011
Provisioning a Multi-tiered Data Staging Area for Extreme-Scale Machines Prabhakar, Ramya; Vazhkudai, Sudharshan S.; Kim, Youngjae 2011 31st International Conference on Distributed Computing Systems (ICDCS) https://doi.org/10.1109/ICDCS.2011.33	conference	June 2011
Functional Partitioning to Optimize End-to-End Performance on Many-core Architectures Li, Min; Vazhkudai, Sudharshan S.; Butt, Ali R. 2010 SC - International Conference for High Performance Computing, Networking, Storage and Analysis, 2010 ACM/IEEE International Conference for High Performance Computing, Networking, Storage and Analysis https://doi.org/10.1109/SC.2010.28	conference	November 2010
Managing storage space in a flash and disk hybrid storage system amp; Simulation of Computer and Telecommunication Systems (MASCOTS), 2009 IEEE International Symposium on Modeling, Analysis & Simulation of Computer and Telecommunication Systems https://doi.org/10.1109/MASCOT.2009.5366764	conference	September 2009
Exploiting Concurrency to Improve Latency and throughput in a Hybrid Storage System Wu, Xiaojian; Reddy, A. L. Narasimha Simulation of Computer and Telecommunication Systems (MASCOTS), 2010 IEEE International Symposium on Modeling, Analysis and Simulation of Computer and Telecommunication Systems https://doi.org/10.1109/MASCOTS.2010.11	conference	August 2010
Umbrella file system: Storage management across heterogeneous devices Garrison, John A.; Reddy, A. L. Narasimha ACM Transactions on Storage, Vol. 5, Issue 1 https://doi.org/10.1145/1502777.1502780	journal	March 2009
Incorporating Network RAM and Flash into Fast Backing Store for Clusters Newhall, Tia; Woos, Douglas 2011 IEEE International Conference on Cluster Computing (CLUSTER) https://doi.org/10.1109/CLUSTER.2011.22	conference	September 2011
The Conquest file system : Better performance through a disk/persistent-RAM hybrid design Wang, An-I Andy; Kuenning, Geoff; Reiher, Peter ACM Transactions on Storage, Vol. 2, Issue 3 https://doi.org/10.1145/1168910.1168914	journal	August 2006
Azor: Using Two-Level Block Selection to Improve SSD-Based I/O Caches Klonatos, Yannis; Makatos, Thanos; Marazakis, Manolis 2011 6th IEEE International Conference on Networking, Architecture, and Storage (NAS), 2011 IEEE Sixth International Conference on Networking, Architecture, and Storage https://doi.org/10.1109/NAS.2011.50	conference	July 2011
Using Active NVRAM for Cloud I/O Kannan, Sudarsun; Milojicic, Dejan; Talwar, Vanish 2011 6th Open Cirrus Summit (OCS), 2011 Sixth Open Cirrus Summit https://doi.org/10.1109/OCS.2011.12	conference	October 2011
A comprehensive study of energy efficiency and performance of flash-based SSD Park, Seonyeong; Kim, Youngjae; Urgaonkar, Bhuvan Journal of Systems Architecture, Vol. 57, Issue 4, p. 354-365 https://doi.org/10.1016/j.sysarc.2011.01.005	journal	April 2011
Making a case for distributed file systems at Exascale Raicu, Ioan; Foster, Ian T.; Beckman, Pete Proceedings of the third international workshop on Large-scale system and application performance - LSAP '11 https://doi.org/10.1145/1996029.1996034	conference	January 2011
Jitter-free co-processing on a prototype exascale storage stack Bent, John; Faibish, Sorin; Ahrens, Jim 2012 IEEE 28th Symposium on Mass Storage Systems and Technologies (MSST) https://doi.org/10.1109/MSST.2012.6232382	conference	April 2012
Verifying Scientific Simulations via Comparative and Quantitative Visualization Ahrens, James; Heitmann, Katrin; Petersen, Mark IEEE Computer Graphics and Applications, Vol. 30, Issue 6 https://doi.org/10.1109/MCG.2010.100	journal	November 2010
Scalable I/O forwarding framework for high-performance computing systems Ali, Nawab; Carns, Philip; Iskra, Kamil 2009 IEEE International Conference on Cluster Computing and Workshops https://doi.org/10.1109/CLUSTR.2009.5289188	conference	August 2009
Design issues for a shingled write disk system Amer, Ahmed; Long, Darrell D. E.; Miller, Ethan L. 2010 IEEE 26th Symposium on Mass Storage Systems and Technologies (MSST) https://doi.org/10.1109/MSST.2010.5496991	conference	May 2010
The ParaView Coprocessing Library: A scalable, general purpose in situ visualization library Fabian, Nathan; Moreland, Kenneth; Thompson, David 2011 IEEE Symposium on Large Data Analysis and Visualization (LDAV) https://doi.org/10.1109/LDAV.2011.6092322	conference	October 2011
Managing Variability in the IO Performance of Petascale Storage Systems Lofstead, Jay; Zheng, Fang; Liu, Qing 2010 SC - International Conference for High Performance Computing, Networking, Storage and Analysis, 2010 ACM/IEEE International Conference for High Performance Computing, Networking, Storage and Analysis https://doi.org/10.1109/SC.2010.32	conference	November 2010
Flexible IO and integration for scientific codes through the adaptable IO system (ADIOS) Lofstead, Jay F.; Klasky, Scott; Schwan, Karsten Proceedings of the 6th international workshop on Challenges of large applications in distributed environments - CLADE '08 https://doi.org/10.1145/1383529.1383533	conference	January 2008
Design, Modeling, and Evaluation of a Scalable Multi-level Checkpointing System Moody, Adam; Bronevetsky, Greg; Mohror, Kathryn 2010 SC - International Conference for High Performance Computing, Networking, Storage and Analysis, 2010 ACM/IEEE International Conference for High Performance Computing, Networking, Storage and Analysis https://doi.org/10.1109/SC.2010.18	conference	November 2010
GIGA+: scalable directories for shared file systems Patil, Swapnil V.; Gibson, Garth A.; Lang, Sam Proceedings of the 2nd international workshop on Petascale data storage held in conjunction with Supercomputing '07 - PDSW '07 https://doi.org/10.1145/1374596.1374604	conference	January 2007
Scalable parallel building blocks for custom data analysis Peterka, Tom; Ross, Robert; Gyulassy, Attila 2011 IEEE Symposium on Large Data Analysis and Visualization (LDAV) https://doi.org/10.1109/LDAV.2011.6092324	conference	October 2011
Visualization by Proxy: A Novel Framework for Deferred Interaction with Volume Data Tikhonova, A.; Correa, C. D. IEEE Transactions on Visualization and Computer Graphics, Vol. 16, Issue 6 https://doi.org/10.1109/TVCG.2010.215	journal	November 2010
Toward simulation-time data analysis and I/O acceleration on leadership-class systems Vishwanath, Venkatram; Hereld, Mark; Papka, Michael E. 2011 IEEE Symposium on Large Data Analysis and Visualization (LDAV) https://doi.org/10.1109/LDAV.2011.6092178	conference	October 2011
Parallel In Situ Coupling of Simulation with a Fully Featured Visualization System Whitlock, Brad; Favre, Jean M.; Meredith, Jeremy S. The Eurographics Association https://doi.org/10.2312/EGPGV/EGPGV11/101-109	null	January 2011
In-situ Sampling of a Large-Scale Particle Simulation for Interactive Visualization and Analysis Woodring, J.; Ahrens, J.; Figg, J. Computer Graphics Forum, Vol. 30, Issue 3 https://doi.org/10.1111/j.1467-8659.2011.01964.x	journal	June 2011
Remote Large Data Visualization in the ParaView Framework Cedilnik, Andy; Geveci, Berk; Moreland, Kenneth The Eurographics Association https://doi.org/10.2312/EGPGV/EGPGV06/163-170	null	January 2006
On the role of burst buffers in leadership-class storage systems Liu, Ning; Cope, Jason; Carns, Philip 2012 IEEE 28th Symposium on Mass Storage Systems and Technologies (MSST) https://doi.org/10.1109/MSST.2012.6232369	conference	April 2012
Modeling a Leadership-Scale Storage System Liu, Ning; Carothers, Christopher; Cope, Jason Parallel Processing and Applied Mathematics https://doi.org/10.1007/978-3-642-31464-3_2	book	January 2012
Storage challenges at Los Alamos National Lab Bent, John; Grider, Gary; Kettering, Brett https://doi.org/10.1109/MSST.2012.6232376	conference	April 2012
A higher order estimate of the optimum checkpoint interval for restart dumps Daly, J. T. Future Generation Computer Systems, Vol. 22, Issue 3, p. 303-312 https://doi.org/10.1016/j.future.2004.11.016	journal	February 2006
A Self-Organizing Storage Cluster for Parallel Data-Intensive Applications Proceedings of the ACM/IEEE SC2004 Conference https://doi.org/10.1109/SC.2004.9	conference	January 2004
Data storage system having separate data transfer section and message network Ofek, Yuval; Black, David; MacArthur, Stephen D. https://doi.org/https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/7117275 US Patent Document 7,117,275	patent	October 2006
Distributed maintenance of snapshot copies by a primary processor managing metadata and a secondary processor providing read-write access to a production dataset Faibish, Sorin; Fridella, Stephen; Gupta, Uday https://doi.org/https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/7676514 US Patent Document 7,676,514	patent	March 2010
Methods, systems, and computer program products for providing access to shared storage by computing grids and clusters with large numbers of nodes Compton, James T.; Gupta, Uday; Faibish, Sorin https://doi.org/https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/7676628 US Patent Document 7,676,628	patent	March 2010
Network file server sharing local caches of file access information in data processors assigned to respective file systems Vahalia, Uresh K.; Gupta, Uday; Porat, Betti https://doi.org/https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/7739379 US Patent Document 7,739,379	patent	June 2010
Techniques for using flash-based memory as a write cache and a vault Gupta, Uday; Hopkins, Charles H.; Evans, Michael B. https://doi.org/https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/7793061 US Patent Document 7,793,061	patent	September 2010
Pre-allocation and hierarchical mapping of data blocks distributed from a first processor to a second processor for use in a file system Faibish, Sorin; Fridella, Stephen; Jiang, Xiaoye https://doi.org/https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/7945726 US Patent Document 7,945,726	patent	May 2011
Efficient read/write algorithms and associated mapping for block-level data reduction processes Raizen, Helen S.; Bappe, Michael E.; Nikolaevich, Agarkov Vadim https://doi.org/https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/8140821 US Patent Document 8,140,821	patent	March 2012
Techniques for using flash-based memory in recovery processing Gupta, Uday; Hopkins, Charles H.; Evans, Michael B. https://doi.org/https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/8296534 US Patent Document 8,296,534	patent	October 2012
High efficiency, high performance system for writing data from applications to a safe file system Nowoczynski, Paul; Stone, Nathan; Yanovich, Jared https://doi.org/https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/8316288 US Patent Document 8,316,288	patent	November 2012
Systems and methods for managing portions of files in multi-tier storage systems Mamidi, Murthy V.; Malige, Raghupathi; Ravi, Gautham https://doi.org/https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/8352429 US Patent Document 8,352,429	patent	January 2013
Managing data on data storage systems Whitney, William C.; Gupta, Uday; Evans, Michael B. https://doi.org/https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/8392370 US Patent Document 8,392,370	patent	March 2013
Small file aggregation in a parallel computing system Faibish, Sorin; Bent, John M.; Tzelnic, Percy https://doi.org/https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/8825652 US Patent Document 8,825,652	patent	September 2014
Multi-path file system with block cache between client and storage array Ma, Gang; Faibish, Sorin; Cote, Dominique https://doi.org/https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/8862645 US Patent Document 8,862,645	patent	October 2014
Storing files in a parallel computing system based on user-specified parser function Faibish, Sorin; Bent, John M.; Tzelnic, Percy https://doi.org/https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/8868576 US Patent Document 8,868,576	patent	October 2014
Methods and apparatus for capture and storage of semantic information with sub-files in a parallel computing system Faibish, Sorin; Bent, John M.; Tzelnic, Percy https://doi.org/https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/8949255 US Patent Document 8,949,255	patent	February 2015
Burst buffer appliance with small file aggregation Faibish, Sorin; Bent, John M. https://doi.org/https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/8972465 US Patent Document 8,972,465	patent	March 2015
Burst buffer appliance comprising multiple virtual machines Faibish, Sorin; Bent, John M. https://doi.org/https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/9069594 US Patent Document 9,069,594	patent	June 2015
Storing files in a parallel computing system using list-based index to identify replica files Faibish, Sorin; Bent, John M.; Tzelnic, Percy https://doi.org/https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/9087075 US Patent Document 9,087,075	patent	July 2015
Hybrid data storage system in an HPC exascale environment Bent, John M.; Faibish, Sorin; Gupta, Uday https://doi.org/https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/9110820 US Patent Document 9,110,820	patent	August 2015
Parallel log structured file system collective buffering to achieve a compact representation of scientific and/or dimensional data Grider, Gary; Poole, Stephen W. https://doi.org/https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/9122700 US Patent Document 9,122,700	patent	September 2015
Dynamically Controlled Checkpoint Timing Ruscio, Joseph; Jones, Nicholas https://doi.org/https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/20070220327 US Patent Application 11/535431; 20070220327	patent-application	September 2007
Simplified RDMA Over Ethernet and Fibre Channel Gupta, Somesh https://doi.org/https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/20100183024 US Patent Application 12/690192; 20100183024	patent-application	July 2010
Apparatus For Enhancing Performance Of A Parallel Processing Environment, And Associated Methods Howard, Kevin D. https://doi.org/https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/20100185719 US Patent Application 12/750338; 20100185719	patent-application	July 2010
Multi-Petascale Highly Efficient Parallel Supercomputer Asaad, Sameh; Bellofatto, Ralph E.; Blocksome, Michael A. https://doi.org/https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/20110219208 US Patent Document 13/004007; 20110219208	patent-application	September 2011

Similar Records

Method and apparatus for offloading compute resources to a flash co-processing appliance

Patent · Tue Oct 13 00:00:00 EDT 2015 · OSTI ID:1243041

Tzelnic, Percy; Faibish, Sorin; Gupta, Uday K.; +3 more

Using the Sirocco File System for high-bandwidth checkpoints.

Technical Report · Wed Feb 01 00:00:00 EST 2012 · OSTI ID:1243041

Klundt, Ruth Ann; Curry, Matthew L; Ward, H Lee

TRIO: Burst Buffer Based I/O Orchestration, In: 2015 IEEE International Conference on Cluster Computing

Conference · Tue Sep 01 00:00:00 EDT 2015 · 2015 IEEE INTERNATIONAL CONFERENCE ON CLUSTER COMPUTING - CLUSTER 2015 · OSTI ID:1243041

Wang, Teng; Oral, Sarp; Pritchard, Michael; +2 more

Related Subjects

97 MATHEMATICS AND COMPUTING

Title: Architecture and method for a burst buffer using flash technology

Citation Formats

References (69)

Similar Records

Related Subjects