Persistent Data Staging Services for Data Intensive In-situ Scientific Workflows

Romanus, Melissa; Zhang, Fan; Jin, Tong; Sun, Qian; Bui, Hoang; Parashar, Manish; Choi, Jong Youl; Janhunen, Salomon; Hager, Robert; Klasky, Scott A; Chang, Choong-Seock; Rodero, Ivan

doi:10.1145/2912152.2912157

Title: Persistent Data Staging Services for Data Intensive In-situ Scientific Workflows

Conference · Fri Jan 01 00:00:00 EST 2016

DOI:https://doi.org/10.1145/2912152.2912157· OSTI ID:1319220

Romanus, Melissa ^[1]; Zhang, Fan ^[1]; Jin, Tong ^[1]; Sun, Qian ^[1]; Bui, Hoang ^[1]; Parashar, Manish ^[1]; Choi, Jong Youl ^[2]; Janhunen, Salomon ^[3]; Hager, Robert ^[3]; Klasky, Scott A ^[2]; Chang, Choong-Seock ^[3]; Rodero, Ivan ^[1]

Rutgers University
ORNL
Princeton Plasma Physics Laboratory (PPPL)

OSTI does not have a digital full text copy available. For more information, please see document availability, search WorldCat, or search Google Scholar.

Cite

Export

Save

Research Organization:: Oak Ridge National Laboratory (ORNL), Oak Ridge, TN (United States). Oak Ridge Leadership Computing Facility (OLCF)

Sponsoring Organization:: USDOE Office of Science (SC)

DOE Contract Number:: AC05-00OR22725

OSTI ID:: 1319220

Resource Relation:: Conference: Data-intensive Distributed Computing (DIDC'16), Kyoto, Japan,, Japan, 20160601, 20160601

Country of Publication:: United States

Language:: English

References (19)

Just in time: adding value to the IO pipelines of high performance applications with JITStaging Abbasi, Hasan; Eisenhauer, Greg; Wolf, Matthew Proceedings of the 20th international symposium on High performance distributed computing - HPDC '11 https://doi.org/10.1145/1996130.1996137	conference	January 2011
DataStager: scalable data staging services for petascale applications Abbasi, Hasan; Wolf, Matthew; Eisenhauer, Greg Proceedings of the 18th ACM international symposium on High performance distributed computing - HPDC '09 https://doi.org/10.1145/1551609.1551618	conference	January 2009
Makeflow: a portable abstraction for data intensive computing on clusters, clouds, and grids Albrecht, Michael; Donnelly, Patrick; Bui, Peter Proceedings of the 1st ACM SIGMOD Workshop on Scalable Workflow Execution Engines and Technologies - SWEET '12 https://doi.org/10.1145/2443416.2443417	conference	January 2012
Interactive Exploration and Analysis of Large-Scale Simulations Using Topology-Based Data Segmentation Bremer, P-T; Weber, G.; Tierny, J. IEEE Transactions on Visualization and Computer Graphics, Vol. 17, Issue 9 https://doi.org/10.1109/TVCG.2010.253	journal	September 2011
Spontaneous rotation sources in a quiescent tokamak edge plasma Chang, C. S.; Ku, S. Physics of Plasmas, Vol. 15, Issue 6 https://doi.org/10.1063/1.2937116	journal	June 2008
Bridging HPC and Grid File I/O with IOFSL Cope, Jason; Iskra, Kamil; Kimpe, Dries Applied Parallel and Scientific Computing https://doi.org/10.1007/978-3-642-28145-7_22	book	January 2012
Moving the Code to the Data - Dynamic Code Deployment Using ActiveSpaces Docan, Ciprian; Parashar, Manish; Cummings, Julian Distributed Processing Symposium (IPDPS), 2011 IEEE International Parallel & Distributed Processing Symposium https://doi.org/10.1109/IPDPS.2011.120	conference	May 2011
DataSpaces: an interaction and coordination framework for coupled simulation workflows Docan, Ciprian; Parashar, Manish; Klasky, Scott Proceedings of the 19th ACM International Symposium on High Performance Distributed Computing - HPDC '10 https://doi.org/10.1145/1851476.1851481	conference	January 2010
Exploring Data Staging Across Deep Memory Hierarchies for Coupled Data Intensive Simulation Workflows Jin, Tong; Zhang, Fan; Sun, Qian 2015 IEEE International Parallel and Distributed Processing Symposium (IPDPS) https://doi.org/10.1109/IPDPS.2015.50	conference	May 2015
Parallel in situ indexing for data-intensive computing Kim, Jinoh; Abbasi, Hasan; Chacon, Luis 2011 IEEE Symposium on Large Data Analysis and Visualization (LDAV) https://doi.org/10.1109/LDAV.2011.6092319	conference	October 2011
Full-f gyrokinetic particle simulation of centrally heated global ITG turbulence from magnetic axis to edge pedestal top in a realistic tokamak geometry Ku, S.; Chang, C. S.; Diamond, P. H. Nuclear Fusion, Vol. 49, Issue 11 https://doi.org/10.1088/0029-5515/49/11/115021	journal	September 2009
On the role of burst buffers in leadership-class storage systems Liu, Ning; Cope, Jason; Carns, Philip 2012 IEEE 28th Symposium on Mass Storage Systems and Technologies (MSST) https://doi.org/10.1109/MSST.2012.6232369	conference	April 2012
Extending scalability of collective IO through nessie and staging Lofstead, Jay; Oldfield, Ron; Kordenbrock, Todd Proceedings of the sixth workshop on Parallel Data Storage - PDSW '11 https://doi.org/10.1145/2159352.2159355	conference	January 2011
In Situ Visualization at Extreme Scale: Challenges and Opportunities IEEE Computer Graphics and Applications, Vol. 29, Issue 6 https://doi.org/10.1109/MCG.2009.120	journal	November 2009
Toward simulation-time data analysis and I/O acceleration on leadership-class systems Vishwanath, Venkatram; Hereld, Mark; Papka, Michael E. 2011 IEEE Symposium on Large Data Analysis and Visualization (LDAV) https://doi.org/10.1109/LDAV.2011.6092178	conference	October 2011
The RAMDISK storage accelerator: a method of accelerating I/O performance on HPC systems using RAMDISKs Wickberg, Tim; Carothers, Christopher Proceedings of the 2nd International Workshop on Runtime and Operating Systems for Supercomputers - ROSS '12 https://doi.org/10.1145/2318916.2318922	conference	January 2012
Enabling In-situ Execution of Coupled Scientific Workflow on Multi-core Platform Zhang, Fan; Docan, Ciprian; Parashar, Manish 2012 IEEE International Symposium on Parallel & Distributed Processing (IPDPS), 2012 IEEE 26th International Parallel and Distributed Processing Symposium https://doi.org/10.1109/IPDPS.2012.122	conference	May 2012
In-situ Feature-Based Objects Tracking for Large-Scale Scientific Simulations Zhang, Fan; Lasluisa, Solomon; Jin, Tong 2012 SC Companion: High Performance Computing, Networking, Storage and Analysis (SCC), 2012 SC Companion: High Performance Computing, Networking Storage and Analysis https://doi.org/10.1109/SC.Companion.2012.100	conference	November 2012
GoldRush: resource efficient in situ scientific data analytics using fine-grained interference aware execution Zheng, Fang; Yu, Hongfeng; Hantas, Can Proceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis on - SC '13 https://doi.org/10.1145/2503210.2503279	conference	January 2013

Similar Records

Services + Components = Data Intensive Scientific Workflow Applications with MeDICi

Conference · Mon Jun 01 00:00:00 EDT 2009 · OSTI ID:1319220

Gorton, Ian; Chase, Jared M; Wynne, Adam S; +2 more

In-Staging Data Placement for Asynchronous Coupling of Task-Based Scientific Workflows, In: 2016 Second International Workshop on Extreme Scale Programming Models and Middlewar (ESPM2)

Conference · Fri Jan 01 00:00:00 EST 2016 · PROCEEDINGS OF SECOND INTERNATIONAL WORKSHOP ON EXTREME SCALE PROGRAMMING MODELS AND MIDDLEWARE (ESPM2 2016) · OSTI ID:1319220

Sun, Qian; Romanus, Melissa; Jin, Tong; +4 more

Plasma fusion code coupling using scalable I/O services and scientific workflows

Conference · Thu Jan 01 00:00:00 EST 2009 · OSTI ID:1319220

Podhorszki, Norbert; Klasky, Scott A; Liu, Qing; +8 more

Title: Persistent Data Staging Services for Data Intensive In-situ Scientific Workflows

Citation Formats

References (19)

Similar Records

Related Subjects