skip to main content
OSTI.GOV title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: Persistent Data Staging Services for Data Intensive In-situ Scientific Workflows

Authors:
 [1];  [1];  [1];  [1];  [1];  [1];  [2];  [3];  [3];  [2];  [3];  [1]
  1. Rutgers University
  2. ORNL
  3. Princeton Plasma Physics Laboratory (PPPL)
Publication Date:
Research Org.:
Oak Ridge National Lab. (ORNL), Oak Ridge, TN (United States). Oak Ridge Leadership Computing Facility (OLCF)
Sponsoring Org.:
USDOE Office of Science (SC)
OSTI Identifier:
1319220
DOE Contract Number:  
AC05-00OR22725
Resource Type:
Conference
Resource Relation:
Conference: Data-intensive Distributed Computing (DIDC'16), Kyoto, Japan,, Japan, 20160601, 20160601
Country of Publication:
United States
Language:
English

Citation Formats

Romanus, Melissa, Zhang, Fan, Jin, Tong, Sun, Qian, Bui, Hoang, Parashar, Manish, Choi, Jong Youl, Janhunen, Salomon, Hager, Robert, Klasky, Scott A, Chang, Choong-Seock, and Rodero, Ivan. Persistent Data Staging Services for Data Intensive In-situ Scientific Workflows. United States: N. p., 2016. Web. doi:10.1145/2912152.2912157.
Romanus, Melissa, Zhang, Fan, Jin, Tong, Sun, Qian, Bui, Hoang, Parashar, Manish, Choi, Jong Youl, Janhunen, Salomon, Hager, Robert, Klasky, Scott A, Chang, Choong-Seock, & Rodero, Ivan. Persistent Data Staging Services for Data Intensive In-situ Scientific Workflows. United States. doi:10.1145/2912152.2912157.
Romanus, Melissa, Zhang, Fan, Jin, Tong, Sun, Qian, Bui, Hoang, Parashar, Manish, Choi, Jong Youl, Janhunen, Salomon, Hager, Robert, Klasky, Scott A, Chang, Choong-Seock, and Rodero, Ivan. Fri . "Persistent Data Staging Services for Data Intensive In-situ Scientific Workflows". United States. doi:10.1145/2912152.2912157.
@article{osti_1319220,
title = {Persistent Data Staging Services for Data Intensive In-situ Scientific Workflows},
author = {Romanus, Melissa and Zhang, Fan and Jin, Tong and Sun, Qian and Bui, Hoang and Parashar, Manish and Choi, Jong Youl and Janhunen, Salomon and Hager, Robert and Klasky, Scott A and Chang, Choong-Seock and Rodero, Ivan},
abstractNote = {},
doi = {10.1145/2912152.2912157},
journal = {},
number = ,
volume = ,
place = {United States},
year = {2016},
month = {1}
}

Conference:
Other availability
Please see Document Availability for additional information on obtaining the full-text document. Library patrons may search WorldCat to identify libraries that hold this conference proceeding.

Save / Share:

Works referenced in this record:

Just in time: adding value to the IO pipelines of high performance applications with JITStaging
conference, January 2011

  • Abbasi, Hasan; Eisenhauer, Greg; Wolf, Matthew
  • Proceedings of the 20th international symposium on High performance distributed computing - HPDC '11
  • DOI: 10.1145/1996130.1996137

DataStager: scalable data staging services for petascale applications
conference, January 2009

  • Abbasi, Hasan; Wolf, Matthew; Eisenhauer, Greg
  • Proceedings of the 18th ACM international symposium on High performance distributed computing - HPDC '09
  • DOI: 10.1145/1551609.1551618

Makeflow: a portable abstraction for data intensive computing on clusters, clouds, and grids
conference, January 2012

  • Albrecht, Michael; Donnelly, Patrick; Bui, Peter
  • Proceedings of the 1st ACM SIGMOD Workshop on Scalable Workflow Execution Engines and Technologies - SWEET '12
  • DOI: 10.1145/2443416.2443417

Interactive Exploration and Analysis of Large-Scale Simulations Using Topology-Based Data Segmentation
journal, September 2011

  • Bremer, P-T; Weber, G.; Tierny, J.
  • IEEE Transactions on Visualization and Computer Graphics, Vol. 17, Issue 9
  • DOI: 10.1109/TVCG.2010.253

Spontaneous rotation sources in a quiescent tokamak edge plasma
journal, June 2008


Moving the Code to the Data - Dynamic Code Deployment Using ActiveSpaces
conference, May 2011

  • Docan, Ciprian; Parashar, Manish; Cummings, Julian
  • Distributed Processing Symposium (IPDPS), 2011 IEEE International Parallel & Distributed Processing Symposium
  • DOI: 10.1109/IPDPS.2011.120

DataSpaces: an interaction and coordination framework for coupled simulation workflows
conference, January 2010

  • Docan, Ciprian; Parashar, Manish; Klasky, Scott
  • Proceedings of the 19th ACM International Symposium on High Performance Distributed Computing - HPDC '10
  • DOI: 10.1145/1851476.1851481

Damaris/Viz: A nonintrusive, adaptable and user-friendly in situ visualization framework
conference, October 2013

  • Dorier, Matthieu; Sisneros, Robert; Peterka, Tom
  • 2013 IEEE Symposium on Large-Scale Data Analysis and Visualization (LDAV)
  • DOI: 10.1109/LDAV.2013.6675160

Exploring Data Staging Across Deep Memory Hierarchies for Coupled Data Intensive Simulation Workflows
conference, May 2015

  • Jin, Tong; Zhang, Fan; Sun, Qian
  • 2015 IEEE International Parallel and Distributed Processing Symposium (IPDPS)
  • DOI: 10.1109/IPDPS.2015.50

Parallel in situ indexing for data-intensive computing
conference, October 2011

  • Kim, Jinoh; Abbasi, Hasan; Chacon, Luis
  • 2011 IEEE Symposium on Large Data Analysis and Visualization (LDAV)
  • DOI: 10.1109/LDAV.2011.6092319

On the role of burst buffers in leadership-class storage systems
conference, April 2012

  • Liu, Ning; Cope, Jason; Carns, Philip
  • 2012 IEEE 28th Symposium on Mass Storage Systems and Technologies (MSST)
  • DOI: 10.1109/MSST.2012.6232369

Extending scalability of collective IO through nessie and staging
conference, January 2011

  • Lofstead, Jay; Oldfield, Ron; Kordenbrock, Todd
  • Proceedings of the sixth workshop on Parallel Data Storage - PDSW '11
  • DOI: 10.1145/2159352.2159355

In Situ Visualization at Extreme Scale: Challenges and Opportunities
journal, November 2009


Toward simulation-time data analysis and I/O acceleration on leadership-class systems
conference, October 2011

  • Vishwanath, Venkatram; Hereld, Mark; Papka, Michael E.
  • 2011 IEEE Symposium on Large Data Analysis and Visualization (LDAV)
  • DOI: 10.1109/LDAV.2011.6092178

The RAMDISK storage accelerator: a method of accelerating I/O performance on HPC systems using RAMDISKs
conference, January 2012

  • Wickberg, Tim; Carothers, Christopher
  • Proceedings of the 2nd International Workshop on Runtime and Operating Systems for Supercomputers - ROSS '12
  • DOI: 10.1145/2318916.2318922

Enabling In-situ Execution of Coupled Scientific Workflow on Multi-core Platform
conference, May 2012

  • Zhang, Fan; Docan, Ciprian; Parashar, Manish
  • 2012 IEEE International Symposium on Parallel & Distributed Processing (IPDPS), 2012 IEEE 26th International Parallel and Distributed Processing Symposium
  • DOI: 10.1109/IPDPS.2012.122

In-situ Feature-Based Objects Tracking for Large-Scale Scientific Simulations
conference, November 2012

  • Zhang, Fan; Lasluisa, Solomon; Jin, Tong
  • 2012 SC Companion: High Performance Computing, Networking, Storage and Analysis (SCC), 2012 SC Companion: High Performance Computing, Networking Storage and Analysis
  • DOI: 10.1109/SC.Companion.2012.100

GoldRush: resource efficient in situ scientific data analytics using fine-grained interference aware execution
conference, January 2013

  • Zheng, Fang; Yu, Hongfeng; Hantas, Can
  • Proceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis on - SC '13
  • DOI: 10.1145/2503210.2503279