Workflow Mini-Apps: Portable, Scalable, Tunable &amp; Faithful Representations of Scientific Workflows

Kilic, Ozgur O.; Wang, Tianle; Turilli, Matteo; Titov, Mikhail; Merzky, Andre; Pouchard, Line; Jha, Shantenu

doi:10.1109/ccgrid59990.2024.00059

Workflow Mini-Apps: Portable, Scalable, Tunable & Faithful Representations of Scientific Workflows

Conference · Mon May 06 00:00:00 EDT 2024

DOI:https://doi.org/10.1109/ccgrid59990.2024.00059· OSTI ID:2527298

; Wang, Tianle; Turilli, Matteo; Titov, Mikhail; Merzky, Andre; Pouchard, Line; Jha, Shantenu

View Conference

Research Organization:: Brookhaven National Laboratory (BNL), Upton, NY (United States)

Sponsoring Organization:: USDOE Office of Science (SC), Advanced Scientific Computing Research (ASCR); USDOE Office of Science (SC), High Energy Physics (HEP)

DOE Contract Number:: SC0012704

OSTI ID:: 2527298

Report Number(s):: BNL-227494-2025-COPA

Country of Publication:: United States

Language:: English

References (30)

Computational reproducibility of scientific workflows at extreme scales Pouchard, Line; Baldwin, Sterling; Elsethagen, Todd The International Journal of High Performance Computing Applications, Vol. 33, Issue 5 https://doi.org/10.1177/1094342019839124	journal	April 2019
Performance, Energy, and Scalability Analysis and Improvement of Parallel Cancer Deep Learning CANDLE Benchmarks Wu, Xingfu; Taylor, Valerie; Wozniak, Justin M. Proceedings of the 48th International Conference on Parallel Processing https://doi.org/10.1145/3337821.3337905	conference	August 2019
The Ghost of Performance Reproducibility Past Ramesh, Srinivasan; Titov, Mikhail; Turilli, Matteo 2022 IEEE 18th International Conference on e-Science (e-Science) https://doi.org/10.1109/eScience55777.2022.00091	conference	October 2022
Colmena: Scalable Machine-Learning-Based Steering of Ensemble Simulations for High Performance Computing Ward, Logan; Sivaraman, Ganesh; Pauloski, J. Gregory 2021 IEEE/ACM Workshop on Machine Learning in High Performance Computing Environments (MLHPC) https://doi.org/10.1109/MLHPC54614.2021.00007	conference	November 2021
DeepDriveMD: Deep-Learning Driven Adaptive Molecular Simulations for Protein Folding Lee, Hyungro; Turilli, Matteo; Jha, Shantenu 2019 IEEE/ACM Third Workshop on Deep Learning on Supercomputers (DLS) https://doi.org/10.1109/DLS49591.2019.00007	conference	November 2019
Performance optimality or reproducibility Patki, Tapasya; Thiagarajan, Jayaraman J.; Ayala, Alexis Proceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis https://doi.org/10.1145/3295500.3356217	conference	November 2019
Toward Understanding I/O Behavior in HPC Workflows Luttgau, Jakob; Snyder, Shane; Carns, Philip 2018 IEEE/ACM 3rd International Workshop on Parallel Data Storage & Data Intensive Scalable Computing Systems (PDSW-DISCS) https://doi.org/10.1109/PDSW-DISCS.2018.00012	conference	November 2018
Coupling streaming AI and HPC ensembles to achieve 100–1000× faster biomolecular simulations Brace, Alexander; Yakushin, Igor; Ma, Heng 2022 IEEE International Parallel and Distributed Processing Symposium (IPDPS) https://doi.org/10.1109/IPDPS53621.2022.00083	conference	May 2022
PAThWay: Performance Analysis and Tuning Using Workflows Petkov, Ventsislav; Gerndt, Michael; Firbach, Michael 2013 IEEE 10th International Conference on High Performance Computing and Communications & 2013 IEEE International Conference on Embedded and Ubiquitous Computing https://doi.org/10.1109/HPCC.and.EUC.2013.115	conference	November 2013
Mini-apps for high performance data analysis Sukumar, Sreenivas R.; Matheson, Michael A.; Kannan, Ramakrishnan 2016 IEEE International Conference on Big Data (Big Data) https://doi.org/10.1109/BigData.2016.7840756	conference	December 2016
Chimbuko: A Workflow-Level Scalable Performance Trace Analysis Tool Kelly, Christopher; Ha, Sungsoo; Huck, Kevin ISAV'20 In Situ Infrastructures for Enabling Extreme-Scale Analysis and Visualization https://doi.org/10.1145/3426462.3426465	conference	November 2020
The Arch Project: Physics Mini-Apps for Algorithmic Exploration and Evaluating Programming Environments on HPC Architectures Martineau, Matthew; McIntosh-Smith, Simon 2017 IEEE International Conference on Cluster Computing (CLUSTER) https://doi.org/10.1109/CLUSTER.2017.126	conference	September 2017
Rapid Memory Footprint Access Diagnostics Kilic, Ozgur O.; Tallent, Nathan R.; Friese, Ryan D. 2020 IEEE International Symposium on Performance Analysis of Systems and Software (ISPASS) https://doi.org/10.1109/ISPASS48437.2020.00047	conference	August 2020
MemGaze: Rapid and Effective Load-Level Memory Trace Analysis Kilic, Ozgur O.; Tallent, Nathan R.; Suriyakumar, Yasodha 2022 IEEE International Conference on Cluster Computing (CLUSTER) https://doi.org/10.1109/CLUSTER51413.2022.00058	conference	September 2022
Overview of ATLAS PanDA Workload Management Maeno, T.; De, K.; Wenaus, T. Journal of Physics: Conference Series, Vol. 331, Issue 7 https://doi.org/10.1088/1742-6596/331/7/072024	journal	December 2011
MiniVite: A Graph Analytics Benchmarking Tool for Massively Parallel Systems Ghosh, Sayan; Halappanavar, Mahantesh; Tumeo, Antonino 2018 IEEE/ACM Performance Modeling, Benchmarking and Simulation of High Performance Computer Systems (PMBS) https://doi.org/10.1109/PMBS.2018.8641631	conference	November 2018
Thoughtful Precision in Mini-Apps Fogerty, Shane; Bishnu, Siddhartha; Zamora, Yuliana 2017 IEEE International Conference on Cluster Computing (CLUSTER) https://doi.org/10.1109/CLUSTER.2017.120	conference	September 2017
Preparing for the Future—Rethinking Proxy Applications Matsuoka, Satoshi; Domke, Jens; Wahib, Mohamed Computing in Science & Engineering, Vol. 24, Issue 2 https://doi.org/10.1109/MCSE.2022.3153105	journal	March 2022
Tunable approximations to control time-to-solution in an HPC molecular docking Mini-App Gadioli, Davide; Palermo, Gianluca; Cherubin, Stefano The Journal of Supercomputing, Vol. 77, Issue 1 https://doi.org/10.1007/s11227-020-03295-x	journal	April 2020
Dynamic steering of HPC scientific workflows: A survey Mattoso, Marta; Dias, Jonas; Ocaña, Kary A. C. S. Future Generation Computer Systems, Vol. 46 https://doi.org/10.1016/j.future.2014.11.017	journal	May 2015
24/7 Characterization of petascale I/O workloads Carns, Philip; Latham, Robert; Ross, Robert 2009 IEEE International Conference on Cluster Computing and Workshops https://doi.org/10.1109/CLUSTR.2009.5289150	conference	August 2009
Building the I (Interoperability) of FAIR for Performance Reproducibility of Large-Scale Composable Workflows in RECUP Nicolae, Bogdan; Islam, Tanzima Z.; Ross, Robert 2023 IEEE 19th International Conference on e-Science (e-Science) https://doi.org/10.1109/e-Science58273.2023.10254808	conference	October 2023
Ensemble Toolkit: Scalable and Flexible Execution of Ensembles of Tasks Balasubramanian, Vivekanandan; Treikalis, Antons; Weidner, Ole 2016 45th International Conference on Parallel Processing (ICPP) https://doi.org/10.1109/ICPP.2016.59	conference	August 2016
The ββα fold: explorations in sequence space11Edited by M. F. Summers Sarisky, Catherine A.; Mayo, Stephen L. Journal of Molecular Biology, Vol. 307, Issue 5 https://doi.org/10.1006/jmbi.2000.4345	journal	April 2001
A Parallel Machine Learning Workflow for Neutron Scattering Data Analysis Wang, Tianle; Seal, Sudip K.; Kannan, Ramakrishnan 2023 IEEE International Parallel and Distributed Processing Symposium Workshops (IPDPSW) https://doi.org/10.1109/IPDPSW59300.2023.00133	conference	May 2023
Co-design Center for Exascale Machine Learning Technologies (ExaLearn) Alexander, Francis J.; Ang, James; Bilbrey, Jenna A. The International Journal of High Performance Computing Applications, Vol. 35, Issue 6 https://doi.org/10.1177/10943420211029302	journal	September 2021
Neural Mini-Apps as a Tool for Neuromorphic Computing Insight Vineyard, Craig; Cardwell, Suma; Chance, Frances Neuro-Inspired Computational Elements Conference https://doi.org/10.1145/3517343.3517353	conference	March 2022
AI-driven multiscale simulations illuminate mechanisms of SARS-CoV-2 spike dynamics Casalino, Lorenzo; Dommer, Abigail C.; Gaieb, Zied The International Journal of High Performance Computing Applications https://doi.org/10.1177/10943420211006452	journal	April 2021
Performance issues and performance analysis tools for HPC cloud applications: a survey Benedict, Shajulin Computing, Vol. 95, Issue 2 https://doi.org/10.1007/s00607-012-0213-0	journal	September 2012
Volume I. Introduction to DUNE Abi, B.; Acciarri, R.; Acero, M. A. Journal of Instrumentation, Vol. 15, Issue 08 https://doi.org/10.1088/1748-0221/15/08/T08008	journal	August 2020

Similar Records

Modeling the Performance and Scaling of Scientific Workflows with Resource-efficient Workflow Mini-apps

Conference · Thu Aug 01 00:00:00 EDT 2024 · OSTI ID:2588349

Scalable Composition and Analysis Techniques for Massive Scientific Workflows

Conference · Thu Sep 01 00:00:00 EDT 2022 · OSTI ID:1893596

Scalable Composition and Analysis Techniques for Massive Scientific Workflows

Conference · Mon Oct 18 00:00:00 EDT 2021 · OSTI ID:1959451

Related Subjects

97 MATHEMATICS AND COMPUTING

Workflow Mini-Apps: Portable, Scalable, Tunable & Faithful Representations of Scientific Workflows

Citation Formats

References (30)

Similar Records

Related Subjects