Novel Proposals for FAIR, Automated, Recommendable, and Robust Workflows

Abhinit, Ishan; Adams, Emily K.; Alam, Khairul; Chase, Brian; Deelman, Ewa; Gorenstein, Lev; Hudson, Stephen; Islam, Tanzima; Larson, Jeffrey; Lentner, Geoffrey; Mandal, Anirban; Navarro, John-Luke; Nicolae, Bogdan; Pouchard, Line; Ross, Rob; Roy, Banani; Rynge, Mats; Serebrenik, Alexander; Vahi, Karan; Wild, Stefan; Xin, Yufeng; da Silva, Rafael Ferreira; Filgueira, Rosa

doi:10.1109/WORKS56498.2022.00016

Novel Proposals for FAIR, Automated, Recommendable, and Robust Workflows

Conference · 01 January 2022

DOI:https://doi.org/10.1109/WORKS56498.2022.00016· OSTI ID:1958760

Abhinit, Ishan; Adams, Emily K.; Alam, Khairul; Chase, Brian; Deelman, Ewa; Gorenstein, Lev; Hudson, Stephen; Islam, Tanzima; Larson, Jeffrey; Lentner, Geoffrey; Mandal, Anirban; Navarro, John-Luke; Nicolae, Bogdan; Pouchard, Line; Ross, Rob; Roy, Banani; Rynge, Mats; Serebrenik, Alexander; Vahi, Karan; Wild, Stefan more »

Lightning talks of the Workflows in Support of Large-Scale Science (WORKS) workshop are a venue where the workflow community (researchers, developers, and users) can discuss work in progress, emerging technologies and frameworks, and training and education materials. This paper summarizes the WORKS 2022 lightning talks, which cover five broad topics: data integrity of scientific workflows; a machine learning-based recommendation system; a Python toolkit for running dynamic ensembles of simulations; a cross-platform, high-performance computing utility for processing shell commands; and a meta(data) framework for reproducing hybrid workflows.

🛈

OSTI does not have a digital full text copy available. For more information, please see document availability, search WorldCat, or search Google Scholar.

Research Organization:: Argonne National Lab. (ANL), Argonne, IL (United States)

Sponsoring Organization:: USDOE Office of Science (SC); National Science Foundation (NSF); USDOE Exascale Computing Project (ECP)

DOE Contract Number:: AC02-06CH11357

OSTI ID:: 1958760

Resource Relation:: Conference: 17th Workshop on Workflows in Support of Large-Scale Science held in conjunction with SC21, 11/14/22 - 11/14/22, Dallas, TX, US

Country of Publication:: United States

Language:: English

References (26)

Parsl: Pervasive Parallel Programming in Python Babuji, Yadu; Foster, Ian; Wilde, Michael Proceedings of the 28th International Symposium on High-Performance Parallel and Distributed Computing - HPDC '19 https://doi.org/10.1145/3307681.3325400	conference	January 2019
Sustainable data analysis with Snakemake Mölder, Felix; Jablonski, Kim Philipp; Letcher, Brice F1000Research, Vol. 10 https://doi.org/10.12688/f1000research.29032.2	journal	April 2021
HyperShell v2: Distributed Task Execution for HPC Lentner, Geoffrey; Gorenstein, Lev Practice and Experience in Advanced Research Computing https://doi.org/10.1145/3491418.3535138	conference	July 2022
Launcher: A simple tool for executing high throughput computing workloads A. Wilson, Lucas; M. Fonner, John; Allison, Jason The Journal of Open Source Software, Vol. 2, Issue 16 https://doi.org/10.21105/joss.00289	journal	August 2017
Full-length transcriptome assembly from RNA-Seq data without a reference genome Grabherr, Manfred G.; Haas, Brian J.; Yassour, Moran Nature Biotechnology, Vol. 29, Issue 7 https://doi.org/10.1038/nbt.1883	journal	May 2011
Swift: A language for distributed parallel scripting Wilde, Michael; Hategan, Mihael; Wozniak, Justin M. Parallel Computing, Vol. 37, Issue 9 https://doi.org/10.1016/j.parco.2011.05.005	journal	September 2011
Security in high-performance computing environments Peisert, Sean Communications of the ACM, Vol. 60, Issue 9 https://doi.org/10.1145/3096742	journal	August 2017
A Community Roadmap for Scientific Workflows Research and Development da Silva, Rafael Ferreira; Casanova, Henri; Chard, Kyle 2021 IEEE Workshop on Workflows in Support of Large-Scale Science (WORKS) https://doi.org/10.1109/WORKS54523.2021.00016	conference	November 2021
Semi-automatic web service composition for the life sciences using the BioMoby semantic web framework DiBernardo, Michael; Pottinger, Rachel; Wilkinson, Mark Journal of Biomedical Informatics, Vol. 41, Issue 5 https://doi.org/10.1016/j.jbi.2008.02.005	journal	October 2008
Automated workflow composition in mass spectrometry-based proteomics Palmblad, Magnus; Lamprecht, Anna-Lena; Ison, Jon Bioinformatics, Vol. 35, Issue 4 https://doi.org/10.1093/bioinformatics/bty646	journal	July 2018
libEnsemble: A Library to Coordinate the Concurrent Evaluation of Dynamic Ensembles of Calculations Hudson, Stephen; Larson, Jeffrey; Navarro, John-Luke IEEE Transactions on Parallel and Distributed Systems, Vol. 33, Issue 4 https://doi.org/10.1109/TPDS.2021.3082815	journal	April 2022
FAIR Digital Objects for Science: From Data Pieces to Actionable Knowledge Units De Smedt, Koenraad; Koureas, Dimitris; Wittenburg, Peter Publications, Vol. 8, Issue 2 https://doi.org/10.3390/publications8020021	journal	April 2020
The fundamental principles of reproducibility Gundersen, Odd Erik Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences, Vol. 379, Issue 2197 https://doi.org/10.1098/rsta.2020.0210	journal	March 2021
Tool recommender system in Galaxy using deep learning Kumar, Anup; Rasche, Helena; Grüning, Björn GigaScience, Vol. 10, Issue 1 https://doi.org/10.1093/gigascience/giaa152	journal	January 2021
VisComplete: Automating Suggestions for Visualization Pipelines Koop, D.; Scheidegger, C. E.; Callahan, S. P. IEEE Transactions on Visualization and Computer Graphics, Vol. 14, Issue 6 https://doi.org/10.1109/TVCG.2008.174	journal	November 2008
Workflow composition through design suggestions using design-time provenance information Junaid, Malik Muhammad; Berger, Maximilian; Vitvar, Tomas 2009 5th IEEE International Conference on E-Science Workshops https://doi.org/10.1109/ESCIW.2009.5407989	conference	December 2009
Integrity Protection for Scientific Workflow Data Rynge, Mats; Vahi, Karan; Deelman, Ewa Proceedings of the Practice and Experience in Advanced Research Computing on Rise of the Machines (learning) https://doi.org/10.1145/3332186.3332222	conference	July 2019
Pegasus, a workflow management system for science automation Deelman, Ewa; Vahi, Karan; Juve, Gideon Future Generation Computer Systems, Vol. 46 https://doi.org/10.1016/j.future.2014.10.008	journal	May 2015
Mochi: Composing Data Services for High-Performance Computing Environments Ross, Robert B.; Amvrosiadis, George; Carns, Philip Journal of Computer Science and Technology, Vol. 35, Issue 1 https://doi.org/10.1007/s11390-020-9802-0	journal	January 2020
Recommender systems Lü, Linyuan; Medo, Matúš; Yeung, Chi Ho Physics Reports, Vol. 519, Issue 1 https://doi.org/10.1016/j.physrep.2012.02.006	journal	October 2012
Middleware Building Blocks for Workflow Systems Turilli, Matteo; Balasubramanian, Vivek; Merzky, Andre Computing in Science & Engineering, Vol. 21, Issue 4 https://doi.org/10.1109/MCSE.2019.2920048	journal	July 2019
Performance optimality or reproducibility Patki, Tapasya; Thiagarajan, Jayaraman J.; Ayala, Alexis Proceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis https://doi.org/10.1145/3295500.3356217	conference	November 2019
Understanding and improving computational science storage access through continuous characterization Carns, Philip; Harms, Kevin; Allcock, William 2011 IEEE 27th Symposium on Mass Storage Systems and Technologies (MSST) https://doi.org/10.1109/MSST.2011.5937212	conference	May 2011
Chimbuko: A Workflow-Level Scalable Performance Trace Analysis Tool Kelly, Christopher; Ha, Sungsoo; Huck, Kevin ISAV'20 In Situ Infrastructures for Enabling Extreme-Scale Analysis and Visualization https://doi.org/10.1145/3426462.3426465	conference	November 2020
Asterism: Pegasus and Dispel4py Hybrid Workflows for Data-Intensive Science Filgueira, Rosa; Da Silva, Rafael Ferreira; Krause, Amrey 2016 Seventh International Workshop on Data-Intensive Computing in the Clouds (DataCloud) https://doi.org/10.1109/DataCloud.2016.004	conference	November 2016
FAIR Computational Workflows Goble, Carole; Cohen-Boulakia, Sarah; Soiland-Reyes, Stian Data Intelligence, Vol. 2, Issue 1-2 https://doi.org/10.1162/dint_a_00033	journal	January 2020

Similar Records

Emerging Frameworks for Advancing Scientific Workflows Research, Development, and Education

Conference · 2021 · 2021 IEEE Workshop on Workflows in Support of Large-Scale Science (WORKS) · OSTI ID:2001242

Casanova, Henri; Deelman, Ewa; Gesing, Sandra; +14 more

Novel Approaches Toward Scalable Composable Workflows in Hyper-Heterogeneous Computing Environments

Conference · 2023 · OSTI ID:2305814

Titov, Mikhail; Carson, Robert; Rolchigo, Matt; +6 more

Towards a Standard Process Management Infrastructure for Workflows Using Python

Conference · 2023 · OSTI ID:1969826

Elwasif, Wael; Naughton III, Thomas; Baker, Matthew

Novel Proposals for FAIR, Automated, Recommendable, and Robust Workflows

Citation Formats

References (26)

Similar Records

Related Subjects