A Community Roadmap for Scientific Workflows Research and Development

Conference · Mon Nov 01 04:00:00 EDT 2021

OSTI ID:1837860

Ferreira Da Silva, Rafael ^[1]; Casanova, Henri ^[2]; Chard, Kyle ^[3]; Altintas, Ilkay ^[4]; Badia, Rosa ^[5]; Balis, Bartosz ^[6]; Coleman, Taina ^[7]; Coppens, Frederik ^[8]; Fahringer, Thomas ^[9]; Filgueira, Rosa ^[10]; Fursin, Grigori ^[11]; Garijo, Daniel ^[12]; Goble, Carole ^[13]; Howell, Dorran ^[14]; S. Katz, Daniel ^[15]; Laney, Daniel ^[16]; Leser, Ulf ^[17]; Malawski, Maciej ^[6]; Mehta, Kshitij ^[1]; Pottier, Loic ^[18] ; Ozik, Jonathan ^[19]; Peterson, J Luc ^[16]; Ramakrishnan, Lavanya ^[20]; Soiland reyes, Stian ^[13]; Thain, Douglas ^[21]; Wolf, Matthew ^[1]

---

1. ORNL
2. University of Hawaii at Manoa, Honolulu
3. University of Chicago
4. University of California, San Diego
5. Barcelona Supercomputing Center
6. AGH University of Science and Technology, Krakow, Poland
7. University of Southern California, Los Angeles
8. Ghent University, Belgium
9. University of Innsbruck, Austria
10. Heriot-Watt University, Edinburgh, UK
11. Tuning Foundation and Knowledge SAS
12. Universidad Politecnica de Madrid, Spain
13. University of Manchester University, UK
14. Tweag, Zurich, Switzerland
15. University of Illinois at Urbana-Champaign
16. Lawrence Livermore National Laboratory (LLNL)
17. Humboldt-Universitat zu Berlin
18. University of Southern California, Information Sciences Institute
19. Argonne National Laboratory (ANL)
20. Lawrence Berkeley National Laboratory
21. University of Notre Dame, IN

The landscape of workflow systems for scientific applications is notoriously convoluted with hundreds of seemingly equivalent workflow systems, many isolated research claims, and a steep learning curve. To address some of these challenges and lay the groundwork for transforming workflows research and development, the WorkflowsRI and ExaWorks projects partnered to bring the international workflows community together. This paper reports on discussions and findings from two virtual “Workflows Community Summits” (January and April, 2021). The overarching goals of these workshops were to develop a view of the state of the art, identify crucial research challenges in the workflows community, articulate a vision for potential community efforts, and discuss technical approaches for realizing this vision. To this end, participants identified six broad themes: FAIR computational workflows; AI workflows; exascale challenges; APIs, interoperability, reuse, and standards; training and education; and building a workflows community. We summarize discussions and recommendations for each of these themes.

• Research Organization: Oak Ridge National Laboratory (ORNL), Oak Ridge, TN (United States)
• Sponsoring Organization: USDOE
• DOE Contract Number: AC05-00OR22725
• OSTI ID: 1837860
• Country of Publication: United States
• Language: English