Enabling Seamless Transitions from Experimental to Production HPC for Interactive Workflows

Conference · Sat Nov 01 04:00:00 EDT 2025

DOI:https://doi.org/10.1007/978-3-032-07612-0_28· OSTI ID:3007916

Etz, Brian ^[1]; Rogers, David ^[1]; Brim, Michael ^[1]; Maheshwari, Ketan ^[1]; Leland, Kellen ^[1]; Skluzacek, Tyler ^[1]; Lange, Jack ^[1]; Pelfrey, Daniel S ^[1]; Webb, Jordan ^[1]; Widener, Patrick ^[1]; Adamson, Ryan ^[1]; Zimmer, Christopher ^[1]; Melesse Vergara, Veronica ^[1]; Shankar, Mallikarjun (Arjun) ^[1]; Oral, Sarp ^[1]; Ferreira Da Silva, Rafael ^[1]

---

1. ORNL

The evolving landscape of scientific computing requires seamless transitions from experimental to production HPC environments for interactive workflows. This paper presents a structured transition pathway developed at OLCF that bridges the gap between development testbeds and production systems. We address both technological and policy challenges, introducing frameworks for data streaming architectures, secure service interfaces, and adaptive resource scheduling for time-sensitive workloads and improved HPC interactivity. Our approach transforms traditional batch-oriented HPC into a more dynamic ecosystem capable of supporting modern scientific workflows that require near real-time data analysis, experimental steering, and cross-facility integration.

• Research Organization: Oak Ridge National Laboratory (ORNL), Oak Ridge, TN (United States)
• Sponsoring Organization: USDOE Office of Science (SC), Advanced Scientific Computing Research (ASCR) (SC-21); USDOE
• DOE Contract Number: AC05-00OR22725
• OSTI ID: 3007916
• Resource Type: Conference paper/presentation
• Conference Information: ISC High Performance Computing: Fifth Combined Workshop on Interactive and Urgent High-Performance Computing (WIUHPC) - Hamburg, Germany - 6/13/2025-6/13/2025
• Country of Publication: United States
• Language: English