Opportunities for Cost Savings with In-Transit Visualization

Conference · Mon Jun 01 00:00:00 EDT 2020

DOI:https://doi.org/10.1007/978-3-030-50743-5_8· OSTI ID:1649280

Kress, James  ^[1]; Larsen, Matthew ^[2]; Choi, Jong Youl  ^[1]; Kim, Mark B.  ^[1]; Wolf, Matthew  ^[1]; Podhorszki, Norbert  ^[1]; Klasky, Scott  ^[1]; Childs, Hank ^[3]; Pugmire, Dave  ^[1]

---

1. ORNL
2. Lawrence Livermore National Laboratory (LLNL)
3. University of Oregon

We analyze the opportunities for in-transit visualization to provide cost savings compared to in-line visualization. We begin by developing a cost model that includes factors related to both in-line and in-transit which allows comparisons to be made between the two methods. We then run a series of studies to create a corpus of data for our model. We run two different visualization algorithms, one that is computation heavy and one that is communication heavy with concurrencies up to 32, 768 cores. Our primary results are in exploring the cost model within the context of our corpus. Our findings show that in-transit consistently achieves significant cost efficiencies by running visualization algorithms at lower concurrency, and that in many cases these efficiencies are enough to offset other costs (transfer, blocking, and additional nodes) to be cost effective overall. Finally, this work informs future studies, which can focus on choosing ideal configurations for in-transit processing that can consistently achieve cost efficiencies.

• Research Organization: Oak Ridge National Laboratory (ORNL), Oak Ridge, TN (United States)
• Sponsoring Organization: USDOE
• DOE Contract Number: AC05-00OR22725
• OSTI ID: 1649280
• Resource Relation: Journal Volume: 12151; Conference: ISC High Performance - Frankfurt, , Germany - 6/21/2020 8:00:00 AM-6/25/2020 8:00:00 AM
• Country of Publication: United States
• Language: English