Comparative evaluation of deep learning workloads for leadership-class systems
Deep learning (DL) workloads and their performance at scale are becoming important factors to consider as we design, develop and deploy next-generation high-performance computing systems. Since DL applications rely heavily on DL frameworks and underlying compute (CPU/GPU) stacks, it is essential to gain a holistic understanding from compute kernels, models, and frameworks of popular DL stacks, and to assess their impact on science-driven, mission-critical applications. At Oak Ridge Leadership Computing Facility (OLCF), we employ a set of micro and macro DL benchmarks established through the Collaboration of Oak Ridge, Argonne, and Livermore (CORAL) to evaluate the AI readiness of our next-generation supercomputers. In this paper, we present our early observations and performance benchmark comparisons between the Nvidia V100 based Summit system with its CUDA stack and an AMD MI100 based testbed system with its ROCm stack. We take a layered perspective on DL benchmarking and point to opportunities for future optimizations in the technologies that we consider.
- Research Organization:
- Oak Ridge National Laboratory (ORNL), Oak Ridge, TN (United States)
- Sponsoring Organization:
- USDOE Office of Science (SC), Advanced Scientific Computing Research (ASCR)
- DOE Contract Number:
- AC05-00OR22725
- OSTI ID:
- 1838972
- Resource Relation:
- Journal Volume: 1; Journal Issue: 1; Conference: 2021 BenchCouncil International Symposium on Benchmarking, Measuring and Optimizing - N/A, Tennessee, United States of America - 11/14/2021 10:00:00 AM-11/16/2021 10:00:00 AM
- Country of Publication:
- United States
- Language:
- English
Similar Records
Studying performance portability of LAMMPS across diverse GPU-based platforms
SV-Sim: Scalable PGAS-based State Vector Simulation of Quantum Circuits