Design Space Exploration of Emerging Memory Technologies for Machine Learning Applications

Conference · Sat May 01 00:00:00 EDT 2021

OSTI ID:1807257

Hasan, S M Shamimul ^[1]; Imam, Neena  ^[1]; Kannan, Ramakrishnan {ramki}  ^[1]; Yoginath, Srikanth  ^[1]; Kurte, Kuldeep ^[1]

---

1. ORNL

Memory design space exploration methods study memory systems’ performances and limitations before implementation. The computer memory design space has grown exponentially because of the enormous growth of memory types, memory controllers, and application software. Computer simulators are commonly used for memory design space exploration. However, complex memory simulations take an enormous amount of time. Hence, in this paper, we proposed a machine learning-based design space exploration method for dynamic random-access memory and non-volatile memory systems. We applied our method to the CosmoGAN and LeNet applications to predict the following six memory response parameters: (i) bandwidth, (ii) power, (iii) average latency, (iv) average total latency, (v) memory reads, and (vi) memory writes. Our experimental results show that machine learning models can predict memory response parameter values faster than simulations. We used support vector machine, random forest, and gradient boosting machine learning models. We observed that the support vector machine provides better performance for bandwidth, average latency, and average total latency. The random forest model works better for memory reads and writes. The gradient boosting model provides superior prediction performance for power. We provide a detailed discussion on learning curve characteristics, error analysis, and memory type recommendation.

• Research Organization: Oak Ridge National Laboratory (ORNL), Oak Ridge, TN (United States)
• Sponsoring Organization: USDOE
• DOE Contract Number: AC05-00OR22725
• OSTI ID: 1807257
• Resource Relation: Conference: IEEE IPDPS 2021 - The Eleventh International Workshop on Accelerators and Hybrid Emerging Systems (AsHES) - Portland, Oregon, United States of America - 5/17/2021 4:00:00 AM-5/21/2021 4:00:00 AM
• Country of Publication: United States
• Language: English