Latency hiding for caches
Abstract
A technique for accessing a memory having a high latency portion and a low latency portion is provided. The technique includes detecting a promotion trigger to promote data from the high latency portion to the low latency portion, in response to the promotion trigger, copying cache lines associated with the promotion trigger from the high latency portion to the low latency portion, and in response to a read request, providing data from either or both of the high latency portion or the low latency portion, based on a state associated with data in the high latency portion and the low latency portion.
- Inventors:
- Issue Date:
- Research Org.:
- Lawrence Livermore National Laboratory (LLNL), Livermore, CA (United States)
- Sponsoring Org.:
- USDOE
- OSTI Identifier:
- 1924927
- Patent Number(s):
- 11397691
- Application Number:
- 16/683,142
- Assignee:
- Advanced Micro Devices, Inc. (Santa Clara, CA)
- Patent Classifications (CPCs):
-
G - PHYSICS G06 - COMPUTING G06F - ELECTRIC DIGITAL DATA PROCESSING
- DOE Contract Number:
- AC52-07NA27344; B620717
- Resource Type:
- Patent
- Resource Relation:
- Patent File Date: 11/13/2019
- Country of Publication:
- United States
- Language:
- English
- Subject:
- 97 MATHEMATICS AND COMPUTING
Citation Formats
Kalamatianos, John, Kokolis, Apostolos, and Ganapathy, Shrikanth. Latency hiding for caches. United States: N. p., 2022.
Web.
Kalamatianos, John, Kokolis, Apostolos, & Ganapathy, Shrikanth. Latency hiding for caches. United States.
Kalamatianos, John, Kokolis, Apostolos, and Ganapathy, Shrikanth. Tue .
"Latency hiding for caches". United States. https://www.osti.gov/servlets/purl/1924927.
@article{osti_1924927,
title = {Latency hiding for caches},
author = {Kalamatianos, John and Kokolis, Apostolos and Ganapathy, Shrikanth},
abstractNote = {A technique for accessing a memory having a high latency portion and a low latency portion is provided. The technique includes detecting a promotion trigger to promote data from the high latency portion to the low latency portion, in response to the promotion trigger, copying cache lines associated with the promotion trigger from the high latency portion to the low latency portion, and in response to a read request, providing data from either or both of the high latency portion or the low latency portion, based on a state associated with data in the high latency portion and the low latency portion.},
doi = {},
journal = {},
number = ,
volume = ,
place = {United States},
year = {2022},
month = {7}
}
Works referenced in this record:
Density Tradeoffs of Non-Volatile Memory as a Replacement for SRAM Based Last Level Cache
conference, June 2018
- Korgaonkar, Kunal; Bhati, Ishwar; Liu, Huichu
- 2018 ACM/IEEE 45th Annual International Symposium on Computer Architecture (ISCA)
Multi retention level STT-RAM cache designs with a dynamic refresh scheme
conference, December 2011
- Sun, Zhenyu; Bi, Xiuyuan; Li, Hai (Helen)
- Proceedings of the 44th Annual IEEE/ACM International Symposium on Microarchitecture
Prefetching techniques for STT-RAM based last-level cache in CMP systems
conference, January 2014
- Mao, Mengjie; Sun, Guangyu; Li, Yong
- 2014 19th Asia and South Pacific Design Automation Conference (ASP-DAC)
Performance and Energy-Efficient Design of STT-RAM Last-Level Cache
journal, June 2018
- Hameed, Fazal; Khan, Asif Ali; Castrillon, Jeronimo
- IEEE Transactions on Very Large Scale Integration (VLSI) Systems, Vol. 26, Issue 6
Bypassing Memory Requested to a Main Memory
patent-application, June 2014
- Sim, Jaewoong; Loh, Ganriel H.
- US Patent Application 13/709,044; 2014/0164713 Al
Intelligently Partitioning Data Cache to Allocate Space for Translation Entries
patent-application, March 2019
- John, Lizy K.; Marathe, YAshwant; Ryoo, Jee Ho
- US Patent Application 15/706,573; 2019/0087350 Al
Read Performance: The Newest Barrier in Scaled STT-RAM
journal, June 2015
- Zhang, Yaojun; Li, Yong; Sun, Zhenyu
- IEEE Transactions on Very Large Scale Integration (VLSI) Systems, Vol. 23, Issue 6
Relaxing non-volatility for fast and energy-efficient STT-RAM caches
conference, February 2011
- Smullen, Clinton W.; Mohan, Vidyabhushan; Nigam, Anurag
- 2011 IEEE 17th International Symposium on High Performance Computer Architecture
Evaluating STT-RAM as an energy-efficient main memory alternative
conference, April 2013
- Kultursay, Emre; Kandemir, Mahmut; Sivasubramaniam, Anand
- 2013 IEEE International Symposium on Performance Analysis of Systems and Software (ISPASS)
Spatial Locality-Aware Cache Partitioning for Effective Cache Sharing
conference, September 2015
- Gupta, Saurabh; Zhou, Huiyang
- 2015 44th International Conference on Parallel Processing
OAP: An Obstruction-Aware Cache Management Policy for STT-RAM Last-Level Caches
conference, January 2013
- Wang, Jue; Dong, Xiangyu; Xie, Yuan
- Design, Automation & Test in Europe Conference & Exhibition (DATE), 2013
Adaptive placement and migration policy for an STT-RAM-based hybrid cache
conference, February 2014
- Wang, Zhe; Jimenez, Daniel A.; Xu, Cong
- 2014 IEEE 20th International Symposium on High Performance Computer Architecture (HPCA)