DOE Patents title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: Cache utilization and eviction based on allocated priority tokens

Abstract

A system, method, and computer program product are provided for providing prioritized access for multithreaded processing. The method includes the steps of allocating threads to process a workload and assigning a set of priority tokens to at least a portion of the threads. Access to a resource, by each one of the threads, is based on the priority token assigned to the thread and the threads are executed by a multithreaded processor to process the workload.

Inventors:
; ; ;
Issue Date:
Research Org.:
NVIDIA Corp., Santa Clara, CA (United States)
Sponsoring Org.:
USDOE
OSTI Identifier:
1531953
Patent Number(s):
9477526
Application Number:
14/147,395
Assignee:
NVIDIA Corporation (Santa Clara, CA)
Patent Classifications (CPCs):
G - PHYSICS G06 - COMPUTING G06F - ELECTRIC DIGITAL DATA PROCESSING
Y - NEW / CROSS SECTIONAL TECHNOLOGIES Y02 - TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE Y02D - CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THIR OWN ENERGY USE
DOE Contract Number:  
B599861
Resource Type:
Patent
Resource Relation:
Patent File Date: 2014-01-03
Country of Publication:
United States
Language:
English

Citation Formats

Johnson, Daniel Robert, Rhu, Minsoo, O'Connor, James M., and Keckler, Stephen William. Cache utilization and eviction based on allocated priority tokens. United States: N. p., 2016. Web.
Johnson, Daniel Robert, Rhu, Minsoo, O'Connor, James M., & Keckler, Stephen William. Cache utilization and eviction based on allocated priority tokens. United States.
Johnson, Daniel Robert, Rhu, Minsoo, O'Connor, James M., and Keckler, Stephen William. Tue . "Cache utilization and eviction based on allocated priority tokens". United States. https://www.osti.gov/servlets/purl/1531953.
@article{osti_1531953,
title = {Cache utilization and eviction based on allocated priority tokens},
author = {Johnson, Daniel Robert and Rhu, Minsoo and O'Connor, James M. and Keckler, Stephen William},
abstractNote = {A system, method, and computer program product are provided for providing prioritized access for multithreaded processing. The method includes the steps of allocating threads to process a workload and assigning a set of priority tokens to at least a portion of the threads. Access to a resource, by each one of the threads, is based on the priority token assigned to the thread and the threads are executed by a multithreaded processor to process the workload.},
doi = {},
journal = {},
number = ,
volume = ,
place = {United States},
year = {2016},
month = {10}
}

Works referenced in this record:

Cache memory with improved replacement policy
patent-application, August 2005


Controlling a Processor Cache Using a Real-Time Attribute
patent-application, September 2013


Tokenized Resource Access
patent-application, April 2010


Method of resource allocation using an access control mechanism
patent-application, June 2005


Resource Access Throttling
patent-application, August 2013


Prioritized Token Based Arbiter and Method
patent-application, March 2014


End-to-End Flow Control in System on Chip Interconnects
patent-application, January 2015


System for and managing assets using priority tokens
patent-application, April 2003


Priority control in resource allocation for low request rate, latency-sensitive units
patent-application, May 2007


System and method for allocating resources for heterogeneous service requests
patent, August 2013


Managing storage units in multi-core and multi-threaded systems
patent-application, March 2010


Dynamic instruction execution based on transaction priority tagging
patent-application, May 2009


Dynamic Mitigation of Thread Hogs on a Threaded Processor
patent-application, February 2011


Enforcement of Policies on Context-Based Authorization
patent-application, July 2011


Token swapping for hot spot management
patent-application, June 2005


Priority based throttling for power/performance Quality of Service
patent-application, October 2008


Controlling usage of system resources by a network manager
patent-application, October 2004


Efficient Resource Arbitration
patent-application, July 2008


Programmable priority for concurrent multi-threaded processors
patent-application, April 2007


Acquiring Access To A Token Controlled System Resource
patent-application, June 2012


    Works referencing / citing this record:

    Management of asynchronous and synchronous resource requests
    patent, January 2018


    Management of asynchronous and synchronous resource requests
    patent, February 2018