Cache utilization and eviction based on allocated priority tokens

Johnson, Daniel Robert; Rhu, Minsoo; O'Connor, James M.; Keckler, Stephen William

Advanced Search OptionsAdvanced Search queries use a traditional Term Search. For more info, see our FAQ.

All Fields:

Patent Title:

Abstract:

Assignee:

Inventor(s):

Patent Number:

Patent Classification (CPC):

All Classifications
A - human necessities
A01 - agriculture
A21 - baking
A22 - butchering
A23 - foods or foodstuffs
A24 - tobacco
A41 - wearing apparel
A42 - headwear
A43 - footwear
A44 - haberdashery
A45 - hand or travelling articles
A46 - brushware
A47 - furniture
A61 - medical or veterinary science
A62 - life-saving
A63 - sports
A99 - subject matter not otherwise provided for in this section
B - performing operations
B01 - physical or chemical processes or apparatus in general
B02 - crushing, pulverising, or disintegrating
B03 - separation of solid materials using liquids or using pneumatic tables or jigs
B04 - centrifugal apparatus or machines for carrying-out physical or chemical processes
B05 - spraying or atomising in general
B06 - generating or transmitting mechanical vibrations in general
B07 - separating solids from solids
B08 - cleaning
B09 - disposal of solid waste
B21 - mechanical metal-working without essentially removing material
B22 - casting
B23 - machine tools
B24 - grinding
B25 - hand tools
B26 - hand cutting tools
B27 - working or preserving wood or similar material
B28 - working cement, clay, or stone
B29 - working of plastics
B30 - presses
B31 - making articles of paper, cardboard or material worked in a manner analogous to paper
B32 - layered products
B33 - additive manufacturing technology
B41 - printing
B42 - bookbinding
B43 - writing or drawing implements
B44 - decorative arts
B60 - vehicles in general
B61 - railways
B62 - land vehicles for travelling otherwise than on rails
B63 - ships or other waterborne vessels
B64 - aircraft
B65 - conveying
B66 - hoisting
B67 - opening, closing {or cleaning} bottles, jars or similar containers
B68 - saddlery
B81 - microstructural technology
B82 - nanotechnology
B99 - subject matter not otherwise provided for in this section
C - chemistry
C01 - inorganic chemistry
C02 - treatment of water, waste water, sewage, or sludge
C03 - glass
C04 - cements
C05 - fertilisers
C06 - explosives
C07 - organic chemistry
C08 - organic macromolecular compounds
C09 - dyes
C10 - petroleum, gas or coke industries
C11 - animal or vegetable oils, fats, fatty substances or waxes
C12 - biochemistry
C13 - sugar industry
C14 - skins
C21 - metallurgy of iron
C22 - metallurgy
C23 - coating metallic material
C25 - electrolytic or electrophoretic processes
C30 - crystal growth
C40 - combinatorial technology
C99 - subject matter not otherwise provided for in this section
D - textiles
D01 - natural or man-made threads or fibres
D02 - yarns
D03 - weaving
D04 - braiding
D05 - sewing
D06 - treatment of textiles or the like
D07 - ropes
D10 - indexing scheme associated with sublasses of section d, relating to textiles
D21 - paper-making
D99 - subject matter not otherwise provided for in this section
E - fixed constructions
E01 - construction of roads, railways, or bridges
E02 - hydraulic engineering
E03 - water supply
E04 - building
E05 - locks
E06 - doors, windows, shutters, or roller blinds in general
E21 - earth drilling
E99 - subject matter not otherwise provided for in this section
F - mechanical engineering
F01 - machines or engines in general
F02 - combustion engines
F03 - machines or engines for liquids
F04 - positive - displacement machines for liquids
F05 - indexing schemes relating to engines or pumps in various subclasses of classes f01-f04
F15 - fluid-pressure actuators
F16 - engineering elements and units
F17 - storing or distributing gases or liquids
F21 - lighting
F22 - steam generation
F23 - combustion apparatus
F24 - heating
F25 - refrigeration or cooling
F26 - drying
F27 - furnaces
F28 - heat exchange in general
F41 - weapons
F42 - ammunition
F99 - subject matter not otherwise provided for in this section
G - physics
G01 - measuring
G02 - optics
G03 - photography
G04 - horology
G05 - controlling
G06 - computing
G07 - checking-devices
G08 - signalling
G09 - education
G10 - musical instruments
G11 - information storage
G12 - instrument details
G16 - information and communication technology [ict] specially adapted for specific application fields
G21 - nuclear physics
G99 - subject matter not otherwise provided for in this section
H - electricity
H01 - basic electric elements
H02 - generation
H03 - basic electronic circuitry
H04 - electric communication technique
H05 - electric techniques not otherwise provided for
H99 - subject matter not otherwise provided for in this section
Y - new / cross sectional technologies
Y02 - technologies or applications for mitigation or adaptation against climate change
Y04 - information or communication technologies having an impact on other technology areas
Y10 - technical subjects covered by former uspc

More Options ...

Title: Cache utilization and eviction based on allocated priority tokens

Abstract

A system, method, and computer program product are provided for providing prioritized access for multithreaded processing. The method includes the steps of allocating threads to process a workload and assigning a set of priority tokens to at least a portion of the threads. Access to a resource, by each one of the threads, is based on the priority token assigned to the thread and the threads are executed by a multithreaded processor to process the workload.

Inventors:: Johnson, Daniel Robert; Rhu, Minsoo; O'Connor, James M.; Keckler, Stephen William

Issue Date:: Tue Oct 25 00:00:00 EDT 2016

Research Org.:: NVIDIA Corp., Santa Clara, CA (United States)

Sponsoring Org.:: USDOE

OSTI Identifier:: 1531953

Patent Number(s):: 9477526

Application Number:: 14/147,395

Assignee:: NVIDIA Corporation (Santa Clara, CA)

Patent Classifications (CPCs):: G - PHYSICS G06 - COMPUTING G06F - ELECTRIC DIGITAL DATA PROCESSING

Y - NEW / CROSS SECTIONAL TECHNOLOGIES Y02 - TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE Y02D - CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THIR OWN ENERGY USE

Show more

G - PHYSICS G06 - COMPUTING G06F - ELECTRIC DIGITAL DATA PROCESSING
G06F2209/5021 - Priority
G06F9/48 - Program initiating
G06F9/5016 - {the resource being the memory}
G06F9/5027 - {the resource being a machine, e.g. CPUs, Servers, Terminals}

Y - NEW / CROSS SECTIONAL TECHNOLOGIES Y02 - TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE Y02D - CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THIR OWN ENERGY USE
Y02D10/00 - Energy efficient computing

Show less

DOE Contract Number:: B599861

Resource Type:: Patent

Resource Relation:: Patent File Date: 2014-01-03

Country of Publication:: United States

Language:: English

Citation Formats


                    Johnson, Daniel Robert, Rhu, Minsoo, O'Connor, James M., and Keckler, Stephen William. Cache utilization and eviction based on allocated priority tokens.  United States: N. p., 2016. 
        Web.

Copy to clipboard


                    Johnson, Daniel Robert, Rhu, Minsoo, O'Connor, James M., & Keckler, Stephen William. Cache utilization and eviction based on allocated priority tokens.  United States.

Copy to clipboard


                    Johnson, Daniel Robert, Rhu, Minsoo, O'Connor, James M., and Keckler, Stephen William. Tue .  
        "Cache utilization and eviction based on allocated priority tokens".  United States.  https://www.osti.gov/servlets/purl/1531953.

Copy to clipboard


                    
@article{osti_1531953,

  title        = {Cache utilization and eviction based on allocated priority tokens},

  author       = {Johnson, Daniel Robert and Rhu, Minsoo and O'Connor, James M. and Keckler, Stephen William},

  abstractNote = {A system, method, and computer program product are provided for providing prioritized access for multithreaded processing. The method includes the steps of allocating threads to process a workload and assigning a set of priority tokens to at least a portion of the threads. Access to a resource, by each one of the threads, is based on the priority token assigned to the thread and the threads are executed by a multithreaded processor to process the workload.},

  doi          = {},

  journal      = {},
number       = ,

  volume       = ,

  place        = {United States},

  year         = {Tue Oct 25 00:00:00 EDT 2016},

  month        = {Tue Oct 25 00:00:00 EDT 2016}

}

Copy to clipboard

Patent:

Save / Share:

Export Metadata

Save to My Library

Works referenced in this record:

Cache memory with improved replacement policy
patent-application, August 2005

Schubert, Richard P.
US Patent Application 10/786250; 20050188158
URL: https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/20050188158

Controlling a Processor Cache Using a Real-Time Attribute
patent-application, September 2013

Coleman, James A.; Srivastava, Durgesh
US Patent Application 13/993052; 20130254491
URL: https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/20130254491

Tokenized Resource Access
patent-application, April 2010

Kline, Daniel E.; Medvinsky, Alexander
US Patent Application 12/242150; 20100083386
URL: https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/20100083386

Method of resource allocation using an access control mechanism
patent-application, June 2005

Clark, Scott Douglass; Day, Michael Norman; Johns, Charles Ray
US Patent Application 10/738720; 20050138621
URL: https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/20050138621

Resource Access Throttling
patent-application, August 2013

Hsieh, Anderthan; Chapman, James W.; Lin, Fuyan
US Patent Application 13/372259; 20130212270
URL: https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/20130212270

Prioritized Token Based Arbiter and Method
patent-application, March 2014

Reilly, Craig P.; Bekiares, Tyrone D.
US Patent Application 13/601748; 20140068700
URL: https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/20140068700

End-to-End Flow Control in System on Chip Interconnects
patent-application, January 2015

Mittal, Millind; Mitchell, Phil
US Patent Application 13/953059; 20150032794
URL: https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/20150032794

System for and managing assets using priority tokens
patent-application, April 2003

Blazey, Richard N.; Covannon, Edward
US Patent Application 09/970948; 20030069828
URL: https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/20030069828

Methods and apparatus for multi-threading on a simultaneous multi-threading on a simultaneous multi-threading processor
patent-application, May 2004

Ramanujam, Gopalan; Nayak, Narendra S.
US Patent Application 10/284602; 20040088708
URL: https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/20040088708

Priority control in resource allocation for low request rate, latency-sensitive units
patent-application, May 2007

Chen, Wen-Tzer T.; Johns, Charles R.; Raghavan, Ram
US Patent Application 11/260579; 20070101033
URL: https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/20070101033

System and method for allocating resources for heterogeneous service requests
patent, August 2013

Tobler, Benjamin; Brooker, Marc John; de Kadt, Christopher Richard Jacques
US Patent Document 8,504,691
URL: https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/8504691

Methods And Apparatus For Dynamic Grouping Of Requestors Of Resources In A Multi-Processor System
patent-application, March 2003

Terakawa, Hiroaki
US Patent Application 11/535128; 20080077721
URL: https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/20080077721

Managing storage units in multi-core and multi-threaded systems
patent-application, March 2010

Bull, David Michael; Ozer, Emre
US Patent Application 12/232188; 20100064109
URL: https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/20100064109

Dynamic instruction execution based on transaction priority tagging
patent-application, May 2009

Capps, JR., Louis B.; Bell, JR., Robert H.
US Patent Application 11/946504; 20090138682
URL: https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/20090138682

Dynamic Mitigation of Thread Hogs on a Threaded Processor
patent-application, February 2011

Smolens, Jared C.; Golla, Robert T.; Smittle, Matthew B.
US Patent Application 12/511620; 20110029978
URL: https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/20110029978

Enforcement of Policies on Context-Based Authorization
patent-application, July 2011

Maes, Stephane H.
US Patent Application 12/986435; 20110167479
URL: https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/20110167479

Token swapping for hot spot management
patent-application, June 2005

Raghavan, Ram; Chen, Wen-Tzer Thomas
US Patent Application 10/738722; 20050138254
URL: https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/20050138254

Priority based throttling for power/performance Quality of Service
patent-application, October 2008

Illikkal, Ramesh Kumar; Iyer, Ravishankar; Moses, Jaideep
US Patent Application 11/786019; 20080250415
URL: https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/20080250415

Controlling usage of system resources by a network manager
patent-application, October 2004

Das, Debashis
US Patent Application 10/409939; 20040215578
URL: https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/20040215578

Efficient Resource Arbitration
patent-application, July 2008

Jacob, Rojit
US Patent Application 11/616539; 20080162760
URL: https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/20080162760

Programmable priority for concurrent multi-threaded processors
patent-application, April 2007

So, Kimming; Truong, Baobinh; Lu, Yang
US Patent Application 11/256631; 20070094664
URL: https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/20070094664

Acquiring Access To A Token Controlled System Resource
patent-application, June 2012

Cox, Jason A.; Lin, Kevin C.; Robinson, Eric F.
US Patent Application 12/969634; 20120159640
URL: https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/20120159640

Methods And Apparatus For Dynamic Redistribution Of Tokens In A Multi-Processor System
patent-application, May 2008

Terakawa, Hiroaki
US Patent Application 11/559980; 20080112313
URL: https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/20080112313

Works referencing / citing this record:

Management of asynchronous and synchronous resource requests
patent, January 2018

Gentile, Joseph W.; Hou, Jie; Sica, Andrew M.
US Patent Document 9,875,147
URL: https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/9875147

Management of asynchronous and synchronous resource requests
patent, February 2018

Gentile, Joseph W.; Hou, Jie; Sica, Andrew M.
US Patent Document 9,898,349
URL: https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/9898349

Similar Records in DOE Patents and OSTI.GOV collections:

Evict on write, a management strategy for a prefetch unit and/or first level cache in a multiprocessor system with speculative execution

Patent Gara, Alan; Ohmacht, Martin

In a multiprocessor system with at least two levels of cache, a speculative thread may run on a core processor in parallel with other threads. When the thread seeks to do a write to main memory, this access is to be written through the first level cache to the second level cache. After the write though, the corresponding line is deleted from the first level cache and/or prefetch unit, so that any further accesses to the same location in main memory have to be retrieved from the second level cache. The second level cache keeps track of multiple versions ofmore » « less
Full Text Available
Cache management based on access type priority

Patent Yin, Jieming; Eckert, Yasuko; Sethumurugan, Subhash

Systems, apparatuses, and methods for cache management based on access type priority are disclosed. A system includes at least a processor and a cache. During a program execution phase, certain access types are more likely to cause demand hits in the cache than others. Demand hits are load and store hits to the cache. A run-time profiling mechanism is employed to find which access types are more likely to cause demand hits. Based on the profiling results, the cache lines that will likely be accessed in the future are retained based on their most recent access type. The goal ismore » « less
Full Text Available
Constant time worker thread allocation via configuration caching

Patent Eichenberger, Alexandre E; O'Brien, John K. P.

Mechanisms are provided for allocating threads for execution of a parallel region of code. A request for allocation of worker threads to execute the parallel region of code is received from a master thread. Cached thread allocation information identifying prior thread allocations that have been performed for the master thread are accessed. Worker threads are allocated to the master thread based on the cached thread allocation information. The parallel region of code is executed using the allocated worker threads.
Full Text Available
Device and method for cache utilization aware data compression

Patent Das, Shomit N.; Punniyamurthy, Kishore; Tomei, Matthew; ...

A processing device is provided which includes memory and at least one processor. The memory includes main memory and cache memory in communication with the main memory via a link. The at least one processor is configured to receive a request for a cache line and read the cache line from main memory. The at least one processor is also configured to compress the cache line according to a compression algorithm and, when the compressed cache line includes at least one byte predicted not to be accessed, drop the at least one byte from the compressed cache line based onmore » « less
Full Text Available
Cache management based on reuse distance

Patent Yin, Jieming; Sethumurugan, Subhash; Eckert, Yasuko

A cache of a processor includes a cache controller to implement a cache management policy for the insertion and replacement of cache lines of the cache. The cache management policy assigns replacement priority levels to each cache line of at least a subset of cache lines in a region of the cache based on a comparison of a number of accesses to a cache set having a way that stores a cache line since the cache line was last accessed to a reuse distance determined for the region of the cache, wherein the reuse distance represents an average number ofmore » « less
Full Text Available

Similar Records

Title: Cache utilization and eviction based on allocated priority tokens

Abstract

Citation Formats

Cache memory with improved replacement policy patent-application, August 2005

Controlling a Processor Cache Using a Real-Time Attribute patent-application, September 2013

Tokenized Resource Access patent-application, April 2010

Method of resource allocation using an access control mechanism patent-application, June 2005

Resource Access Throttling patent-application, August 2013

Prioritized Token Based Arbiter and Method patent-application, March 2014

End-to-End Flow Control in System on Chip Interconnects patent-application, January 2015

System for and managing assets using priority tokens patent-application, April 2003

Methods and apparatus for multi-threading on a simultaneous multi-threading on a simultaneous multi-threading processor patent-application, May 2004

Priority control in resource allocation for low request rate, latency-sensitive units patent-application, May 2007

System and method for allocating resources for heterogeneous service requests patent, August 2013

Methods And Apparatus For Dynamic Grouping Of Requestors Of Resources In A Multi-Processor System patent-application, March 2003

Managing storage units in multi-core and multi-threaded systems patent-application, March 2010

Dynamic instruction execution based on transaction priority tagging patent-application, May 2009

Dynamic Mitigation of Thread Hogs on a Threaded Processor patent-application, February 2011

Enforcement of Policies on Context-Based Authorization patent-application, July 2011

Token swapping for hot spot management patent-application, June 2005

Priority based throttling for power/performance Quality of Service patent-application, October 2008

Controlling usage of system resources by a network manager patent-application, October 2004

Efficient Resource Arbitration patent-application, July 2008

Programmable priority for concurrent multi-threaded processors patent-application, April 2007

Acquiring Access To A Token Controlled System Resource patent-application, June 2012

Methods And Apparatus For Dynamic Redistribution Of Tokens In A Multi-Processor System patent-application, May 2008

Management of asynchronous and synchronous resource requests patent, January 2018

Management of asynchronous and synchronous resource requests patent, February 2018

Cache memory with improved replacement policy
patent-application, August 2005

Controlling a Processor Cache Using a Real-Time Attribute
patent-application, September 2013

Tokenized Resource Access
patent-application, April 2010

Method of resource allocation using an access control mechanism
patent-application, June 2005

Resource Access Throttling
patent-application, August 2013

Prioritized Token Based Arbiter and Method
patent-application, March 2014

End-to-End Flow Control in System on Chip Interconnects
patent-application, January 2015

System for and managing assets using priority tokens
patent-application, April 2003

Methods and apparatus for multi-threading on a simultaneous multi-threading on a simultaneous multi-threading processor
patent-application, May 2004

Priority control in resource allocation for low request rate, latency-sensitive units
patent-application, May 2007

System and method for allocating resources for heterogeneous service requests
patent, August 2013

Methods And Apparatus For Dynamic Grouping Of Requestors Of Resources In A Multi-Processor System
patent-application, March 2003

Managing storage units in multi-core and multi-threaded systems
patent-application, March 2010

Dynamic instruction execution based on transaction priority tagging
patent-application, May 2009

Dynamic Mitigation of Thread Hogs on a Threaded Processor
patent-application, February 2011

Enforcement of Policies on Context-Based Authorization
patent-application, July 2011

Token swapping for hot spot management
patent-application, June 2005

Priority based throttling for power/performance Quality of Service
patent-application, October 2008

Controlling usage of system resources by a network manager
patent-application, October 2004

Efficient Resource Arbitration
patent-application, July 2008

Programmable priority for concurrent multi-threaded processors
patent-application, April 2007

Acquiring Access To A Token Controlled System Resource
patent-application, June 2012

Methods And Apparatus For Dynamic Redistribution Of Tokens In A Multi-Processor System
patent-application, May 2008

Management of asynchronous and synchronous resource requests
patent, January 2018

Management of asynchronous and synchronous resource requests
patent, February 2018