Techniques for collective operations in distributed systems

Langer, Akhil

Advanced Search OptionsAdvanced Search queries use a traditional Term Search. For more info, see our FAQ.

All Fields:

Patent Title:

Abstract:

Assignee:

Inventor(s):

Patent Number:

Patent Classification (CPC):

All Classifications
A - human necessities
A01 - agriculture
A21 - baking
A22 - butchering
A23 - foods or foodstuffs
A24 - tobacco
A41 - wearing apparel
A42 - headwear
A43 - footwear
A44 - haberdashery
A45 - hand or travelling articles
A46 - brushware
A47 - furniture
A61 - medical or veterinary science
A62 - life-saving
A63 - sports
A99 - subject matter not otherwise provided for in this section
B - performing operations
B01 - physical or chemical processes or apparatus in general
B02 - crushing, pulverising, or disintegrating
B03 - separation of solid materials using liquids or using pneumatic tables or jigs
B04 - centrifugal apparatus or machines for carrying-out physical or chemical processes
B05 - spraying or atomising in general
B06 - generating or transmitting mechanical vibrations in general
B07 - separating solids from solids
B08 - cleaning
B09 - disposal of solid waste
B21 - mechanical metal-working without essentially removing material
B22 - casting
B23 - machine tools
B24 - grinding
B25 - hand tools
B26 - hand cutting tools
B27 - working or preserving wood or similar material
B28 - working cement, clay, or stone
B29 - working of plastics
B30 - presses
B31 - making articles of paper, cardboard or material worked in a manner analogous to paper
B32 - layered products
B33 - additive manufacturing technology
B41 - printing
B42 - bookbinding
B43 - writing or drawing implements
B44 - decorative arts
B60 - vehicles in general
B61 - railways
B62 - land vehicles for travelling otherwise than on rails
B63 - ships or other waterborne vessels
B64 - aircraft
B65 - conveying
B66 - hoisting
B67 - opening, closing {or cleaning} bottles, jars or similar containers
B68 - saddlery
B81 - microstructural technology
B82 - nanotechnology
B99 - subject matter not otherwise provided for in this section
C - chemistry
C01 - inorganic chemistry
C02 - treatment of water, waste water, sewage, or sludge
C03 - glass
C04 - cements
C05 - fertilisers
C06 - explosives
C07 - organic chemistry
C08 - organic macromolecular compounds
C09 - dyes
C10 - petroleum, gas or coke industries
C11 - animal or vegetable oils, fats, fatty substances or waxes
C12 - biochemistry
C13 - sugar industry
C14 - skins
C21 - metallurgy of iron
C22 - metallurgy
C23 - coating metallic material
C25 - electrolytic or electrophoretic processes
C30 - crystal growth
C40 - combinatorial technology
C99 - subject matter not otherwise provided for in this section
D - textiles
D01 - natural or man-made threads or fibres
D02 - yarns
D03 - weaving
D04 - braiding
D05 - sewing
D06 - treatment of textiles or the like
D07 - ropes
D10 - indexing scheme associated with sublasses of section d, relating to textiles
D21 - paper-making
D99 - subject matter not otherwise provided for in this section
E - fixed constructions
E01 - construction of roads, railways, or bridges
E02 - hydraulic engineering
E03 - water supply
E04 - building
E05 - locks
E06 - doors, windows, shutters, or roller blinds in general
E21 - earth drilling
E99 - subject matter not otherwise provided for in this section
F - mechanical engineering
F01 - machines or engines in general
F02 - combustion engines
F03 - machines or engines for liquids
F04 - positive - displacement machines for liquids
F05 - indexing schemes relating to engines or pumps in various subclasses of classes f01-f04
F15 - fluid-pressure actuators
F16 - engineering elements and units
F17 - storing or distributing gases or liquids
F21 - lighting
F22 - steam generation
F23 - combustion apparatus
F24 - heating
F25 - refrigeration or cooling
F26 - drying
F27 - furnaces
F28 - heat exchange in general
F41 - weapons
F42 - ammunition
F99 - subject matter not otherwise provided for in this section
G - physics
G01 - measuring
G02 - optics
G03 - photography
G04 - horology
G05 - controlling
G06 - computing
G07 - checking-devices
G08 - signalling
G09 - education
G10 - musical instruments
G11 - information storage
G12 - instrument details
G16 - information and communication technology [ict] specially adapted for specific application fields
G21 - nuclear physics
G99 - subject matter not otherwise provided for in this section
H - electricity
H01 - basic electric elements
H02 - generation
H03 - basic electronic circuitry
H04 - electric communication technique
H05 - electric techniques not otherwise provided for
H99 - subject matter not otherwise provided for in this section
Y - new / cross sectional technologies
Y02 - technologies or applications for mitigation or adaptation against climate change
Y04 - information or communication technologies having an impact on other technology areas
Y10 - technical subjects covered by former uspc

More Options ...

Title: Techniques for collective operations in distributed systems

Abstract

Various embodiments are generally directed to techniques for collective operations among compute nodes in a distributed processing set, such as by utilizing ring sets and local sets of the distributed processing set. In some embodiments, a ring set may include a subset of the distributed processing set in which each compute node is connected to a network with a separate router. In various embodiments, a local set may include a subset of the distributed processing set in which each compute node is connected to a network with a common router. In one or more embodiments, each compute node in a distributed processing set may belong to one ring set and one local set.

Inventors:: Langer, Akhil

Issue Date:: 2022-05-03

Research Org.:: Intel Corporation, Santa Clara, CA (United States)

Sponsoring Org.:: USDOE

OSTI Identifier:: 1892897

Patent Number(s):: 11321136

Application Number:: 15/856,538

Assignee:: Intel Corporation (Santa Clara, CA)

Patent Classifications (CPCs):: G - PHYSICS G06 - COMPUTING G06F - ELECTRIC DIGITAL DATA PROCESSING

H - ELECTRICITY H04 - ELECTRIC COMMUNICATION TECHNIQUE H04L - TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION

Show more

G - PHYSICS G06 - COMPUTING G06F - ELECTRIC DIGITAL DATA PROCESSING
G06F15/17312 - {Routing techniques specific to parallel machines, e.g. wormhole, store and forward, shortest path problem congestion
G06F15/17362 - {hierarchical topologies}
G06F9/465 - {Distributed object oriented systems
G06F9/5027 - {the resource being a machine, e.g. CPUs, Servers, Terminals}
G06F9/5061 - {Partitioning or combining of resources}
G06F9/546 - {Message passing systems or structures, e.g. queues}

H - ELECTRICITY H04 - ELECTRIC COMMUNICATION TECHNIQUE H04L - TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
H04L45/04 - {Interdomain routing, e.g. hierarchical routing}
H04L45/10 - {Routing in connection-oriented networks, e.g. X.25, ATM}
H04L45/54 - {Organization of routing tables}
H04L45/58 - {Association of routers}
H04L45/60 - {Router architecture}
H04L49/102 - {using shared medium, e.g. bus or ring}
H04L49/15 - {Interconnection of switching modules}
H04L67/10 - {in which an application is distributed across nodes in the network

Show less

DOE Contract Number:: B609815

Resource Type:: Patent

Resource Relation:: Patent File Date: 12/28/2017

Country of Publication:: United States

Language:: English

Citation Formats


                    Langer, Akhil. Techniques for collective operations in distributed systems.  United States: N. p., 2022. 
        Web.

Copy to clipboard


                    Langer, Akhil. Techniques for collective operations in distributed systems.  United States.

Copy to clipboard


                    Langer, Akhil. Tue .  
        "Techniques for collective operations in distributed systems".  United States.  https://www.osti.gov/servlets/purl/1892897.

Copy to clipboard


                    
@article{osti_1892897,

  title        = {Techniques for collective operations in distributed systems},

  author       = {Langer, Akhil},

  abstractNote = {Various embodiments are generally directed to techniques for collective operations among compute nodes in a distributed processing set, such as by utilizing ring sets and local sets of the distributed processing set. In some embodiments, a ring set may include a subset of the distributed processing set in which each compute node is connected to a network with a separate router. In various embodiments, a local set may include a subset of the distributed processing set in which each compute node is connected to a network with a common router. In one or more embodiments, each compute node in a distributed processing set may belong to one ring set and one local set.},

  doi          = {},

  journal      = {},
number       = ,

  volume       = ,

  place        = {United States},

  year         = {2022},

  month        = {5}

}

Copy to clipboard

Patent:

Save / Share:

Export Metadata

Save to My Library

Works referenced in this record:

Optimization of computer system logical partition migrations in a multiple computer system environment
patent, March 2018

Birkestrand, Daniel C.; Heyrman, Peter J.; Olsen, Paul F.
US Patent Document 9,912,741
URL: https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/9912741

Flexible grouping for port analysis
patent, November 2010

Ham, David M.; Lobo, Shane A.; Parrott, Steve D.
US Patent Document 7,831,709
URL: https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/7831709

Administering Globally Accessible Memory Space in a Distributed Computing System
patent-application, July 2013

Jea, Tsai-Yang; Nie, Yuan Yuan
US Patent Application 13/710,611; 2013/0173740 Al
URL: https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/20130173740

Evaluation of Topology-Aware Broadcast Algorithms for Dragonfly Networks
conference, September 2016

Dorier, Matthieu; Mubarak, Misbah; Ross, Rob
2016 IEEE International Conference on Cluster Computing (CLUSTER)
https://doi.org/10.1109/CLUSTER.2016.26

Parallel Processing Systems and Method
patent-application, October 2003

Howard, Kevin David; Rea, Glen Curtis; Robertson, Nick Wade
US Patent Application 10/340,524; 2003/0195938 Al
URL: https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/20030195938

Composing Cores and FPGAS at Massive Scale with Directional, Two Dimensional Routers and Interconnecting Networks
patent-application, October 2018

Gray, Jan stephen
US Patent Application 15/945,662; 2018/0287964 Al
URL: https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/20180287964

Ring configurator for system interconnection using fully covered rings
patent, July 1996

Pan, Shien-Tai; Cheng, Ting; Georgiou, Christos J.
US Patent Document 5,535,213
URL: https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/5535213

Remote Memory Access Functionality in a Cluster of Data Processing Nodes
patent-application, August 2016

Davis, Mark Bradley; Evans, Barry Ross; Borland, David James
US Patent Application 15/042,489; 2016/0239415 Al
URL: https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/20160239415

Device type differentiation for redundancy coded data storage systems
patent, June 2018

Lazier, Colin Laird
US Patent Document 10,009,044
URL: https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/10009044

Interconnection Network Topology for Large Scale High Performance Computing (HPC) Systems
patent-application, January 2016

Arimilli, Baba L.; Denzel, Wolfgang; Heidelberger, Philip
US Patent Application 14/326,208; 2016/0012004 Al
URL: https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/20160012004

Optimization of Collective Communication Operations in MPICH
journal, February 2005

Thakur, Rajeev; Rabenseifner, Rolf; Gropp, William
The International Journal of High Performance Computing Applications, Vol. 19, Issue 1
https://doi.org/10.1177/1094342005051521

Distributing an Executable Job Load File to Compute Nodes in a Parallel Computer
patent-application, June 2015

Gooding, Thomas M.
US Patent Application 14/303,208; 2015/0163287 Al
URL: https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/20150163287

Generalized Hierarchical All-to-All Exchange Patterns
conference, May 2013

Prisacari, Bogdan; Rodriguez, German; Minkenberg, Cyriel
2013 IEEE 27th International Symposium on Parallel and Distributed Processing
https://doi.org/10.1109/IPDPS.2013.87

Table-Driven Routing in a Dragonfly Processor Interconnect Network
patent-application, October 2016

Parker, Mike; Scott, Steve; Cheng, Albert
US Patent Application 15/063191; 20160294694
URL: https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/20160294694

On-Chip and System-Area Multi-Processor Interconnection Networks in Advanced Processes for Maximizing Performance Minimizing Cost and Energy
patent-application, July 2017

Prasad, Sharat C.; Ghosh, Subir
US Patent Application 15/445,844; 2017/0193136 Al
URL: https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/20170193136

Techniques to Manage Virtual Classes for Statistical Tests
patent-application, March 2021

Chen, Xilong; Little, Mark Roland
US Patent Application 16/952,375; 2021/0073023 Al
URL: https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/20210073023

Data-Aware Workload Scheduling and Execution in Heterogeneous Environments
patent-application, March 2016

Dube, Parijat; Zhang, Li
US Patent Application 14/489,664; 2016/0085587 Al
URL: https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/20160085587

Label distribution protocol (LDP) signaled multi-protocol label switching rings
patent, February 2019

Easale, Santosh S.; Kompella, Kireeti; Torvi, Raveendra
US Patent Document 10,218,611
URL: https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/10218611

Latency reduction techniques for partitioned processing
patent, May 2013

Cox, Richard
US Patent Document 8,447,757
URL: https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/8447757

High Performance, Scalable Multi Chip Interconnect
patent-application, May 2014

Ramey, Carl G.; Mattina, Matthew
US Patent Application 13/789801; 20140122560
URL: https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/20140122560

Method and apparatus for remotely testing token ring local area networks
patent, January 2001

Kolb, Ronald E.
US Patent Document 6,178,531
URL: https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/6178531

Resource Selection for Transmission of Multiple ACK/NASCK on Pucch Channel
patent-application, April 2015

Hu, Yang; Astely, David; Cheng, Jung-Fu
US Patent Application 14/588,676; 2015/0117276 Al
URL: https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/20150117276

Table-Driven Routing in a Dragonfly Processor Interconnect Network
patent-application, July 2015

Parker, Mike; Scott, Steve; Cheng, Albert
US Patent Application 14/583,579; 2015/0188817 Al
URL: https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/20150188817

Interconnection Network Topology for Large Scale High Performance Computing (HPC) Systems
patent-application, January 2016

Arimilli, Baba L.; Denzel, Wolfgang; Heidelberger, Philip
US Patent Application 14/486,719; 2016/0012002 Al
URL: https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/20160012002

Optimization of Computer System Logical Partition Migrations in a Multiple Computer System Environment
patent-application, July 2016

Birkestrand, Daniel C.; Heyrman, Peter J.; Olsen, Paul F.
US Patent Application 14/600,364; 2016/0212202 Al
URL: https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/20160212202

Optimization of Resource Utilization in a Collection of Devices
patent-application, June 2013

Kruglick, Ezekiel
US Patent Application 13/515,052; 2013/0166749 Al
URL: https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/20130166749

Similar Records in DOE Patents and OSTI.GOV collections:

Implementing asyncronous collective operations in a multi-node processing system

Patent Chen, Dong; Eisley, Noel A.; Heidelberger, Philip; ...

A method, system, and computer program product are disclosed for implementing an asynchronous collective operation in a multi-node data processing system. In one embodiment, the method comprises sending data to a plurality of nodes in the data processing system, broadcasting a remote get to the plurality of nodes, and using this remote get to implement asynchronous collective operations on the data by the plurality of nodes. In one embodiment, each of the nodes performs only one task in the asynchronous operations, and each nodes sets up a base address table with an entry for a base address of a memorymore » « less
Full Text Available
Collective operations in a file system based execution model

Patent Shinde, Pravin; Van Hensbergen, Eric

A mechanism is provided for group communications using a MULTI-PIPE synthetic file system. A master application creates a multi-pipe synthetic file in the MULTI-PIPE synthetic file system, the master application indicating a multi-pipe operation to be performed. The master application then writes a header-control block of the multi-pipe synthetic file specifying at least one of a multi-pipe synthetic file system name, a message type, a message size, a specific destination, or a specification of the multi-pipe operation. Any other application participating in the group communications then opens the same multi-pipe synthetic file. A MULTI-PIPE file system module then implements themore » « less
Full Text Available
Collective operations in a file system based execution model

Patent Shinde, Pravin; Van Hensbergen, Eric

A mechanism is provided for group communications using a MULTI-PIPE synthetic file system. A master application creates a multi-pipe synthetic file in the MULTI-PIPE synthetic file system, the master application indicating a multi-pipe operation to be performed. The master application then writes a header-control block of the multi-pipe synthetic file specifying at least one of a multi-pipe synthetic file system name, a message type, a message size, a specific destination, or a specification of the multi-pipe operation. Any other application participating in the group communications then opens the same multi-pipe synthetic file. A MULTI-PIPE file system module then implements themore » « less
Full Text Available
Performing a scatterv operation on a hierarchical tree network optimized for collective operations

Patent Archer, Charles J; Blocksome, Michael A; Ratterman, Joseph D; ...

Performing a scatterv operation on a hierarchical tree network optimized for collective operations including receiving, by the scatterv module installed on the node, from a nearest neighbor parent above the node a chunk of data having at least a portion of data for the node; maintaining, by the scatterv module installed on the node, the portion of the data for the node; determining, by the scatterv module installed on the node, whether any portions of the data are for a particular nearest neighbor child below the node or one or more other nodes below the particular nearest neighbor child; andmore » « less
Full Text Available
Determining collective barrier operation skew in a parallel computer

Patent Faraj, Daniel A.

Determining collective barrier operation skew in a parallel computer that includes a number of compute nodes organized into an operational group includes: for each of the nodes until each node has been selected as a delayed node: selecting one of the nodes as a delayed node; entering, by each node other than the delayed node, a collective barrier operation; entering, after a delay by the delayed node, the collective barrier operation; receiving an exit signal from a root of the collective barrier operation; and measuring, for the delayed node, a barrier completion time. The barrier operation skew is calculated by:more » « less
Full Text Available

Similar Records

Title: Techniques for collective operations in distributed systems

Abstract

Citation Formats

Optimization of computer system logical partition migrations in a multiple computer system environment patent, March 2018

Flexible grouping for port analysis patent, November 2010

Administering Globally Accessible Memory Space in a Distributed Computing System patent-application, July 2013

Evaluation of Topology-Aware Broadcast Algorithms for Dragonfly Networks conference, September 2016

Parallel Processing Systems and Method patent-application, October 2003

Composing Cores and FPGAS at Massive Scale with Directional, Two Dimensional Routers and Interconnecting Networks patent-application, October 2018

Ring configurator for system interconnection using fully covered rings patent, July 1996

Remote Memory Access Functionality in a Cluster of Data Processing Nodes patent-application, August 2016

Device type differentiation for redundancy coded data storage systems patent, June 2018

Interconnection Network Topology for Large Scale High Performance Computing (HPC) Systems patent-application, January 2016

Optimization of Collective Communication Operations in MPICH journal, February 2005

Distributing an Executable Job Load File to Compute Nodes in a Parallel Computer patent-application, June 2015

Generalized Hierarchical All-to-All Exchange Patterns conference, May 2013

Table-Driven Routing in a Dragonfly Processor Interconnect Network patent-application, October 2016

On-Chip and System-Area Multi-Processor Interconnection Networks in Advanced Processes for Maximizing Performance Minimizing Cost and Energy patent-application, July 2017

Techniques to Manage Virtual Classes for Statistical Tests patent-application, March 2021

Data-Aware Workload Scheduling and Execution in Heterogeneous Environments patent-application, March 2016

Label distribution protocol (LDP) signaled multi-protocol label switching rings patent, February 2019

Latency reduction techniques for partitioned processing patent, May 2013

High Performance, Scalable Multi Chip Interconnect patent-application, May 2014

Method and apparatus for remotely testing token ring local area networks patent, January 2001

Resource Selection for Transmission of Multiple ACK/NASCK on Pucch Channel patent-application, April 2015

Table-Driven Routing in a Dragonfly Processor Interconnect Network patent-application, July 2015

Interconnection Network Topology for Large Scale High Performance Computing (HPC) Systems patent-application, January 2016

Optimization of Computer System Logical Partition Migrations in a Multiple Computer System Environment patent-application, July 2016

Optimization of Resource Utilization in a Collection of Devices patent-application, June 2013

Optimization of computer system logical partition migrations in a multiple computer system environment
patent, March 2018

Flexible grouping for port analysis
patent, November 2010

Administering Globally Accessible Memory Space in a Distributed Computing System
patent-application, July 2013

Evaluation of Topology-Aware Broadcast Algorithms for Dragonfly Networks
conference, September 2016

Parallel Processing Systems and Method
patent-application, October 2003

Composing Cores and FPGAS at Massive Scale with Directional, Two Dimensional Routers and Interconnecting Networks
patent-application, October 2018

Ring configurator for system interconnection using fully covered rings
patent, July 1996

Remote Memory Access Functionality in a Cluster of Data Processing Nodes
patent-application, August 2016

Device type differentiation for redundancy coded data storage systems
patent, June 2018

Interconnection Network Topology for Large Scale High Performance Computing (HPC) Systems
patent-application, January 2016

Optimization of Collective Communication Operations in MPICH
journal, February 2005

Distributing an Executable Job Load File to Compute Nodes in a Parallel Computer
patent-application, June 2015

Generalized Hierarchical All-to-All Exchange Patterns
conference, May 2013

Table-Driven Routing in a Dragonfly Processor Interconnect Network
patent-application, October 2016

On-Chip and System-Area Multi-Processor Interconnection Networks in Advanced Processes for Maximizing Performance Minimizing Cost and Energy
patent-application, July 2017

Techniques to Manage Virtual Classes for Statistical Tests
patent-application, March 2021

Data-Aware Workload Scheduling and Execution in Heterogeneous Environments
patent-application, March 2016

Label distribution protocol (LDP) signaled multi-protocol label switching rings
patent, February 2019

Latency reduction techniques for partitioned processing
patent, May 2013

High Performance, Scalable Multi Chip Interconnect
patent-application, May 2014

Method and apparatus for remotely testing token ring local area networks
patent, January 2001

Resource Selection for Transmission of Multiple ACK/NASCK on Pucch Channel
patent-application, April 2015

Table-Driven Routing in a Dragonfly Processor Interconnect Network
patent-application, July 2015

Interconnection Network Topology for Large Scale High Performance Computing (HPC) Systems
patent-application, January 2016

Optimization of Computer System Logical Partition Migrations in a Multiple Computer System Environment
patent-application, July 2016

Optimization of Resource Utilization in a Collection of Devices
patent-application, June 2013