Performing an allreduce operation on a plurality of compute nodes of a parallel computer

Faraj, Ahmad

Title: Performing an allreduce operation on a plurality of compute nodes of a parallel computer

Patent · Tue Jul 09 00:00:00 EDT 2013

OSTI ID:1087901

Faraj, Ahmad

Methods, apparatus, and products are disclosed for performing an allreduce operation on a plurality of compute nodes of a parallel computer, each node including at least two processing cores, that include: establishing, for each node, a plurality of logical rings, each ring including a different set of at least one core on that node, each ring including the cores on at least two of the nodes; iteratively for each node: assigning each core of that node to one of the rings established for that node to which the core has not previously been assigned, and performing, for each ring for that node, a global allreduce operation using contribution data for the cores assigned to that ring or any global allreduce results from previous global allreduce operations, yielding current global allreduce results for each core; and performing, for each node, a local allreduce operation using the global allreduce results.

View Patent

Cite

Export

Save

Research Organization:: International Business Machines Corp., Armonk, NY (United States)

Sponsoring Organization:: USDOE

DOE Contract Number:: B554331

Assignee:: International Business Machines Corporation (Armonk, NY)

Patent Number(s):: 8,484,440

Application Number:: 12/124,745

OSTI ID:: 1087901

Country of Publication:: United States

Language:: English

References (152)

Root node redundancy for multipoint-to-multipoint transport trees Wijnands, Ijsbrand; Boers, Arjen; Lo, Alton https://doi.org/https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/7835378 US Patent Document 7,835,378	patent	November 2010
Performing An All-To-All Data Exchange On A Plurality Of Data Buffers By Performing Swap Operations Archer, Charles J.; Peters, Amanda E.; Smith, Brian E. https://doi.org/https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/20100017420 US Patent Application 12/176816; 20100017420	patent-application	January 2010
Data transfer apparatus and method Yosimoto, Atuyuki; Hayasaka, Kazumi; Saito, Hiroshi https://doi.org/https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/6954806 US Patent Document 6,954,806	patent	October 2005
Non-Binary Source-to-Channel Symbol Mappings with Minimized Distortion Chan, Ho Yin; Mow, Wai Ho https://doi.org/https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/20090196361 US Patent Application 12/023750; 20090196361	patent-application	August 2009
Method, system and computer program product for managing memory in a non-uniform memory access system Stevens, Luis F. https://doi.org/https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/6289424 US Patent Document 6,289,424	patent	September 2001
Method and system for pre-pending layer 2 (L2) frame descriptors Fan, Kan F.; McDaniel, Scott https://doi.org/https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/20050135395 US Patent Application 11/009258; 20050135395	patent-application	June 2005
Performing A Scatterv Operation On A Hierarchical Tree Network Optimized For Collective Operations Archer, Charles J.; Blocksome, Michael A.; Ratterman, Joseph D. https://doi.org/https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/20110238950 US Patent Application 12/748594; 20110238950	patent-application	September 2011
Correlating Hardware Devices Between Local Operating System and Global Management Entity Ritz, Andrew J.; Jodh, Santosh S.; Walker, Ellsworth D. https://doi.org/https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/20080201603 US Patent Application 11/675261; 20080201603	patent-application	August 2008
Method and apparatus for manifold array processing Pechanek, Gerald George; Pitsianis, Nikos P.; Barry, Edwin Franklin https://doi.org/https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/6167502 US Patent Document 6,167,502	patent	December 2000
Locating hardware faults in a parallel computer Archer, Charles J.; Megerian, Mark G.; Ratterman, Joseph D. https://doi.org/https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/7697443 US Patent Document 7,697,443	patent	April 2010
Method and apparatus for pre-provisioning networks to support fast restoration with minimum overbuild Alicherry, Mansoor Ali Khan; Bhatia, Randeep Singh https://doi.org/https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/20050243711 US Patent Application 10/838098; 20050243711	patent-application	November 2005
Interleaved all-to-all reliable broadcast on meshes and hypercubes IEEE Transactions on Parallel and Distributed Systems, Vol. 5, Issue 5 https://doi.org/10.1109/71.282556	journal	May 1994
Executing a Scatter Operation on a Parallel Computer Archer, Charles J.; Ratterman, Joseph D. https://doi.org/https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/20080263320 US Patent Application 11/737286; 20080263320	patent-application	October 2008
Class network routing Bhanot, Gyan; Blumrich, Matthias A.; Chen, Dong https://doi.org/https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/7587516 US Patent Document 7,587,516	patent	September 2009
Performance analysis and optimization of MPI collective operations on multi-core clusters Tu, Bibo; Fan, Jianping; Zhan, Jianfeng The Journal of Supercomputing, Vol. 60, Issue 1 https://doi.org/10.1007/s11227-009-0296-3	journal	April 2009
Direct Memory Access ('DMA') Engine Assisted Local Reduction Archer, Charles J.; , Michael A. Blocksome https://doi.org/https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/20090006663 US Patent Application 11/769367; 20090006663	patent-application	January 2009
Broadcasting A Message In A Parallel Computer Berg, Jeremy E.; Faraj, Ahmad A. https://doi.org/https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/20090240838 US Patent Application 12/053902; 20090240838	patent-application	September 2009
Performing an allreduce operation on a plurality of compute nodes of a parallel computer Faraj, Ahmad A. https://doi.org/https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/8161268 US Patent Document 8,161,268	patent	April 2012
Computing the Hough transform on a scan line array processor (image processing) Fisher, A. L.; Highnam, P. T. IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 11, Issue 3 https://doi.org/10.1109/34.21795	journal	March 1989
Method for testing integrated memory using an integrated DMA controller Gittinger, Robert Paul; Spilo, David A. https://doi.org/https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/5668815 US Patent Document 5,668,815	patent	September 1997
DMA descriptor queue read and cache write pointer arrangement Pope, Steve L.; Roberts, Derek; Riddoch, David J. https://doi.org/https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/7496699 US Patent Document 7,496,699	patent	February 2009
Method and apparatus for stacked address, bus to memory data transfer Wiedenman, Gregory B.; Eckel, Nathan A.; Artmann, Joel B. https://doi.org/https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/7739451 US Patent Document 7,739,451	patent	June 2010
Dead reckoning routing of packet data within a network of nodes having generally regular topology Cotter, David; Tatham, Martin C. https://doi.org/https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/6272548 US Patent Document 6,272,548	patent	August 2001
Partitioning of processing elements in a SIMD/MIMD array processor Wilkinson, Paul Amba; Dieffenderfer, James Warren; Kogge, Peter M. https://doi.org/https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/5878241 US Patent Document 5,878,241	patent	March 1999
Performing process migration with allreduce operations Archer, Charles J.; Peters, Amanda; Wallenfelt, Brian Paul https://doi.org/https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/7853639 US Patent Document 7,853,639	patent	December 2010
Apparatus and methods for connecting modules using remote switching Carvey, Philip P.; Dally, William J.; Dennison, Larry R. https://doi.org/https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/20020016901 US Patent Application 09/765138; 20020016901	patent-application	February 2002
Hierarchical interconnection network architecture for parallel processing, having interconnections between bit-addressible nodes based on address bit permutations Cypher, Robert E.; Sanz, Jorge L. C. https://doi.org/https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/5513371 US Patent Document 5,513,371	patent	April 1996
Dynamic load balancing among processors in a parallel computer Hardwick, Jonathan C. https://doi.org/https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/6292822 US Patent Document 6,292,822	patent	September 2001
Input/output controller for coupling the processor-memory complex to the fabric in fabric-backplane interprise servers Lovett, Thomas D.; Mehrotra, Sharad; Nicolaou, Cosmos https://doi.org/https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/7664110 US Patent Document 7,664,110	patent	February 2010
Scalable system control unit for distributed shared memory multi-processor systems Venkitakrishnan, Padmanabha; Janakiraman, Gopalakrishnan; Hsu, Tsen-Gong Jim https://doi.org/https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/6378029 US Patent Document 6,378,029	patent	April 2002
Performing An Allreduce Operation On A Plurality Of Compute Nodes Of A Parallel Computer Faraj, Ahmad https://doi.org/https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/20090292905 US Patent Application 12/124763; 20090292905	patent-application	November 2009
Deterministic real time hierarchical distributed computing system Ambuel, Jack https://doi.org/https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/7263598 US Patent Document 7,263,598	patent	August 2007
Protocol for self-organizing network using a logical spanning tree backbone Lee, Chung-Chieh; Hester, Lance; O'Dea, Robert J. https://doi.org/https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/6982960 US Patent Document 6,982,960	patent	January 2006
System and method for configuring computer applications and devices using inheritance Melchione, Daniel; Kouznetsov, Victor https://doi.org/https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/20020091819 US Patent Application 09/755525; 20020091819	patent-application	July 2002
Lingering locks with fairness control for multi-node computer systems McKenney, Paul E.; Closson, Kevin A.; Malige, Raghupathi https://doi.org/https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/6480918 US Patent Document 6,480,918	patent	November 2002
Building packet buffers using interleaved memories Shrimali, G.; McKeown, N. HPSR. 2005 Workshop on High Performance Switching and Routing, 2005. https://doi.org/10.1109/HPSR.2005.1503183	conference	January 2005
Computer hardware fault administration Archer, Charles J.; Megerian, Mark G.; Ratterman, Joseph D. https://doi.org/https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/7796527 US Patent Document 7,796,527	patent	September 2010
Performing an Allreduce Operation Using Shared Memory Archer, Charles J.; Dozsa, Gabor; Ratterman, Joseph D. https://doi.org/https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/20080301683 US Patent Application 11/754782; 20080301683	patent-application	December 2008
Performing A Deterministic Reduction Operation In A Parallel Computer Archer, Charles J.; Blocksome, Michael A.; Ratterman, Joseph D. https://doi.org/https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/20110296139 US Patent Application 12/790037; 20110296139	patent-application	December 2011
Adaptive congestion control mechanism for modular computer networks Scott, Steven L.; Pribnow, Richard D.; Logghe, Peter G. https://doi.org/https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/5958017 US Patent Document 5,958,017	patent	September 1999
Optimizing Collective Operations Archer, Charles J.; Carey, James E.; Markland, Matthew W. https://doi.org/https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/20110270986 US Patent Application 12/770286; 20110270986	patent-application	November 2011
Bandwidth Efficient All-reduce Operation on Tree Topologies Patarasuk, Pitch; Yuan, Xin 2007 IEEE International Parallel and Distributed Processing Symposium https://doi.org/10.1109/IPDPS.2007.370405	conference	March 2007
System and method for generating object code for map-reduce idioms in multiprocessor systems Liao, Shih-wei; Huang, Bo; Chen, Guilin https://doi.org/https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/20080127146 US Patent Application 11/516292; 20080127146	patent-application	May 2008
Multiprocessor computer system with interleaved processing element nodes Birrittella, Mark S.; Kessler, Richard E.; Oberlin, Steven M. https://doi.org/https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/5737628 US Patent Document 5,737,628	patent	April 1998
Apparatus and method for controlling direct memory access Seong, Shee-Hoon https://doi.org/https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/20060179181 US Patent Application 11/341787: 20060179181	patent-application	August 2006
Apparatus, system, and method for reliable, fast, and scalable multicast message delivery in service overlay networks Tang, Chunqiang; Chang, Rong Nickle; Ward, Christopher https://doi.org/https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/20070110063 US Patent Application 11/281792; 20070110063	patent-application	May 2007
Signaling completion of a message transfer from an origin compute node to a target compute node Blocksome, Michael A.; Parker, Jeffrey J. https://doi.org/https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/7948999 US Patent Document 7,948,999	patent	May 2011
Method and apparatus for storing tree data structures among and within multiple memory channels Rangarajan, Vijay; Maniyar, Shyamsundar N.; Eatherton, William N. https://doi.org/https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/7352739 US Patent Document 7,352,739	patent	April 2008
Parallel computing system Maddox, James L. https://doi.org/https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/6000024 US Patent Document 6,000,024	patent	December 1999
Multi-use data access descriptor Schmisseur, Mark A. https://doi.org/https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/20020144027 US Patent Application 09/820121; 20020144027	patent-application	October 2002
Parallel computer system using properties of messages to route them through an interconnect network and to select virtual channel circuits therewithin Yasuda, Yoshiko; Tanaka, Teruo https://doi.org/https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/5892923 US Patent Document 5,892,923	patent	April 1999
Configuring compute nodes of a parallel computer in an operational group into a plurality of independent non-overlapping collective networks Archer, Charles J.; Inglett, Todd A.; Ratterman, Joseph D. https://doi.org/https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/7673011 US Patent Document 7,673,011	patent	March 2010
Arithmetic functions in torus and tree networks Bhanot, Gyan; Blumrich, Matthias A.; Chen, Dong https://doi.org/https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/20040073590 US Patent Application 10/468991; 20040073590	patent-application	April 2004
Optimized Collectives Using a DMA on a Parallel Computer Chen, Dong; Gabor, Dozsa; Giampapa, Mark E. https://doi.org/https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/20090006662 US Patent Application 11/768645; 20090006662	patent-application	January 2009
Cross-Channel Network Operation Offloading for Collective Operations Bloch, Noam; Bloch, Gil; Shachar, Ariel https://doi.org/https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/20110119673 US Patent Application 12/945904; 20110119673	patent-application	May 2011
Method for performing alltoall communication in parallel computers Kureya, Kimihide https://doi.org/https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/6334138 US Patent Document 6,334,138	patent	December 2001
Video output controller and video card Amemiya, Jiro; Uesugi, Kouki https://doi.org/https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/6914606 US Patent Document 6,914,606	patent	July 2005
Parallel processing method and system using a lazy parallel data type to reduce inter-processor communication Hardwick, Jonathan C. https://doi.org/https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/6212617 US Patent Document 6,212,617	patent	April 2001
High-speed, parallel, processor architecture for front-end electronics, based on a single type of ASIC, and method use thereof Crosetto, Dario B. https://doi.org/https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/5937202 US Patent Document 5,937,202	patent	August 1999
Inter-computer message routing system with each computer having separate routinng automata for each dimension of the network Flaig, Charles M.; Seitz, Charles L. https://doi.org/https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/5105424 US Patent Document 5,105,424	patent	April 1992
Send-Side Matching Of Data Communications Messages Archer, Charles J.; Blocksome, Michael A.; Ratterman, Joseph D. https://doi.org/https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/20120066284 US Patent Application 12/881863; 20120066284	patent-application	March 2012
System for allocating computing resources of distributed computer system with transaction manager Neiman, Steven; Sulzhyk, Roman https://doi.org/https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/7590983 US Patent Document 7,590,983	patent	September 2009
Cluster Computing Support for Application Programs Tannenbaum, Zvi; Dauger, Dean E. https://doi.org/https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/20070288935 US Patent Application 11/744461; 20070288935	patent-application	December 2007
Executing a Gather Operation on a Parallel Computer Archer, Charles J.; Ratterman, Joseph D. https://doi.org/https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/20100274997 US Patent Application 11/754740; 20100274997	patent-application	October 2010
Performing An Allreduce Operation Using Shared Memory Archer, Charles J.; Dozsa, Gabor; Ratterman, Joseph D. https://doi.org/https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/20120179881 US Patent Application 13/427057; 20120179881	patent-application	July 2012
Computer Hardware Fault Diagnosis Archer, Charles J.; Megerian, Mark G.; Ratterman, Joseph D. https://doi.org/https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/20070242611 US Patent Application 1/279573; 20070242611	patent-application	October 2007
Administering an Epoch Initiated for Remote Memory Access Blocksome, Michael A.; Miller, Douglas R. https://doi.org/https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/20080313661 US Patent Application 11/764333; 20080313661	patent-application	December 2008
Executing an Allgather Operation on a Parallel Computer Archer, Charles J.; Moreira, JOse F.; Ratterman, Joseph D. https://doi.org/https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/20070245122 US Patent Application 11/279620; 20070245122	patent-application	October 2007
Processing Data Communications Events In A Parallel Active Messaging Interface Of A Parallel Computer Archer, Charles J.; Blocksome, Michael A.; Ratterman, Joseph D. https://doi.org/https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/20120117361 US Patent Application 12/943105; 20120117361	patent-application	May 2012
Broadcast invalidate scheme Webb, Jr., David A. J.; Kessler, Richard E.; Lang, Steve https://doi.org/https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/20040073755 US Patent Application 10/685039; 20040073755	patent-application	April 2004
Executing an Allgather Operation with an Alltoallv Operation in a Parallel Computer Archer, Charles J.; Heidelberger, Philip; Moreira, Jose Eduardo https://doi.org/https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/20080022079 US Patent Application 11/459387; 20080022079	patent-application	January 2008
Irregular network Dally, William J.; Mann, William F.; Carvey, Philip P. https://doi.org/https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/20030212877 US Patent Application 10/457718; 20030212877	patent-application	November 2003
Hexagonal mesh multiprocessor system Shin, Kang G.; Chen, Ming-Syan; Kandlur, Dilip Dinkar https://doi.org/https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/5101480 US Patent Document 5,101,480	patent	March 1992
Performing A Local Reduction Operation On A Parallel Computer Blocksome, Michael A.; Faraj, Daniel A. https://doi.org/https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/20110258245 US Patent Application 12/760020; 20110258245	patent-application	October 2011
Computing parallel prefix and reduction using coterie structures Herbordt, M. C.; Weems, C. C. [1992] The Fourth Symposium on the Frontiers of Massively Parallel Computation, [Proceedings 1992] The Fourth Symposium on the Frontiers of Massively Parallel Computation https://doi.org/10.1109/FMPC.1992.234895	conference	January 1992
Distributed processing multi-processor computer Bremner, Neale https://doi.org/https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/20030182376 US Patent Application 10/276634; 20030182376	patent-application	September 2003
Data gathering/scattering system for a plurality of processors in a parallel computer Kato, Sadaharu; Ishihata, Hiroaki; Horie, Takeshi https://doi.org/https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/5832215 US Patent Document 5,832,215	patent	November 1998
Adaptive Address Mapping with Dynamic Runtime Memory Mapping Selection Schafer, Andre; Gries, Matthias https://doi.org/https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/20110153908 US Patent Application 12/646248; 20110153908	patent-application	June 2011
Pattern generation and shift plane operations for a mesh connected computer Meeker, Woodrow; Abercrombie, Andrew P. https://doi.org/https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/6067609 US Patent Document 6,067,609	patent	May 2000
Hybrid hypercube/torus architecture Passint, Randal S.; Thorson, Greg; Galles, Michael B. https://doi.org/https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/6230252 US Patent Document 6,230,252	patent	May 2001
Method, System, and Program for Handling Input/Output Commands Bissessur, Sailesh; Mackey, Richard P.; Schmisseur, Mark A. https://doi.org/https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/20060168359 US Patent Application 11/279086; 20060168359	patent-application	July 2006
Parallel Programming Development Environment Ladd, Patrick G. https://doi.org/https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/20020054051 US Patent Application 09/222482; 20020054051	patent-application	May 2002
Recording A Communication Pattern and Replaying Messages in a Parallel Computing System Heidelberger, Philip; Kumar, Sameer https://doi.org/https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/20110010471 US Patent Application 12/500715; 20110010471	patent-application	January 2011
Tracking Network Contention Archer, Charles J.; Peters, Amanda; Smith, Brian E. https://doi.org/https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/20090154486 US Patent Application 11/955474; 20090154486	patent-application	June 2009
Direct memory access controller system with message-based programming Clayton, Shawn Adam; Fortin, Brian Mark; Willie, Daniel Brian https://doi.org/https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/20050165980 US Patent Application 11/088344; 20050165980	patent-application	July 2005
Towards Efficient Execution of MPI Applications on the Grid: Porting and Optimization Issues Keller, Rainer; Gabriel, Edgar; Krammer, Bettina Journal of Grid Computing, Vol. 1, Issue 2 https://doi.org/10.1023/B:GRID.0000024071.12177.91	journal	January 2003
Routing resource reserve/release protocol for multi-processor computer systems Nugent, Steven F. https://doi.org/https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/6076131 US Patent Document 6,076,131	patent	June 2000
Method and apparatus for storing tree data structures among and within multiple memory channels Rangarajan, Vijay; Maniyar, Shyamsundar N.; Eatherton, William N. https://doi.org/https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/7613134 US Patent Document 7,613,134	patent	November 2009
Method and apparatus for internetworking buffer management Van Seters, Stephen L.; Hauser, Stephen A.; Sankey, Mark A. https://doi.org/https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/6108692 US Patent Document 6,108,692	patent	August 2000
Performing An Allreduce Operation On A Plurality Of Compute Nodes Of A Parallel Computer Faraj, Ahmad https://doi.org/https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/20090307467 US Patent Application 12/124756; 20090307467	patent-application	December 2009
Performing Process Migration with Allreduce Operations Archer, Charles Jens; Peters, Amanda; Wallenfelt, Brian Paul https://doi.org/https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/20100185718 US Patent Application 11/531175; 20100185718	patent-application	July 2010
Data transfer apparatus and method Yosimoto, Atuyuki; Hayasaka, Kazumi; Saito, Hiroshi https://doi.org/https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/20030188054 US Patent Application 10/400669; 20030188054	patent-application	October 2003
Effecting a Broadcast with an Allreduce Operation on a Parallel Computer Almasi, Gheorghe; Archer, Charles J.; Ratterman, Joseph D. https://doi.org/https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/20090037511 US Patent Application 11/832918; 20090037511	patent-application	February 2009
Central shared queue based time multiplexed packet switch with deadlock avoidance Hochschild, Peter H.; Denneau, Monty M. https://doi.org/https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/5805589 US Patent Document 5,805,589	patent	September 1998
Facilitating intra-node data transfer in collective communications Blackmore, Robert S.; Jia, Bin; Treumann, Richard R. https://doi.org/https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/7539989 US Patent Document 7,539,989	patent	May 2009
Virtual private networks within a packet network having a mesh topology Ashwood-Smith, Peter https://doi.org/https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/20050094577 US Patent Application 10/694833; 20050094577	patent-application	May 2005
System-On-A-Chip Having an Array of Programmable Processing Elements Linked By an On-Chip Network with Distributed On-Chip Shared Memory and External Shared Memory Heddes, Marco; Ravasi, Masssimo; Malik, Rakesh Kumar https://doi.org/https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/20100191911 US Patent Application 12/639325; 20100191911	patent-application	July 2010
Fast restoration mechanism and method of determining minimum restoration capacity in a transmission networks Weis, Bernd https://doi.org/https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/7133359 US Patent Document 7,133,359	patent	November 2006
Systems for communicating current and future activity information among mobile internet users and methods therefor Jhanji, Neeraj https://doi.org/https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/7284033 US Patent Document 7,284,033	patent	October 2007
Handling potential deadlocks and correctness problems of reduce operations in parallel systems Ohly, Patrick; Shumilin, Victor https://doi.org/https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/20090064176 US Patent Application 11/897480; 20090064176	patent-application	March 2009
Optimizing threaded MPI execution on SMP clusters Tang, Hong; Yang, Tao Proceedings of the 15th international conference on Supercomputing - ICS '01 https://doi.org/10.1145/377792.377895	conference	January 2001
Method and apparatus for the connection of a closed ring through a telephone exchange Nilsson, Olof E. https://doi.org/https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/4715032 US Patent Document 4,715,032	patent	December 1987
Administering Communications Schedules for Data Communications Among Compute Nodes in a Data Communications Network of a Parallel Computer Almasi, Gheorghe; Archer, Charles J.; Erway, Charles C. https://doi.org/https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/20090113308 US Patent Application 11/924934; 20090113308	patent-application	April 2009
SMP clusters with remote resource managers for distributing work to other clusters while reducing bus traffic to a minimum VanHuben, Gary A.; Blake, Michael A.; Mak, Pak-kin https://doi.org/https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/6038651 US Patent Document 6,038,651	patent	March 2000
Managing Hardware Resources by Sending Messages Amongst Servers in a Data Center Mayo, Mark G.; Duncan, James; Candel, Pedro Palazon https://doi.org/https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/20110179134 US Patent Application 12/696802; 20110179134	patent-application	July 2011
Broadcasting A Message In A Parallel Computer Archer, Charles J.; Faraj, Ahmad A. https://doi.org/https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/20090245134 US Patent Application 12/060492; 20090245134	patent-application	October 2009
Performing A Deterministic Reduction Operation In A Parallel Computer Archer, Charles J.; Blocksome, Michael A.; Ratterman, Joseph D. https://doi.org/https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/20110296137 US Patent Application 12/789986; 20110296137	patent-application	December 2011
Direct memory access transfer reduction method and apparatus to overlay data on to scatter gather descriptors for bus-mastering I/O controllers Connor, Patrick; McVay, Robert https://doi.org/https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/6647438 US Patent Document 6,647,438	patent	November 2003
Method and apparatus for controlling (N+I) I/O channels with (N) data managers in a homogenous software programmable environment Carmichael, Richard; Ward, Joel M.; Winchell, Michael A. https://doi.org/https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/5864712 US Patent Document 5,864,712	patent	January 1999
Communications network Cotter, David https://doi.org/https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/6714552 US Patent Document 6,714,552	patent	March 2004
Abmahnung statt Jobverlust: Kündigung Kaufmann, Stephanie working@office, Vol. 11, Issue 8 https://doi.org/10.1007/BF03250352	journal	August 2010
Method and apparatus for wire speed IP multicast forwarding Brown, David A. https://doi.org/https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/6754211 US Patent Document 6,754,211	patent	June 2004
Parallel processor system having computing clusters and auxiliary clusters connected with network of partial networks and exchangers Nakagoshi, Junji; Hamanaka, Naoki; Chiba, Hiroyuki https://doi.org/https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/5377333 US Patent Document 5,377,333	patent	December 1994
Efficient circuits for out-of-order microprocessors Kuszmaul, Bradley C.; Henry-Kuszmaul, Dana Sue https://doi.org/https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/20040034678 US Patent Application 10/608621; 20040034678	patent-application	February 2004
Reliable datagram transport service Krause, Michael R.; Garcia, David J.; Culley, Paul R. https://doi.org/https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/7171484 US Patent Document 7,171,484	patent	January 2007
Self-timed mesh routing chip with data broadcasting Dunning, Dave https://doi.org/https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/5333279 US Patent Document 5,333,279	patent	July 1994
Extending the message passing interface (MPI) Skjellum, A.; Doss, N. E.; Viswanathan, K. Proceedings Scalable Parallel Libraries Conference https://doi.org/10.1109/SPLC.1994.376998	conference	January 1995
Efficient MPI Collective Operations for Clusters in Long-and-Fast Networks Matsuda, Motohiko; Kudoh, Tomohiro; Kodama, Yuetsu 2006 IEEE International Conference on Cluster Computing https://doi.org/10.1109/CLUSTR.2006.311848	conference	September 2006
Dynamically matching users for group communications based on a threshold degree of matching of sender and recipient predetermined acceptance criteria Olivier, Michael https://doi.org/https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/6480885 US Patent Document 6,480,885	patent	November 2002
Apparatus and method for capacity planning for data center server consolidation and workload reassignment Neuse, Douglas M.; Matchett, Douglas K.; Walton, Chris https://doi.org/https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/20080077366 US Patent Application 11/525511; 20080077366	patent-application	March 2008
Efficient algorithms for all-to-all communications in multiport message-passing systems Bruck, J.; Kipnis, S. IEEE Transactions on Parallel and Distributed Systems, Vol. 8, Issue 11 https://doi.org/10.1109/71.642949	journal	January 1997
Broadcasting Collective Operation Contributions Throughout A Parallel Computer Faraj, Ahmad https://doi.org/https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/20090240915 US Patent Application 12/053842; 20090240915	patent-application	September 2009
Novel Massively Parallel Supercomputer Blumrich, Matthias A.; Chen, Dong; Chiu, George L. https://doi.org/https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/20090259713 US Patent Application 12/492799; 20090259713	patent-application	October 2009
Parallel processing method Stolfo, Salvatore J. https://doi.org/https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/4843540 US Patent Document 4,843,540	patent	June 1989
Prediction system for RF power distribution Feisullin, Farid; Naylor, Bruce E.; Raukumar, Ajay https://doi.org/https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/5949988 US Patent Document 5,949,988	patent	September 1999
Coprocessor design to support MPI primitives in configurable multiprocessors Ziavras, Sotirios G.; Gerbessiotis, Alexandros V.; Bafna, Rohan Integration, the VLSI Journal, Vol. 40, Issue 3, p. 235-252 https://doi.org/10.1016/j.vlsi.2005.10.001	journal	April 2007
Communicator-based token/buffer management for eager protocol support in collective communication operations Jia, Bin https://doi.org/https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/20100122268 US Patent Application 12/267730; 20100122268	patent-application	May 2010
Message transfer system and method for parallel computer with message transfers being scheduled by skew and roll functions to avoid bottlenecks Heller, Steven K. https://doi.org/https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/5617538 US Patent Document 5,617,538	patent	April 1997
Database system providing optimization of group by operator over a union all MacNicol, Roger; Kirk, Steven A.; Li, Xiqing https://doi.org/https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/6691101 US Patent Document 6,691,101	patent	February 2004
Mechanism For Process Migration On A Massively Parallel Computer Archer, Charles; Darrington, David; McCarthy, Patrick https://doi.org/https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/20090067334 US Patent Application 11/853927; 20090067334	patent-application	March 2009
Method of optimizing recognition of collective data movement in a parallel distributed system Ogasawara, Takeshi; Komatsu, Hideaki https://doi.org/https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/5822604 US Patent Document 5,822,604	patent	October 1998
Multicomputer memory access architecture Frisch, Robert C. https://doi.org/https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/5721828 US Patent Document 5,721,828	patent	February 1998
Parallel processor system with a broadcast message serializing circuit provided within a network Higuchi, Tatsuo; Isobe, Tadaaki; Nakagoshi, Junji https://doi.org/https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/5822605 US Patent Document 5,822,605	patent	October 1998
Non-Volatile Memory And Method With Non-Sequential Update Block Management Sinclair, Alan Walsh; Gorobets, Sergey Anatolievich; Bennett, Alan David https://doi.org/https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/20090019218 US Patent Application 12/239489; 20090019218	patent-application	January 2009
Method and apparatus for zeroing a transfer buffer memory as a background task Thompson, Mark J.; Zimmer, Vincent J. https://doi.org/https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/20020065984 US Patent Application 10/006553; 20020065984	patent-application	May 2002
Performing An All-To-All Data Exchange On A Plurality Of Data Buffers By Performing Swap Operations Archer, Charles J.; Peters, Amanda E.; Smith, Brian E. https://doi.org/https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/20120216021 US Patent Application 13/459832; 20120216021	patent-application	August 2012
System and method for configuration, management, and monitoring of a computer network using inheritance Hanchett, Paul F. https://doi.org/https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/6834301 US Patent Document 6,834,301	patent	December 2004
Memory control device Tagawa, Fumitake https://doi.org/https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/7707366 US Patent Document 7,707,366	patent	April 2010
Manifold array processor Pechanek, Gerald George; Kurak, Jr., Charles W. https://doi.org/https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/7197624 US Patent Document 7,197,624	patent	March 2007
Development of parallel/distributed applications Joublin, Frank; Georick, Christian; Ceravola, Antonello https://doi.org/https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/20060277323 US Patent Application 11/429383; 20060277323	patent-application	December 2006
Effecting Hardware Acceleration Of Broadcast Operations In A Parallel Computer Archer, Charles J.; Blocksome, Michael A.; Ratterman, Joseph D. https://doi.org/https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/20110289177 US Patent Application 12/782791; 20110289177	patent-application	November 2011
Optimization of MPI collectives on clusters of large-scale SMP's Sistare, Steve; vandeVaart, Rolf; Loh, Eugene Proceedings of the 1999 ACM/IEEE conference on Supercomputing (CDROM) - Supercomputing '99 https://doi.org/10.1145/331532.331555	conference	January 1999
Method, system and program product for communicating among processes in a symmetric multi-processing cluster environment Jia, Bin; Treumann, Richard R. https://doi.org/https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/20070174558 US Patent Application 11/282011; 20070174558	patent-application	July 2007
Parallel-Prefix Broadcast for a Parallel-Prefix Operation on a Parallel Computer Archer, Charles J.; Peters, Amanda; Ricard, Gary R. https://doi.org/https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/20080263329 US Patent Application 11/737209; 20080263329	patent-application	October 2008
Line-Plane Broadcasting in a Data Communications Network of a Parallel Computer Archer, Charles J.; Berg, Jeremy E.; Blocksome, Michael A. https://doi.org/https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/20090055474 US Patent Application 11/843090; 20090055474	patent-application	February 2009
Packet-switched self-routing multistage interconnection network having contention-free fanout, low-loss routing, and fanin buffering to efficiently realize arbitrarily low packet loss Krishnamoorthy, Ashok V.; Kiamilev, Fouad https://doi.org/https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/5541914 US Patent Document 5,541,914	patent	July 1996
Method and apparatus for efficient transfer of data packets Hellum, Pål Longva; Kleven, Bjørn Kristian https://doi.org/https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/6742063 US Patent Document 6,742,063	patent	May 2004
DADO: A tree-structured machine architecture for production systems Stolfo, Salvatore; Shaw, David Elliot Columbia University, 15 p. https://doi.org/10.7916/D8SQ97CN CUCS-24-82	report	March 1982
Massively parallel supercomputer Blumrich, Matthias A.; Chen, Dong; Chiu, George Liang-Tai https://doi.org/https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/7555566 US Patent Document 7,555,566	patent	June 2009
Executing an Allgather Operation on a Parallel Computer Archer, Charles J.; Faraj, Ahmad A. https://doi.org/https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/20090040946 US Patent Application 11/834153; 20090040946	patent-application	February 2009
System and method for automatic generation of a hierarchical tree network and the use of two complementary learning algorithms, optimized for each leaf of the hierarchical tree network Kil, David H.; Pottschmidt, David B. https://doi.org/https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/7725329 US Patent Document 7,725,329	patent	May 2010
Line-Plane Broadcasting in a Data Communications Network of a Parallel Computer Archer, Charles J.; Berg, Jeremy E.; Blocksome, Michael A. https://doi.org/https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/20090052462 US Patent Application 11/843083; 20090052462	patent-application	February 2009

Similar Records

Performing an allreduce operation on a plurality of compute nodes of a parallel computer

Patent · Tue Apr 17 00:00:00 EDT 2012 · OSTI ID:1087901

Faraj, Ahmad

Performing an allreduce operation on a plurality of compute nodes of a parallel computer

Patent · Tue Feb 12 00:00:00 EST 2013 · OSTI ID:1087901

Faraj, Ahmad

Effecting a broadcast with an allreduce operation on a parallel computer

Patent · Tue Nov 02 00:00:00 EDT 2010 · OSTI ID:1087901

Almasi, Gheorghe; Archer, Charles J; Ratterman, Joseph D; +1 more

Related Subjects

97 MATHEMATICS AND COMPUTING

Title: Performing an allreduce operation on a plurality of compute nodes of a parallel computer

Citation Formats

References (152)

Similar Records

Related Subjects