Data shuffling with hierarchical tuple spaces

Patent · Tue Mar 23 04:00:00 EDT 2021

OSTI ID:1805660

Andrade Costa, Carlos Henrique; Kayi, Abdullah; Park, Yoonho; Johns, Charles Ray

Methods and systems for shuffling data are described. A processor may generate pair data from source data. The processor may insert the pair data into local tuple spaces. In response to a request for a particular key, the processor may determine a presence of the requested key in a global tuple space. The processor may, in response to a presence of the requested key in the global tuple space, update the global tuple space. The update may be based on the pair data among the local tuple spaces including the existing key. The processor may, in response to an absence of the requested key in the global tuple space, insert pair data including the missing key from the local tuple spaces into the global tuple space. The processor may fetch the requested pair data, and may shuffle the fetched data to generate a dataset.

• Research Organization: Lawrence Berkeley National Laboratory (LBNL), Berkeley, CA (United States)
• Sponsoring Organization: USDOE
• DOE Contract Number: AC02-05CH11231
• Assignee: International Business Machines Corporation (Armonk, NY)
• Patent Number(s): 10,956,125
• Application Number: 15/851,480
• OSTI ID: 1805660
• Country of Publication: United States
• Language: English