mdtmFTP

Conference · Thu Jan 01 00:00:00 EST 2015

OSTI ID:1250788

Zhang, L. ^[1]; Wu, Wenji ^[1]; DeMar, P. ^[1]; Katramatos, D. ^[2]; Yu, D. ^[2]

---

1. Fermilab
2. BNL

To address the high-performance challenges of data transfer in big data era, we research, develop, and implement mdtmFTP: a High-performance Data Transfer Tool in Bigdata Era. DOE’s Advanced Scientific Computing Research (ASCR) office has funded Fermilab and Brookhaven National Laboratory to collaboratively work on the Multicore-Aware Data Transfer Middleware (MDTM) project. MDTM aims to accelerate data movement toolkits on multicore systems. mdtmFTP is the latest outcome of this continued research effort. mdtmFTP is a high-performance data transfer tool that builds upon the MDTM middleware. Initial tests show that mdtmFTP performs better than existing data transfer tools

• Research Organization: Fermi National Accelerator Lab. (FNAL), Batavia, IL (United States)
• Sponsoring Organization: USDOE Office of Science (SC), High Energy Physics (HEP)
• DOE Contract Number: AC02-07CH11359
• OSTI ID: 1250788
• Report Number(s): FERMILAB-CONF-15-345-CD; 1414311
• Resource Relation: Conference: International Conference for High Performance Computing, Networking, Storage and Analysis, Austin, TX, USA, 11/15-11/20/2015
• Country of Publication: United States
• Language: English