Why wait? Let us start computing while the data is still on the wire

Bhattacharyya, Shilpi; Katramatos, Dimitrios; Yoo, Shinjae

doi:10.1016/j.future.2018.07.024

Title: Why wait? Let us start computing while the data is still on the wire

Authors:: Bhattacharyya, Shilpi; Katramatos, Dimitrios; Yoo, Shinjae

Publication Date:: 2018-12-01

Sponsoring Org.:: USDOE

OSTI Identifier:: 1460745

Grant/Contract Number:: SC0012704

Resource Type:: Published Article

Journal Name:: Future Generations Computer Systems

Additional Journal Information:: Journal Name: Future Generations Computer Systems Journal Volume: 89 Journal Issue: C; Journal ID: ISSN 0167-739X

Publisher:: Elsevier

Country of Publication:: Netherlands

Language:: English

Citation Formats


                    Bhattacharyya, Shilpi, Katramatos, Dimitrios, and Yoo, Shinjae. Why wait? Let us start computing while the data is still on the wire.  Netherlands: N. p., 2018. 
Web.  doi:10.1016/j.future.2018.07.024.

Copy to clipboard


                    Bhattacharyya, Shilpi, Katramatos, Dimitrios, & Yoo, Shinjae. Why wait? Let us start computing while the data is still on the wire.  Netherlands.  https://doi.org/10.1016/j.future.2018.07.024

Copy to clipboard


                    Bhattacharyya, Shilpi, Katramatos, Dimitrios, and Yoo, Shinjae. Sat .  
"Why wait? Let us start computing while the data is still on the wire".  Netherlands.  https://doi.org/10.1016/j.future.2018.07.024.

Copy to clipboard


                    
@article{osti_1460745,

  title        = {Why wait? Let us start computing while the data is still on the wire},

  author       = {Bhattacharyya, Shilpi and Katramatos, Dimitrios and Yoo, Shinjae},

  abstractNote = {},

  doi          = {10.1016/j.future.2018.07.024},

  journal      = {Future Generations Computer Systems},

  number       = C,

  volume       = 89,

  place        = {Netherlands},

  year         = {2018},

  month        = {12}

}

Copy to clipboard

Journal Article:

Free Publicly Available Full Text

Publisher's Version of Record
https://doi.org/10.1016/j.future.2018.07.024

Other availability

Search WorldCat to find libraries that may hold this journal

Save / Share:

Export Metadata

Save to My Library

Works referenced in this record:

A survey on platforms for big data analytics
journal, October 2014

Singh, Dilpreet; Reddy, Chandan K.
Journal of Big Data, Vol. 2, Issue 1
DOI: 10.1186/s40537-014-0008-6

Software-defined networking
journal, September 2013

Kirkpatrick, Keith
Communications of the ACM, Vol. 56, Issue 9
DOI: 10.1145/2500468.2500473

A Survey of Software-Defined Networking: Past, Present, and Future of Programmable Networks
journal, October 2014

Nunes, Bruno Astuto A.; Mendonca, Marc; Nguyen, Xuan-Nam
IEEE Communications Surveys & Tutorials, Vol. 16, Issue 3
DOI: 10.1109/SURV.2014.012214.00180

Streaming data analysis on the wire
conference, August 2016

Katramatos, Dimitrios; Yue, Meng; Yoo, Shinjae
2016 New York Scientific Data Summit (NYSDS)
DOI: 10.1109/NYSDS.2016.7747816

A survey of active network research
journal, January 1997

Tennenhouse, D. L.; Smith, J. M.; Sincoskie, W. D.
IEEE Communications Magazine, Vol. 35, Issue 1
DOI: 10.1109/35.568214

Trends of CPU, GPU and FPGA for high-performance computing
conference, September 2014

Vestias, Mario; Neto, Horacio
2014 24th International Conference on Field Programmable Logic and Applications (FPL)
DOI: 10.1109/FPL.2014.6927483

The Emergence of Edge Computing
journal, January 2017

Satyanarayanan, Mahadev
Computer, Vol. 50, Issue 1
DOI: 10.1109/MC.2017.9

mePaaS: Mobile-Embedded Platform as a Service for Distributing Fog Computing to Edge Nodes
conference, December 2016

Liyanage, Mohan; Chang, Chii; Srirama, Satish Narayana
2016 17th International Conference on Parallel and Distributed Computing, Applications and Technologies (PDCAT)
DOI: 10.1109/PDCAT.2016.030

Active networks: Applications, security, safety, and architectures
journal, January 1999

Psounis, Konstantinos
IEEE Communications Surveys & Tutorials, Vol. 2, Issue 1
DOI: 10.1109/COMST.1999.5340509

Making a case for high-bandwidth monitoring - a use case for analysis on the wire
conference, August 2017

DePhillips, Michael; Katramatos, Dimitrios; Bhattacharyya, Shilpi
2017 New York Scientific Data Summit (NYSDS)
DOI: 10.1109/NYSDS.2017.8085037

The Promise of Edge Computing
journal, May 2016

Shi, Weisong; Dustdar, Schahram
Computer, Vol. 49, Issue 5
DOI: 10.1109/MC.2016.145

Directions in active networks
journal, January 1998

Calvert, K. L.; Bhattacharjee, S.; Zegura, E.
IEEE Communications Magazine, Vol. 36, Issue 10
DOI: 10.1109/35.722139

Similar Records in DOE PAGES and OSTI.GOV collections:

Why wait? Lets start computing while data is still on the wire

Conference Bhattacharyya, S. ; Katramatos, D. ; Yoo, S.
Full Text Available
Why wait? Let's start computing while data is still on the wire

Conference Bhattacharyya, Shilpi ; Katramatos, Dimitrios

In this era of Big Data, computing useful information from data is becoming increasingly complicated, particularly due to the ever increasing volumes of data that need to travel over the network to data centers to be stored and processed, all highly expensive operations in the long haul. In this paper we suggest that we can do computing and analysis of data "on the wire," i.e., while data is still in transit. The nature of these computations include analysis, visualization, pattern recognition, and prediction, or forecasting, on the streaming data. We follow a service function chaining architecture to implement this, assumingmore »« less
Full Text Available
Why are we still using 3D masses for cluster cosmology?

Journal Article Debackere, Stijn N. B. ; Hoekstra, Henk ; Schaye, Joop ; ... - Monthly Notices of the Royal Astronomical Society

ABSTRACT The abundance of clusters of galaxies is highly sensitive to the late-time evolution of the matter distribution, since clusters form at the highest density peaks. However, the 3D cluster mass cannot be inferred without deprojecting the observations, introducing model-dependent biases and uncertainties due to the mismatch between the assumed and the true cluster density profile and the neglected matter along the sightline. Since projected aperture masses can be measured directly in simulations and observationally through weak lensing, we argue that they are better suited for cluster cosmology. Using the Mira–Titan suite of gravity-only simulations, we show that aperture masses correlate strongly with 3D halo masses, albeit with large intrinsic scatter due to the varying matter distribution along the sightline. Nonetheless, aperture masses can be measured ≈2–3 times more precisely from observations, since they do not require assumptions about the density profile and are only affected by the shape noise in the weak lensing measurements. We emulate the cosmology dependence of the aperture mass function directly with a Gaussian process. Comparing the cosmology sensitivity of the aperture mass function and the 3D halo mass function for a fixed survey solid angle and redshift interval, we find the aperture mass sensitivity is higher for Ωm andmore »« less
https://doi.org/10.1093/mnras/stac1687
The Practical Obstacles of Data Transfer: Why researchers still love scp

Conference Nam, Hai Ah ; Hill, Jason J ; Parete-Koon, Suzanne T

The importance of computing facilities is heralded every six months with the announcement of the new Top500 list, showcasing the world s fastest supercomputers. Unfortu- nately, with great computing capability does not come great long-term data storage capacity, which often means users must move their data to their local site archive, to remote sites where they may be doing future computation or anal- ysis, or back to their home institution, else face the dreaded data purge that most HPC centers employ to keep utiliza- tion of large parallel filesystems low to manage performance and capacity. At HPC centers, data transfermore »« less
https://doi.org/10.1145/2534695.2534703
Cutting Balloon Angioplasty in Dialysis Fistulas: Let Us Start to Ask the Right Questions

Journal Article Vorwerk, Dierk - Cardiovascular and Interventional Radiology

No abstract prepared.
https://doi.org/10.1007/S00270-007-9144-0

Similar Records

Title: Why wait? Let us start computing while the data is still on the wire

Citation Formats

A survey on platforms for big data analytics journal, October 2014

Software-defined networking journal, September 2013

A Survey of Software-Defined Networking: Past, Present, and Future of Programmable Networks journal, October 2014

Streaming data analysis on the wire conference, August 2016

A survey of active network research journal, January 1997

Trends of CPU, GPU and FPGA for high-performance computing conference, September 2014

The Emergence of Edge Computing journal, January 2017

mePaaS: Mobile-Embedded Platform as a Service for Distributing Fog Computing to Edge Nodes conference, December 2016

Active networks: Applications, security, safety, and architectures journal, January 1999

Making a case for high-bandwidth monitoring - a use case for analysis on the wire conference, August 2017

The Promise of Edge Computing journal, May 2016

Directions in active networks journal, January 1998

A survey on platforms for big data analytics
journal, October 2014

Software-defined networking
journal, September 2013

A Survey of Software-Defined Networking: Past, Present, and Future of Programmable Networks
journal, October 2014

Streaming data analysis on the wire
conference, August 2016

A survey of active network research
journal, January 1997

Trends of CPU, GPU and FPGA for high-performance computing
conference, September 2014

The Emergence of Edge Computing
journal, January 2017

mePaaS: Mobile-Embedded Platform as a Service for Distributing Fog Computing to Edge Nodes
conference, December 2016

Active networks: Applications, security, safety, and architectures
journal, January 1999

Making a case for high-bandwidth monitoring - a use case for analysis on the wire
conference, August 2017

The Promise of Edge Computing
journal, May 2016

Directions in active networks
journal, January 1998