skip to main content
OSTI.GOV title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: Storages Are Not Forever

Abstract

Not unlike the concern over diminishing fossil fuel, information technology is bringing its own share of future worries. Here, we chose to look closely into one concern in this paper, namely the limited amount of data storage. By a simple extrapolatory analysis, it is shown that we are on the way to exhaust our storage capacity in less than two centuries with current technology and no recycling. This can be taken as a note of caution to expand research initiative in several directions: firstly, bringing forth innovative data analysis techniques to represent, learn, and aggregate useful knowledge while filtering out noise from data; secondly, tap onto the interplay between storage and computing to minimize storage allocation; thirdly, explore ingenious solutions to expand storage capacity. Throughout this paper, we delve deeper into the state-of-the-art research and also put forth novel propositions in all of the abovementioned directions, including space- and time-efficient data representation, intelligent data aggregation, in-memory computing, extra-terrestrial storage, and data curation. The main aim of this paper is to raise awareness on the storage limitation we are about to face if current technology is adopted and the storage utilization growth rate persists. In the manuscript, we propose some storagemore » solutions and a better utilization of storage capacity through a global DIKW hierarchy.« less

Authors:
ORCiD logo [1];  [1];  [2];  [3];  [4]
  1. Nanyang Technological Univ. (Singapore)
  2. RWTH Aachen Univ., Aachen (Germany)
  3. A*STAR (Singapore)
  4. SLAC National Accelerator Lab., Menlo Park, CA (United States)
Publication Date:
Research Org.:
SLAC National Accelerator Lab., Menlo Park, CA (United States)
Sponsoring Org.:
USDOE
OSTI Identifier:
1420053
Grant/Contract Number:
AC02-76SF00515
Resource Type:
Journal Article: Accepted Manuscript
Journal Name:
Cognitive Computation
Additional Journal Information:
Journal Volume: 9; Journal Issue: 5; Journal ID: ISSN 1866-9956
Publisher:
Springer
Country of Publication:
United States
Language:
English
Subject:
96 KNOWLEDGE MANAGEMENT AND PRESERVATION; information technology; big data analysis; data storage; data representation; data learning; data aggregation

Citation Formats

Cambria, Erik, Chattopadhyay, Anupam, Linn, Eike, Mandal, Bappaditya, and White, Bebo. Storages Are Not Forever. United States: N. p., 2017. Web. doi:10.1007/s12559-017-9482-4.
Cambria, Erik, Chattopadhyay, Anupam, Linn, Eike, Mandal, Bappaditya, & White, Bebo. Storages Are Not Forever. United States. doi:10.1007/s12559-017-9482-4.
Cambria, Erik, Chattopadhyay, Anupam, Linn, Eike, Mandal, Bappaditya, and White, Bebo. Sat . "Storages Are Not Forever". United States. doi:10.1007/s12559-017-9482-4. https://www.osti.gov/servlets/purl/1420053.
@article{osti_1420053,
title = {Storages Are Not Forever},
author = {Cambria, Erik and Chattopadhyay, Anupam and Linn, Eike and Mandal, Bappaditya and White, Bebo},
abstractNote = {Not unlike the concern over diminishing fossil fuel, information technology is bringing its own share of future worries. Here, we chose to look closely into one concern in this paper, namely the limited amount of data storage. By a simple extrapolatory analysis, it is shown that we are on the way to exhaust our storage capacity in less than two centuries with current technology and no recycling. This can be taken as a note of caution to expand research initiative in several directions: firstly, bringing forth innovative data analysis techniques to represent, learn, and aggregate useful knowledge while filtering out noise from data; secondly, tap onto the interplay between storage and computing to minimize storage allocation; thirdly, explore ingenious solutions to expand storage capacity. Throughout this paper, we delve deeper into the state-of-the-art research and also put forth novel propositions in all of the abovementioned directions, including space- and time-efficient data representation, intelligent data aggregation, in-memory computing, extra-terrestrial storage, and data curation. The main aim of this paper is to raise awareness on the storage limitation we are about to face if current technology is adopted and the storage utilization growth rate persists. In the manuscript, we propose some storage solutions and a better utilization of storage capacity through a global DIKW hierarchy.},
doi = {10.1007/s12559-017-9482-4},
journal = {Cognitive Computation},
number = 5,
volume = 9,
place = {United States},
year = {Sat May 27 00:00:00 EDT 2017},
month = {Sat May 27 00:00:00 EDT 2017}
}

Journal Article:
Free Publicly Available Full Text
Publisher's Version of Record

Save / Share: