DOE PAGES title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: Storages Are Not Forever

Abstract

Not unlike the concern over diminishing fossil fuel, information technology is bringing its own share of future worries. Here, we chose to look closely into one concern in this paper, namely the limited amount of data storage. By a simple extrapolatory analysis, it is shown that we are on the way to exhaust our storage capacity in less than two centuries with current technology and no recycling. This can be taken as a note of caution to expand research initiative in several directions: firstly, bringing forth innovative data analysis techniques to represent, learn, and aggregate useful knowledge while filtering out noise from data; secondly, tap onto the interplay between storage and computing to minimize storage allocation; thirdly, explore ingenious solutions to expand storage capacity. Throughout this paper, we delve deeper into the state-of-the-art research and also put forth novel propositions in all of the abovementioned directions, including space- and time-efficient data representation, intelligent data aggregation, in-memory computing, extra-terrestrial storage, and data curation. The main aim of this paper is to raise awareness on the storage limitation we are about to face if current technology is adopted and the storage utilization growth rate persists. In the manuscript, we propose some storagemore » solutions and a better utilization of storage capacity through a global DIKW hierarchy.« less

Authors:
ORCiD logo [1];  [1];  [2];  [3];  [4]
  1. Nanyang Technological Univ. (Singapore)
  2. RWTH Aachen Univ., Aachen (Germany)
  3. A*STAR (Singapore)
  4. SLAC National Accelerator Lab., Menlo Park, CA (United States)
Publication Date:
Research Org.:
SLAC National Accelerator Laboratory (SLAC), Menlo Park, CA (United States)
Sponsoring Org.:
USDOE
OSTI Identifier:
1420053
Grant/Contract Number:  
AC02-76SF00515
Resource Type:
Accepted Manuscript
Journal Name:
Cognitive Computation
Additional Journal Information:
Journal Volume: 9; Journal Issue: 5; Journal ID: ISSN 1866-9956
Publisher:
Springer
Country of Publication:
United States
Language:
English
Subject:
96 KNOWLEDGE MANAGEMENT AND PRESERVATION; information technology; big data analysis; data storage; data representation; data learning; data aggregation

Citation Formats

Cambria, Erik, Chattopadhyay, Anupam, Linn, Eike, Mandal, Bappaditya, and White, Bebo. Storages Are Not Forever. United States: N. p., 2017. Web. doi:10.1007/s12559-017-9482-4.
Cambria, Erik, Chattopadhyay, Anupam, Linn, Eike, Mandal, Bappaditya, & White, Bebo. Storages Are Not Forever. United States. https://doi.org/10.1007/s12559-017-9482-4
Cambria, Erik, Chattopadhyay, Anupam, Linn, Eike, Mandal, Bappaditya, and White, Bebo. Sat . "Storages Are Not Forever". United States. https://doi.org/10.1007/s12559-017-9482-4. https://www.osti.gov/servlets/purl/1420053.
@article{osti_1420053,
title = {Storages Are Not Forever},
author = {Cambria, Erik and Chattopadhyay, Anupam and Linn, Eike and Mandal, Bappaditya and White, Bebo},
abstractNote = {Not unlike the concern over diminishing fossil fuel, information technology is bringing its own share of future worries. Here, we chose to look closely into one concern in this paper, namely the limited amount of data storage. By a simple extrapolatory analysis, it is shown that we are on the way to exhaust our storage capacity in less than two centuries with current technology and no recycling. This can be taken as a note of caution to expand research initiative in several directions: firstly, bringing forth innovative data analysis techniques to represent, learn, and aggregate useful knowledge while filtering out noise from data; secondly, tap onto the interplay between storage and computing to minimize storage allocation; thirdly, explore ingenious solutions to expand storage capacity. Throughout this paper, we delve deeper into the state-of-the-art research and also put forth novel propositions in all of the abovementioned directions, including space- and time-efficient data representation, intelligent data aggregation, in-memory computing, extra-terrestrial storage, and data curation. The main aim of this paper is to raise awareness on the storage limitation we are about to face if current technology is adopted and the storage utilization growth rate persists. In the manuscript, we propose some storage solutions and a better utilization of storage capacity through a global DIKW hierarchy.},
doi = {10.1007/s12559-017-9482-4},
journal = {Cognitive Computation},
number = 5,
volume = 9,
place = {United States},
year = {Sat May 27 00:00:00 EDT 2017},
month = {Sat May 27 00:00:00 EDT 2017}
}

Journal Article:
Free Publicly Available Full Text
Publisher's Version of Record

Citation Metrics:
Cited by: 5 works
Citation information provided by
Web of Science

Save / Share:

Works referenced in this record:

Accelerating the convergence of the back-propagation method
journal, September 1988

  • Vogl, T. P.; Mangis, J. K.; Rigler, A. K.
  • Biological Cybernetics, Vol. 59, Issue 4-5
  • DOI: 10.1007/BF00332914

Extreme Learning Machine for Regression and Multiclass Classification
journal, April 2012

  • Guang-Bin Huang,
  • IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics), Vol. 42, Issue 2
  • DOI: 10.1109/TSMCB.2011.2168604

Database-friendly random projections: Johnson-Lindenstrauss with binary coins
journal, June 2003


Memristive devices and systems
journal, January 1976


Scaling limits of resistive memories
journal, May 2011


A Complementary Resistive Switch-Based Crossbar Array Adder
journal, March 2015

  • Siemon, Anne; Menzel, Stephan; Waser, Rainer
  • IEEE Journal on Emerging and Selected Topics in Circuits and Systems, Vol. 5, Issue 1
  • DOI: 10.1109/JETCAS.2015.2398217

Ultimate physical limits to computation
journal, August 2000


Multistate Memristive Tantalum Oxide Devices for Ternary Arithmetic
journal, November 2016

  • Kim, Wonjoo; Chattopadhyay, Anupam; Siemon, Anne
  • Scientific Reports, Vol. 6, Issue 1
  • DOI: 10.1038/srep36652

Fisher discriminant analysis with kernels
conference, January 1999

  • Mika, S.; Ratsch, G.; Weston, J.
  • Neural Networks for Signal Processing IX: 1999 IEEE Signal Processing Society Workshop, Neural Networks for Signal Processing IX: Proceedings of the 1999 IEEE Signal Processing Society Workshop (Cat. No.98TH8468)
  • DOI: 10.1109/NNSP.1999.788121

Beyond von Neumann—logic operations in passive crossbar arrays alongside memory operations
journal, July 2012


Input space versus feature space in kernel-based methods
journal, January 1999

  • Scholkopf, B.; Mika, S.; Burges, C. J. C.
  • IEEE Transactions on Neural Networks, Vol. 10, Issue 5
  • DOI: 10.1109/72.788641

‘Memristive’ switches enable ‘stateful’ logic operations via material implication
journal, April 2010

  • Borghetti, Julien; Snider, Gregory S.; Kuekes, Philip J.
  • Nature, Vol. 464, Issue 7290
  • DOI: 10.1038/nature08940

Image Processing Unit for General-Purpose Representation and Association System for Recognizing Low-Resolution Digits With Visual Information Variability
journal, March 2018

  • Dai, Bowen; Li, Huihui; Wei, Lei
  • IEEE Transactions on Systems, Man, and Cybernetics: Systems, Vol. 48, Issue 3
  • DOI: 10.1109/TSMC.2016.2601902

Learning word dependencies in text by means of a deep recurrent belief network
journal, September 2016


Face recognition in unconstrained videos with matched background similarity
conference, June 2011

  • Wolf, Lior; Hassner, Tal; Maoz, Itay
  • 2011 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), CVPR 2011
  • DOI: 10.1109/CVPR.2011.5995566

The DCC Curation Lifecycle Model
journal, August 2008

  • Higgins, Sarah
  • International Journal of Digital Curation, Vol. 3, Issue 1
  • DOI: 10.2218/ijdc.v3i1.48

The FERET evaluation methodology for face-recognition algorithms
journal, January 2000

  • Phillips, P. J.; Rizvi, S. A.
  • IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 22, Issue 10
  • DOI: 10.1109/34.879790

The Emerging "Big Dimensionality"
journal, August 2014

  • Zhai, Yiteng; Ong, Yew-Soon; Tsang, Ivor W.
  • IEEE Computational Intelligence Magazine, Vol. 9, Issue 3
  • DOI: 10.1109/MCI.2014.2326099

Using discriminant eigenfeatures for image retrieval
journal, January 1996

  • Swets, D. L.; Weng, J. J.
  • IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 18, Issue 8
  • DOI: 10.1109/34.531802

Whole space subclass discriminant analysis for face recognition
conference, September 2015

  • Mandal, Bappaditya; Li, Liyuan; Chandrasekhar, Vijay
  • 2015 IEEE International Conference on Image Processing (ICIP)
  • DOI: 10.1109/ICIP.2015.7350814

In-memory adder functionality in 1S1R arrays
conference, May 2015

  • Siemon, A.; Menzel, S.; Chattopadhyay, A.
  • 2015 IEEE International Symposium on Circuits and Systems (ISCAS)
  • DOI: 10.1109/ISCAS.2015.7168889

Extreme learning machines: a survey
journal, May 2011

  • Huang, Guang-Bin; Wang, Dian Hui; Lan, Yuan
  • International Journal of Machine Learning and Cybernetics, Vol. 2, Issue 2
  • DOI: 10.1007/s13042-011-0019-y

Critical decision method for eliciting knowledge
journal, January 1989

  • Klein, G. A.; Calderwood, R.; MacGregor, D.
  • IEEE Transactions on Systems, Man, and Cybernetics, Vol. 19, Issue 3
  • DOI: 10.1109/21.31053

Improved Analysis of the Subsampled Randomized Hadamard Transform
journal, April 2011


Realization of Boolean Logic Functionality Using Redox-Based Memristive Devices
journal, June 2015

  • Siemon, Anne; Breuer, Thomas; Aslam, Nabeel
  • Advanced Functional Materials, Vol. 25, Issue 40
  • DOI: 10.1002/adfm.201500865

Sentiment Data Flow Analysis by Means of Dynamic Linguistic Patterns
journal, November 2015

  • Poria, Soujanya; Cambria, Erik; Gelbukh, Alexander
  • IEEE Computational Intelligence Magazine, Vol. 10, Issue 4
  • DOI: 10.1109/MCI.2015.2471215

Complete discriminant evaluation and feature extraction in kernel space for face recognition
journal, November 2007

  • Jiang, Xudong; Mandal, Bappaditya; Kot, Alex
  • Machine Vision and Applications, Vol. 20, Issue 1
  • DOI: 10.1007/s00138-007-0103-1

The missing memristor found
journal, May 2008

  • Strukov, Dmitri B.; Snider, Gregory S.; Stewart, Duncan R.
  • Nature, Vol. 453, Issue 7191
  • DOI: 10.1038/nature06932

New Trends of Learning in Computational Intelligence [Guest Editorial]
journal, May 2015

  • Huang, Guang-Bin; Cambria, Erik; Toh, Kar-Ann
  • IEEE Computational Intelligence Magazine, Vol. 10, Issue 2
  • DOI: 10.1109/MCI.2015.2405277

In-Memory Data Compression Using ReRAMs
book, January 2017

  • Bhattacharjee, Debjyoti; Chattopadhyay, Anupam
  • Emerging Technology and Architecture for Big-data Analytics
  • DOI: 10.1007/978-3-319-54840-1_13

Eigenfeature Regularization and Extraction in Face Recognition
journal, March 2008

  • Xudong Jiang, ; Mandal, B.; Kot, A.
  • IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 30, Issue 3
  • DOI: 10.1109/TPAMI.2007.70708

Jumping NLP Curves: A Review of Natural Language Processing Research [Review Article]
journal, May 2014


Extreme Learning Machines [Trends & Controversies]
journal, November 2013

  • Cambria, Erik; Huang, Guang-Bin; Kasun, Liyanaarachchi Lekamalage Chamara
  • IEEE Intelligent Systems, Vol. 28, Issue 6
  • DOI: 10.1109/MIS.2013.140

Statistical Learning Theory and ELM for Big Social Data Analysis
journal, August 2016

  • Oneto, Luca; Bisio, Federica; Cambria, Erik
  • IEEE Computational Intelligence Magazine, Vol. 11, Issue 3
  • DOI: 10.1109/MCI.2016.2572540

Bistability in Atomic-Scale Antiferromagnets
journal, January 2012


Efficient Binary Basic Linear Algebra Operations on ReRAM Crossbar Arrays
conference, January 2017

  • Bhattacharjee, Debjyoti; Chattopadhyay, Anupam
  • 2017 30th International Conference on VLSI Design and 2017 16th International Conference on Embedded Systems (VLSID)
  • DOI: 10.1109/VLSID.2017.10

Universal upper bound on the entropy-to-energy ratio for bounded systems
journal, January 1981


Universal Approximation Using Incremental Constructive Feedforward Networks With Random Hidden Nodes
journal, July 2006

  • Huang, G. -B.; Chen, L.; Siew, C. -K.
  • IEEE Transactions on Neural Networks, Vol. 17, Issue 4
  • DOI: 10.1109/TNN.2006.875977

The wisdom hierarchy: representations of the DIKW hierarchy
journal, February 2007


An Insight into Extreme Learning Machines: Random Neurons, Random Features and Kernels
journal, April 2014


Circular backpropagation networks for classification
journal, January 1997

  • Ridella, S.; Rovetta, S.; Zunino, R.
  • IEEE Transactions on Neural Networks, Vol. 8, Issue 1
  • DOI: 10.1109/72.554194

Improved Approximation Algorithms for Large Matrices via Random Projections
conference, October 2006

  • Sarlos, Tamas
  • 2006 47th Annual IEEE Conference on Foundations of Computer Science, 2006 47th Annual IEEE Symposium on Foundations of Computer Science (FOCS'06)
  • DOI: 10.1109/FOCS.2006.37

A Hybrid Belief Rule-Based Classification System Based on Uncertain Training Data and Expert Knowledge
journal, December 2016

  • Jiao, Lianmeng; Denoeux, Thierry; Pan, Quan
  • IEEE Transactions on Systems, Man, and Cybernetics: Systems, Vol. 46, Issue 12
  • DOI: 10.1109/TSMC.2015.2503381

(Keynote) Atomic Scale and Interface Interactions in Redox-Based Resistive Switching Memories
journal, August 2014


High density 3D memory architecture based on the resistive switching effect
journal, December 2009


DeepFace: Closing the Gap to Human-Level Performance in Face Verification
conference, June 2014

  • Taigman, Yaniv; Yang, Ming; Ranzato, Marc'Aurelio
  • 2014 IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
  • DOI: 10.1109/CVPR.2014.220

Deep Learning-Based Model Reduction for Distributed Parameter Systems
journal, December 2016

  • Wang, Mingliang; Li, Han-Xiong; Chen, Xin
  • IEEE Transactions on Systems, Man, and Cybernetics: Systems, Vol. 46, Issue 12
  • DOI: 10.1109/TSMC.2016.2605159

Eigenfaces for Recognition
journal, January 1991


Incremental Linear Discriminant Analysis for Face Recognition
journal, February 2008

  • Zhao, Haitao; Yuen, Pong Chi
  • IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics), Vol. 38, Issue 1
  • DOI: 10.1109/TSMCB.2007.908870

Unsupervised learning of hierarchical representations with convolutional deep belief networks
journal, October 2011

  • Lee, Honglak; Grosse, Roger; Ranganath, Rajesh
  • Communications of the ACM, Vol. 54, Issue 10
  • DOI: 10.1145/2001269.2001295

Extreme learning machine: Theory and applications
journal, December 2006


Random projection in dimensionality reduction: applications to image and text data
conference, January 2001

  • Bingham, Ella; Mannila, Heikki
  • Proceedings of the seventh ACM SIGKDD international conference on Knowledge discovery and data mining - KDD '01
  • DOI: 10.1145/502512.502546

Guest Editorial: Big Social Data Analysis
journal, October 2014


Next-Generation Digital Information Storage in DNA
journal, August 2012


Semi-supervised Learning for Affective Common-Sense Reasoning
journal, October 2016


Redox-based Resistive Memory
book, November 2014


Multi-level 40nm WOX resistive memory with excellent reliability
conference, December 2011

  • Chien, Wei-Chih; Lee, Ming-Hsiu
  • 2011 IEEE International Electron Devices Meeting (IEDM), 2011 International Electron Devices Meeting
  • DOI: 10.1109/IEDM.2011.6131651

A HfO 2 -Based Complementary Switching Crossbar Adder
journal, August 2015

  • Breuer, Thomas; Siemon, Anne; Linn, Eike
  • Advanced Electronic Materials, Vol. 1, Issue 10
  • DOI: 10.1002/aelm.201500138

Works referencing / citing this record:

Mining Big Data with Random Forests
journal, January 2019


A Grammar-Guided Genetic Programing Algorithm for Associative Classification in Big Data
journal, January 2019


PAS3-HSID: a Dynamic Bio-Inspired Approach for Real-Time Hot Spot Identification in Data Streams
journal, April 2019

  • Tickle, Rebecca; Triguero, Isaac; Figueredo, Grazziela P.
  • Cognitive Computation, Vol. 11, Issue 3
  • DOI: 10.1007/s12559-019-09638-y