Storages Are Not Forever
Abstract
Not unlike the concern over diminishing fossil fuel, information technology is bringing its own share of future worries. Here, we chose to look closely into one concern in this paper, namely the limited amount of data storage. By a simple extrapolatory analysis, it is shown that we are on the way to exhaust our storage capacity in less than two centuries with current technology and no recycling. This can be taken as a note of caution to expand research initiative in several directions: firstly, bringing forth innovative data analysis techniques to represent, learn, and aggregate useful knowledge while filtering out noise from data; secondly, tap onto the interplay between storage and computing to minimize storage allocation; thirdly, explore ingenious solutions to expand storage capacity. Throughout this paper, we delve deeper into the state-of-the-art research and also put forth novel propositions in all of the abovementioned directions, including space- and time-efficient data representation, intelligent data aggregation, in-memory computing, extra-terrestrial storage, and data curation. The main aim of this paper is to raise awareness on the storage limitation we are about to face if current technology is adopted and the storage utilization growth rate persists. In the manuscript, we propose some storagemore »
- Authors:
-
- Nanyang Technological Univ. (Singapore)
- RWTH Aachen Univ., Aachen (Germany)
- A*STAR (Singapore)
- SLAC National Accelerator Lab., Menlo Park, CA (United States)
- Publication Date:
- Research Org.:
- SLAC National Accelerator Laboratory (SLAC), Menlo Park, CA (United States)
- Sponsoring Org.:
- USDOE
- OSTI Identifier:
- 1420053
- Grant/Contract Number:
- AC02-76SF00515
- Resource Type:
- Accepted Manuscript
- Journal Name:
- Cognitive Computation
- Additional Journal Information:
- Journal Volume: 9; Journal Issue: 5; Journal ID: ISSN 1866-9956
- Publisher:
- Springer
- Country of Publication:
- United States
- Language:
- English
- Subject:
- 96 KNOWLEDGE MANAGEMENT AND PRESERVATION; information technology; big data analysis; data storage; data representation; data learning; data aggregation
Citation Formats
Cambria, Erik, Chattopadhyay, Anupam, Linn, Eike, Mandal, Bappaditya, and White, Bebo. Storages Are Not Forever. United States: N. p., 2017.
Web. doi:10.1007/s12559-017-9482-4.
Cambria, Erik, Chattopadhyay, Anupam, Linn, Eike, Mandal, Bappaditya, & White, Bebo. Storages Are Not Forever. United States. https://doi.org/10.1007/s12559-017-9482-4
Cambria, Erik, Chattopadhyay, Anupam, Linn, Eike, Mandal, Bappaditya, and White, Bebo. Sat .
"Storages Are Not Forever". United States. https://doi.org/10.1007/s12559-017-9482-4. https://www.osti.gov/servlets/purl/1420053.
@article{osti_1420053,
title = {Storages Are Not Forever},
author = {Cambria, Erik and Chattopadhyay, Anupam and Linn, Eike and Mandal, Bappaditya and White, Bebo},
abstractNote = {Not unlike the concern over diminishing fossil fuel, information technology is bringing its own share of future worries. Here, we chose to look closely into one concern in this paper, namely the limited amount of data storage. By a simple extrapolatory analysis, it is shown that we are on the way to exhaust our storage capacity in less than two centuries with current technology and no recycling. This can be taken as a note of caution to expand research initiative in several directions: firstly, bringing forth innovative data analysis techniques to represent, learn, and aggregate useful knowledge while filtering out noise from data; secondly, tap onto the interplay between storage and computing to minimize storage allocation; thirdly, explore ingenious solutions to expand storage capacity. Throughout this paper, we delve deeper into the state-of-the-art research and also put forth novel propositions in all of the abovementioned directions, including space- and time-efficient data representation, intelligent data aggregation, in-memory computing, extra-terrestrial storage, and data curation. The main aim of this paper is to raise awareness on the storage limitation we are about to face if current technology is adopted and the storage utilization growth rate persists. In the manuscript, we propose some storage solutions and a better utilization of storage capacity through a global DIKW hierarchy.},
doi = {10.1007/s12559-017-9482-4},
journal = {Cognitive Computation},
number = 5,
volume = 9,
place = {United States},
year = {Sat May 27 00:00:00 EDT 2017},
month = {Sat May 27 00:00:00 EDT 2017}
}
Web of Science
Works referenced in this record:
Accelerating the convergence of the back-propagation method
journal, September 1988
- Vogl, T. P.; Mangis, J. K.; Rigler, A. K.
- Biological Cybernetics, Vol. 59, Issue 4-5
Extreme Learning Machine for Regression and Multiclass Classification
journal, April 2012
- Guang-Bin Huang,
- IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics), Vol. 42, Issue 2
Database-friendly random projections: Johnson-Lindenstrauss with binary coins
journal, June 2003
- Achlioptas, Dimitris
- Journal of Computer and System Sciences, Vol. 66, Issue 4
Memristive devices and systems
journal, January 1976
- Chua, L. O.
- Proceedings of the IEEE, Vol. 64, Issue 2
Scaling limits of resistive memories
journal, May 2011
- Zhirnov, Victor V.; Meade, Roy; Cavin, Ralph K.
- Nanotechnology, Vol. 22, Issue 25
A Complementary Resistive Switch-Based Crossbar Array Adder
journal, March 2015
- Siemon, Anne; Menzel, Stephan; Waser, Rainer
- IEEE Journal on Emerging and Selected Topics in Circuits and Systems, Vol. 5, Issue 1
Ultimate physical limits to computation
journal, August 2000
- Lloyd, Seth
- Nature, Vol. 406, Issue 6799
Multistate Memristive Tantalum Oxide Devices for Ternary Arithmetic
journal, November 2016
- Kim, Wonjoo; Chattopadhyay, Anupam; Siemon, Anne
- Scientific Reports, Vol. 6, Issue 1
Fisher discriminant analysis with kernels
conference, January 1999
- Mika, S.; Ratsch, G.; Weston, J.
- Neural Networks for Signal Processing IX: 1999 IEEE Signal Processing Society Workshop, Neural Networks for Signal Processing IX: Proceedings of the 1999 IEEE Signal Processing Society Workshop (Cat. No.98TH8468)
Beyond von Neumann—logic operations in passive crossbar arrays alongside memory operations
journal, July 2012
- Linn, E.; Rosezin, R.; Tappertzhofen, S.
- Nanotechnology, Vol. 23, Issue 30
Input space versus feature space in kernel-based methods
journal, January 1999
- Scholkopf, B.; Mika, S.; Burges, C. J. C.
- IEEE Transactions on Neural Networks, Vol. 10, Issue 5
‘Memristive’ switches enable ‘stateful’ logic operations via material implication
journal, April 2010
- Borghetti, Julien; Snider, Gregory S.; Kuekes, Philip J.
- Nature, Vol. 464, Issue 7290
Image Processing Unit for General-Purpose Representation and Association System for Recognizing Low-Resolution Digits With Visual Information Variability
journal, March 2018
- Dai, Bowen; Li, Huihui; Wei, Lei
- IEEE Transactions on Systems, Man, and Cybernetics: Systems, Vol. 48, Issue 3
Learning word dependencies in text by means of a deep recurrent belief network
journal, September 2016
- Chaturvedi, Iti; Ong, Yew-Soon; Tsang, Ivor W.
- Knowledge-Based Systems, Vol. 108
Face recognition in unconstrained videos with matched background similarity
conference, June 2011
- Wolf, Lior; Hassner, Tal; Maoz, Itay
- 2011 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), CVPR 2011
The DCC Curation Lifecycle Model
journal, August 2008
- Higgins, Sarah
- International Journal of Digital Curation, Vol. 3, Issue 1
The FERET evaluation methodology for face-recognition algorithms
journal, January 2000
- Phillips, P. J.; Rizvi, S. A.
- IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 22, Issue 10
The Emerging "Big Dimensionality"
journal, August 2014
- Zhai, Yiteng; Ong, Yew-Soon; Tsang, Ivor W.
- IEEE Computational Intelligence Magazine, Vol. 9, Issue 3
Using discriminant eigenfeatures for image retrieval
journal, January 1996
- Swets, D. L.; Weng, J. J.
- IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 18, Issue 8
Whole space subclass discriminant analysis for face recognition
conference, September 2015
- Mandal, Bappaditya; Li, Liyuan; Chandrasekhar, Vijay
- 2015 IEEE International Conference on Image Processing (ICIP)
In-memory adder functionality in 1S1R arrays
conference, May 2015
- Siemon, A.; Menzel, S.; Chattopadhyay, A.
- 2015 IEEE International Symposium on Circuits and Systems (ISCAS)
Extreme learning machines: a survey
journal, May 2011
- Huang, Guang-Bin; Wang, Dian Hui; Lan, Yuan
- International Journal of Machine Learning and Cybernetics, Vol. 2, Issue 2
Critical decision method for eliciting knowledge
journal, January 1989
- Klein, G. A.; Calderwood, R.; MacGregor, D.
- IEEE Transactions on Systems, Man, and Cybernetics, Vol. 19, Issue 3
Improved Analysis of the Subsampled Randomized Hadamard Transform
journal, April 2011
- Tropp, Joel A.
- Advances in Adaptive Data Analysis, Vol. 03, Issue 01n02
Realization of Boolean Logic Functionality Using Redox-Based Memristive Devices
journal, June 2015
- Siemon, Anne; Breuer, Thomas; Aslam, Nabeel
- Advanced Functional Materials, Vol. 25, Issue 40
Sentiment Data Flow Analysis by Means of Dynamic Linguistic Patterns
journal, November 2015
- Poria, Soujanya; Cambria, Erik; Gelbukh, Alexander
- IEEE Computational Intelligence Magazine, Vol. 10, Issue 4
Complete discriminant evaluation and feature extraction in kernel space for face recognition
journal, November 2007
- Jiang, Xudong; Mandal, Bappaditya; Kot, Alex
- Machine Vision and Applications, Vol. 20, Issue 1
The missing memristor found
journal, May 2008
- Strukov, Dmitri B.; Snider, Gregory S.; Stewart, Duncan R.
- Nature, Vol. 453, Issue 7191
New Trends of Learning in Computational Intelligence [Guest Editorial]
journal, May 2015
- Huang, Guang-Bin; Cambria, Erik; Toh, Kar-Ann
- IEEE Computational Intelligence Magazine, Vol. 10, Issue 2
In-Memory Data Compression Using ReRAMs
book, January 2017
- Bhattacharjee, Debjyoti; Chattopadhyay, Anupam
- Emerging Technology and Architecture for Big-data Analytics
Eigenfeature Regularization and Extraction in Face Recognition
journal, March 2008
- Xudong Jiang, ; Mandal, B.; Kot, A.
- IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 30, Issue 3
Jumping NLP Curves: A Review of Natural Language Processing Research [Review Article]
journal, May 2014
- Cambria, Erik; White, Bebo
- IEEE Computational Intelligence Magazine, Vol. 9, Issue 2
Extreme Learning Machines [Trends & Controversies]
journal, November 2013
- Cambria, Erik; Huang, Guang-Bin; Kasun, Liyanaarachchi Lekamalage Chamara
- IEEE Intelligent Systems, Vol. 28, Issue 6
Statistical Learning Theory and ELM for Big Social Data Analysis
journal, August 2016
- Oneto, Luca; Bisio, Federica; Cambria, Erik
- IEEE Computational Intelligence Magazine, Vol. 11, Issue 3
Bistability in Atomic-Scale Antiferromagnets
journal, January 2012
- Loth, S.; Baumann, S.; Lutz, C. P.
- Science, Vol. 335, Issue 6065
Efficient Binary Basic Linear Algebra Operations on ReRAM Crossbar Arrays
conference, January 2017
- Bhattacharjee, Debjyoti; Chattopadhyay, Anupam
- 2017 30th International Conference on VLSI Design and 2017 16th International Conference on Embedded Systems (VLSID)
Universal upper bound on the entropy-to-energy ratio for bounded systems
journal, January 1981
- Bekenstein, Jacob D.
- Physical Review D, Vol. 23, Issue 2
Universal Approximation Using Incremental Constructive Feedforward Networks With Random Hidden Nodes
journal, July 2006
- Huang, G. -B.; Chen, L.; Siew, C. -K.
- IEEE Transactions on Neural Networks, Vol. 17, Issue 4
The wisdom hierarchy: representations of the DIKW hierarchy
journal, February 2007
- Rowley, Jennifer
- Journal of Information Science, Vol. 33, Issue 2
An Insight into Extreme Learning Machines: Random Neurons, Random Features and Kernels
journal, April 2014
- Huang, Guang-Bin
- Cognitive Computation, Vol. 6, Issue 3
Circular backpropagation networks for classification
journal, January 1997
- Ridella, S.; Rovetta, S.; Zunino, R.
- IEEE Transactions on Neural Networks, Vol. 8, Issue 1
Improved Approximation Algorithms for Large Matrices via Random Projections
conference, October 2006
- Sarlos, Tamas
- 2006 47th Annual IEEE Conference on Foundations of Computer Science, 2006 47th Annual IEEE Symposium on Foundations of Computer Science (FOCS'06)
A Hybrid Belief Rule-Based Classification System Based on Uncertain Training Data and Expert Knowledge
journal, December 2016
- Jiao, Lianmeng; Denoeux, Thierry; Pan, Quan
- IEEE Transactions on Systems, Man, and Cybernetics: Systems, Vol. 46, Issue 12
(Keynote) Atomic Scale and Interface Interactions in Redox-Based Resistive Switching Memories
journal, August 2014
- Valov, I.; Tappertzhofen, S.; Linn, E.
- ECS Transactions, Vol. 64, Issue 14
High density 3D memory architecture based on the resistive switching effect
journal, December 2009
- Kügeler, C.; Meier, M.; Rosezin, R.
- Solid-State Electronics, Vol. 53, Issue 12
DeepFace: Closing the Gap to Human-Level Performance in Face Verification
conference, June 2014
- Taigman, Yaniv; Yang, Ming; Ranzato, Marc'Aurelio
- 2014 IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
Deep Learning-Based Model Reduction for Distributed Parameter Systems
journal, December 2016
- Wang, Mingliang; Li, Han-Xiong; Chen, Xin
- IEEE Transactions on Systems, Man, and Cybernetics: Systems, Vol. 46, Issue 12
Eigenfaces for Recognition
journal, January 1991
- Turk, Matthew; Pentland, Alex
- Journal of Cognitive Neuroscience, Vol. 3, Issue 1
Sentic Computing: A Common-Sense-Based Framework for Concept-Level Sentiment Analysis
book, January 2015
- Cambria, Erik; Hussain, Amir
Incremental Linear Discriminant Analysis for Face Recognition
journal, February 2008
- Zhao, Haitao; Yuen, Pong Chi
- IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics), Vol. 38, Issue 1
Unsupervised learning of hierarchical representations with convolutional deep belief networks
journal, October 2011
- Lee, Honglak; Grosse, Roger; Ranganath, Rajesh
- Communications of the ACM, Vol. 54, Issue 10
Extreme learning machine: Theory and applications
journal, December 2006
- Huang, Guang-Bin; Zhu, Qin-Yu; Siew, Chee-Kheong
- Neurocomputing, Vol. 70, Issue 1-3
Random projection in dimensionality reduction: applications to image and text data
conference, January 2001
- Bingham, Ella; Mannila, Heikki
- Proceedings of the seventh ACM SIGKDD international conference on Knowledge discovery and data mining - KDD '01
Guest Editorial: Big Social Data Analysis
journal, October 2014
- Cambria, Erik; Wang, Haixun; White, Bebo
- Knowledge-Based Systems, Vol. 69
Next-Generation Digital Information Storage in DNA
journal, August 2012
- Church, G. M.; Gao, Y.; Kosuri, S.
- Science, Vol. 337, Issue 6102
Semi-supervised Learning for Affective Common-Sense Reasoning
journal, October 2016
- Oneto, Luca; Bisio, Federica; Cambria, Erik
- Cognitive Computation, Vol. 9, Issue 1
Redox-based Resistive Memory
book, November 2014
- Menzel, Stephan; Linn, Eike; Waser, Rainer
- Emerging Nanoelectronic Devices
Multi-level 40nm WOX resistive memory with excellent reliability
conference, December 2011
- Chien, Wei-Chih; Lee, Ming-Hsiu
- 2011 IEEE International Electron Devices Meeting (IEDM), 2011 International Electron Devices Meeting
A HfO 2 -Based Complementary Switching Crossbar Adder
journal, August 2015
- Breuer, Thomas; Siemon, Anne; Linn, Eike
- Advanced Electronic Materials, Vol. 1, Issue 10
Works referencing / citing this record:
Mining Big Data with Random Forests
journal, January 2019
- Lulli, Alessandro; Oneto, Luca; Anguita, Davide
- Cognitive Computation, Vol. 11, Issue 2
A Grammar-Guided Genetic Programing Algorithm for Associative Classification in Big Data
journal, January 2019
- Padillo, F.; Luna, J. M.; Ventura, S.
- Cognitive Computation, Vol. 11, Issue 3
PAS3-HSID: a Dynamic Bio-Inspired Approach for Real-Time Hot Spot Identification in Data Streams
journal, April 2019
- Tickle, Rebecca; Triguero, Isaac; Figueredo, Grazziela P.
- Cognitive Computation, Vol. 11, Issue 3