Storages Are Not Forever

Cambria, Erik; Chattopadhyay, Anupam; Linn, Eike; Mandal, Bappaditya; White, Bebo

doi:10.1007/s12559-017-9482-4

Title: Storages Are Not Forever

Journal Article · Sat May 27 00:00:00 UTC 2017 · Cognitive Computation

DOI: https://doi.org/10.1007/s12559-017-9482-4 · OSTI ID:1420053

^[1]; Chattopadhyay, Anupam ^[1]; Linn, Eike ^[2]; Mandal, Bappaditya ^[3]; White, Bebo ^[4]

Nanyang Technological Univ. (Singapore)
RWTH Aachen Univ., Aachen (Germany)
A*STAR (Singapore)
SLAC National Accelerator Lab., Menlo Park, CA (United States)

Not unlike the concern over diminishing fossil fuel, information technology is bringing its own share of future worries. Here, we chose to look closely into one concern in this paper, namely the limited amount of data storage. By a simple extrapolatory analysis, it is shown that we are on the way to exhaust our storage capacity in less than two centuries with current technology and no recycling. This can be taken as a note of caution to expand research initiative in several directions: firstly, bringing forth innovative data analysis techniques to represent, learn, and aggregate useful knowledge while filtering out noise from data; secondly, tap onto the interplay between storage and computing to minimize storage allocation; thirdly, explore ingenious solutions to expand storage capacity. Throughout this paper, we delve deeper into the state-of-the-art research and also put forth novel propositions in all of the abovementioned directions, including space- and time-efficient data representation, intelligent data aggregation, in-memory computing, extra-terrestrial storage, and data curation. The main aim of this paper is to raise awareness on the storage limitation we are about to face if current technology is adopted and the storage utilization growth rate persists. In the manuscript, we propose some storage solutions and a better utilization of storage capacity through a global DIKW hierarchy.

View Accepted Manuscript (DOE)

Cite

Export

Save

Research Organization:: SLAC National Accelerator Laboratory (SLAC), Menlo Park, CA (United States)

Sponsoring Organization:: USDOE

Grant/Contract Number:: AC02-76SF00515

OSTI ID:: 1420053

Journal Information:: Cognitive Computation, Journal Name: Cognitive Computation Journal Issue: 5 Vol. 9; ISSN 1866-9956

Publisher:: SpringerCopyright Statement

Country of Publication:: United States

Language:: English

References (59)

Redox-based Resistive Memory Menzel, Stephan; Linn, Eike; Waser, Rainer Emerging Nanoelectronic Devices https://doi.org/10.1002/9781118958254.ch08	book	November 2014
Realization of Boolean Logic Functionality Using Redox-Based Memristive Devices Siemon, Anne; Breuer, Thomas; Aslam, Nabeel Advanced Functional Materials, Vol. 25, Issue 40 https://doi.org/10.1002/adfm.201500865	journal	June 2015
A HfO ₂ -Based Complementary Switching Crossbar Adder Breuer, Thomas; Siemon, Anne; Linn, Eike Advanced Electronic Materials, Vol. 1, Issue 10 https://doi.org/10.1002/aelm.201500138	journal	August 2015
Sentic Computing: A Common-Sense-Based Framework for Concept-Level Sentiment Analysis Cambria, Erik; Hussain, Amir https://doi.org/10.1007/978-3-319-23654-4	book	January 2015
In-Memory Data Compression Using ReRAMs Bhattacharjee, Debjyoti; Chattopadhyay, Anupam Emerging Technology and Architecture for Big-data Analytics https://doi.org/10.1007/978-3-319-54840-1_13	book	January 2017
Accelerating the convergence of the back-propagation method Vogl, T. P.; Mangis, J. K.; Rigler, A. K. Biological Cybernetics, Vol. 59, Issue 4-5 https://doi.org/10.1007/BF00332914	journal	September 1988
Complete discriminant evaluation and feature extraction in kernel space for face recognition Jiang, Xudong; Mandal, Bappaditya; Kot, Alex Machine Vision and Applications, Vol. 20, Issue 1 https://doi.org/10.1007/s00138-007-0103-1	journal	November 2007
An Insight into Extreme Learning Machines: Random Neurons, Random Features and Kernels Huang, Guang-Bin Cognitive Computation, Vol. 6, Issue 3 https://doi.org/10.1007/s12559-014-9255-2	journal	April 2014
Semi-supervised Learning for Affective Common-Sense Reasoning Oneto, Luca; Bisio, Federica; Cambria, Erik Cognitive Computation, Vol. 9, Issue 1 https://doi.org/10.1007/s12559-016-9433-5	journal	October 2016
Extreme learning machines: a survey Huang, Guang-Bin; Wang, Dian Hui; Lan, Yuan International Journal of Machine Learning and Cybernetics, Vol. 2, Issue 2 https://doi.org/10.1007/s13042-011-0019-y	journal	May 2011
Database-friendly random projections: Johnson-Lindenstrauss with binary coins Achlioptas, Dimitris Journal of Computer and System Sciences, Vol. 66, Issue 4 https://doi.org/10.1016/S0022-0000(03)00025-4	journal	June 2003
Guest Editorial: Big Social Data Analysis Cambria, Erik; Wang, Haixun; White, Bebo Knowledge-Based Systems, Vol. 69 https://doi.org/10.1016/j.knosys.2014.07.002	journal	October 2014
Learning word dependencies in text by means of a deep recurrent belief network Chaturvedi, Iti; Ong, Yew-Soon; Tsang, Ivor W. Knowledge-Based Systems, Vol. 108 https://doi.org/10.1016/j.knosys.2016.07.019	journal	September 2016
Extreme learning machine: Theory and applications Huang, Guang-Bin; Zhu, Qin-Yu; Siew, Chee-Kheong Neurocomputing, Vol. 70, Issue 1-3 https://doi.org/10.1016/j.neucom.2005.12.126	journal	December 2006
High density 3D memory architecture based on the resistive switching effect Kügeler, C.; Meier, M.; Rosezin, R. Solid-State Electronics, Vol. 53, Issue 12 https://doi.org/10.1016/j.sse.2009.09.034	journal	December 2009
Ultimate physical limits to computation Lloyd, Seth Nature, Vol. 406, Issue 6799 https://doi.org/10.1038/35023282	journal	August 2000
The missing memristor found Strukov, Dmitri B.; Snider, Gregory S.; Stewart, Duncan R. Nature, Vol. 453, Issue 7191 https://doi.org/10.1038/nature06932	journal	May 2008
‘Memristive’ switches enable ‘stateful’ logic operations via material implication Borghetti, Julien; Snider, Gregory S.; Kuekes, Philip J. Nature, Vol. 464, Issue 7290 https://doi.org/10.1038/nature08940	journal	April 2010
Multistate Memristive Tantalum Oxide Devices for Ternary Arithmetic Kim, Wonjoo; Chattopadhyay, Anupam; Siemon, Anne Scientific Reports, Vol. 6, Issue 1 https://doi.org/10.1038/srep36652	journal	November 2016
Scaling limits of resistive memories Zhirnov, Victor V.; Meade, Roy; Cavin, Ralph K. Nanotechnology, Vol. 22, Issue 25 https://doi.org/10.1088/0957-4484/22/25/254027	journal	May 2011
Beyond von Neumann—logic operations in passive crossbar arrays alongside memory operations Linn, E.; Rosezin, R.; Tappertzhofen, S. Nanotechnology, Vol. 23, Issue 30 https://doi.org/10.1088/0957-4484/23/30/305205	journal	July 2012
Universal upper bound on the entropy-to-energy ratio for bounded systems Bekenstein, Jacob D. Physical Review D, Vol. 23, Issue 2 https://doi.org/10.1103/PhysRevD.23.287	journal	January 1981
Critical decision method for eliciting knowledge Klein, G. A.; Calderwood, R.; MacGregor, D. IEEE Transactions on Systems, Man, and Cybernetics, Vol. 19, Issue 3 https://doi.org/10.1109/21.31053	journal	January 1989
Using discriminant eigenfeatures for image retrieval Swets, D. L.; Weng, J. J. IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 18, Issue 8 https://doi.org/10.1109/34.531802	journal	January 1996
The FERET evaluation methodology for face-recognition algorithms Phillips, P. J.; Rizvi, S. A. IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 22, Issue 10 https://doi.org/10.1109/34.879790	journal	January 2000
Circular backpropagation networks for classification Ridella, S.; Rovetta, S.; Zunino, R. IEEE Transactions on Neural Networks, Vol. 8, Issue 1 https://doi.org/10.1109/72.554194	journal	January 1997
Input space versus feature space in kernel-based methods Scholkopf, B.; Mika, S.; Burges, C. J. C. IEEE Transactions on Neural Networks, Vol. 10, Issue 5 https://doi.org/10.1109/72.788641	journal	January 1999
Face recognition in unconstrained videos with matched background similarity Wolf, Lior; Hassner, Tal; Maoz, Itay 2011 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), CVPR 2011 https://doi.org/10.1109/CVPR.2011.5995566	conference	June 2011
DeepFace: Closing the Gap to Human-Level Performance in Face Verification Taigman, Yaniv; Yang, Ming; Ranzato, Marc'Aurelio 2014 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) https://doi.org/10.1109/CVPR.2014.220	conference	June 2014
Improved Approximation Algorithms for Large Matrices via Random Projections Sarlos, Tamas 2006 47th Annual IEEE Conference on Foundations of Computer Science, 2006 47th Annual IEEE Symposium on Foundations of Computer Science (FOCS'06) https://doi.org/10.1109/FOCS.2006.37	conference	October 2006
Whole space subclass discriminant analysis for face recognition Mandal, Bappaditya; Li, Liyuan; Chandrasekhar, Vijay 2015 IEEE International Conference on Image Processing (ICIP) https://doi.org/10.1109/ICIP.2015.7350814	conference	September 2015
Multi-level 40nm WOX resistive memory with excellent reliability Chien, Wei-Chih; Lee, Ming-Hsiu 2011 IEEE International Electron Devices Meeting (IEDM), 2011 International Electron Devices Meeting https://doi.org/10.1109/IEDM.2011.6131651	conference	December 2011
In-memory adder functionality in 1S1R arrays Siemon, A.; Menzel, S.; Chattopadhyay, A. 2015 IEEE International Symposium on Circuits and Systems (ISCAS) https://doi.org/10.1109/ISCAS.2015.7168889	conference	May 2015
A Complementary Resistive Switch-Based Crossbar Array Adder Siemon, Anne; Menzel, Stephan; Waser, Rainer IEEE Journal on Emerging and Selected Topics in Circuits and Systems, Vol. 5, Issue 1 https://doi.org/10.1109/JETCAS.2015.2398217	journal	March 2015
Jumping NLP Curves: A Review of Natural Language Processing Research [Review Article] Cambria, Erik; White, Bebo IEEE Computational Intelligence Magazine, Vol. 9, Issue 2 https://doi.org/10.1109/MCI.2014.2307227	journal	May 2014
The Emerging "Big Dimensionality" Zhai, Yiteng; Ong, Yew-Soon; Tsang, Ivor W. IEEE Computational Intelligence Magazine, Vol. 9, Issue 3 https://doi.org/10.1109/MCI.2014.2326099	journal	August 2014
New Trends of Learning in Computational Intelligence [Guest Editorial] Huang, Guang-Bin; Cambria, Erik; Toh, Kar-Ann IEEE Computational Intelligence Magazine, Vol. 10, Issue 2 https://doi.org/10.1109/MCI.2015.2405277	journal	May 2015
Sentiment Data Flow Analysis by Means of Dynamic Linguistic Patterns Poria, Soujanya; Cambria, Erik; Gelbukh, Alexander IEEE Computational Intelligence Magazine, Vol. 10, Issue 4 https://doi.org/10.1109/MCI.2015.2471215	journal	November 2015
Statistical Learning Theory and ELM for Big Social Data Analysis Oneto, Luca; Bisio, Federica; Cambria, Erik IEEE Computational Intelligence Magazine, Vol. 11, Issue 3 https://doi.org/10.1109/MCI.2016.2572540	journal	August 2016
Extreme Learning Machines [Trends & Controversies] Cambria, Erik; Huang, Guang-Bin; Kasun, Liyanaarachchi Lekamalage Chamara IEEE Intelligent Systems, Vol. 28, Issue 6 https://doi.org/10.1109/MIS.2013.140	journal	November 2013
Fisher discriminant analysis with kernels Mika, S.; Ratsch, G.; Weston, J. Neural Networks for Signal Processing IX: 1999 IEEE Signal Processing Society Workshop, Neural Networks for Signal Processing IX: Proceedings of the 1999 IEEE Signal Processing Society Workshop (Cat. No.98TH8468) https://doi.org/10.1109/NNSP.1999.788121	conference	January 1999
Memristive devices and systems Chua, L. O. Proceedings of the IEEE, Vol. 64, Issue 2 https://doi.org/10.1109/PROC.1976.10092	journal	January 1976
Universal Approximation Using Incremental Constructive Feedforward Networks With Random Hidden Nodes Huang, G. -B.; Chen, L.; Siew, C. -K. IEEE Transactions on Neural Networks, Vol. 17, Issue 4 https://doi.org/10.1109/TNN.2006.875977	journal	July 2006
Eigenfeature Regularization and Extraction in Face Recognition IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 30, Issue 3 https://doi.org/10.1109/TPAMI.2007.70708	journal	March 2008
A Hybrid Belief Rule-Based Classification System Based on Uncertain Training Data and Expert Knowledge Jiao, Lianmeng; Denoeux, Thierry; Pan, Quan IEEE Transactions on Systems, Man, and Cybernetics: Systems, Vol. 46, Issue 12 https://doi.org/10.1109/TSMC.2015.2503381	journal	December 2016
Image Processing Unit for General-Purpose Representation and Association System for Recognizing Low-Resolution Digits With Visual Information Variability Dai, Bowen; Li, Huihui; Wei, Lei IEEE Transactions on Systems, Man, and Cybernetics: Systems, Vol. 48, Issue 3 https://doi.org/10.1109/TSMC.2016.2601902	journal	March 2018
Deep Learning-Based Model Reduction for Distributed Parameter Systems Wang, Mingliang; Li, Han-Xiong; Chen, Xin IEEE Transactions on Systems, Man, and Cybernetics: Systems, Vol. 46, Issue 12 https://doi.org/10.1109/TSMC.2016.2605159	journal	December 2016
Incremental Linear Discriminant Analysis for Face Recognition Zhao, Haitao; Yuen, Pong Chi IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics), Vol. 38, Issue 1 https://doi.org/10.1109/TSMCB.2007.908870	journal	February 2008
Extreme Learning Machine for Regression and Multiclass Classification IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics), Vol. 42, Issue 2 https://doi.org/10.1109/TSMCB.2011.2168604	journal	April 2012
Efficient Binary Basic Linear Algebra Operations on ReRAM Crossbar Arrays Bhattacharjee, Debjyoti; Chattopadhyay, Anupam 2017 30th International Conference on VLSI Design and 2017 16th International Conference on Embedded Systems (VLSID) https://doi.org/10.1109/VLSID.2017.10	conference	January 2017
Bistability in Atomic-Scale Antiferromagnets Loth, S.; Baumann, S.; Lutz, C. P. Science, Vol. 335, Issue 6065 https://doi.org/10.1126/science.1214131	journal	January 2012
Next-Generation Digital Information Storage in DNA Church, G. M.; Gao, Y.; Kosuri, S. Science, Vol. 337, Issue 6102 https://doi.org/10.1126/science.1226355	journal	August 2012
Improved Analysis of the Subsampled Randomized Hadamard Transform Tropp, Joel A. Advances in Adaptive Data Analysis, Vol. 03, Issue 01n02 https://doi.org/10.1142/S1793536911000787	journal	April 2011
Unsupervised learning of hierarchical representations with convolutional deep belief networks Lee, Honglak; Grosse, Roger; Ranganath, Rajesh Communications of the ACM, Vol. 54, Issue 10 https://doi.org/10.1145/2001269.2001295	journal	October 2011
Random projection in dimensionality reduction: applications to image and text data Bingham, Ella; Mannila, Heikki Proceedings of the seventh ACM SIGKDD international conference on Knowledge discovery and data mining - KDD '01 https://doi.org/10.1145/502512.502546	conference	January 2001
(Keynote) Atomic Scale and Interface Interactions in Redox-Based Resistive Switching Memories Valov, I.; Tappertzhofen, S.; Linn, E. ECS Transactions, Vol. 64, Issue 14 https://doi.org/10.1149/06414.0003ecst	journal	August 2014
Eigenfaces for Recognition Turk, Matthew; Pentland, Alex Journal of Cognitive Neuroscience, Vol. 3, Issue 1 https://doi.org/10.1162/jocn.1991.3.1.71	journal	January 1991
The wisdom hierarchy: representations of the DIKW hierarchy Rowley, Jennifer Journal of Information Science, Vol. 33, Issue 2 https://doi.org/10.1177/0165551506070706	journal	February 2007
The DCC Curation Lifecycle Model Higgins, Sarah International Journal of Digital Curation, Vol. 3, Issue 1 https://doi.org/10.2218/ijdc.v3i1.48	journal	August 2008

Cited By (3)

Mining Big Data with Random Forests Lulli, Alessandro; Oneto, Luca; Anguita, Davide Cognitive Computation, Vol. 11, Issue 2 https://doi.org/10.1007/s12559-018-9615-4	journal	January 2019
A Grammar-Guided Genetic Programing Algorithm for Associative Classification in Big Data Padillo, F.; Luna, J. M.; Ventura, S. Cognitive Computation, Vol. 11, Issue 3 https://doi.org/10.1007/s12559-018-9617-2	journal	January 2019
PAS3-HSID: a Dynamic Bio-Inspired Approach for Real-Time Hot Spot Identification in Data Streams Tickle, Rebecca; Triguero, Isaac; Figueredo, Grazziela P. Cognitive Computation, Vol. 11, Issue 3 https://doi.org/10.1007/s12559-019-09638-y	journal	April 2019

Similar Records

Numerical simulations of multicomponent evaporation and gas-phase transport using M{sup 2}NOTS

Conference · Wed Mar 01 04:00:00 UTC 1995 · OSTI ID:107187

Ho, C K

High-tech hydro: an overview of pumped storage

Journal Article · · Hydro Rev.; (United States) · OSTI ID:5750609

Vansant, C

Study of photovoltaic cost elements. Volume 3. Sandia National Laboratories photovoltaic systems design catalog. Final report

Technical Report · Wed Jul 01 04:00:00 UTC 1981 · OSTI ID:6074190

Related Subjects

96 KNOWLEDGE MANAGEMENT AND PRESERVATION
big data analysis
data aggregation
data learning
data representation
data storage
information technology

Title: Storages Are Not Forever

Citation Formats

References (59)

Cited By (3)

Similar Records

Related Subjects