The Entropy Economy and the Kolmogorov Learning Cycle: Leveraging the intersection of Machine Learning and Algorithmic Information Theory to jointly optimize energy and learning

Evans, Scott C.; Shah, Tapan; Huang, Hao; Ekanayake, Sachini Piyoni

doi:10.1016/j.physd.2024.134051

Title: The Entropy Economy and the Kolmogorov Learning Cycle: Leveraging the intersection of Machine Learning and Algorithmic Information Theory to jointly optimize energy and learning

Journal Article · 01 May 2024 · Physica. D, Nonlinear Phenomena

DOI: https://doi.org/10.1016/j.physd.2024.134051 · OSTI ID:2369897

; Shah, Tapan; Huang, Hao; Ekanayake, Sachini Piyoni

View Accepted Manuscript (Publisher)

This content will become publicly available on February 28, 2026

Cite

Export

Save

Sponsoring Organization:: USDOE

OSTI ID:: 2369897

Journal Information:: Physica. D, Nonlinear Phenomena, Journal Name: Physica. D, Nonlinear Phenomena Vol. 461 Journal Issue: C; ISSN 0167-2789

Publisher:: ElsevierCopyright Statement

Country of Publication:: Netherlands

Language:: English

References (12)

A Mathematical Theory of Communication Shannon, C. E. Bell System Technical Journal, Vol. 27, Issue 3 https://doi.org/10.1002/j.1538-7305.1948.tb01338.x	journal	July 1948
Neural Networks and the Bias/Variance Dilemma Geman, Stuart; Bienenstock, Elie; Doursat, René Neural Computation, Vol. 4, Issue 1 https://doi.org/10.1162/neco.1992.4.1.1	journal	January 1992
Logical Reversibility of Computation Bennett, C. H. IBM Journal of Research and Development, Vol. 17, Issue 6 https://doi.org/10.1147/rd.176.0525	journal	November 1973
Kolmogorov's Structure Functions and Model Selection Vereshchagin, N. K.; Vitanyi, P. M. B. IEEE Transactions on Information Theory, Vol. 50, Issue 12 https://doi.org/10.1109/TIT.2004.838346	journal	December 2004
The thermodynamics of computation—a review Bennett, Charles H. International Journal of Theoretical Physics, Vol. 21, Issue 12 https://doi.org/10.1007/BF02084158	journal	December 1982
MicroRNA Target Detection and Analysis for Genes Related to Breast Cancer Using MDLcompress Evans, Scott C.; Kourtidis, Antonis; Markham, T. Stephen EURASIP Journal on Bioinformatics and Systems Biology, Vol. 2007 https://doi.org/10.1155/2007/43670	journal	January 2007
On data mining, compression, and Kolmogorov complexity Faloutsos, Christos; Megalooikonomou, Vasileios Data Mining and Knowledge Discovery, Vol. 15, Issue 1 https://doi.org/10.1007/s10618-006-0057-3	journal	January 2007
Green AI Schwartz, Roy; Dodge, Jesse; Smith, Noah A. Communications of the ACM, Vol. 63, Issue 12 https://doi.org/10.1145/3381831	journal	November 2020
Information is Physical Landauer, Rolf Physics Today, Vol. 44, Issue 5 https://doi.org/10.1063/1.881299	journal	May 1991
Thermodynamics of computing with circuits Wolpert, David H.; Kolchinsky, Artemy New Journal of Physics, Vol. 22, Issue 6 https://doi.org/10.1088/1367-2630/ab82b8	journal	June 2020
Thermodynamic costs of Turing machines Kolchinsky, Artemy; Wolpert, David H. Physical Review Research, Vol. 2, Issue 3 https://doi.org/10.1103/PhysRevResearch.2.033312	journal	August 2020
The minimum description length principle for pattern mining: a survey Galbrun, Esther Data Mining and Knowledge Discovery, Vol. 36, Issue 5 https://doi.org/10.1007/s10618-022-00846-z	journal	July 2022

Similar Records

Leveraging Machine Learning Algorithms for Efficient Optimization

Conference · 2023 · OSTI ID:2371792

Fernandez, M G; Schill, W J; Aage, N

Machine-learning informed prediction of high-entropy solid solution formation: Beyond the Hume-Rothery rules

Journal Article · 2020 · npj Computational Materials · OSTI ID:1617776

Pei, Zongrui; Yin, Junqi; Hawk, Jeffrey A.; +2 more

Cycle-by-cycle Delay Estimation at Signalized Intersections by using Machine Learning and Simulated Video Detection Data

Conference · 2023 · 2023 8th International Conference on Models and Technologies for Intelligent Transportation Systems (MT-ITS) · OSTI ID:2453898

Erdagi, Ismet Goksad; Dobrota, Nemanja; Gavric, Slavica; +1 more

Title: The Entropy Economy and the Kolmogorov Learning Cycle: Leveraging the intersection of Machine Learning and Algorithmic Information Theory to jointly optimize energy and learning

Citation Formats

References (12)

Similar Records

Related Subjects