Learning efficient erasure protocols for an underdamped memory

Barros, Nicolas; Whitelam, Stephen; Ciliberto, Sergio; Bellon, Ludovic

doi:10.1103/physreve.111.044114

Learning efficient erasure protocols for an underdamped memory

Journal Article · Thu Apr 10 00:00:00 EDT 2025 · Physical Review. E

DOI:https://doi.org/10.1103/physreve.111.044114· OSTI ID:2565640

^[1]; ^[2]; ^[1]; ^[1]

Centre National de la Recherche Scientifique (CNRS) (France); École normale supérieure de Lyon (France)
Lawrence Berkeley National Laboratory (LBNL), Berkeley, CA (United States). Molecular Foundry

Here we apply evolutionary reinforcement learning to a simulation model to identify efficient time-dependent erasure protocols for a physical realization of a 1-bit memory using an underdamped mechanical cantilever. We show that these protocols, when applied to the cantilever in the laboratory, are considerably more efficient than our best hand-designed protocols. The learned protocols allow reliable high-speed erasure by minimizing the heating of the memory during its operation. More generally, the combination of methods used here opens the door to the rational design of efficient protocols for various physics applications.

View Accepted Manuscript (DOE)

Research Organization:: Lawrence Berkeley National Laboratory (LBNL), Berkeley, CA (United States). Molecular Foundry

Sponsoring Organization:: USDOE Office of Science (SC), Basic Energy Sciences (BES). Scientific User Facilities (SUF)

Grant/Contract Number:: AC02-05CH11231

OSTI ID:: 2565640

Alternate ID(s):: OSTI ID: 2554087

Journal Information:: Physical Review. E, Journal Name: Physical Review. E Journal Issue: 4 Vol. 111; ISSN 2470-0045

Publisher:: American Physical Society (APS)Copyright Statement

Country of Publication:: United States

Language:: English

References (30)

Reliability and Operation Cost of Underdamped Memories during Cyclic Erasures Dago, Salambô; Ciliberto, Sergio; Bellon, Ludovic Advanced Physics Research, Vol. 3, Issue 2 https://doi.org/10.1002/apxr.202300074	journal	October 2023
Stochastic Energetics Sekimoto, Ken Lecture Notes in Physics https://doi.org/10.1007/978-3-642-05411-2	book	January 2010
Shortcuts to Thermodynamic Computing: The Cost of Fast and Faithful Information Processing Boyd, Alexander B.; Patra, Ayoti; Jarzynski, Christopher Journal of Statistical Physics, Vol. 187, Issue 2 https://doi.org/10.1007/s10955-022-02871-0	journal	March 2022
Optimal Control of Underdamped Systems: An Analytic Approach Sanders, Julia; Baldovin, Marco; Muratore-Ginanneschi, Paolo Journal of Statistical Physics, Vol. 191, Issue 9 https://doi.org/10.1007/s10955-024-03320-w	journal	September 2024
Neuroevolution: from architectures to learning Floreano, Dario; Dürr, Peter; Mattiussi, Claudio Evolutionary Intelligence, Vol. 1, Issue 1 https://doi.org/10.1007/s12065-007-0002-4	journal	January 2008
Experimental verification of Landauer’s principle linking information and thermodynamics Bérut, Antoine; Arakelyan, Artak; Petrosyan, Artyom Nature, Vol. 483, Issue 7388 https://doi.org/10.1038/nature10872	journal	March 2012
Learning protocols for the fast and efficient control of active matter Casert, Corneel; Whitelam, Stephen Nature Communications, Vol. 15, Issue 1 https://doi.org/10.1038/s41467-024-52878-2	journal	October 2024
The Fundamental Physical Limits of Computation Bennett, Charles H.; Landauer, Rolf Scientific American, Vol. 253, Issue 1 https://doi.org/10.1038/scientificamerican0785-48	journal	July 1985
Genetic Algorithms Holland, John H. Scientific American, Vol. 267, Issue 1 https://doi.org/10.1038/scientificamerican0792-66	journal	July 1992
Optimal protocols for minimal work processes in underdamped stochastic thermodynamics Gomez-Marin, Alex; Schmiedl, Tim; Seifert, Udo The Journal of Chemical Physics, Vol. 129, Issue 2 https://doi.org/10.1063/1.2948948	journal	July 2008
Thermal noise of microcantilevers in viscous fluids Bellon, L. Journal of Applied Physics, Vol. 104, Issue 10 https://doi.org/10.1063/1.3021102	journal	November 2008
Frequency response of cantilever beams immersed in viscous fluids with applications to the atomic force microscope Sader, John Elie Journal of Applied Physics, Vol. 84, Issue 1 https://doi.org/10.1063/1.368002	journal	July 1998
Quadrature phase interferometer for high resolution force spectroscopy Paolino, Pierdomenico; Aguilar Sandoval, Felipe A.; Bellon, Ludovic Review of Scientific Instruments, Vol. 84, Issue 9 https://doi.org/10.1063/1.4819743	journal	September 2013
Adiabatic computing for optimal thermodynamic efficiency of information processing Dago, Salambô; Ciliberto, Sergio; Bellon, Ludovic Proceedings of the National Academy of Sciences, Vol. 120, Issue 39 https://doi.org/10.1073/pnas.2301742120	journal	September 2023
Virtual double-well potential for an underdamped oscillator created by a feedback loop Dago, Salambô; Pereda, Jorge; Ciliberto, Sergio Journal of Statistical Mechanics: Theory and Experiment, Vol. 2022, Issue 5 https://doi.org/10.1088/1742-5468/ac6d62	journal	May 2022
Learning to grow: Control of material self-assembly using evolutionary reinforcement learning Whitelam, Stephen; Tamblyn, Isaac Physical Review E, Vol. 101, Issue 5 https://doi.org/10.1103/PhysRevE.101.052604	journal	May 2020
Steps minimize dissipation in rapidly driven stochastic systems Blaber, Steven; Louwerse, Miranda D.; Sivak, David A. Physical Review E, Vol. 104, Issue 2 https://doi.org/10.1103/PhysRevE.104.L022101	journal	August 2021
How to train your demon to do fast information erasure without heat production Whitelam, Stephen Physical Review E, Vol. 108, Issue 4 https://doi.org/10.1103/PhysRevE.108.044138	journal	October 2023
Shortcut to finite-time memory erasure Li, Geng; Dong, Hui Physical Review E, Vol. 110, Issue 3 https://doi.org/10.1103/PhysRevE.110.034115	journal	September 2024
Minimal work protocols for inertial particles in nonharmonic traps Sanders, Julia; Baldovin, Marco; Muratore-Ginanneschi, Paolo Physical Review E, Vol. 111, Issue 3 https://doi.org/10.1103/PhysRevE.111.034127	journal	March 2025
Optimal control in nonequilibrium systems: Dynamic Riemannian geometry of the Ising model Rotskoff, Grant M.; Crooks, Gavin E. Physical Review E, Vol. 92, Issue 6 https://doi.org/10.1103/PhysRevE.92.060102	journal	December 2015
High-Precision Test of Landauer’s Principle in a Feedback Trap Jun, Yonggun; Gavrilov, Momčilo; Bechhoefer, John Physical Review Letters, Vol. 113, Issue 19 https://doi.org/10.1103/PhysRevLett.113.190601	journal	November 2014
Finite-Time Landauer Principle Proesmans, Karel; Ehrich, Jannik; Bechhoefer, John Physical Review Letters, Vol. 125, Issue 10 https://doi.org/10.1103/PhysRevLett.125.100602	journal	September 2020
Information and Thermodynamics: Fast and Precise Approach to Landauer's Bound in an Underdamped Micromechanical Oscillator Dago, Salambo; Pereda, Jorge; Barros, Nicolas Physical Review Letters, Vol. 126, Issue 17 https://doi.org/10.1103/PhysRevLett.126.170601	journal	April 2021
Dynamics of Information Erasure and Extension of Landauer’s Bound to Fast Processes Dago, Salambô; Bellon, Ludovic Physical Review Letters, Vol. 128, Issue 7 https://doi.org/10.1103/PhysRevLett.128.070604	journal	February 2022
Non-Markovian momentum computing: Thermodynamically efficient and computation universal Ray, Kyle J.; Boyd, Alexander B.; Wimsatt, Gregory W. Physical Review Research, Vol. 3, Issue 2 https://doi.org/10.1103/PhysRevResearch.3.023164	journal	June 2021
Energetic cost of feedback control Ehrich, Jannik; Still, Susanne; Sivak, David A. Physical Review Research, Vol. 5, Issue 2 https://doi.org/10.1103/PhysRevResearch.5.023080	journal	May 2023
Demon in the Machine: Learning to Extract Work and Absorb Entropy from Fluctuating Nanosystems Whitelam, Stephen Physical Review X, Vol. 13, Issue 2 https://doi.org/10.1103/PhysRevX.13.021005	journal	April 2023
Irreversibility and Heat Generation in the Computing Process Landauer, R. IBM Journal of Research and Development, Vol. 5, Issue 3 https://doi.org/10.1147/rd.53.0183	journal	July 1961
Dataset: Learning efficient erasure protocols for an underdamped memory Barros, Nicolas; Bellon, Ludovic Zenodo https://doi.org/10.5281/zenodo.13829200	dataset	January 2024

Similar Records

Learning protocols for the fast and efficient control of active matter

Journal Article · Tue Oct 22 20:00:00 EDT 2024 · Nature Communications · OSTI ID:2473390

Nonequilibrium formulation of varying-temperature bit erasure

Journal Article · Tue Jun 25 20:00:00 EDT 2024 · Journal of Statistical Mechanics · OSTI ID:2446606

Related Subjects

74 ATOMIC AND MOLECULAR PHYSICS
Artificial neural networks
Optimization problems
Stochastic thermodynamics

Learning efficient erasure protocols for an underdamped memory

Citation Formats

References (30)

Similar Records

Related Subjects