Selective consolidation of learning and memory via recall-gated plasticity

Lindsey, Jack W.; Litwin-Kumar, Ashok

doi:10.7554/eLife.90793

Selective consolidation of learning and memory via recall-gated plasticity

Journal Article · Thu Jul 18 00:00:00 EDT 2024 · eLife

DOI:https://doi.org/10.7554/eLife.90793· OSTI ID:2404443

;

In a variety of species and behavioral contexts, learning and memory formation recruits two neural systems, with initial plasticity in one system being consolidated into the other over time. Moreover, consolidation is known to be selective; that is, some experiences are more likely to be consolidated into long-term memory than others. Here, we propose and analyze a model that captures common computational principles underlying such phenomena. The key component of this model is a mechanism by which a long-term learning and memory system prioritizes the storage of synaptic changes that are consistent with prior updates to the short-term system. This mechanism, which we refer to as recall-gated consolidation, has the effect of shielding long-term memory from spurious synaptic changes, enabling it to focus on reliable signals in the environment. We describe neural circuit implementations of this model for different types of learning problems, including supervised learning, reinforcement learning, and autoassociative memory storage. These implementations involve synaptic plasticity rules modulated by factors such as prediction accuracy, decision confidence, or familiarity. We then develop an analytical theory of the learning and memory performance of the model, in comparison to alternatives relying only on synapse-local consolidation mechanisms. We find that recall-gated consolidation provides significant advantages, substantially amplifying the signal-to-noise ratio with which memories can be stored in noisy environments. We show that recall-gated consolidation gives rise to a number of phenomena that are present in behavioral learning paradigms, including spaced learning effects, task-dependent rates of consolidation, and differing neural representations in short- and long-term pathways.

View Journal Article

Sponsoring Organization:: USDOE

OSTI ID:: 2404443

Alternate ID(s):: OSTI ID: 2404444
OSTI ID: 2471921

Journal Information:: eLife, Journal Name: eLife Vol. 12; ISSN 2050-084X

Publisher:: eLife Sciences Publications, Ltd.Copyright Statement

Country of Publication:: United States

Language:: English

References (53)

Considerations arising from a complementary learning systems perspective on hippocampus and neocortex McClelland, James L.; Goddard, Nigel H. Hippocampus, Vol. 6, Issue 6 https://doi.org/10.1002/(SICI)1098-1063(1996)6:6<654::AID-HIPO8>3.0.CO;2-G	journal	January 1996
Hippocampal mediation of stimulus representation: A computational theory Gluck, Mark A.; Myers, Catherine E. Hippocampus, Vol. 3, Issue 4 https://doi.org/10.1002/hipo.450030410	journal	October 1993
Knowledge Distillation: A Survey Gou, Jianping; Yu, Baosheng; Maybank, Stephen J. International Journal of Computer Vision, Vol. 129, Issue 6 https://doi.org/10.1007/s11263-021-01453-z	journal	March 2021
The time window hypothesis: Spacing effects Rovee-Collier, Carolyn; Evancio, Sharon; Earley, Linda A. Infant Behavior and Development, Vol. 18, Issue 1 https://doi.org/10.1016/0163-6383(95)90008-X	journal	January 1995
Short-term, intermediate-term, and long-term memories Rosenzweig, Mark R.; Bennett, Edward L.; Colombo, Paul J. Behavioural Brain Research, Vol. 57, Issue 2 https://doi.org/10.1016/0166-4328(93)90135-d	journal	November 1993
Retrograde amnesia and memory consolidation: a neurobiological perspective Squire, Larry R.; Alvarez, Pablo Current Opinion in Neurobiology, Vol. 5, Issue 2 https://doi.org/10.1016/0959-4388(95)80023-9	journal	April 1995
The Molecular and Systems Biology of Memory Kandel, Eric R.; Dudai, Yadin; Mayford, Mark R. Cell, Vol. 157, Issue 1 https://doi.org/10.1016/j.cell.2014.03.001	journal	March 2014
Systems memory consolidation in Drosophila Dubnau, Josh; Chiang, Ann-Shyn Current Opinion in Neurobiology, Vol. 23, Issue 1 https://doi.org/10.1016/j.conb.2012.09.006	journal	February 2013
The Role of Hippocampal Replay in Memory and Planning Ólafsdóttir, H. Freyja; Bush, Daniel; Barry, Caswell Current Biology, Vol. 28, Issue 1 https://doi.org/10.1016/j.cub.2017.10.073	journal	January 2018
Spaced training enhances memory and prefrontal ensemble stability in mice Glas, Annet; Hübener, Mark; Bonhoeffer, Tobias Current Biology, Vol. 31, Issue 18 https://doi.org/10.1016/j.cub.2021.06.085	journal	September 2021
Cascade Models of Synaptically Stored Memories Fusi, Stefano; Drew, Patrick J.; Abbott, L. F. Neuron, Vol. 45, Issue 4 https://doi.org/10.1016/j.neuron.2005.02.001	journal	February 2005
Traces of Drosophila Memory Davis, Ronald L. Neuron, Vol. 70, Issue 1 https://doi.org/10.1016/j.neuron.2011.03.012	journal	April 2011
Sparseness and Expansion in Sensory Representations Babadi, Baktash; Sompolinsky, Haim Neuron, Vol. 83, Issue 5 https://doi.org/10.1016/j.neuron.2014.07.035	journal	September 2014
Motor Cortex Is Required for Learning but Not for Executing a Motor Skill Kawai, Risa; Markman, Timothy; Poddar, Rajesh Neuron, Vol. 86, Issue 3 https://doi.org/10.1016/j.neuron.2015.03.024	journal	May 2015
Actor–critic models of the basal ganglia: new anatomical and computational perspectives Joel, Daphna; Niv, Yael; Ruppin, Eytan Neural Networks, Vol. 15, Issue 4-6 https://doi.org/10.1016/s0893-6080(02)00047-3	journal	June 2002
Limitations to the Spacing Effect Verkoeijen, Peter P. J. L.; Rikers, Remy M. J. P.; Schmidt, Henk G. Experimental Psychology, Vol. 52, Issue 4 https://doi.org/10.1027/1618-3169.52.4.257	journal	January 2005
Distributed practice in verbal recall tasks: A review and quantitative synthesis. Cepeda, Nicholas J.; Pashler, Harold; Vul, Edward Psychological Bulletin, Vol. 132, Issue 3 https://doi.org/10.1037/0033-2909.132.3.354	journal	January 2006
Why there are complementary learning systems in the hippocampus and neocortex: Insights from the successes and failures of connectionist models of learning and memory. McClelland, James L.; McNaughton, Bruce L.; O'Reilly, Randall C. Psychological Review, Vol. 102, Issue 3 https://doi.org/10.1037/0033-295X.102.3.419	journal	July 1995
Hippocampal replay in the awake state: a potential substrate for memory consolidation and retrieval Carr, Margaret F.; Jadhav, Shantanu P.; Frank, Loren M. Nature Neuroscience, Vol. 14, Issue 2 https://doi.org/10.1038/nn.2732	journal	January 2011
Computational principles of synaptic memory consolidation Benna, Marcus K.; Fusi, Stefano Nature Neuroscience, Vol. 19, Issue 12 https://doi.org/10.1038/nn.4401	journal	October 2016
The organization of recent and remote memories Frankland, Paul W.; Bontempi, Bruno Nature Reviews Neuroscience, Vol. 6, Issue 2 https://doi.org/10.1038/nrn1607	journal	February 2005
Brain-inspired replay for continual learning with artificial neural networks van de Ven, Gido M.; Siegelmann, Hava T.; Tolias, Andreas S. Nature Communications, Vol. 11, Issue 1 https://doi.org/10.1038/s41467-020-17866-2	journal	August 2020
Remembrance of things practiced with fast and slow learning in cortical and subcortical pathways Murray, James M.; Escola, G. Sean Nature Communications, Vol. 11, Issue 1 https://doi.org/10.1038/s41467-020-19788-5	journal	December 2020
Computational models of episodic-like memory in food-caching birds Brea, Johanni; Clayton, Nicola S.; Gerstner, Wulfram Nature Communications, Vol. 14, Issue 1 https://doi.org/10.1038/s41467-023-38570-x	journal	May 2023
Adaptive stimulus selection for consolidation in the hippocampus Terada, Satoshi; Geiller, Tristan; Liao, Zhenrui Nature, Vol. 601, Issue 7892 https://doi.org/10.1038/s41586-021-04118-6	journal	December 2021
The basal ganglia control the detailed kinematics of learned motor skills Dhawale, Ashesh K.; Wolff, Steffen B. E.; Ko, Raymond Nature Neuroscience, Vol. 24, Issue 9 https://doi.org/10.1038/s41593-021-00889-3	journal	July 2021
A basal ganglia-forebrain circuit in the songbird biases motor output to avoid vocal errors Andalman, Aaron S.; Fee, Michale S. Proceedings of the National Academy of Sciences, Vol. 106, Issue 30 https://doi.org/10.1073/pnas.0903214106	journal	July 2009
Rapid and independent memory formation in the parietal cortex Brodt, Svenja; Pöhlchen, Dorothee; Flanagin, Virginia L. Proceedings of the National Academy of Sciences, Vol. 113, Issue 46 https://doi.org/10.1073/pnas.1605719113	journal	November 2016
The neural circuit linking mushroom body parallel circuits induces memory consolidation in Drosophila Awata, Hiroko; Takakura, Mai; Kimura, Yoko Proceedings of the National Academy of Sciences, Vol. 116, Issue 32 https://doi.org/10.1073/pnas.1901292116	journal	July 2019
Neural networks and physical systems with emergent collective computational abilities. Hopfield, J. J. Proceedings of the National Academy of Sciences, Vol. 79, Issue 8 https://doi.org/10.1073/pnas.79.8.2554	journal	April 1982
The space of interactions in neural network models Gardner, E. Journal of Physics A: Mathematical and General, Vol. 21, Issue 1 https://doi.org/10.1088/0305-4470/21/1/030	journal	January 1988
Stochastic Consolidation of Lifelong Memory Shaham, Nimrod; Chandra, Jay; Kreiman, Gabriel bioRxiv https://doi.org/10.1101/2021.08.24.457446	preprint	August 2021
Organizing memories for generalization in complementary learning systems Sun, Weinan; Advani, Madhu; Spruston, Nelson bioRxiv https://doi.org/10.1101/2021.10.13.463791	preprint	January 2023
The Role of Experience in Prioritizing Hippocampal Replay Gorriz, M. Huelin; Takigawa, M.; Bendor, D. bioRxiv https://doi.org/10.1101/2023.03.28.534589	preprint	March 2023
Dynamics of striatal action selection and reinforcement learning Lindsey, Jack; Markowitz, Jeffrey E.; Datta, Sandeep Robert bioRxiv https://doi.org/10.1101/2024.02.14.580408	preprint	February 2024
The basal ganglia can control learned motor sequences independently of motor cortex Dhawale, Ashesh K.; Wolff, Steffen B. E.; Ko, Raymond bioRxiv https://doi.org/10.1101/827261	preprint	November 2019
Spacing Effects in Learning Cepeda, Nicholas J.; Vul, Edward; Rohrer, Doug Psychological Science, Vol. 19, Issue 11 https://doi.org/10.1111/j.1467-9280.2008.02209.x	journal	November 2008
Disengagement of motor cortex from movement control during long-term learning Hwang, Eun Jung; Dahlen, Jeffrey E.; Hu, Yvonne Yuling Science Advances, Vol. 5, Issue 10 https://doi.org/10.1126/sciadv.aay0001	journal	October 2019
Mechanisms and time course of vocal learning and consolidation in the adult songbird Warren, Timothy L.; Tumer, Evren C.; Charlesworth, Jonathan D. Journal of Neurophysiology, Vol. 106, Issue 4 https://doi.org/10.1152/jn.00311.2011	journal	October 2011
Learning in Neural Networks with Material Synapses Amit, Daniel J.; Fusi, Stefano Neural Computation, Vol. 6, Issue 5 https://doi.org/10.1162/neco.1994.6.5.957	journal	September 1994
Efficient Partitioning of Memory Systems and Its Importance for Memory Consolidation Roxin, Alex; Fusi, Stefano PLoS Computational Biology, Vol. 9, Issue 7 https://doi.org/10.1371/journal.pcbi.1003146	journal	July 2013
Hebbian plasticity in parallel synaptic pathways: A circuit mechanism for systems memory consolidation Remme, Michiel W. H.; Bergmann, Urs; Alevi, Denis PLOS Computational Biology, Vol. 17, Issue 12 https://doi.org/10.1371/journal.pcbi.1009681	journal	December 2021
System-Like Consolidation of Olfactory Memories in Drosophila Cervantes-Sandoval, I.; Martin-Pena, A.; Berry, J. A. Journal of Neuroscience, Vol. 33, Issue 23 https://doi.org/10.1523/JNEUROSCI.0451-13.2013	journal	June 2013
Performance-Dependent Consolidation of Learned Vocal Changes in Adult Songbirds Tachibana, Ryosuke O.; Lee, Dahyun; Kai, Kazuki The Journal of Neuroscience, Vol. 42, Issue 10 https://doi.org/10.1523/JNEUROSCI.1942-21.2021	journal	January 2022
Learning Performance of Normal and MutantDrosophilaafter Repeated Conditioning Trials with Discrete Stimuli Beck, C. D. O.; Schroeder, Bradley; Davis, Ronald L. The Journal of Neuroscience, Vol. 20, Issue 8 https://doi.org/10.1523/JNEUROSCI.20-08-02944.2000	journal	April 2000
Disengagement of Motor Cortex during Long-Term Learning Tracks the Performance Level of Learned Movements Hwang, Eun Jung; Dahlen, Jeffrey E.; Mukundan, Madan The Journal of Neuroscience, Vol. 41, Issue 33 https://doi.org/10.1523/JNEUROSCI.3049-20.2021	journal	July 2021
Hippocampal Sharp Waves and Reactivation during Awake States Depend on Repeated Sequential Experience Jackson, Jadin C.; Johnson, Adam; Redish, A. David The Journal of Neuroscience, Vol. 26, Issue 48 https://doi.org/10.1523/JNEUROSCI.4118-06.2006	journal	November 2006
Neuromodulated Spike-Timing-Dependent Plasticity, and Theory of Three-Factor Learning Rules Frémaux, Nicolas; Gerstner, Wulfram Frontiers in Neural Circuits, Vol. 9 https://doi.org/10.3389/fncir.2015.00085	journal	January 2016
The neuronal architecture of the mushroom body provides a logic for associative learning Aso, Yoshinori; Hattori, Daisuke; Yu, Yang eLife, Vol. 3 https://doi.org/10.7554/eLife.04577	journal	December 2014
Rules and mechanisms for efficient two-stage learning in neural circuits Teşileanu, Tiberiu; Ölveczky, Bence; Balasubramanian, Vijay eLife, Vol. 6 https://doi.org/10.7554/eLife.20944	journal	April 2017
Learning multiple variable-speed sequences in striatum via cortical tutoring Murray, James M.; Escola, G. Sean eLife, Vol. 6 https://doi.org/10.7554/eLife.26084	journal	May 2017
Can sleep protect memories from catastrophic forgetting? González, Oscar C.; Sokolov, Yury; Krishnan, Giri P. eLife, Vol. 9 https://doi.org/10.7554/eLife.51005	journal	August 2020
The connectome of the adult Drosophila mushroom body provides insights into function Li, Feng; Lindsey, Jack W.; Marin, Elizabeth C. eLife, Vol. 9 https://doi.org/10.7554/eLife.62576	journal	December 2020

Similar Records

Selective consolidation of learning and memory via recall-gated plasticity

Journal Article · Thu Jul 18 00:00:00 EDT 2024 · eLife · OSTI ID:2404460

Selective consolidation of learning and memory via recall-gated plasticity

Citation Formats

References (53)

Similar Records

Related Subjects