Three-terminal magnetic tunnel junction synapse circuits showing spike-timing-dependent plasticity
Abstract
There have been recent efforts towards the development of biologically-inspired neuromorphic devices and architecture. In this work, we demonstrate a synapse circuit that is designed to perform spike-timing-dependent plasticity which works with the leaky, integrate, and fire neuron in a neuromorphic computing architecture. The circuit consists of a three-terminal magnetic tunnel junction with a mobile domain wall between two low-pass filters and has been modeled in SPICE. The findings show that the current flowing through the synapse is highly correlated to the timing delay between the pre-synaptic and post-synaptic neurons. Using micromagnetic simulations, we show that introducing notches along the length of the domain wall track pins the domain wall at each successive notch to properly respond to the timing between the input and output current pulses of the circuit, producing a multi-state resistance representing synaptic weights. We show in SPICE that a notch-free ideal magnetic device also shows spike-timing dependent plasticity in response to the circuit current. This work is key progress towards making more bio-realistic artificial synapses with multiple weights, which can be trained online with a promise of CMOS compatibility and energy efficiency.
- Authors:
-
- Univ. of Texas, Austin, TX (United States)
- Univ. of Texas at Dallas, Richardson, TX (United States)
- Sandia National Lab. (SNL-NM), Albuquerque, NM (United States)
- Publication Date:
- Research Org.:
- Sandia National Lab. (SNL-NM), Albuquerque, NM (United States)
- Sponsoring Org.:
- USDOE National Nuclear Security Administration (NNSA)
- OSTI Identifier:
- 1574455
- Report Number(s):
- SAND-2019-12134J
Journal ID: ISSN 0022-3727; 680164; TRN: US2001334
- Grant/Contract Number:
- AC04-94AL85000; NA0003525
- Resource Type:
- Accepted Manuscript
- Journal Name:
- Journal of Physics. D, Applied Physics
- Additional Journal Information:
- Journal Volume: 52; Journal Issue: 49; Journal ID: ISSN 0022-3727
- Publisher:
- IOP Publishing
- Country of Publication:
- United States
- Language:
- English
- Subject:
- 42 ENGINEERING; Synapse; neuromorphic; magnetic tunnel junction; plasticity; domain wall
Citation Formats
Akinola, Otitoaleke, Hu, Xuan, Bennett, Christopher H., Marinella, Matthew, Friedman, Joseph S., and Incorvia, Jean Anne C. Three-terminal magnetic tunnel junction synapse circuits showing spike-timing-dependent plasticity. United States: N. p., 2019.
Web. doi:10.1088/1361-6463/ab4157.
Akinola, Otitoaleke, Hu, Xuan, Bennett, Christopher H., Marinella, Matthew, Friedman, Joseph S., & Incorvia, Jean Anne C. Three-terminal magnetic tunnel junction synapse circuits showing spike-timing-dependent plasticity. United States. https://doi.org/10.1088/1361-6463/ab4157
Akinola, Otitoaleke, Hu, Xuan, Bennett, Christopher H., Marinella, Matthew, Friedman, Joseph S., and Incorvia, Jean Anne C. Mon .
"Three-terminal magnetic tunnel junction synapse circuits showing spike-timing-dependent plasticity". United States. https://doi.org/10.1088/1361-6463/ab4157. https://www.osti.gov/servlets/purl/1574455.
@article{osti_1574455,
title = {Three-terminal magnetic tunnel junction synapse circuits showing spike-timing-dependent plasticity},
author = {Akinola, Otitoaleke and Hu, Xuan and Bennett, Christopher H. and Marinella, Matthew and Friedman, Joseph S. and Incorvia, Jean Anne C.},
abstractNote = {There have been recent efforts towards the development of biologically-inspired neuromorphic devices and architecture. In this work, we demonstrate a synapse circuit that is designed to perform spike-timing-dependent plasticity which works with the leaky, integrate, and fire neuron in a neuromorphic computing architecture. The circuit consists of a three-terminal magnetic tunnel junction with a mobile domain wall between two low-pass filters and has been modeled in SPICE. The findings show that the current flowing through the synapse is highly correlated to the timing delay between the pre-synaptic and post-synaptic neurons. Using micromagnetic simulations, we show that introducing notches along the length of the domain wall track pins the domain wall at each successive notch to properly respond to the timing between the input and output current pulses of the circuit, producing a multi-state resistance representing synaptic weights. We show in SPICE that a notch-free ideal magnetic device also shows spike-timing dependent plasticity in response to the circuit current. This work is key progress towards making more bio-realistic artificial synapses with multiple weights, which can be trained online with a promise of CMOS compatibility and energy efficiency.},
doi = {10.1088/1361-6463/ab4157},
journal = {Journal of Physics. D, Applied Physics},
number = 49,
volume = 52,
place = {United States},
year = {Mon Sep 23 00:00:00 EDT 2019},
month = {Mon Sep 23 00:00:00 EDT 2019}
}
Web of Science
Works referenced in this record:
Modelling the molecular mechanisms of synaptic plasticity using systems biology approaches
journal, April 2010
- Kotaleski, Jeanette Hellgren; Blackwell, Kim T.
- Nature Reviews Neuroscience, Vol. 11, Issue 4
Selective domain wall depinning by localized Oersted fields and Joule heating
journal, September 2008
- Ilgaz, Dennis; Kläui, Mathias; Heyne, Lutz
- Applied Physics Letters, Vol. 93, Issue 13
Single pairing spike-timing dependent plasticity in BiFeO3 memristors with a time window of 25 ms to 125 μs
journal, June 2015
- Du, Nan; Kiani, Mahdi; Mayr, Christian G.
- Frontiers in Neuroscience, Vol. 9
Integrate-and-Fire (I&F) Neuron Circuit Using Resistive-Switching Random Access Memory (RRAM)
journal, May 2017
- Kwon, Min-Woo; Kim, Sungjun; Kim, Min-Hwi
- Journal of Nanoscience and Nanotechnology, Vol. 17, Issue 5
Ground and river water quality monitoring using a smartphone-based pH sensor
journal, May 2015
- Dutta, Sibasish; Sarma, Dhrubajyoti; Nath, Pabitra
- AIP Advances, Vol. 5, Issue 5
Spike timing dependent plasticity: a consequence of more fundamental learning rules
journal, January 2010
- Shouval, Harel
- Frontiers in Computational Neuroscience
The design and verification of MuMax3
journal, October 2014
- Vansteenkiste, Arne; Leliaert, Jonathan; Dvornik, Mykola
- AIP Advances, Vol. 4, Issue 10
Reliable Multivalued Conductance States in TaO x Memristors through Oxygen Plasma-Assisted Electrode Deposition with in Situ-Biased Conductance State Transmission Electron Microscopy Analysis
journal, July 2018
- Lee, Myoung-Jae; Park, Gyeong-Su; Seo, David H.
- ACS Applied Materials & Interfaces, Vol. 10, Issue 35
Stochastic Properties of Synaptic Transmission Affect the Shape of Spike Time–Dependent Plasticity Curves
journal, February 2005
- Shouval, Harel Z.; Kalantzis, Georgios
- Journal of Neurophysiology, Vol. 93, Issue 2
Mechanisms of induction and maintenance of spike-timing dependent plasticity in biophysical synapse models
journal, January 2010
- Graupner, Michael
- Frontiers in Computational Neuroscience, Vol. 4
The Formation of Multi-synaptic Connections by the Interaction of Synaptic and Structural Plasticity and Their Functional Consequences
journal, January 2015
- Fauth, Michael; Wörgötter, Florentin; Tetzlaff, Christian
- PLOS Computational Biology, Vol. 11, Issue 1
Neuromodulated Spike-Timing-Dependent Plasticity, and Theory of Three-Factor Learning Rules
journal, January 2016
- Frémaux, Nicolas; Gerstner, Wulfram
- Frontiers in Neural Circuits, Vol. 9
Ultrastructural Characterization of the Lower Motor System in a Mouse Model of Krabbe Disease
journal, December 2016
- Cappello, Valentina; Marchetti, Laura; Parlanti, Paola
- Scientific Reports, Vol. 6, Issue 1
Capacity analysis in multi-state synaptic models: a retrieval probability perspective
journal, October 2010
- Huang, Yibi; Amit, Yali
- Journal of Computational Neuroscience, Vol. 30, Issue 3
Synchronous Circuit Design With Beyond-CMOS Magnetoelectric Spin–Orbit Devices Toward 100-mV Logic
journal, June 2019
- Liu, Huichu; Manipatruni, Sasikanth; Morris, Daniel H.
- IEEE Journal on Exploratory Solid-State Computational Devices and Circuits, Vol. 5, Issue 1
Synaptic computation
journal, October 2004
- Abbott, L. F.; Regehr, Wade G.
- Nature, Vol. 431, Issue 7010
Benchmarking of Beyond-CMOS Exploratory Devices for Logic Integrated Circuits
journal, January 2015
- Nikonov, Dmitri E.; Young, Ian A.
- IEEE Journal on Exploratory Solid-State Computational Devices and Circuits, Vol. 1
Phase change memory as synapse for ultra-dense neuromorphic systems: Application to complex visual pattern extraction
conference, December 2011
- Suri, Manan; Bichler, Olivier; Querlioz, Damien
- 2011 IEEE International Electron Devices Meeting (IEDM), 2011 International Electron Devices Meeting
Reservoir computing using dynamic memristors for temporal information processing
journal, December 2017
- Du, Chao; Cai, Fuxi; Zidan, Mohammed A.
- Nature Communications, Vol. 8, Issue 1
Current-driven domain-wall motion in magnetic wires with asymmetric notches
journal, December 2005
- Himeno, A.; Kasai, S.; Ono, T.
- Applied Physics Letters, Vol. 87, Issue 24
Current-driven domain-wall depinning
journal, July 2005
- He, J.; Li, Z.; Zhang, S.
- Journal of Applied Physics, Vol. 98, Issue 1
Track heating study for current-induced domain wall motion experiments
journal, December 2010
- Curiale, J.; Lemaître, A.; Faini, G.
- Applied Physics Letters, Vol. 97, Issue 24
Spintronic Nanodevices for Bioinspired Computing
journal, October 2016
- Grollier, Julie; Querlioz, Damien; Stiles, Mark D.
- Proceedings of the IEEE, Vol. 104, Issue 10
Magnetic domain wall neuron with lateral inhibition
journal, October 2018
- Hassan, Naimul; Hu, Xuan; Jiang-Wei, Lucian
- Journal of Applied Physics, Vol. 124, Issue 15
Filamentary Switching: Synaptic Plasticity through Device Volatility
journal, January 2015
- La Barbera, Selina; Vuillaume, Dominique; Alibart, Fabien
- ACS Nano, Vol. 9, Issue 1
Spin-Transfer Torque Magnetic Memory as a Stochastic Memristive Synapse for Neuromorphic Systems
journal, April 2015
- Vincent, Adrien F.; Larroque, Jerome; Locatelli, Nicolas
- IEEE Transactions on Biomedical Circuits and Systems, Vol. 9, Issue 2
Proposal for an All-Spin Artificial Neural Network: Emulating Neural and Synaptic Functionalities Through Domain Wall Motion in Ferromagnets
journal, December 2016
- Sengupta, Abhronil; Shim, Yong; Roy, Kaushik
- IEEE Transactions on Biomedical Circuits and Systems, Vol. 10, Issue 6
Composable Probabilistic Inference Networks Using MRAM-based Stochastic Neurons
journal, March 2019
- Zand, Ramtin; Camsari, Kerem Y.; Datta, Supriyo
- ACM Journal on Emerging Technologies in Computing Systems, Vol. 15, Issue 2
Neuromorphic computing enabled by physics of electron spins: Prospects and perspectives
journal, February 2018
- Sengupta, Abhronil; Roy, Kaushik
- Applied Physics Express, Vol. 11, Issue 3
Short-Term Memory to Long-Term Memory Transition in a Nanoscale Memristor
journal, August 2011
- Chang, Ting; Jo, Sung-Hyun; Lu, Wei
- ACS Nano, Vol. 5, Issue 9
All Spin Artificial Neural Networks Based on Compound Spintronic Synapse and Neuron
journal, August 2016
- Zhang, Deming; Zhao, Weisheng; Zeng, Lang
- IEEE Transactions on Biomedical Circuits and Systems, Vol. 10, Issue 4
SPICE-Only Model for Spin-Transfer Torque Domain Wall MTJ Logic
journal, June 2019
- Hu, Xuan; Timm, Andrew; Brigner, Wesley H.
- IEEE Transactions on Electron Devices, Vol. 66, Issue 6
The emergence of spin electronics in data storage
journal, November 2007
- Chappert, Claude; Fert, Albert; Van Dau, Frédéric Nguyen
- Nature Materials, Vol. 6, Issue 11
Spin wave based synapse and neuron for ultra low power neuromorphic computation system
conference, May 2016
- Zeng, Lang; Zhang, Deming; Zhang, Youguang
- 2016 IEEE International Symposium on Circuits and Systems (ISCAS)
Low Energy Magnetic Domain Wall Logic in Short, Narrow, Ferromagnetic Wires
journal, January 2012
- Currivan, Jean Anne; Mascaro, M. D.
- IEEE Magnetics Letters, Vol. 3
Logic circuit prototypes for three-terminal magnetic tunnel junctions with mobile domain walls
journal, January 2016
- Currivan-Incorvia, J. A.; Siddiqui, S.; Dutta, S.
- Nature Communications, Vol. 7, Issue 1
Synaptic plasticity and learning behaviours mimicked through Ag interface movement in an Ag/conducting polymer/Ta memristive system
journal, January 2013
- Li, Sizhao; Zeng, Fei; Chen, Chao
- Journal of Materials Chemistry C, Vol. 1, Issue 34
Emerging Memory Devices for Neuromorphic Computing
journal, January 2019
- Upadhyay, Navnidhi K.; Jiang, Hao; Wang, Zhongrui
- Advanced Materials Technologies, Vol. 4, Issue 4
Neuromorphic computing using non-volatile memory
journal, October 2016
- Burr, Geoffrey W.; Shelby, Robert M.; Sebastian, Abu
- Advances in Physics: X, Vol. 2, Issue 1
Exploiting the short-term to long-term plasticity transition in memristive nanodevice learning architectures
conference, July 2016
- Bennett, Christopher H.; La Barbera, Selina; Vincent, Adrien F.
- 2016 International Joint Conference on Neural Networks (IJCNN)
Encoding neural and synaptic functionalities in electron spin: A pathway to efficient neuromorphic computing
journal, December 2017
- Sengupta, Abhronil; Roy, Kaushik
- Applied Physics Reviews, Vol. 4, Issue 4
Spin orbit torques and Dzyaloshinskii-Moriya interaction in dual-interfaced Co-Ni multilayers
journal, September 2016
- Yu, Jiawei; Qiu, Xuepeng; Wu, Yang
- Scientific Reports, Vol. 6, Issue 1
Magnetic Tunnel Junction Based Long-Term Short-Term Stochastic Synapse for a Spiking Neural Network with On-Chip STDP Learning
journal, July 2016
- Srinivasan, Gopalakrishnan; Sengupta, Abhronil; Roy, Kaushik
- Scientific Reports, Vol. 6, Issue 1
Synaptic Modification by Correlated Activity: Hebb's Postulate Revisited
journal, March 2001
- Bi, Guo-qiang; Poo, Mu-ming
- Annual Review of Neuroscience, Vol. 24, Issue 1
Overview of Beyond-CMOS Devices and a Uniform Methodology for Their Benchmarking
journal, December 2013
- Nikonov, Dmitri E.; Young, Ian A.
- Proceedings of the IEEE, Vol. 101, Issue 12
Spin–orbit torques in action
journal, February 2014
- Brataas, Arne; Hals, Kjetil M. D.
- Nature Nanotechnology, Vol. 9, Issue 2
Chain of magnetic tunnel junctions as a spintronic memristor
journal, October 2018
- Raymenants, Eline; Vaysset, Adrien; Wan, Danny
- Journal of Applied Physics, Vol. 124, Issue 15
Magnetic Domain-Wall Racetrack Memory
journal, April 2008
- Parkin, S. S. P.; Hayashi, M.; Thomas, L.
- Science, Vol. 320, Issue 5873, p. 190-194
Demonstration of spike timing dependent plasticity in CBRAM devices with silicon neurons
conference, May 2016
- Mahalanabis, D.; Sivaraj, M.; Chen, W.
- 2016 IEEE International Symposium on Circuits and Systems (ISCAS)
Publisher’s Note: “Reduction of internal polarization fields in InGaN quantum wells by InGaN/AlGaN ultra-thin superlattice barriers with different indium” [J. Appl. Phys. 110, 123108 (2011)]
journal, February 2012
- Noh, Young-Kyun; Kim, Moon-Deock; Oh, Jae-Eung
- Journal of Applied Physics, Vol. 111, Issue 3
Energy-efficient neuromorphic computation based on compound spin synapse with stochastic learning
conference, May 2015
- Zhang, Deming; Zeng, Lang; Qu, Yuanzhuo
- 2015 IEEE International Symposium on Circuits and Systems (ISCAS)
Perspective: Spintronic synapse for artificial neural network
journal, October 2018
- Fukami, Shunsuke; Ohno, Hideo
- Journal of Applied Physics, Vol. 124, Issue 15
Current-Controlled Magnetic Domain-Wall Nanowire Shift Register
journal, April 2008
- Hayashi, M.; Thomas, L.; Moriya, R.
- Science, Vol. 320, Issue 5873
Self-Adaptive Spike-Time-Dependent Plasticity of Metal-Oxide Memristors
journal, February 2016
- Prezioso, M.; Merrikh Bayat, F.; Hoskins, B.
- Scientific Reports, Vol. 6, Issue 1
Current-induced domain wall motion
journal, April 2008
- Beach, G. S. D.; Tsoi, M.; Erskine, J. L.
- Journal of Magnetism and Magnetic Materials, Vol. 320, Issue 7
The formation of multi-synaptic connections by the interaction of synaptic and structural plasticity and their functional consequences
text, January 2014
- Fauth, Michael; Wörgötter, Florentin; Tetzlaff, Christian
- G-Node
Composable Probabilistic Inference Networks Using MRAM-based Stochastic Neurons
text, January 2018
- Zand, Ramtin; Camsari, Kerem Yunus; Datta, Supriyo
- Unpublished
The formation of multi-synaptic connections by the interaction of synaptic and structural plasticity and their functional consequences
journal, July 2014
- Fauth, Michael; Wörgötter, Florentin; Tetzlaff, Christian
- BMC Neuroscience, Vol. 15, Issue S1
Self-Adaptive Spike-Time-Dependent Plasticity of Metal-Oxide Memristors
text, January 2015
- Prezioso, M.; Merrikh-Bayat, F.; Hoskins, B.
- arXiv
Proposal for an All-Spin Artificial Neural Network: Emulating Neural and Synaptic Functionalities Through Domain Wall Motion in Ferromagnets
text, January 2015
- Sengupta, Abhronil; Shim, Yong; Roy, Kaushik
- arXiv
Spin orbit torques and Dzyaloshinskii-Moriya interaction in dual-interfaced Co-Ni multilayers
text, January 2016
- Yu, Jiawei; Qiu, Xuepeng; Wu, Yang
- arXiv
Encoding Neural and Synaptic Functionalities in Electron Spin: A Pathway to Efficient Neuromorphic Computing
preprint, January 2017
- Sengupta, Abhronil; Roy, Kaushik
- arXiv
Current-driven domain wall motion in magnetic wires with asymmetric notches
text, January 2005
- Himeno, A.; Kasai, S.; Ono, T.
- arXiv