DOE PAGES title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: Three-terminal magnetic tunnel junction synapse circuits showing spike-timing-dependent plasticity

Abstract

There have been recent efforts towards the development of biologically-inspired neuromorphic devices and architecture. In this work, we demonstrate a synapse circuit that is designed to perform spike-timing-dependent plasticity which works with the leaky, integrate, and fire neuron in a neuromorphic computing architecture. The circuit consists of a three-terminal magnetic tunnel junction with a mobile domain wall between two low-pass filters and has been modeled in SPICE. The findings show that the current flowing through the synapse is highly correlated to the timing delay between the pre-synaptic and post-synaptic neurons. Using micromagnetic simulations, we show that introducing notches along the length of the domain wall track pins the domain wall at each successive notch to properly respond to the timing between the input and output current pulses of the circuit, producing a multi-state resistance representing synaptic weights. We show in SPICE that a notch-free ideal magnetic device also shows spike-timing dependent plasticity in response to the circuit current. This work is key progress towards making more bio-realistic artificial synapses with multiple weights, which can be trained online with a promise of CMOS compatibility and energy efficiency.

Authors:
ORCiD logo [1]; ORCiD logo [2]; ORCiD logo [3];  [3]; ORCiD logo [2]; ORCiD logo [1]
  1. Univ. of Texas, Austin, TX (United States)
  2. Univ. of Texas at Dallas, Richardson, TX (United States)
  3. Sandia National Lab. (SNL-NM), Albuquerque, NM (United States)
Publication Date:
Research Org.:
Sandia National Lab. (SNL-NM), Albuquerque, NM (United States)
Sponsoring Org.:
USDOE National Nuclear Security Administration (NNSA)
OSTI Identifier:
1574455
Report Number(s):
SAND-2019-12134J
Journal ID: ISSN 0022-3727; 680164; TRN: US2001334
Grant/Contract Number:  
AC04-94AL85000; NA0003525
Resource Type:
Accepted Manuscript
Journal Name:
Journal of Physics. D, Applied Physics
Additional Journal Information:
Journal Volume: 52; Journal Issue: 49; Journal ID: ISSN 0022-3727
Publisher:
IOP Publishing
Country of Publication:
United States
Language:
English
Subject:
42 ENGINEERING; Synapse; neuromorphic; magnetic tunnel junction; plasticity; domain wall

Citation Formats

Akinola, Otitoaleke, Hu, Xuan, Bennett, Christopher H., Marinella, Matthew, Friedman, Joseph S., and Incorvia, Jean Anne C. Three-terminal magnetic tunnel junction synapse circuits showing spike-timing-dependent plasticity. United States: N. p., 2019. Web. doi:10.1088/1361-6463/ab4157.
Akinola, Otitoaleke, Hu, Xuan, Bennett, Christopher H., Marinella, Matthew, Friedman, Joseph S., & Incorvia, Jean Anne C. Three-terminal magnetic tunnel junction synapse circuits showing spike-timing-dependent plasticity. United States. https://doi.org/10.1088/1361-6463/ab4157
Akinola, Otitoaleke, Hu, Xuan, Bennett, Christopher H., Marinella, Matthew, Friedman, Joseph S., and Incorvia, Jean Anne C. Mon . "Three-terminal magnetic tunnel junction synapse circuits showing spike-timing-dependent plasticity". United States. https://doi.org/10.1088/1361-6463/ab4157. https://www.osti.gov/servlets/purl/1574455.
@article{osti_1574455,
title = {Three-terminal magnetic tunnel junction synapse circuits showing spike-timing-dependent plasticity},
author = {Akinola, Otitoaleke and Hu, Xuan and Bennett, Christopher H. and Marinella, Matthew and Friedman, Joseph S. and Incorvia, Jean Anne C.},
abstractNote = {There have been recent efforts towards the development of biologically-inspired neuromorphic devices and architecture. In this work, we demonstrate a synapse circuit that is designed to perform spike-timing-dependent plasticity which works with the leaky, integrate, and fire neuron in a neuromorphic computing architecture. The circuit consists of a three-terminal magnetic tunnel junction with a mobile domain wall between two low-pass filters and has been modeled in SPICE. The findings show that the current flowing through the synapse is highly correlated to the timing delay between the pre-synaptic and post-synaptic neurons. Using micromagnetic simulations, we show that introducing notches along the length of the domain wall track pins the domain wall at each successive notch to properly respond to the timing between the input and output current pulses of the circuit, producing a multi-state resistance representing synaptic weights. We show in SPICE that a notch-free ideal magnetic device also shows spike-timing dependent plasticity in response to the circuit current. This work is key progress towards making more bio-realistic artificial synapses with multiple weights, which can be trained online with a promise of CMOS compatibility and energy efficiency.},
doi = {10.1088/1361-6463/ab4157},
journal = {Journal of Physics. D, Applied Physics},
number = 49,
volume = 52,
place = {United States},
year = {Mon Sep 23 00:00:00 EDT 2019},
month = {Mon Sep 23 00:00:00 EDT 2019}
}

Journal Article:
Free Publicly Available Full Text
Publisher's Version of Record

Citation Metrics:
Cited by: 21 works
Citation information provided by
Web of Science

Save / Share:

Works referenced in this record:

Modelling the molecular mechanisms of synaptic plasticity using systems biology approaches
journal, April 2010

  • Kotaleski, Jeanette Hellgren; Blackwell, Kim T.
  • Nature Reviews Neuroscience, Vol. 11, Issue 4
  • DOI: 10.1038/nrn2807

Selective domain wall depinning by localized Oersted fields and Joule heating
journal, September 2008

  • Ilgaz, Dennis; Kläui, Mathias; Heyne, Lutz
  • Applied Physics Letters, Vol. 93, Issue 13
  • DOI: 10.1063/1.2990629

Single pairing spike-timing dependent plasticity in BiFeO3 memristors with a time window of 25 ms to 125 μs
journal, June 2015


Integrate-and-Fire (I&F) Neuron Circuit Using Resistive-Switching Random Access Memory (RRAM)
journal, May 2017

  • Kwon, Min-Woo; Kim, Sungjun; Kim, Min-Hwi
  • Journal of Nanoscience and Nanotechnology, Vol. 17, Issue 5
  • DOI: 10.1166/jnn.2017.14025

Ground and river water quality monitoring using a smartphone-based pH sensor
journal, May 2015

  • Dutta, Sibasish; Sarma, Dhrubajyoti; Nath, Pabitra
  • AIP Advances, Vol. 5, Issue 5
  • DOI: 10.1063/1.4921835

Spike timing dependent plasticity: a consequence of more fundamental learning rules
journal, January 2010


The design and verification of MuMax3
journal, October 2014

  • Vansteenkiste, Arne; Leliaert, Jonathan; Dvornik, Mykola
  • AIP Advances, Vol. 4, Issue 10
  • DOI: 10.1063/1.4899186

Stochastic Properties of Synaptic Transmission Affect the Shape of Spike Time–Dependent Plasticity Curves
journal, February 2005

  • Shouval, Harel Z.; Kalantzis, Georgios
  • Journal of Neurophysiology, Vol. 93, Issue 2
  • DOI: 10.1152/jn.00504.2004

Mechanisms of induction and maintenance of spike-timing dependent plasticity in biophysical synapse models
journal, January 2010


The Formation of Multi-synaptic Connections by the Interaction of Synaptic and Structural Plasticity and Their Functional Consequences
journal, January 2015

  • Fauth, Michael; Wörgötter, Florentin; Tetzlaff, Christian
  • PLOS Computational Biology, Vol. 11, Issue 1
  • DOI: 10.1371/journal.pcbi.1004031

Neuromodulated Spike-Timing-Dependent Plasticity, and Theory of Three-Factor Learning Rules
journal, January 2016


Ultrastructural Characterization of the Lower Motor System in a Mouse Model of Krabbe Disease
journal, December 2016


Capacity analysis in multi-state synaptic models: a retrieval probability perspective
journal, October 2010


Neuronal Dynamics
book, August 2014


Synchronous Circuit Design With Beyond-CMOS Magnetoelectric Spin–Orbit Devices Toward 100-mV Logic
journal, June 2019

  • Liu, Huichu; Manipatruni, Sasikanth; Morris, Daniel H.
  • IEEE Journal on Exploratory Solid-State Computational Devices and Circuits, Vol. 5, Issue 1
  • DOI: 10.1109/JXCDC.2019.2897598

Synaptic computation
journal, October 2004


Benchmarking of Beyond-CMOS Exploratory Devices for Logic Integrated Circuits
journal, January 2015

  • Nikonov, Dmitri E.; Young, Ian A.
  • IEEE Journal on Exploratory Solid-State Computational Devices and Circuits, Vol. 1
  • DOI: 10.1109/JXCDC.2015.2418033

Phase change memory as synapse for ultra-dense neuromorphic systems: Application to complex visual pattern extraction
conference, December 2011

  • Suri, Manan; Bichler, Olivier; Querlioz, Damien
  • 2011 IEEE International Electron Devices Meeting (IEDM), 2011 International Electron Devices Meeting
  • DOI: 10.1109/IEDM.2011.6131488

Reservoir computing using dynamic memristors for temporal information processing
journal, December 2017


Current-driven domain-wall motion in magnetic wires with asymmetric notches
journal, December 2005

  • Himeno, A.; Kasai, S.; Ono, T.
  • Applied Physics Letters, Vol. 87, Issue 24
  • DOI: 10.1063/1.2140884

Current-driven domain-wall depinning
journal, July 2005

  • He, J.; Li, Z.; Zhang, S.
  • Journal of Applied Physics, Vol. 98, Issue 1
  • DOI: 10.1063/1.1957122

Track heating study for current-induced domain wall motion experiments
journal, December 2010

  • Curiale, J.; Lemaître, A.; Faini, G.
  • Applied Physics Letters, Vol. 97, Issue 24
  • DOI: 10.1063/1.3526755

Spintronic Nanodevices for Bioinspired Computing
journal, October 2016


Magnetic domain wall neuron with lateral inhibition
journal, October 2018

  • Hassan, Naimul; Hu, Xuan; Jiang-Wei, Lucian
  • Journal of Applied Physics, Vol. 124, Issue 15
  • DOI: 10.1063/1.5042452

Filamentary Switching: Synaptic Plasticity through Device Volatility
journal, January 2015

  • La Barbera, Selina; Vuillaume, Dominique; Alibart, Fabien
  • ACS Nano, Vol. 9, Issue 1
  • DOI: 10.1021/nn506735m

Spin-Transfer Torque Magnetic Memory as a Stochastic Memristive Synapse for Neuromorphic Systems
journal, April 2015

  • Vincent, Adrien F.; Larroque, Jerome; Locatelli, Nicolas
  • IEEE Transactions on Biomedical Circuits and Systems, Vol. 9, Issue 2
  • DOI: 10.1109/TBCAS.2015.2414423

Proposal for an All-Spin Artificial Neural Network: Emulating Neural and Synaptic Functionalities Through Domain Wall Motion in Ferromagnets
journal, December 2016

  • Sengupta, Abhronil; Shim, Yong; Roy, Kaushik
  • IEEE Transactions on Biomedical Circuits and Systems, Vol. 10, Issue 6
  • DOI: 10.1109/TBCAS.2016.2525823

Composable Probabilistic Inference Networks Using MRAM-based Stochastic Neurons
journal, March 2019

  • Zand, Ramtin; Camsari, Kerem Y.; Datta, Supriyo
  • ACM Journal on Emerging Technologies in Computing Systems, Vol. 15, Issue 2
  • DOI: 10.1145/3304105

Neuromorphic computing enabled by physics of electron spins: Prospects and perspectives
journal, February 2018


Short-Term Memory to Long-Term Memory Transition in a Nanoscale Memristor
journal, August 2011

  • Chang, Ting; Jo, Sung-Hyun; Lu, Wei
  • ACS Nano, Vol. 5, Issue 9
  • DOI: 10.1021/nn202983n

All Spin Artificial Neural Networks Based on Compound Spintronic Synapse and Neuron
journal, August 2016

  • Zhang, Deming; Zhao, Weisheng; Zeng, Lang
  • IEEE Transactions on Biomedical Circuits and Systems, Vol. 10, Issue 4
  • DOI: 10.1109/TBCAS.2016.2533798

SPICE-Only Model for Spin-Transfer Torque Domain Wall MTJ Logic
journal, June 2019

  • Hu, Xuan; Timm, Andrew; Brigner, Wesley H.
  • IEEE Transactions on Electron Devices, Vol. 66, Issue 6
  • DOI: 10.1109/TED.2019.2912756

The Developing Brain
journal, September 1992


The emergence of spin electronics in data storage
journal, November 2007

  • Chappert, Claude; Fert, Albert; Van Dau, Frédéric Nguyen
  • Nature Materials, Vol. 6, Issue 11
  • DOI: 10.1038/nmat2024

Spin wave based synapse and neuron for ultra low power neuromorphic computation system
conference, May 2016

  • Zeng, Lang; Zhang, Deming; Zhang, Youguang
  • 2016 IEEE International Symposium on Circuits and Systems (ISCAS)
  • DOI: 10.1109/ISCAS.2016.7527391

Low Energy Magnetic Domain Wall Logic in Short, Narrow, Ferromagnetic Wires
journal, January 2012


Logic circuit prototypes for three-terminal magnetic tunnel junctions with mobile domain walls
journal, January 2016

  • Currivan-Incorvia, J. A.; Siddiqui, S.; Dutta, S.
  • Nature Communications, Vol. 7, Issue 1
  • DOI: 10.1038/ncomms10275

Synaptic plasticity and learning behaviours mimicked through Ag interface movement in an Ag/conducting polymer/Ta memristive system
journal, January 2013

  • Li, Sizhao; Zeng, Fei; Chen, Chao
  • Journal of Materials Chemistry C, Vol. 1, Issue 34
  • DOI: 10.1039/c3tc30575a

Emerging Memory Devices for Neuromorphic Computing
journal, January 2019

  • Upadhyay, Navnidhi K.; Jiang, Hao; Wang, Zhongrui
  • Advanced Materials Technologies, Vol. 4, Issue 4
  • DOI: 10.1002/admt.201800589

Neuromorphic computing using non-volatile memory
journal, October 2016


Exploiting the short-term to long-term plasticity transition in memristive nanodevice learning architectures
conference, July 2016

  • Bennett, Christopher H.; La Barbera, Selina; Vincent, Adrien F.
  • 2016 International Joint Conference on Neural Networks (IJCNN)
  • DOI: 10.1109/IJCNN.2016.7727300

Encoding neural and synaptic functionalities in electron spin: A pathway to efficient neuromorphic computing
journal, December 2017

  • Sengupta, Abhronil; Roy, Kaushik
  • Applied Physics Reviews, Vol. 4, Issue 4
  • DOI: 10.1063/1.5012763

Spin orbit torques and Dzyaloshinskii-Moriya interaction in dual-interfaced Co-Ni multilayers
journal, September 2016

  • Yu, Jiawei; Qiu, Xuepeng; Wu, Yang
  • Scientific Reports, Vol. 6, Issue 1
  • DOI: 10.1038/srep32629

Magnetic Tunnel Junction Based Long-Term Short-Term Stochastic Synapse for a Spiking Neural Network with On-Chip STDP Learning
journal, July 2016

  • Srinivasan, Gopalakrishnan; Sengupta, Abhronil; Roy, Kaushik
  • Scientific Reports, Vol. 6, Issue 1
  • DOI: 10.1038/srep29545

Synaptic Modification by Correlated Activity: Hebb's Postulate Revisited
journal, March 2001


Overview of Beyond-CMOS Devices and a Uniform Methodology for Their Benchmarking
journal, December 2013


Spin–orbit torques in action
journal, February 2014

  • Brataas, Arne; Hals, Kjetil M. D.
  • Nature Nanotechnology, Vol. 9, Issue 2
  • DOI: 10.1038/nnano.2014.8

Chain of magnetic tunnel junctions as a spintronic memristor
journal, October 2018

  • Raymenants, Eline; Vaysset, Adrien; Wan, Danny
  • Journal of Applied Physics, Vol. 124, Issue 15
  • DOI: 10.1063/1.5042431

Magnetic Domain-Wall Racetrack Memory
journal, April 2008


Demonstration of spike timing dependent plasticity in CBRAM devices with silicon neurons
conference, May 2016

  • Mahalanabis, D.; Sivaraj, M.; Chen, W.
  • 2016 IEEE International Symposium on Circuits and Systems (ISCAS)
  • DOI: 10.1109/ISCAS.2016.7539047

Energy-efficient neuromorphic computation based on compound spin synapse with stochastic learning
conference, May 2015

  • Zhang, Deming; Zeng, Lang; Qu, Yuanzhuo
  • 2015 IEEE International Symposium on Circuits and Systems (ISCAS)
  • DOI: 10.1109/ISCAS.2015.7168939

Perspective: Spintronic synapse for artificial neural network
journal, October 2018

  • Fukami, Shunsuke; Ohno, Hideo
  • Journal of Applied Physics, Vol. 124, Issue 15
  • DOI: 10.1063/1.5042317

Current-Controlled Magnetic Domain-Wall Nanowire Shift Register
journal, April 2008


IBM's new brain [News]
journal, October 2014


Self-Adaptive Spike-Time-Dependent Plasticity of Metal-Oxide Memristors
journal, February 2016

  • Prezioso, M.; Merrikh Bayat, F.; Hoskins, B.
  • Scientific Reports, Vol. 6, Issue 1
  • DOI: 10.1038/srep21331

Current-induced domain wall motion
journal, April 2008

  • Beach, G. S. D.; Tsoi, M.; Erskine, J. L.
  • Journal of Magnetism and Magnetic Materials, Vol. 320, Issue 7
  • DOI: 10.1016/j.jmmm.2007.12.021

Composable Probabilistic Inference Networks Using MRAM-based Stochastic Neurons
text, January 2018


The developing brain
journal, February 2012


The formation of multi-synaptic connections by the interaction of synaptic and structural plasticity and their functional consequences
journal, July 2014


Self-Adaptive Spike-Time-Dependent Plasticity of Metal-Oxide Memristors
text, January 2015