9873

Hopfield Network with State-Dependent Threshold

In a Hopfield network model, the two states of a neuron (firing or at rest) are denoted by the values . The future state of a neuron is determined by the present state of all the other neurons via the synaptic matrix, but is independent of its own present state. The overlap between the original and the time-evolved state of the network is a measure of "memory recall"; it depends upon the fractional memory load and a state-dependent neuron firing threshold . This Demonstration obtains the average time-evolution of patterns stored in a network of neurons () with a neuron-state-dependent firing threshold . The distribution of resulting overlaps between the time-evolved and original states, , shifts from a peak at one to a broad distribution at lower values of as the memory load increases, indicating the threshold memory capacity of the neural network.

SNAPSHOTS

  • [Snapshot]
  • [Snapshot]
  • [Snapshot]

DETAILS

Snapshot 1: at memory load , the recall distribution is broad, thus showing a lack of near-perfect recall when the threshold is near zero
Snapshot 2: as the threshold strength is increased, for the same memory load , the probability of recall and thus the memory capacity of the network are increased
Snapshot 3: conversely, when is decreased, even for a smaller memory load , the distribution becomes broad, showing a diminished memory capacity for the network
References
[1] J. J. Hopfield, "Neural Networks and Physical Systems with Emergent Collective Computational Abilities," Proceedings of the National Academy of Sciences, 79(8), 1982 pp. 2554–2558. www.pnas.org/content/79/8/2554.full.pdf.
[2] D. J. Amit, Modeling Brain Function, New York: Cambridge University Press, 1992.
    • Share:

Embed Interactive Demonstration New!

Just copy and paste this snippet of JavaScript code into your website or blog to put the live Demonstration on your site. More details »

Files require Wolfram CDF Player or Mathematica.









 
RELATED RESOURCES
Mathematica »
The #1 tool for creating Demonstrations
and anything technical.
Wolfram|Alpha »
Explore anything with the first
computational knowledge engine.
MathWorld »
The web's most extensive
mathematics resource.
Course Assistant Apps »
An app for every course—
right in the palm of your hand.
Wolfram Blog »
Read our views on math,
science, and technology.
Computable Document Format »
The format that makes Demonstrations
(and any information) easy to share and
interact with.
STEM Initiative »
Programs & resources for
educators, schools & students.
Computerbasedmath.org »
Join the initiative for modernizing
math education.
Step-by-step Solutions »
Walk through homework problems one step at a time, with hints to help along the way.
Wolfram Problem Generator »
Unlimited random practice problems and answers with built-in Step-by-step solutions. Practice online or make a printable study sheet.
Wolfram Language »
Knowledge-based programming for everyone.
Powered by Wolfram Mathematica © 2014 Wolfram Demonstrations Project & Contributors  |  Terms of Use  |  Privacy Policy  |  RSS Give us your feedback
Note: To run this Demonstration you need Mathematica 7+ or the free Mathematica Player 7EX
Download or upgrade to Mathematica Player 7EX
I already have Mathematica Player or Mathematica 7+