How are memories stored in neural networks? | The Hopfield Network
Layerwise Lectures Layerwise Lectures
24.3K subscribers
659,671 views
0

 Published On Aug 15, 2022

Can we measure memories in networks of neurons in bytes? Or should we think of our memory differently?

Submission to the Summer of Math Exposition 2022 (#SoME2). More information: https://summerofmathexposition.substa...

Time stamps:
0:00 - Where is your memory?
1:41 - Computer memory in a nutshell
2:58 - Modeling neural networks
4:42 - Memories in dynamical systems
9:54 - Learning
13:36 - Memory capacity and conclusion

Animations largely made using the manim community edition:
https://www.manim.community/

Original Paper on Hopfield Networks:
Hopfield, J. J. (1982). Neural networks and physical systems with emergent collective computational abilities. Proceedings of the national academy of sciences, 79(8), 2554-2558.

Neuron image by Santiago Ramón y Cajal, The pyramidal neuron of the cerebral cortex, 1904 Ink and pencil on paper, 8 5/8 x 6 7/8 in. Credit: Cajal Institute (CSIC), Madrid

Music: Aakash Gandhi - "Dreamland"

show more

Share/Embed