Access the full text.
Sign up today, get DeepDyve free for 14 days.
(2015)
The Unreasonable Effectiveness of Recurrent Neural Networks
Philip Tully, Henrik Lindén, Matthias Hennig, A. Lansner (2016)
Spike-Based Bayesian-Hebbian Learning of Temporal SequencesPLoS Computational Biology, 12
Kanaka Rajan, C. Harvey, D. Tank (2016)
Recurrent Network Models of Sequence Generation and MemoryNeuron, 90
W. Skaggs, B. McNaughton, M. Wilson, C. Barnes (1996)
Theta phase precession in hippocampal neuronal populations and the compression of temporal sequencesHippocampus, 6
R. Kesner, M. Hunsaker, Warren Ziegler (2010)
The role of the dorsal CA1 and ventral CA1 in memory for the temporal order of a sequence of odorsNeurobiology of Learning and Memory, 93
W. Maass, T. Natschläger, H. Markram (2002)
Real-Time Computing Without Stable States: A New Framework for Neural Computation Based on PerturbationsNeural Computation, 14
Dileep George, J. Hawkins (2009)
Towards a Mathematical Theory of Cortical Micro-circuitsPLoS Computational Biology, 5
J. Cunningham, Byron Yu (2014)
Dimensionality reduction for large-scale neural recordingsNature Neuroscience, 17
V. Itskov, C. Curto, E. Pastalkova, G. Buzsáki (2011)
Cell Assembly Sequences Arising from Spike Threshold Adaptation Keep Track of Time in the HippocampusThe Journal of Neuroscience, 31
J. Lisman, L. Talamini, A. Raffone (2005)
Recall of memory sequences by interaction of the dentate and CA3: A revised model of the phase precessionNeural networks : the official journal of the International Neural Network Society, 18 9
Takeshi Nakamura, J. Barbara, Kyoko Nakamura, W. Ross (1999)
Synergistic Release of Ca2+ from IP3-Sensitive Stores Evoked by Synaptic Activation of mGluRs Paired with Backpropagating Action PotentialsNeuron, 24
Professor Abeles (1982)
Local Cortical Circuits
Benjamin Kraus, Robert Robinson, J. White, H. Eichenbaum, M. Hasselmo (2013)
Hippocampal “Time Cells”: Time versus Path IntegrationNeuron, 78
M. Diesmann, M. Gewaltig, A. Aertsen (1999)
Stable propagation of synchronous spiking in cortical neural networksNature, 402
K. Bouchard, M. Brainard (2016)
Auditory-induced neural dynamics in sensory-motor circuitry predict learned temporal and sequential statistics of birdsongProceedings of the National Academy of Sciences, 113
T. Allen, Daniel Salz, S. McKenzie, N. Fortin (2016)
Nonspatial Sequence Coding in CA1 NeuronsThe Journal of Neuroscience, 36
Liang-Tien Hsieh, Matthias Gruber, Lucas Jenkins, C. Ranganath (2014)
Hippocampal Activity Patterns Carry Information about Objects in Temporal ContextNeuron, 81
F. Vargha-Khadem, D. Gadian, K. Watkins, A. Connelly, W. Paesschen, M. Mishkin (1997)
Differential effects of early hippocampal pathology on episodic and semantic memory.Science, 277 5324
Panayiota Poirazi, T. Brannon, Bartlett Mel (2003)
Pyramidal Neuron as Two-Layer Neural NetworkNeuron, 37
R. Ross, Thackery Brown, C. Stern (2009)
The retrieval of learned sequences engages the hippocampus: Evidence from fMRIHippocampus, 19
Yann LeCun, Yoshua Bengio, Geoffrey Hinton (2015)
Deep LearningNature, 521
E. Bienenstock (1995)
A model of neocortexNetwork: Computation In Neural Systems, 6
Daniel Salz, Z. Tiganj, Srijesa Khasnabish, Annalyse Kohley, D. Sheehan, Marc Howard, H. Eichenbaum (2016)
Time Cells in Hippocampal Area CA3The Journal of Neuroscience, 36
T. Dugladze, D. Schmitz, M. Whittington, I. Vida, T. Gloveli (2012)
Awake Hippocampal Sharp-Wave Ripples Support Spatial MemoryScience, 336
W. Levy, A. Hocking, Xiangbao Wu (2005)
Interpreting hippocampal function as recoding and forecastingNeural networks : the official journal of the International Neural Network Society, 18 9
D. Georgescauld (1983)
Local Cortical Circuits, An Electrophysiological StudyBioelectrochemistry and Bioenergetics, 10
Katie Bittner, Aaron Milstein, Christine Grienberger, S. Romani, J. Magee (2017)
Behavioral time scale synaptic plasticity underlies CA1 place fieldsScience, 357
Stewart Heitmann, T. Boonstra, M. Breakspear (2013)
A Dendritic Mechanism for Decoding Traveling Waves: Principles and Applications to Motor CortexPLoS Computational Biology, 9
J. O’Keefe, J. Dostrovsky (1971)
The hippocampus as a spatial map. Preliminary evidence from unit activity in the freely-moving rat.Brain research, 34 1
M. Tsukada, Xiaochuan Pan (2005)
The spatiotemporal learning rule and its efficiency in separating spatiotemporal patternsBiological Cybernetics, 92
Kara Agster, N. Fortin, H. Eichenbaum (2002)
The Hippocampus and Disambiguation of Overlapping SequencesThe Journal of Neuroscience, 22
(2011)
xkcd: Game AIs
Nick Robinson, James Priestley, J. Rueckemann, Aaron Garcia, Vittoria Smeglin, Francesca Marino, H. Eichenbaum (2017)
Medial Entorhinal Cortex Selectively Supports Temporal Coding by Hippocampal NeuronsNeuron, 94
J. Lisman, N. Otmakhova (2001)
Storage, recall, and novelty detection of sequences by the hippocampus: Elaborating on the SOCRATIC model to account for normal and aberrant effects of dopamineHippocampus, 11
L. Devito, H. Eichenbaum (2011)
Memory for the Order of Events in Specific Sequences: Contributions of the Hippocampus and Medial Prefrontal CortexThe Journal of Neuroscience, 31
D. Tank, J. Hopfield (1987)
Neural computation by concentrating information in time.Proceedings of the National Academy of Sciences of the United States of America, 84 7
E. Tulving, H. Markowitsch (1998)
Episodic and declarative memory: Role of the hippocampusHippocampus, 8
Susumu Takahashi (2015)
Episodic-like memory trace in awake replay of hippocampal place cell activity sequenceseLife, 4
A. Azizi, Laurenz Wiskott, Sen Cheng (2013)
A computational model for preplay in the hippocampusFrontiers in Computational Neuroscience, 7
Marc Howard, H. Eichenbaum (2013)
The hippocampus, time, and memory across scales.Journal of experimental psychology. General, 142 4
D. Verstraeten, B. Schrauwen, Michiel D'Haene, D. Stroobandt (2007)
2007 Special Issue: An experimental unification of reservoir computing methodsNeural Networks, 20
Andrew Wikenheiser, David Redish (2015)
Hippocampal theta sequences reflect current goalsNature Neuroscience, 18
V. Sohal, Michael Hasselmo (1998)
GABAB modulation improves sequence disambiguation in computational models of hippocampal region CA3Hippocampus, 8
Richard Wroe, H. Chan, E. Bornberg-Bauer (2007)
A structural model of latent evolutionary potentials underlying neutral networks in proteinsHFSP Journal, 1
Geoffrey Hinton, L. Deng, Dong Yu, George Dahl, Abdel-rahman Mohamed, N. Jaitly, A. Senior, Vincent Vanhoucke, Patrick Nguyen, Tara Sainath, Brian Kingsbury (2017)
Top Downloads in IEEE Xplore [Reader's Choice]IEEE Signal Processing Magazine, 34
R.G.M. Morris (2001)
Episodic-like memory in animals: psychological criteria, neural mechanisms and the value of episodic-like tasks to investigate animal models of neurodegenerative disease.Philosophical transactions of the Royal Society of London. Series B, Biological sciences, 356 1413
David Foster, M. Wilson (2006)
Reverse replay of behavioural sequences in hippocampal place cells during the awake stateNature, 440
E. Wood, Paul Dudchenko, R. Robitsek, H. Eichenbaum (2000)
Hippocampal Neurons Encode Information about Different Types of Memory Episodes Occurring in the Same LocationNeuron, 27
A. Govindarajan, Inbal Israely, S. Huang, S. Tonegawa (2011)
The Dendritic Branch Is the Preferred Integrative Unit for Protein Synthesis-Dependent LTPNeuron, 69
D. Rumelhart, Geoffrey Hinton, Ronald Williams (1986)
Learning internal representations by error propagation
Delia Silva, Ting Feng, David Foster (2015)
Trajectory events across hippocampal place-cells require previous experienceNature neuroscience, 18
R. Kesner, E. Rolls (2015)
A computational theory of hippocampal function, and tests of the theory: New developmentsNeuroscience & Biobehavioral Reviews, 48
M. Abeles, Gaby Hayon, D. Lehmann (2004)
Modeling Compositionality by Dynamic Binding of Synfire ChainsJournal of Computational Neuroscience, 17
Thackery Brown, R. Ross, J. Keller, M. Hasselmo, C. Stern (2010)
Which Way Was I Going? Contextual Retrieval Supports the Disambiguation of Well Learned Overlapping Navigational RoutesThe Journal of Neuroscience, 30
Yoshua Bengio, P. Simard, P. Frasconi (1994)
Learning long-term dependencies with gradient descent is difficultIEEE transactions on neural networks, 5 2
S. Abbas, Khaldoun Hamade, Ellen Yang, S. Nawy, Robert Smith, D. Pettit (2013)
Directional Summation in Non-direction Selective Retinal Ganglion CellsPLoS Computational Biology, 9
Joshua Plotkin, W. Shen, Igor Rafalovich, Luke Sebel, Michelle Day, C. Chan, D. Surmeier (2013)
Regulation of dendritic calcium release in striatal spiny projection neurons.Journal of neurophysiology, 110 10
C. MacDonald, Stephen Carrow, Ryan Place, H. Eichenbaum (2013)
Distinct Hippocampal Time Cell Sequences Represent Odor Memories in Immobilized RatsThe Journal of Neuroscience, 33
W. Levy (1996)
A sequence predicting CA3 is a flexible associator that learns and uses context to solve hippocampal‐like tasksHippocampus, 6
M. Modi, Ashesh Dhawale, U. Bhalla (2014)
CA1 cell activity sequences emerge after reorganization of network correlation structure during associative learningeLife, 3
O. Barak, M. Tsodyks (2006)
Recognition by Variance: Learning Rules for Spatiotemporal PatternsNeural Computation, 18
B. Wilson, W. Marslen-Wilson, C. Petkov (2017)
Conserved Sequence Processing in Primate Frontal CortexTrends in Neurosciences, 40
U. Bhalla (2017)
Synaptic input sequence discrimination on behavioral timescales mediated by reaction-diffusion chemistry in dendriteseLife, 6
Nicolas Frémaux, Henning Sprekeler, W. Gerstner (2013)
Reinforcement Learning Using a Continuous Time Actor-Critic Framework with Spiking NeuronsPLoS Computational Biology, 9
Andrew Howe, W. Levy (2007)
A hippocampal model predicts a fluctuating phase transition when learning certain trace conditioning paradigmsCognitive Neurodynamics, 1
J. O’Keefe, M. Recce (1993)
Phase relationship between hippocampal place units and the EEG theta rhythmHippocampus, 3
N. Fortin, Kara Agster, H. Eichenbaum (2002)
Critical role of the hippocampus in memory for sequences of eventsNature Neuroscience, 5
K. Doya (2000)
Reinforcement Learning in Continuous Time and SpaceNeural Computation, 12
E. Capaldi (1992)
The organization of behavior.Journal of applied behavior analysis, 25 3
V. Goudar, D. Buonomano (2015)
A model of order-selectivity based on dynamic changes in the balance of excitation and inhibition produced by short-term synaptic plasticity.Journal of neurophysiology, 113 2
S. M. Ajay, U. S. Bhalla (2007)
A propagating ERKII switch forms zones of elevated dendritic activation correlated with plasticity, 1
J. Tapson, Gregory Cohen, Saeed Afshar, K. Stiefel, Y. Buskila, Runchun Wang, T. Hamilton, A. Schaik (2013)
Synthesis of neural networks for spatio-temporal spike pattern recognition and processingFrontiers in Neuroscience, 7
G. Dragoi, S. Tonegawa (2011)
Preplay of future place cell sequences by hippocampal cellular assembliesNature, 469
G. Hinton, L. Deng, D. Yu, G. E. Dahl, A. R. Mohamed, N. Jaitly, B. Kingsbury (2012)
Deep Neural Networks for Acoustic Modeling in Speech Recognition: The Shared Views of Four Research Groups, 29
Jason Hunzinger, V. Chan, R. Froemke (2012)
Learning complex temporal patterns with resource-dependent spike timing-dependent plasticity.Journal of neurophysiology, 108 2
M. Hasselmo, B. Anderson, J. Bower (1992)
Cholinergic modulation of cortical associative memory function.Journal of neurophysiology, 67 5
R. Kesner, Paul Gilbert, Lindsay Barua (2002)
The role of the hippocampus in memory for the temporal order of a sequence of odors.Behavioral neuroscience, 116 2
Vincent Villette, A. Malvache, T. Tressard, Nathalie Dupuy, R. Cossart (2015)
Internally Recurring Hippocampal Sequences as a Population Template of Spatiotemporal InformationNeuron, 88
Mathieu Schiess, R. Urbanczik, W. Senn (2016)
Somato-dendritic Synaptic Plasticity and Error-backpropagation in Active DendritesPLoS Computational Biology, 12
T. Kitamura, C. MacDonald, S. Tonegawa (2015)
Entorhinal–hippocampal neuronal circuits bridge temporally discontiguous eventsLearning & Memory, 22
Bartlett Mel (1993)
Synaptic integration in an excitable dendritic tree.Journal of neurophysiology, 70 3
Andrew Wikenheiser, A. Redish (2015)
Decoding the cognitive map: ensemble hippocampal sequences and decision makingCurrent Opinion in Neurobiology, 32
T. Branco, B. Clark, M. Häusser (2010)
Dendritic Discrimination of Temporal Input Sequences in Cortical NeuronsScience, 329
A. Singer, Margaret Carr, Mattias Karlsson, L. Frank (2013)
Hippocampal SWR Activity Predicts Correct Decisions during the Initial Learning of an Alternation TaskNeuron, 77
J. Fuster, G. Alexander (1971)
Neuron Activity Related to Short-Term MemoryScience, 173
R. Hyde, B. Strowbridge (2012)
Mnemonic representations of transient stimuli and temporal sequences in the rodent hippocampus in vitroNature neuroscience, 15
E. Rolls (2010)
A computational theory of episodic memory formation in the hippocampusBehavioural Brain Research, 215
David Sussillo, L. Abbott (2009)
Generating Coherent Patterns of Activity from Chaotic Neural NetworksNeuron, 63
V. Šrajer, W. Schildkamp, Michael Wulff, K. Moffat (1996)
Chaos in Neuronal Networks with Balanced Excitatory and Inhibitory ActivityScience, 274
H. Eichenbaum (2008)
Faculty Opinions recommendation of Internally generated cell assembly sequences in the rat hippocampus.
C. Mehring, U. Hehl, M. Kubo, M. Diesmann, A. Aertsen (2003)
Activity dynamics and propagation of synchronous spiking in locally connected random networksBiological Cybernetics, 88
Sven Jahnke, M. Timme, Raoul-Martin Memmesheimer (2015)
A Unified Dynamic Model for Learning, Replay, and Sharp-Wave/RipplesThe Journal of Neuroscience, 35
S. Hochreiter, J. Schmidhuber (1997)
Long Short-Term MemoryNeural Computation, 9
S. Ortial, Jean-Luc Montchamp (2011)
Hydroalumination and Carbocupration of Alkynylphosphine-BoraneComplexesSynfacts, 2011
D. Aronov, Rhino Nevers, D. Tank (2017)
Mapping of a non-spatial dimension by the hippocampal/entorhinal circuitNature, 543
Ilya Sutskever, Oriol Vinyals, Quoc Le (2014)
Sequence to Sequence Learning with Neural NetworksArXiv, abs/1409.3215
S. Trenholm, Kyle Johnson, Xiao Li, Robert Smith, G. Awatramani (2011)
Parallel Mechanisms Encode Direction in the RetinaNeuron, 71
N. Ulanovsky, C. Moss (2007)
Hippocampal cellular and network activity in freely moving echolocating batsNature Neuroscience, 10
R. N (1938)
SYNAPTIC STIMULATION OF MOTONEURONS AS A LOCAL PROCESSJournal of Neurophysiology, 1
R. Lorente (2004)
ANALYSIS OF THE ACTIVITY OF THE CHAINS -OF INTERNUNCIAL NEURONS
M. Hasselmo (2009)
A model of episodic memory: Mental time travel along encoded trajectories using grid cellsNeurobiology of Learning and Memory, 92
M. Tsodyks, W. Skaggs, T. Sejnowski, B. McNaughton (1998)
Population dynamics and theta rhythm phase precession of hippocampal place cell firing: A spiking neuron modelHippocampus, 6
J. Elman (2004)
Distributed representations, simple recurrent networks, and grammatical structureMachine Learning, 7
R. Józefowicz, Wojciech Zaremba, Ilya Sutskever (2015)
An Empirical Exploration of Recurrent Network Architectures
Bin Shen, B. McNaughton (1996)
Modeling the spontaneous reactivation of experience‐specific hippocampal cell assembles during sleepHippocampus, 6
C. MacDonald, K. Lepage, U. Eden, H. Eichenbaum (2011)
Hippocampal “Time Cells” Bridge the Gap in Memory for Discontiguous EventsNeuron, 71
Gaby Hayon, M. Abeles, D. Lehmann (2005)
A Model for Representing the Dynamics of a System of Synfire ChainsJournal of Computational Neuroscience, 18
Klaus Greff, R. Srivastava, J. Koutník, Bas Steunebrink, J. Schmidhuber (2015)
LSTM: A Search Space OdysseyIEEE Transactions on Neural Networks and Learning Systems, 28
Kyunghyun Cho, Bart Merrienboer, Çaglar Gülçehre, Dzmitry Bahdanau, Fethi Bougares, Holger Schwenk, Yoshua Bengio (2014)
Learning Phrase Representations using RNN Encoder–Decoder for Statistical Machine Translation
T. Allen, Andrea Morris, A. Mattfeld, C. Stark, N. Fortin (2014)
A Sequence of events model of episodic memory shows parallels in rats and humansHippocampus, 24
M. Wilson, B. McNaughton (1993)
Dynamics of the hippocampal ensemble code for space.Science, 261 5124
Mathew Wilson, B. McNaughton (1994)
Reactivation of hippocampal ensemble memories during sleep.Science, 265 5172
D. Kumaran, E. Maguire (2006)
An Unexpected Sequence of Events: Mismatch Detection in the Human HippocampusPLoS Biology, 4
J. Banquet, P. Gaussier, M. Quoy, A. Revel, Y. Burnod (2005)
A Hierarchy of Associations in Hippocampo-Cortical Systems: Cognitive Maps and Navigation StrategiesNeural Computation, 17
(2017)
How to cite this article: Bhalla US. Dendrites, deep learning, and sequences in the hippocampus
J. Epsztein, M. Brecht, Albert Lee (2011)
Intracellular Determinants of Hippocampal CA1 Place and Silent Cell Activity in a Novel EnvironmentNeuron, 70
U. Frey, R. Morris (1997)
Synaptic tagging and long-term potentiationNature, 385
A. Muto, Masamichi Ohkura, Gembu Abe, J. Nakai, K. Kawakami (2013)
Real-Time Visualization of Neuronal Activity during PerceptionCurrent Biology, 23
U. Karmarkar, D. Buonomano (2007)
Timing in the Absence of Clocks: Encoding Time in Neural Network StatesNeuron, 53
Brad Pfeiffer, David Foster (2013)
Hippocampal place cell sequences depict future paths to remembered goalsNature, 497
M. Ozturk, J. Príncipe (2007)
2007 Special Issue: An associative memory readout for ESNs with applications to dynamical pattern recognitionNeural Networks, 20
Anoopum Gupta, Matthijs Meer, D. Touretzky, A. Redish (2010)
Hippocampal Replay Is Not a Simple Function of ExperienceNeuron, 65
R. Gütig, H. Sompolinsky (2006)
The tempotron: a neuron that learns spike timing–based decisionsNature Neuroscience, 9
Sergio Verduzco-Flores, M. Bodner, B. Ermentrout (2011)
A model for complex sequence learning and reproduction in neural populationsJournal of Computational Neuroscience, 32
R. Froemke, M. Poo, Y. Dan (2005)
Spike-timing-dependent synaptic plasticity depends on dendritic locationNature, 434
W. Rall (1964)
Theoretical significance of dendritic trees for neuronal input-output relations
J. Hawkins, Subutai Ahmad (2015)
Why Neurons Have Thousands of Synapses, a Theory of Sequence Memory in NeocortexFrontiers in Neural Circuits, 10
U. Bhalla (2002)
Mechanisms for temporal tuning and filtering by postsynaptic signaling pathways.Biophysical journal, 83 2
G. Wallenstein, M. Hasselmo, H. Eichenbaum (1998)
The hippocampus as an associator of discontiguous eventsTrends in Neurosciences, 21
G. Bi, M. Poo (1998)
Synaptic Modifications in Cultured Hippocampal Neurons: Dependence on Spike Timing, Synaptic Strength, and Postsynaptic Cell TypeThe Journal of Neuroscience, 18
The hippocampus places us both in time and space. It does so over remarkably large spans: milliseconds to years, and centimeters to kilometers. This works for sensory representations, for memory, and for behavioral context. How does it fit in such wide ranges of time and space scales, and keep order among the many dimensions of stimulus context? A key organizing principle for a wide sweep of scales and stimulus dimensions is that of order in time, or sequences. Sequences of neuronal activity are ubiquitous in sensory processing, in motor control, in planning actions, and in memory. Against this strong evidence for the phenomenon, there are currently more models than definite experiments about how the brain generates ordered activity. The flip side of sequence generation is discrimination. Discrimination of sequences has been extensively studied at the behavioral, systems, and modeling level, but again physiological mechanisms are fewer. It is against this backdrop that I discuss two recent developments in neural sequence computation, that at face value share little beyond the label “neural.” These are dendritic sequence discrimination, and deep learning. One derives from channel physiology and molecular signaling, the other from applied neural network theory ‐ apparently extreme ends of the spectrum of neural circuit detail. I suggest that each of these topics has deep lessons about the possible mechanisms, scales, and capabilities of hippocampal sequence computation.
Hippocampus – Wiley
Published: Mar 1, 2019
Keywords: ; ; ;
Read and print from thousands of top scholarly journals.
Already have an account? Log in
Bookmark this article. You can see your Bookmarks on your DeepDyve Library.
To save an article, log in first, or sign up for a DeepDyve account if you don’t already have one.
Copy and paste the desired citation format or use the link below to download a file formatted for EndNote
Access the full text.
Sign up today, get DeepDyve free for 14 days.
All DeepDyve websites use cookies to improve your online experience. They were placed on your computer when you launched this website. You can change your cookie settings through your browser.