Glutamate-receptor-mediated encoding and retrieval of paired-associate learning

Paired-associate learning is often used to examine episodic memory in humans. Animal models include the recall of food-cache locations by scrub jays and sequential memory. Here we report a model in which rats encode, during successive sample trials, two paired associates (flavours of food and their spatial locations) and display better-than-chance recall of one item when cued by the other. In a first study, pairings of a particular foodstuff and its location were never repeated, so ensuring unique 'what-where' attributes. Blocking N-methyl-d-aspartate receptors in the hippocampus--crucial for the induction of certain forms of activity-dependent synaptic plasticity--impaired memory encoding but had no effect on recall. Inactivating hippocampal neural activity by blocking alpha-amino-3-hydroxy-5-methyl-4-isoxazole propionic acid (AMPA) receptors impaired both encoding and recall. In a second study, two paired associates were trained repeatedly over 8 weeks in new pairs, but blocking of hippocampal AMPA receptors did not affect their recall. Thus we conclude that unique what-where paired associates depend on encoding and retrieval within a hippocampal memory space, with consolidation of the memory traces representing repeated paired associates in circuits elsewhere.     

Neuronal correlate of visual associative long-term memory in the primate temporal cortex

In human long-term memory, ideas and concepts become associated in the learning process. No neuronal correlate for this cognitive function has so far been described, except that memory traces are thought to be localized in the cerebral cortex; the temporal lobe has been assigned as the site for visual experience because electric stimulation of this area results in imagery recall and lesions produce deficits in visual recognition of objects. We previously reported that in the anterior ventral temporal cortex of monkeys, individual neurons have a sustained activity that is highly selective for a few of the 100 coloured fractal patterns used in a visual working-memory task. Here I report the development of this selectivity through repeated trials involving the working memory. The few patterns for which a neuron was conjointly selective were frequently related to each other through stimulus-stimulus association imposed during training. The results indicate that the selectivity acquired by these cells represents a neuronal correlate of the associative long-term memory of pictures.     

Disruption of neurotransmission in Drosophila mushroom body blocks retrieval but not acquisition of memory

Surgical, pharmacological and genetic lesion studies have revealed distinct anatomical sites involved with different forms of learning. Studies of patients with localized brain damage and work in rodent model systems, for example, have shown that the hippocampal formation participates in acquisition of declarative tasks but is not the site of their long-term storage. Such lesions are usually irreversible, however, which has limited their use for dissecting the temporal processes of acquisition, storage and retrieval of memories. Studies in bees and flies have similarly revealed a distinct anatomical region of the insect brain, the mushroom body, that is involved specifically in olfactory associative learning. We have used a temperature-sensitive dynamin transgene, which disrupts synaptic transmission reversibly and on the time-scale of minutes, to investigate the temporal requirements for ongoing neural activity during memory formation. Here we show that synaptic transmission from mushroom body neurons is required during memory retrieval but not during acquisition or storage. We propose that the hebbian processes underlying olfactory associative learning reside in mushroom body dendrites or upstream of the mushroom body and that the resulting alterations in synaptic strength modulate mushroom body output during memory retrieval.     

Neurons in medial prefrontal cortex signal memory for fear extinction

Conditioned fear responses to a tone previously paired with a shock diminish if the tone is repeatedly presented without the shock, a process known as extinction. Since Pavlov it has been hypothesized that extinction does not erase conditioning, but forms a new memory. Destruction of the ventral medial prefrontal cortex, which consists of infralimbic and prelimbic cortices, blocks recall of fear extinction, indicating that medial prefrontal cortex might store long-term extinction memory. Here we show that infralimbic neurons recorded during fear conditioning and extinction fire to the tone only when rats are recalling extinction on the following day. Rats that froze the least showed the greatest increase in infralimbic tone responses. We also show that conditioned tones paired with brief electrical stimulation of infralimbic cortex elicit low freezing in rats that had not been extinguished. Thus, stimulation resembling extinction-induced infralimbic tone responses is able to simulate extinction memory. We suggest that consolidation of extinction learning potentiates infralimbic activity, which inhibits fear during subsequent encounters with fear stimuli.     

Optogenetic stimulation of a hippocampal engram activates fear memory recall

A specific memory is thought to be encoded by a sparse population of neurons. These neurons can be tagged during learning for subsequent identification and manipulation. Moreover, their ablation or inactivation results in reduced memory expression, suggesting their necessity in mnemonic processes. However, the question of sufficiency remains: it is unclear whether it is possible to elicit the behavioural output of a specific memory by directly activating a population of neurons that was active during learning. Here we show in mice that optogenetic reactivation of hippocampal neurons activated during fear conditioning is sufficient to induce freezing behaviour. We labelled a population of hippocampal dentate gyrus neurons activated during fear learning with channelrhodopsin-2 (ChR2) and later optically reactivated these neurons in a different context. The mice showed increased freezing only upon light stimulation, indicating light-induced fear memory recall. This freezing was not detected in non-fear-conditioned mice expressing ChR2 in a similar proportion of cells, nor in fear-conditioned mice with cells labelled by enhanced yellow fluorescent protein instead of ChR2. Finally, activation of cells labelled in a context not associated with fear did not evoke freezing in mice that were previously fear conditioned in a different context, suggesting that light-induced fear memory recall is context specific. Together, our findings indicate that activating a sparse but specific ensemble of hippocampal neurons that contribute to a memory engram is sufficient for the recall of that memory. Moreover, our experimental approach offers a general method of mapping cellular populations bearing memory engrams.     

Neuronal correlate of pictorial short-term memory in the primate temporal cortex

It has been proposed that visual-memory traces are located in the temporal lobes of the cerebral cortex, as electric stimulation of this area in humans results in recall of imagery. Lesions in this area also affect recognition of an object after a delay in both humans and monkeys, indicating a role in short-term memory of images. Single-unit recordings from the temporal cortex have shown that some neurons continue to fire when one of two or four colours are to be remembered temporarily. But neuronal responses selective to specific complex objects, including hands and faces, cease soon after the offset of stimulus presentation. These results led to the question of whether any of these neurons could serve the memory of complex objects. We report here a group of shape-selective neurons in an anterior ventral part of the temporal cortex of monkeys that exhibited sustained activity during the delay period of a visual short-term memory task. The activity was highly selective for the pictorial information to be memorized and was independent of the physical attributes such as size, orientation, colour or position of the object. These observations show that the delay activity represents the short-term memory of the categorized percept of a picture.     

Interactive memory systems in the human brain.

Learning and memory in humans rely upon several memory systems, which appear to have dissociable brain substrates. A fundamental question concerns whether, and how, these memory systems interact. Here we show using functional magnetic resonance imaging (FMRI) that these memory systems may compete with each other during classification learning in humans. The medial temporal lobe and basal ganglia were differently engaged across subjects during classification learning depending upon whether the task emphasized declarative or nondeclarative memory, even when the to-be-learned material and the level of performance did not differ. Consistent with competition between memory systems suggested by animal studies and neuroimaging, activity in these regions was negatively correlated across individuals. Further examination of classification learning using event-related FMRI showed rapid modulation of activity in these regions at the beginning of learning, suggesting that subjects relied upon the medial temporal lobe early in learning. However, this dependence rapidly declined with training, as predicted by previous computational models of associative learning.     

Top-down signal from prefrontal cortex in executive control of memory retrieval.

Knowledge or experience is voluntarily recalled from memory by reactivation of the neural representations in the cerebral association cortex. In inferior temporal cortex, which serves as the storehouse of visual long-term memory, activation of mnemonic engrams through electric stimulation results in imagery recall in humans, and neurons can be dynamically activated by the necessity for memory recall in monkeys. Neuropsychological studies and previous split-brain experiments predicted that prefrontal cortex exerts executive control upon inferior temporal cortex in memory retrieval; however, no neuronal correlate of this process has ever been detected. Here we show evidence of the top-down signal from prefrontal cortex. In the absence of bottom-up visual inputs, single inferior temporal neurons were activated by the top-down signal, which conveyed information on semantic categorization imposed by visual stimulus-stimulus association. Behavioural performance was severely impaired with loss of the top-down signal. Control experiments confirmed that the signal was transmitted not through a subcortical but through a fronto-temporal cortical pathway. Thus, feedback projections from prefrontal cortex to the posterior association cortex appear to serve the executive control of voluntary recall.     

Perception of sniff phase in mouse olfaction

Olfactory systems encode odours by which neurons respond and by when they respond. In mammals, every sniff evokes a precise, odour-specific sequence of activity across olfactory neurons. Likewise, in a variety of neural systems, ranging from sensory periphery to cognitive centres, neuronal activity is timed relative to sampling behaviour and/or internally generated oscillations. As in these neural systems, relative timing of activity may represent information in the olfactory system. However, there is no evidence that mammalian olfactory systems read such cues. To test whether mice perceive the timing of olfactory activation relative to the sniff cycle ('sniff phase'), we used optogenetics in gene-targeted mice to generate spatially constant, temporally controllable olfactory input. Here we show that mice can behaviourally report the sniff phase of optogenetically driven activation of olfactory sensory neurons. Furthermore, mice can discriminate between light-evoked inputs that are shifted in the sniff cycle by as little as 10 milliseconds, which is similar to the temporal precision of olfactory bulb odour responses. Electrophysiological recordings in the olfactory bulb of awake mice show that individual cells encode the timing of photoactivation in relation to the sniff in both the timing and the amplitude of their responses. Our work provides evidence that the mammalian olfactory system can read temporal patterns, and suggests that timing of activity relative to sampling behaviour is a potent cue that may enable accurate olfactory percepts to form quickly.     

Distributed synaptic modification in neural networks induced by patterned stimulation.

Activity-dependent changes in synaptic efficacy or connectivity are critical for the development, signal processing and learning and memory functions of the nervous system. Repetitive correlated spiking of pre- and postsynaptic neurons can induce a persistent increase or decrease in synaptic strength, depending on the timing of the pre- and postsynaptic excitation. Previous studies on such synaptic modifications have focused on synapses made by the stimulated neuron. Here we examine, in networks of cultured hippocampal neurons, whether and how localized stimulation can modify synapses that are remote from the stimulated neuron. We found that repetitive paired-pulse stimulation of a single neuron for brief periods induces persistent strengthening or weakening of specific polysynaptic pathways in a manner that depends on the interpulse interval. These changes can be accounted for by correlated pre- and postsynaptic excitation at distant synaptic sites, resulting from different transmission delays along separate pathways. Thus, through such a 'delay-line' mechanism, temporal information coded in the timing of individual spikes can be converted into and stored as spatially distributed patterns of persistent synaptic modifications in a neural network.     

Neurogenesis in the adult is involved in the formation of trace memories

The vertebrate brain continues to produce new neurons throughout life. In the rat hippocampus, several thousand are produced each day, many of which die within weeks. Associative learning can enhance their survival; however, until now it was unknown whether new neurons are involved in memory formation. Here we show that a substantial reduction in the number of newly generated neurons in the adult rat impairs hippocampal-dependent trace conditioning, a task in which an animal must associate stimuli that are separated in time. A similar reduction did not affect learning when the same stimuli are not separated in time, a task that is hippocampal-independent. The reduction in neurogenesis did not induce death of mature hippocampal neurons or permanently alter neurophysiological properties of the CA1 region, such as long-term potentiation. Moreover, recovery of cell production was associated with the ability to acquire trace memories. These results indicate that newly generated neurons in the adult are not only affected by the formation of a hippocampal-dependent memory, but also participate in it.     

Dopamine responses comply with basic assumptions of formal learning theory.

According to contemporary learning theories, the discrepancy, or error, between the actual and predicted reward determines whether learning occurs when a stimulus is paired with a reward. The role of prediction errors is directly demonstrated by the observation that learning is blocked when the stimulus is paired with a fully predicted reward. By using this blocking procedure, we show that the responses of dopamine neurons to conditioned stimuli was governed differentially by the occurrence of reward prediction errors rather than stimulus-reward associations alone, as was the learning of behavioural reactions. Both behavioural and neuronal learning occurred predominantly when dopamine neurons registered a reward prediction error at the time of the reward. Our data indicate that the use of analytical tests derived from formal behavioural learning theory provides a powerful approach for studying the role of single neurons in learning.     

Behavioural access to short-term memory in bees.

Memory formation proceeds in temporal phases which differ in their effectiveness in controlling subsequent behavior and in their susceptibility to amnestic treatment. The initial phase of memory formation, frequently termed short-term memory, is generally considered a necessary precursor to long-term memory. However, the course of short-term memory differs widely between animal species and is dependent on experimental procedure. Information may even bypass the short-term phase en route to the long-term one. Experiments reported here using honey bees in a behavioural learning situation suggest that the greatest significance of short-term memory is its function as a mode of memory storage which may be altered effectively by new and contradictory information. Freely flying honey bees were presented two colour alternatives and rewarded on first one and then the other in a reversal learning paradigm. Subsequent colour preference was dependent on the interval between the two trials. Several new features of short-term memory are described. It is concluded that a single mechanisms of short- to long-term memory transfer cannot account for the observed bimodal interval dependent behaviour. Two mechanisms are proposed.     

Activity of striatal neurons reflects dynamic encoding and recoding of procedural memories

Learning to perform a behavioural procedure as a well-ingrained habit requires extensive repetition of the behavioural sequence, and learning not to perform such behaviours is notoriously difficult. Yet regaining a habit can occur quickly, with even one or a few exposures to cues previously triggering the behaviour. To identify neural mechanisms that might underlie such learning dynamics, we made long-term recordings from multiple neurons in the sensorimotor striatum, a basal ganglia structure implicated in habit formation, in rats successively trained on a reward-based procedural task, given extinction training and then given reacquisition training. The spike activity of striatal output neurons, nodal points in cortico-basal ganglia circuits, changed markedly across multiple dimensions during each of these phases of learning. First, new patterns of task-related ensemble firing successively formed, reversed and then re-emerged. Second, task-irrelevant firing was suppressed, then rebounded, and then was suppressed again. These changing spike activity patterns were highly correlated with changes in behavioural performance. We propose that these changes in task representation in cortico-basal ganglia circuits represent neural equivalents of the explore-exploit behaviour characteristic of habit learning.     

Structural basis of long-term potentiation in single dendritic spines

Dendritic spines of pyramidal neurons in the cerebral cortex undergo activity-dependent structural remodelling that has been proposed to be a cellular basis of learning and memory. How structural remodelling supports synaptic plasticity, such as long-term potentiation, and whether such plasticity is input-specific at the level of the individual spine has remained unknown. We investigated the structural basis of long-term potentiation using two-photon photolysis of caged glutamate at single spines of hippocampal CA1 pyramidal neurons. Here we show that repetitive quantum-like photorelease (uncaging) of glutamate induces a rapid and selective enlargement of stimulated spines that is transient in large mushroom spines but persistent in small spines. Spine enlargement is associated with an increase in AMPA-receptor-mediated currents at the stimulated synapse and is dependent on NMDA receptors, calmodulin and actin polymerization. Long-lasting spine enlargement also requires Ca2+/calmodulin-dependent protein kinase II. Our results thus indicate that spines individually follow Hebb's postulate for learning. They further suggest that small spines are preferential sites for long-term potentiation induction, whereas large spines might represent physical traces of long-term memory.     

NMDA-receptor-mediated, cell-specific integration of new neurons in adult dentate gyrus

New neurons are continuously integrated into existing neural circuits in adult dentate gyrus of the mammalian brain. Accumulating evidence indicates that these new neurons are involved in learning and memory. A substantial fraction of newly born neurons die before they mature and the survival of new neurons is regulated in an experience-dependent manner, raising the possibility that the selective survival or death of new neurons has a direct role in a process of learning and memory--such as information storage--through the information-specific construction of new circuits. However, a critical assumption of this hypothesis is that the survival or death decision of new neurons is information-specific. Because neurons receive their information primarily through their input synaptic activity, we investigated whether the survival of new neurons is regulated by input activity in a cell-specific manner. Here we developed a retrovirus-mediated, single-cell gene knockout technique in mice and showed that the survival of new neurons is competitively regulated by their own NMDA-type glutamate receptor during a short, critical period soon after neuronal birth. This finding indicates that the survival of new neurons and the resulting formation of new circuits are regulated in an input-dependent, cell-specific manner. Therefore, the circuits formed by new neurons may represent information associated with input activity within a short time window in the critical period. This information-specific addition of new circuits through selective survival or death of new neurons may be a unique attribute of new neurons that enables them to play a critical role in learning and memory.     

An ultra-sparse code underlies the generation of neural sequences in a songbird

Sequences of motor activity are encoded in many vertebrate brains by complex spatio-temporal patterns of neural activity; however, the neural circuit mechanisms underlying the generation of these pre-motor patterns are poorly understood. In songbirds, one prominent site of pre-motor activity is the forebrain robust nucleus of the archistriatum (RA), which generates stereotyped sequences of spike bursts during song and recapitulates these sequences during sleep. We show that the stereotyped sequences in RA are driven from nucleus HVC (high vocal centre), the principal pre-motor input to RA. Recordings of identified HVC neurons in sleeping and singing birds show that individual HVC neurons projecting onto RA neurons produce bursts sparsely, at a single, precise time during the RA sequence. These HVC neurons burst sequentially with respect to one another. We suggest that at each time in the RA sequence, the ensemble of active RA neurons is driven by a subpopulation of RA-projecting HVC neurons that is active only at that time. As a population, these HVC neurons may form an explicit representation of time in the sequence. Such a sparse representation, a temporal analogue of the 'grandmother cell' concept for object recognition, eliminates the problem of temporal interference during sequence generation and learning attributed to more distributed representations.     

A neural representation of depth from motion parallax in macaque visual cortex

Perception of depth is a fundamental challenge for the visual system, particularly for observers moving through their environment. The brain makes use of multiple visual cues to reconstruct the three-dimensional structure of a scene. One potent cue, motion parallax, frequently arises during translation of the observer because the images of objects at different distances move across the retina with different velocities. Human psychophysical studies have demonstrated that motion parallax can be a powerful depth cue, and motion parallax seems to be heavily exploited by animal species that lack highly developed binocular vision. However, little is known about the neural mechanisms that underlie this capacity. Here we show, by using a virtual-reality system to translate macaque monkeys (Macaca mulatta) while they viewed motion parallax displays that simulated objects at different depths, that many neurons in the middle temporal area (area MT) signal the sign of depth (near versus far) from motion parallax in the absence of other depth cues. To achieve this, neurons must combine visual motion with extra-retinal (non-visual) signals related to the animal's movement. Our findings suggest a new neural substrate for depth perception and demonstrate a robust interaction of visual and non-visual cues in area MT. Combined with previous studies that implicate area MT in depth perception based on binocular disparities, our results suggest that area MT contains a more general representation of three-dimensional space that makes use of multiple cues.     

Motor learning in a recurrent network model based on the vestibulo-ocular reflex.

Most models of neural networks have assumed that neurons process information on a timescale of milliseconds and that the long-term modification of synaptic strengths underlies learning and memory. But neurons also have cellular mechanisms that operate on a timescale of tens or hundreds of milliseconds, such as a gradual rise in firing rate in response to injection of constant current or a rapid rise followed by a slower adaptation. These dynamic properties of neuronal responses are mediated by ion channels that are subject to modulation. We demonstrate here how a neural network with recurrent feedback connections can convert long-term modulation of neural responses that occur over these intermediate timescales into changes in the amplitude of the steady output from the system. This general principle may be relevant to many feedback systems in the brain. Here it is applied to the vestibulo-ocular reflex, whose amplitude is subject to long-term adaptive modification by visual inputs. The model reconciles apparently contradictory data on the neural locus of the cellular mechanisms that mediate this simple form of learning and memory.     

Odour-plume dynamics influence the brain's olfactory code

The neural computations used to represent olfactory information in the brain have long been investigated. Recent studies in the insect antennal lobe suggest that precise temporal and/or spatial patterns of activity underlie the recognition and discrimination of different odours, and that these patterns may be strengthened by associative learning. It remains unknown, however, whether these activity patterns persist when odour intensity varies rapidly and unpredictably, as often occurs in nature. Here we show that with naturally intermittent odour stimulation, spike patterns recorded from moth antennal-lobe output neurons varied predictably with the fine-scale temporal dynamics and intensity of the odour. These data support the hypothesis that olfactory circuits compensate for contextual variations in the stimulus pattern with high temporal precision. The timing of output neuron activity is constantly modulated to reflect ongoing changes in stimulus intensity and dynamics that occur on a millisecond timescale.