Top-down signal from prefrontal cortex in executive control of memory retrieval.

Knowledge or experience is voluntarily recalled from memory by reactivation of the neural representations in the cerebral association cortex. In inferior temporal cortex, which serves as the storehouse of visual long-term memory, activation of mnemonic engrams through electric stimulation results in imagery recall in humans, and neurons can be dynamically activated by the necessity for memory recall in monkeys. Neuropsychological studies and previous split-brain experiments predicted that prefrontal cortex exerts executive control upon inferior temporal cortex in memory retrieval; however, no neuronal correlate of this process has ever been detected. Here we show evidence of the top-down signal from prefrontal cortex. In the absence of bottom-up visual inputs, single inferior temporal neurons were activated by the top-down signal, which conveyed information on semantic categorization imposed by visual stimulus-stimulus association. Behavioural performance was severely impaired with loss of the top-down signal. Control experiments confirmed that the signal was transmitted not through a subcortical but through a fronto-temporal cortical pathway. Thus, feedback projections from prefrontal cortex to the posterior association cortex appear to serve the executive control of voluntary recall.     

Neural organization for the long-term memory of paired associates

Most of our long-term memories of episodes or objects are organized so that we can retrieve them by association. Clinical neuropsychologists assess human memory by the paired-associate learning test, in which a series of paired words or figures is presented and the subject is then asked to retrieve the other pair member associated with each cue. Patients with lesions of the temporal lobe show marked impairment in this test. In our study, we trained monkeys in a pair-association task using a set of computer-generated paired patterns. We found two types of task-related neurons in the anterior temporal cortex. One type selectively responded to both pictures of the paired associates. The other type, which had the strongest response to one picture during the cue presentation, exhibited increasing activity during the delay period when the associate of that picture was used as a cue. These results provide new evidence that single neurons acquire selectivity for visual patterns through associative learning. They also indicate neural mechanisms for storage and retrieval in the long-term memory of paired associates.     

Neuronal correlate of pictorial short-term memory in the primate temporal cortex

It has been proposed that visual-memory traces are located in the temporal lobes of the cerebral cortex, as electric stimulation of this area in humans results in recall of imagery. Lesions in this area also affect recognition of an object after a delay in both humans and monkeys, indicating a role in short-term memory of images. Single-unit recordings from the temporal cortex have shown that some neurons continue to fire when one of two or four colours are to be remembered temporarily. But neuronal responses selective to specific complex objects, including hands and faces, cease soon after the offset of stimulus presentation. These results led to the question of whether any of these neurons could serve the memory of complex objects. We report here a group of shape-selective neurons in an anterior ventral part of the temporal cortex of monkeys that exhibited sustained activity during the delay period of a visual short-term memory task. The activity was highly selective for the pictorial information to be memorized and was independent of the physical attributes such as size, orientation, colour or position of the object. These observations show that the delay activity represents the short-term memory of the categorized percept of a picture.     

Entrained rhythmic activities of neuronal ensembles as perceptual memory of time interval

The ability to process temporal information is fundamental to sensory perception, cognitive processing and motor behaviour of all living organisms, from amoebae to humans. Neural circuit mechanisms based on neuronal and synaptic properties have been shown to process temporal information over the range of tens of microseconds to hundreds of milliseconds. How neural circuits process temporal information in the range of seconds to minutes is much less understood. Studies of working memory in monkeys and rats have shown that neurons in the prefrontal cortex, the parietal cortex and the thalamus exhibit ramping activities that linearly correlate with the lapse of time until the end of a specific time interval of several seconds that the animal is trained to memorize. Many organisms can also memorize the time interval of rhythmic sensory stimuli in the timescale of seconds and can coordinate motor behaviour accordingly, for example, by keeping the rhythm after exposure to the beat of music. Here we report a form of rhythmic activity among specific neuronal ensembles in the zebrafish optic tectum, which retains the memory of the time interval (in the order of seconds) of repetitive sensory stimuli for a duration of up to approximately 20 s. After repetitive visual conditioning stimulation (CS) of zebrafish larvae, we observed rhythmic post-CS activities among specific tectal neuronal ensembles, with a regular interval that closely matched the CS. Visuomotor behaviour of the zebrafish larvae also showed regular post-CS repetitions at the entrained time interval that correlated with rhythmic neuronal ensemble activities in the tectum. Thus, rhythmic activities among specific neuronal ensembles may act as an adjustable 'metronome' for time intervals in the order of seconds, and serve as a mechanism for the short-term perceptual memory of rhythmic sensory experience.     

Visual categorization shapes feature selectivity in the primate temporal cortex.

The way that we perceive and interact with objects depends on our previous experience with them. For example, a bird expert is more likely to recognize a bird as a sparrow, a sandpiper or a cockatiel than a non-expert. Neurons in the inferior temporal cortex have been shown to be important in the representation of visual objects; however, it is unknown which object features are represented and how these representations are affected by categorization training. Here we show that feature selectivity in the macaque inferior temporal cortex is shaped by categorization of objects on the basis of their visual features. Specifically, we recorded from single neurons while monkeys performed a categorization task with two sets of parametric stimuli. Each stimulus set consisted of four varying features, but only two of the four were important for the categorization task (diagnostic features). We found enhanced neuronal representation of the diagnostic features relative to the non-diagnostic ones. These findings demonstrate that stimulus features important for categorization are instantiated in the activity of single units (neurons) in the primate inferior temporal cortex.     

A comparison of inhibition in orientation and spatial frequency selectivity of cat visual cortex

Neurones in the visual cortex are highly selective for orientation and spatial frequency of visual stimuli. There is strong neurophysiological evidence that orientation selectivity is enhanced by inhibitory interconnections between columns in the cortex which have different orientation sensitivities, an idea which is supported by experiments using neuropharmacological manipulation or complex visual stimuli. It has also been proposed that selectivity for spatial frequency is mediated in part by a similar mechanism to that for orientation, although evidence for this is based on special use of visual stimuli, which hampers interpretation of the findings. We have therefore examined selectivity for both orientation and spatial frequency using a technique which allows direct inferences about inhibitory processes. Our method uses microiontophoresis of an excitatory amino acid to elevate maintained discharge of single neurones in the visual cortex. We then present visual stimuli both within and outside the range of orientations and spatial frequencies which cause a cell to respond with increased discharge. Our results show that orientations presented on either side of the responsive range usually produce clear suppression of maintained discharge. In marked contrast, spatial frequencies shown to either side of the responsive range have little or no effect on maintained activity. We conclude that there is an intracortical organization of inhibitory connections between cells tuned to different orientations but not different spatial frequencies.     

Practising orientation identification improves orientation coding in V1 neurons

The adult brain shows remarkable plasticity, as demonstrated by the improvement in fine sensorial discriminations after intensive practice. The behavioural aspects of such perceptual learning are well documented, especially in the visual system. Specificity for stimulus attributes clearly implicates an early cortical site, where receptive fields retain fine selectivity for these attributes; however, the neuronal correlates of a simple visual discrimination task remained unidentified. Here we report electrophysiological correlates in the primary visual cortex (V1) of monkeys for learning orientation identification. We link the behavioural improvement in this type of learning to an improved neuronal performance of trained compared to naive neurons. Improved long-term neuronal performance resulted from changes in the characteristics of orientation tuning of individual neurons. More particularly, the slope of the orientation tuning curve that was measured at the trained orientation increased only for the subgroup of trained neurons most likely to code the orientation identified by the monkey. No modifications of the tuning curve were observed for orientations for which the monkey had not been trained. Thus training induces a specific and efficient increase in neuronal sensitivity in V1.     

Selective responses of visual cortical cells do not depend on shunting inhibition

Theoretical analyses of the electrical behaviour of the highly branched processes of nerve cells has focused attention on the possibility that single cells perform complex logical operations rather than simply summing their synaptic inputs. In particular, it has been suggested that the orientation and direction selectivity of cells in the visual cortex results from the action of a nonlinear 'shunting' inhibition that emulates an AND-NOT logical operation. The characteristic biophysical feature of this proposed inhibitory mechanism is that it evokes a large and relatively sustained increase in the conductance of the neuronal membrane while leaving the membrane potential unaffected. This shunting mechanism contrasts with linear 'summative' inhibition in which conductance changes are less prominent, and inhibition is achieved by hyperpolarization of the membrane potential. In a direct experimental test of the hypothesis that the selectivity of visual cortical neurons depends on shunting inhibition we found no evidence for the large conductance changes predicted by the theory.     

Choice-specific sequences in parietal cortex during a virtual-navigation decision task

The posterior parietal cortex (PPC) has an important role in many cognitive behaviours; however, the neural circuit dynamics underlying PPC function are not well understood. Here we optically imaged the spatial and temporal activity patterns of neuronal populations in mice performing a PPC-dependent task that combined a perceptual decision and memory-guided navigation in a virtual environment. Individual neurons had transient activation staggered relative to one another in time, forming a sequence of neuronal activation spanning the entire length of a task trial. Distinct sequences of neurons were triggered on trials with opposite behavioural choices and defined divergent, choice-specific trajectories through a state space of neuronal population activity. Cells participating in the different sequences and at distinct time points in the task were anatomically intermixed over microcircuit length scales (<100 micrometres). During working memory decision tasks, the PPC may therefore perform computations through sequence-based circuit dynamics, rather than long-lived stable states, implemented using anatomically intermingled microcircuits.     

Functional imaging with cellular resolution reveals precise micro-architecture in visual cortex

Neurons in the cerebral cortex are organized into anatomical columns, with ensembles of cells arranged from the surface to the white matter. Within a column, neurons often share functional properties, such as selectivity for stimulus orientation; columns with distinct properties, such as different preferred orientations, tile the cortical surface in orderly patterns. This functional architecture was discovered with the relatively sparse sampling of microelectrode recordings. Optical imaging of membrane voltage or metabolic activity elucidated the overall geometry of functional maps, but is averaged over many cells (resolution >100 microm). Consequently, the purity of functional domains and the precision of the borders between them could not be resolved. Here, we labelled thousands of neurons of the visual cortex with a calcium-sensitive indicator in vivo. We then imaged the activity of neuronal populations at single-cell resolution with two-photon microscopy up to a depth of 400 microm. In rat primary visual cortex, neurons had robust orientation selectivity but there was no discernible local structure; neighbouring neurons often responded to different orientations. In area 18 of cat visual cortex, functional maps were organized at a fine scale. Neurons with opposite preferences for stimulus direction were segregated with extraordinary spatial precision in three dimensions, with columnar borders one to two cells wide. These results indicate that cortical maps can be built with single-cell precision.     

Cortical microstimulation influences perceptual judgements of motion direction

Neurons in the visual cortex respond selectively to perceptually salient features of the visual scene, such as the direction and speed of moving objects, the orientation of local contours, or the colour or relative depth of a visual pattern. It is commonly assumed that the brain constructs its percept of the visual scene from information encoded in the selective responses of such neurons. We have now tested this hypothesis directly by measuring the effect on psychophysical performance of modifying the firing rates of physiologically characterized neurons. We required rhesus monkeys to report the direction of motion in a visual display while we electrically stimulated clusters of directionally selective neurons in the middle temporal visual area (MT, or V5), an extrastriate area that plays a prominent role in the analysis of visual motion information. Microstimulation biased the animals' judgements towards the direction of motion encoded by the stimulated neurons. This result indicates that physiological properties measured at the neuronal level can be causally related to a specific aspect of perceptual performance.     

Attention modulates synchronized neuronal firing in primate somatosensory cortex

A potentially powerful information processing strategy in the brain is to take advantage of the temporal structure of neuronal spike trains. An increase in synchrony within the neural representation of an object or location increases the efficacy of that neural representation at the next synaptic stage in the brain; thus, increasing synchrony is a candidate for the neural correlate of attentional selection. We investigated the synchronous firing of pairs of neurons in the secondary somatosensory cortex (SII) of three monkeys trained to switch attention between a visual task and a tactile discrimination task. We found that most neuron pairs in SII cortex fired synchronously and, furthermore, that the degree of synchrony was affected by the monkey's attentional state. In the monkey performing the most difficult task, 35% of neuron pairs that fired synchronously changed their degree of synchrony when the monkey switched attention between the tactile and visual tasks. Synchrony increased in 80% and decreased in 20% of neuron pairs affected by attention.     

Microstimulation of inferotemporal cortex influences face categorization

The inferior temporal cortex (IT) of primates is thought to be the final visual area in the ventral stream of cortical areas responsible for object recognition. Consistent with this hypothesis, single IT neurons respond selectively to highly complex visual stimuli such as faces. However, a direct causal link between the activity of face-selective neurons and face perception has not been demonstrated. In the present study of macaque monkeys, we artificially activated small clusters of IT neurons by means of electrical microstimulation while the monkeys performed a categorization task, judging whether noisy visual images belonged to 'face' or 'non-face' categories. Here we show that microstimulation of face-selective sites, but not other sites, strongly biased the monkeys' decisions towards the face category. The magnitude of the effect depended upon the degree of face selectivity of the stimulation site, the size of the stimulated cluster of face-selective neurons, and the exact timing of microstimulation. Our results establish a causal relationship between the activity of face-selective neurons and face perception.     

Global and fine information coded by single neurons in the temporal visual cortex.

When we see a person's face, we can easily recognize their species, individual identity and emotional state. How does the brain represent such complex information? A substantial number of neurons in the macaque temporal cortex respond to faces. However, the neuronal mechanisms underlying the processing of complex information are not yet clear. Here we recorded the activity of single neurons in the temporal cortex of macaque monkeys while presenting visual stimuli consisting of geometric shapes, and monkey and human faces with various expressions. Information theory was used to investigate how well the neuronal responses could categorize the stimuli. We found that single neurons conveyed two different scales of facial information in their firing patterns, starting at different latencies. Global information, categorizing stimuli as monkey faces, human faces or shapes, was conveyed in the earliest part of the responses. Fine information about identity or expression was conveyed later, beginning on average 51 ms after global information. We speculate that global information could be used as a 'header' to prepare destination areas for receiving more detailed information.     

Voltage-sensitive dyes reveal a modular organization in monkey striate cortex

Voltage-sensitive dyes allow neuronal activity to be studied by non-invasive optical techniques. They provide an attractive means of investigating striate cortex, where important response properties are organized in two dimensions. In the present study, patterns of ocular dominance and orientation selectivity were obtained repeatedly from the same patch of cortex using the dye merocyanine oxazolone, together with current image-processing techniques. The patterns observed agree with most established features of monkey striate cortex and suggest a new unit of cortical organization; one that is modular in structure and which appears to link the organization of orientation selectivity with that of ocular dominance.     

Structural basis of long-term potentiation in single dendritic spines

Dendritic spines of pyramidal neurons in the cerebral cortex undergo activity-dependent structural remodelling that has been proposed to be a cellular basis of learning and memory. How structural remodelling supports synaptic plasticity, such as long-term potentiation, and whether such plasticity is input-specific at the level of the individual spine has remained unknown. We investigated the structural basis of long-term potentiation using two-photon photolysis of caged glutamate at single spines of hippocampal CA1 pyramidal neurons. Here we show that repetitive quantum-like photorelease (uncaging) of glutamate induces a rapid and selective enlargement of stimulated spines that is transient in large mushroom spines but persistent in small spines. Spine enlargement is associated with an increase in AMPA-receptor-mediated currents at the stimulated synapse and is dependent on NMDA receptors, calmodulin and actin polymerization. Long-lasting spine enlargement also requires Ca2+/calmodulin-dependent protein kinase II. Our results thus indicate that spines individually follow Hebb's postulate for learning. They further suggest that small spines are preferential sites for long-term potentiation induction, whereas large spines might represent physical traces of long-term memory.     

Guarding the gateway to cortex with attention in visual thalamus

The massive visual input from the eye to the brain requires selective processing of some visual information at the expense of other information, a process referred to as visual attention. Increases in the responses of visual neurons with attention have been extensively studied along the visual processing streams in monkey cerebral cortex, from primary visual areas to parietal and frontal cortex. Here we show, by recording neurons in attending macaque monkeys (Macaca mulatta), that attention modulates visual signals before they even reach cortex by increasing responses of both magnocellular and parvocellular neurons in the first relay between retina and cortex, the lateral geniculate nucleus (LGN). At the same time, attention decreases neuronal responses in the adjacent thalamic reticular nucleus (TRN). Crick argued for such modulation of the LGN by observing that it is inhibited by the TRN, and suggested that "if the thalamus is the gateway to the cortex, the reticular complex might be described as the guardian of the gateway", a reciprocal relationship we now show to be more than just hypothesis. The reciprocal modulation in LGN and TRN appears only during the initial visual response, but the modulation of LGN reappears later in the response, suggesting separate early and late sources of attentional modulation in LGN.     

Role for a cortical input to hippocampal area CA1 in the consolidation of a long-term memory

A dialogue between the hippocampus and the neocortex is thought to underlie the formation, consolidation and retrieval of episodic memories, although the nature of this cortico-hippocampal communication is poorly understood. Using selective electrolytic lesions in rats, here we examined the role of the direct entorhinal projection (temporoammonic, TA) to the hippocampal area CA1 in short-term (24 hours) and long-term (four weeks) spatial memory in the Morris water maze. When short-term memory was examined, both sham- and TA-lesioned animals showed a significant preference for the target quadrant. When re-tested four weeks later, sham-lesioned animals exhibited long-term memory; in contrast, the TA-lesioned animals no longer showed target quadrant preference. Many long-lasting memories require a process called consolidation, which involves the exchange of information between the cortex and hippocampus. The disruption of long-term memory by the TA lesion could reflect a requirement for TA input during either the acquisition or consolidation of long-term memory. To distinguish between these possibilities, we trained animals, verified their spatial memory 24 hours later, and then subjected trained animals to TA lesions. TA-lesioned animals still exhibited a deficit in long-term memory, indicating a disruption of consolidation. Animals in which the TA lesion was delayed by three weeks, however, showed a significant preference for the target quadrant, indicating that the memory had already been adequately consolidated at the time of the delayed lesion. These results indicate that, after learning, ongoing cortical input conveyed by the TA path is required to consolidate long-term spatial memory.     

Division and subtraction by distinct cortical inhibitory networks in vivo

Brain circuits process information through specialized neuronal subclasses interacting within a network. Revealing their interplay requires activating specific cells while monitoring others in a functioning circuit. Here we use a new platform for two-way light-based circuit interrogation in visual cortex in vivo to show the computational implications of modulating different subclasses of inhibitory neurons during sensory processing. We find that soma-targeting, parvalbumin-expressing (PV) neurons principally divide responses but preserve stimulus selectivity, whereas dendrite-targeting, somatostatin-expressing (SOM) neurons principally subtract from excitatory responses and sharpen selectivity. Visualized in vivo cell-attached recordings show that division by PV neurons alters response gain, whereas subtraction by SOM neurons shifts response levels. Finally, stimulating identified neurons while scanning many target cells reveals that single PV and SOM neurons functionally impact only specific subsets of neurons in their projection fields. These findings provide direct evidence that inhibitory neuronal subclasses have distinct and complementary roles in cortical computations.