Spatio-temporal correlations and visual signalling in a complete neuronal population

Statistical dependencies in the responses of sensory neurons govern both the amount of stimulus information conveyed and the means by which downstream neurons can extract it. Although a variety of measurements indicate the existence of such dependencies, their origin and importance for neural coding are poorly understood. Here we analyse the functional significance of correlated firing in a complete population of macaque parasol retinal ganglion cells using a model of multi-neuron spike responses. The model, with parameters fit directly to physiological data, simultaneously captures both the stimulus dependence and detailed spatio-temporal correlations in population responses, and provides two insights into the structure of the neural code. First, neural encoding at the population level is less noisy than one would expect from the variability of individual neurons: spike times are more precise, and can be predicted more accurately when the spiking of neighbouring neurons is taken into account. Second, correlations provide additional sensory information: optimal, model-based decoding that exploits the response correlation structure extracts 20% more information about the visual scene than decoding under the assumption of independence, and preserves 40% more visual information than optimal linear decoding. This model-based approach reveals the role of correlated activity in the retinal coding of visual stimuli, and provides a general framework for understanding the importance of correlated activity in populations of neurons.     

Two types of orientation-sensitive responses of amacrine cells in the mammalian retina.

Neurons sensitive to the orientation of light stimuli exist throughout the mammalian visual system, suggesting that this spatial feature is a fundamental cue used by the brain to decipher visual information. The most peripheral neurons known to show orientation sensitivity are the retinal ganglion cells. Considerable morphological and pharmacological data suggest that the orientation sensitivity of ganglion cells is formed, at least partly, by the amacrine cells, which are laterally oriented interneurons presynaptic to the ganglion cells in the inner plexiform layer. So far there have been few studies of the responses of amacrine cells to oriented visual stimuli and their role in forming orientation-sensitive responses in the retina remains unclear. Here I report the novel finding of a population of amacrine cells in the rabbit retina which are orientation-sensitive. These amacrine cells can be divided into two subtypes, whose orientation sensitivity is manufactured by two distinct mechanisms. The orientation sensitivity of the first subtype of amacrine cell is formed from the interactions of excitatory, centre-receptive field synaptic inputs and inhibitory inputs of opposite polarity, whereas that for cells of the second subtype seems to be the product of a marked asymmetry in their dendritic arbors.     

Molecular identification of a retinal cell type that responds to upward motion

The retina contains complex circuits of neurons that extract salient information from visual inputs. Signals from photoreceptors are processed by retinal interneurons, integrated by retinal ganglion cells (RGCs) and sent to the brain by RGC axons. Distinct types of RGC respond to different visual features, such as increases or decreases in light intensity (ON and OFF cells, respectively), colour or moving objects. Thus, RGCs comprise a set of parallel pathways from the eye to the brain. The identification of molecular markers for RGC subsets will facilitate attempts to correlate their structure with their function, assess their synaptic inputs and targets, and study their diversification. Here we show, by means of a transgenic marking method, that junctional adhesion molecule B (JAM-B) marks a previously unrecognized class of OFF RGCs in mice. These cells have asymmetric dendritic arbors aligned in a dorsal-to-ventral direction across the retina. Their receptive fields are also asymmetric and respond selectively to stimuli moving in a soma-to-dendrite direction; because the lens reverses the image of the world on the retina, these cells detect upward motion in the visual field. Thus, JAM-B identifies a unique population of RGCs in which structure corresponds remarkably to function.     

Global and fine information coded by single neurons in the temporal visual cortex.

When we see a person's face, we can easily recognize their species, individual identity and emotional state. How does the brain represent such complex information? A substantial number of neurons in the macaque temporal cortex respond to faces. However, the neuronal mechanisms underlying the processing of complex information are not yet clear. Here we recorded the activity of single neurons in the temporal cortex of macaque monkeys while presenting visual stimuli consisting of geometric shapes, and monkey and human faces with various expressions. Information theory was used to investigate how well the neuronal responses could categorize the stimuli. We found that single neurons conveyed two different scales of facial information in their firing patterns, starting at different latencies. Global information, categorizing stimuli as monkey faces, human faces or shapes, was conveyed in the earliest part of the responses. Fine information about identity or expression was conveyed later, beginning on average 51 ms after global information. We speculate that global information could be used as a 'header' to prepare destination areas for receiving more detailed information.     

Correlation between neural spike trains increases with firing rate

Populations of neurons in the retina, olfactory system, visual and somatosensory thalamus, and several cortical regions show temporal correlation between the discharge times of their action potentials (spike trains). Correlated firing has been linked to stimulus encoding, attention, stimulus discrimination, and motor behaviour. Nevertheless, the mechanisms underlying correlated spiking are poorly understood, and its coding implications are still debated. It is not clear, for instance, whether correlations between the discharges of two neurons are determined solely by the correlation between their afferent currents, or whether they also depend on the mean and variance of the input. We addressed this question by computing the spike train correlation coefficient of unconnected pairs of in vitro cortical neurons receiving correlated inputs. Notably, even when the input correlation remained fixed, the spike train output correlation increased with the firing rate, but was largely independent of spike train variability. With a combination of analytical techniques and numerical simulations using 'integrate-and-fire' neuron models we show that this relationship between output correlation and firing rate is robust to input heterogeneities. Finally, this overlooked relationship is replicated by a standard threshold-linear model, demonstrating the universality of the result. This connection between the rate and correlation of spiking activity links two fundamental features of the neural code.     

Spatial structure of cone inputs to receptive fields in primate lateral geniculate nucleus.

Human colour vision depends on three classes of cone photoreceptors, those sensitive to short (S), medium (M) or long (L) wavelengths, and on how signals from these cones are combined by neurons in the retina and brain. Macaque monkey colour vision is similar to human, and the receptive fields of macaque visual neurons have been used as an animal model of human colour processing. P retinal ganglion cells and parvocellular neurons are colour-selective neurons in macaque retina and lateral geniculate nucleus. Interactions between cone signals feeding into these neurons are still unclear. On the basis of experimental results with chromatic adaptation, excitatory and inhibitory inputs from L and M cones onto P cells (and parvocellular neurons) were thought to be quite specific (Fig. 1a). But these experiments with spatially diffuse adaptation did not rule out the 'mixed-surround' hypothesis: that there might be one cone-specific mechanism, the receptive field centre, and a surround mechanism connected to all cone types indiscriminately (Fig. 1e). Recent work has tended to support the mixed-surround hypothesis. We report here the development of new stimuli to measure spatial maps of the linear L-, M- and S-cone inputs to test the hypothesis definitively. Our measurements contradict the mixed-surround hypothesis and imply cone specificity in both centre and surround.     

视网膜神经元网络模型分析

将嗅觉神经系统刺激、响应的WinnerLess Competition (WLC)模型应用到视觉通道的视网膜神经元网络的计算之中,研究视网膜神经元的电位发放特性.通过数值实验,发现视网膜神经元的电位发放与生理实验的结果相近,得出WLC模型能够用于视觉通道计算研究的结论,并分析了视网膜神经元网络中神经节神经元电位发放的ISI,讨论了该网络模型的动力学性质.     

Cross-modal and cross-temporal association in neurons of frontal cortex

The prefrontal cortex is essential for the temporal integration of sensory information in behavioural and linguistic sequences. Such information is commonly encoded in more than one sense modality, notably sight and sound. Connections from sensory cortices to the prefrontal cortex support its integrative function. Here we present the first evidence that prefrontal cortex cells associate visual and auditory stimuli across time. We gave monkeys the task of remembering a tone of a certain pitch for 10 s and then choosing the colour associated with it. In this task, prefrontal cortex cells responded selectively to tones, and most of them also responded to colours according to the task rule. Thus, their reaction to a tone was correlated with their subsequent reaction to the associated colour. This correlation faltered in trials ending in behavioural error. We conclude that prefrontal cortex neurons are part of integrative networks that represent behaviourally meaningful cross-modal associations. The orderly and timely activation of neurons in such networks is crucial for the temporal transfer of information in the structuring of behaviour, reasoning and language.     

Dynamic predictive coding by the retina

Retinal ganglion cells convey the visual image from the eye to the brain. They generally encode local differences in space and changes in time rather than the raw image intensity. This can be seen as a strategy of predictive coding, adapted through evolution to the average image statistics of the natural environment. Yet animals encounter many environments with visual statistics different from the average scene. Here we show that when this happens, the retina adjusts its processing dynamically. The spatio-temporal receptive fields of retinal ganglion cells change after a few seconds in a new environment. The changes are adaptive, in that the new receptive field improves predictive coding under the new image statistics. We show that a network model with plastic synapses can account for the large variety of observed adaptations.     

Anticipation of moving stimuli by the retina

A flash of light evokes neural activity in the brain with a delay of 30-100 milliseconds, much of which is due to the slow process of visual transduction in photoreceptors. A moving object can cover a considerable distance in this time, and should therefore be seen noticeably behind its actual location. As this conflicts with everyday experience, it has been suggested that the visual cortex uses the delayed visual data from the eye to extrapolate the trajectory of a moving object, so that it is perceived at its actual location. Here we report that such anticipation of moving stimuli begins in the retina. A moving bar elicits a moving wave of spiking activity in the population of retinal ganglion cells. Rather than lagging behind the visual image, the population activity travels near the leading edge of the moving bar. This response is observed over a wide range of speeds and apparently compensates for the visual response latency. We show how this anticipation follows from known mechanisms of retinal processing.     

Ganglion cell death during development of ipsilateral retino-collicular projection in golden hamster

In rats and hamsters all parts of the superior colliculus (SC) receive a topographically organized projection from the retina of the contralateral eye, and the rostral part also has a direct input from the lower temporal crescent of the ipsilateral retina, which views the central, binocular portion of the visual field. Initially the uncrossed projection covers the entire SC, but over the first 2 weeks of postnatal life it becomes progressively restricted to its adult distribution. However, if the opposite eye is removed at birth there is a persistent widespread uncrossed projection to the SC. We have used short- and long-term retrogradely transported neuronal markers to examine the distribution and fate of the ganglion cells of origin of the uncrossed retino-collicular projection throughout postnatal development. We conclude that the withdrawal of the early exuberant projection to the caudal SC is associated with death of ganglion cells and their virtual elimination outside the temporal crescent of the ipsilateral retina. Early enucleation of the other eye rescues many of these cells.     

Functions of the ON and OFF channels of the visual system

In the mammalian eye, the ON-centre and OFF-centre retinal ganglion cells form two major pathways projecting to central visual structures from the retina. These two pathways originate at the bipolar cell level: one class of bipolar cells becomes hyperpolarized in response to light, as do all photoreceptor cells, and the other class becomes depolarized on exposure to light, thereby inverting the receptor signal. It has recently become possible to examine the functional role of the ON-pathway in vision by selectively blocking it at the bipolar cell level using the glutamate neurotransmitter analogue 2-amino-4-phosphonobutyrate (APB)1. APB application to monkey, cat and rabbit retinas abolishes ON responses in retinal ganglion cells, the lateral geniculate nucleus and the visual cortex but has no effect on the centre-surround antagonism of OFF cells or the orientation and direction selectivities in the cortex2-5. These and related findings6-11 suggest that the ON and OFF pathways remain largely separate through the lateral geniculate nucleus and that in the cortex, contrary to some hypotheses, they are not directly involved in mechanisms giving rise to orientation and direction selectivities. We have examined the roles of the ON and OFF channels in vision in rhesus monkeys trained to do visual detection and discrimination tasks. We report here that the ON channel is reversibly blocked by injection of APB into the vitreous. Detection of light increment but not of light decrement is severely impaired, and there is a pronounced loss in contrast sensitivity. The perception of shape, colour, flicker, movement and stereo images is only mildly impaired, but longer times are required for their discrimination. Our results suggest that two reasons that the mammalian visual system has both ON and OFF channels is to yield equal sensitivity and rapid information transfer for both incremental and decremental light stimuli and to facilitate high contrast sensitivity.     

Cellular networks underlying human spatial navigation

Place cells of the rodent hippocampus constitute one of the most striking examples of a correlation between neuronal activity and complex behaviour in mammals. These cells increase their firing rates when the animal traverses specific regions of its surroundings, providing a context-dependent map of the environment. Neuroimaging studies implicate the hippocampus and the parahippocampal region in human navigation. However, these regions also respond selectively to visual stimuli. It thus remains unclear whether rodent place coding has a homologue in humans or whether human navigation is driven by a different, visually based neural mechanism. We directly recorded from 317 neurons in the human medial temporal and frontal lobes while subjects explored and navigated a virtual town. Here we present evidence for a neural code of human spatial navigation based on cells that respond at specific spatial locations and cells that respond to views of landmarks. The former are present primarily in the hippocampus, and the latter in the parahippocampal region. Cells throughout the frontal and temporal lobes responded to the subjects' navigational goals and to conjunctions of place, goal and view.     

Substance P-immunoreactive retinal ganglion cells and their central axon terminals in the rabbit

Retinal ganglion cells are the projection neurons that link the retina to the brain. Peptide immunoreactive cells in the ganglion cell layer (GCL) of the mammalian retina have been noted but their identity has not been determined. We now report that, in the rabbit, 25-35% of all retinal ganglion cells contain substance P-like (SP) immunoreactivity. They were identified by either retrograde transport of fluorescent tracers injected into the superior colliculus, or by retrograde degeneration after optic nerve section. SP immunoreactive cells are present in all parts of the retina and have medium to large cell bodies with dendrites that ramify extensively in the proximal inner plexiform layer. Their axons terminate in the dorsal lateral geniculate nucleus, superior colliculus and accessory optic nuclei, and these terminals disappear completely after contralateral optic nerve section and/or eye enucleation. In the dorsal lateral geniculate nucleus large, beaded, immunoreactive axons and varicosities make up a narrow plexus just below the optic tract, where they define a new geniculate lamina. The varicosities make multiple synaptic contacts with dendrites of dorsal lateral geniculate nucleus projection neurons and presumptive interneurons in complex glomerular neuropil. This is direct evidence that some mammalian retinal ganglion cells contain substance P-like peptides and strongly suggests that, in the rabbit, substance P (or related tachykinins) may be a transmitter or modulator in a specific population or populations of retinal ganglion cells.     

Cortical magnification factor and the ganglion cell density of the primate retina

It has long been contentious whether the large representation of the fovea in the primate visual cortex (V1) indicates a selective magnification of this part of the retina, or whether it merely reflects the density of retinal ganglion cells. The measurement of the retinal ganglion-cell density is complicated by lateral displacements of cells around the fovea and the presence of displaced amacrine cells in the ganglion cell layer. We have now identified displaced amacrine cells by GABA immunohistochemistry and by retrograde degeneration of ganglion cells. By reconstructing the fovea from serial sections, we were able to compare the densities of cones, cone pedicles and ganglion cells; in this way we found that there are more than three ganglion cells per foveal cone. Between the central and the peripheral retina, the ganglion cell density changes by a factor of 1,000-2,000, which is within the range of estimates of the cortical magnification factor. There is therefore no need to postulate a selective magnification of the fovea in the geniculate and/or the visual cortex.     

Functional connectivity in the retina at the resolution of photoreceptors

To understand a neural circuit requires knowledge of its connectivity. Here we report measurements of functional connectivity between the input and ouput layers of the macaque retina at single-cell resolution and the implications of these for colour vision. Multi-electrode technology was used to record simultaneously from complete populations of the retinal ganglion cell types (midget, parasol and small bistratified) that transmit high-resolution visual signals to the brain. Fine-grained visual stimulation was used to identify the location, type and strength of the functional input of each cone photoreceptor to each ganglion cell. The populations of ON and OFF midget and parasol cells each sampled the complete population of long- and middle-wavelength-sensitive cones. However, only OFF midget cells frequently received strong input from short-wavelength-sensitive cones. ON and OFF midget cells showed a small non-random tendency to selectively sample from either long- or middle-wavelength-sensitive cones to a degree not explained by clumping in the cone mosaic. These measurements reveal computations in a neural circuit at the elementary resolution of individual neurons.     

Neuronal filtering of multiplexed odour representations

Neuronal activity patterns contain information in their temporal structure, indicating that information transfer between neurons may be optimized by temporal filtering. In the zebrafish olfactory bulb, subsets of output neurons (mitral cells) engage in synchronized oscillations during odour responses, but information about odour identity is contained mostly in non-oscillatory firing rate patterns. Using optogenetic manipulations and odour stimulation, we found that firing rate responses of neurons in the posterior zone of the dorsal telencephalon (Dp), a target area homologous to olfactory cortex, were largely insensitive to oscillatory synchrony of mitral cells because passive membrane properties and synaptic currents act as low-pass filters. Nevertheless, synchrony influenced spike timing. Moreover, Dp neurons responded primarily during the decorrelated steady state of mitral cell activity patterns. Temporal filtering therefore tunes Dp neurons to components of mitral cell activity patterns that are particularly informative about precise odour identity. These results demonstrate how temporal filtering can extract specific information from multiplexed neuronal codes.     

Experience-dependent representation of visual categories in parietal cortex

Categorization is a process by which the brain assigns meaning to sensory stimuli. Through experience, we learn to group stimuli into categories, such as 'chair', 'table' and 'vehicle', which are critical for rapidly and appropriately selecting behavioural responses. Although much is known about the neural representation of simple visual stimulus features (for example, orientation, direction and colour), relatively little is known about how the brain learns and encodes the meaning of stimuli. We trained monkeys to classify 360 degrees of visual motion directions into two discrete categories, and compared neuronal activity in the lateral intraparietal (LIP) and middle temporal (MT) areas, two interconnected brain regions known to be involved in visual motion processing. Here we show that neurons in LIP--an area known to be centrally involved in visuo-spatial attention, motor planning and decision-making-robustly reflect the category of motion direction as a result of learning. The activity of LIP neurons encoded directions of motion according to their category membership, and that encoding shifted after the monkeys were retrained to group the same stimuli into two new categories. In contrast, neurons in area MT were strongly direction selective but carried little, if any, explicit category information. This indicates that LIP might be an important nexus for the transformation of visual direction selectivity to more abstract representations that encode the behavioural relevance, or meaning, of stimuli.     

The primate amygdala represents the positive and negative value of visual stimuli during learning

Visual stimuli can acquire positive or negative value through their association with rewards and punishments, a process called reinforcement learning. Although we now know a great deal about how the brain analyses visual information, we know little about how visual representations become linked with values. To study this process, we turned to the amygdala, a brain structure implicated in reinforcement learning. We recorded the activity of individual amygdala neurons in monkeys while abstract images acquired either positive or negative value through conditioning. After monkeys had learned the initial associations, we reversed image value assignments. We examined neural responses in relation to these reversals in order to estimate the relative contribution to neural activity of the sensory properties of images and their conditioned values. Here we show that changes in the values of images modulate neural activity, and that this modulation occurs rapidly enough to account for, and correlates with, monkeys' learning. Furthermore, distinct populations of neurons encode the positive and negative values of visual stimuli. Behavioural and physiological responses to visual stimuli may therefore be based in part on the plastic representation of value provided by the amygdala.     

Functional specificity of local synaptic connections in neocortical networks

Neuronal connectivity is fundamental to information processing in the brain. Therefore, understanding the mechanisms of sensory processing requires uncovering how connection patterns between neurons relate to their function. On a coarse scale, long-range projections can preferentially link cortical regions with similar responses to sensory stimuli. But on the local scale, where dendrites and axons overlap substantially, the functional specificity of connections remains unknown. Here we determine synaptic connectivity between nearby layer 2/3 pyramidal neurons in vitro, the response properties of which were first characterized in mouse visual cortex in vivo. We found that connection probability was related to the similarity of visually driven neuronal activity. Neurons with the same preference for oriented stimuli connected at twice the rate of neurons with orthogonal orientation preferences. Neurons responding similarly to naturalistic stimuli formed connections at much higher rates than those with uncorrelated responses. Bidirectional synaptic connections were found more frequently between neuronal pairs with strongly correlated visual responses. Our results reveal the degree of functional specificity of local synaptic connections in the visual cortex, and point to the existence of fine-scale subnetworks dedicated to processing related sensory information.