Spatio-temporal correlations and visual signalling in a complete neuronal population

Statistical dependencies in the responses of sensory neurons govern both the amount of stimulus information conveyed and the means by which downstream neurons can extract it. Although a variety of measurements indicate the existence of such dependencies, their origin and importance for neural coding are poorly understood. Here we analyse the functional significance of correlated firing in a complete population of macaque parasol retinal ganglion cells using a model of multi-neuron spike responses. The model, with parameters fit directly to physiological data, simultaneously captures both the stimulus dependence and detailed spatio-temporal correlations in population responses, and provides two insights into the structure of the neural code. First, neural encoding at the population level is less noisy than one would expect from the variability of individual neurons: spike times are more precise, and can be predicted more accurately when the spiking of neighbouring neurons is taken into account. Second, correlations provide additional sensory information: optimal, model-based decoding that exploits the response correlation structure extracts 20% more information about the visual scene than decoding under the assumption of independence, and preserves 40% more visual information than optimal linear decoding. This model-based approach reveals the role of correlated activity in the retinal coding of visual stimuli, and provides a general framework for understanding the importance of correlated activity in populations of neurons.     

Temporal precision in the neural code and the timescales of natural vision

The timing of action potentials relative to sensory stimuli can be precise down to milliseconds in the visual system, even though the relevant timescales of natural vision are much slower. The existence of such precision contributes to a fundamental debate over the basis of the neural code and, specifically, what timescales are important for neural computation. Using recordings in the lateral geniculate nucleus, here we demonstrate that the relevant timescale of neuronal spike trains depends on the frequency content of the visual stimulus, and that 'relative', not absolute, precision is maintained both during spatially uniform white-noise visual stimuli and naturalistic movies. Using information-theoretic techniques, we demonstrate a clear role of relative precision, and show that the experimentally observed temporal structure in the neuronal response is necessary to represent accurately the more slowly changing visual world. By establishing a functional role of precision, we link visual neuron function on slow timescales to temporal structure in the response at faster timescales, and uncover a straightforward purpose of fine-timescale features of neuronal spike trains.     

视知觉训练与初级视皮层神经元信息及其表征容量

通过分析猕猴初级视皮层（V1）神经元的群体活动在轮廓线检测训练过程中的变化发现：知觉训练可以降低V1神经元响应在不同试次之间的变异性，促使V1神经元对相同刺激的响应更加稳定；训练还可降低V1神经元群体中神经元活动之间的相关性，使V1神经元之间的活动更加独立；增加了神经活动的维度，提高了神经元表征信息的容量，减少了冗余的神经活动，进而提升了感知能力.     

Experience-dependent representation of visual categories in parietal cortex

Categorization is a process by which the brain assigns meaning to sensory stimuli. Through experience, we learn to group stimuli into categories, such as 'chair', 'table' and 'vehicle', which are critical for rapidly and appropriately selecting behavioural responses. Although much is known about the neural representation of simple visual stimulus features (for example, orientation, direction and colour), relatively little is known about how the brain learns and encodes the meaning of stimuli. We trained monkeys to classify 360 degrees of visual motion directions into two discrete categories, and compared neuronal activity in the lateral intraparietal (LIP) and middle temporal (MT) areas, two interconnected brain regions known to be involved in visual motion processing. Here we show that neurons in LIP--an area known to be centrally involved in visuo-spatial attention, motor planning and decision-making-robustly reflect the category of motion direction as a result of learning. The activity of LIP neurons encoded directions of motion according to their category membership, and that encoding shifted after the monkeys were retrained to group the same stimuli into two new categories. In contrast, neurons in area MT were strongly direction selective but carried little, if any, explicit category information. This indicates that LIP might be an important nexus for the transformation of visual direction selectivity to more abstract representations that encode the behavioural relevance, or meaning, of stimuli.     

The primate amygdala represents the positive and negative value of visual stimuli during learning

Visual stimuli can acquire positive or negative value through their association with rewards and punishments, a process called reinforcement learning. Although we now know a great deal about how the brain analyses visual information, we know little about how visual representations become linked with values. To study this process, we turned to the amygdala, a brain structure implicated in reinforcement learning. We recorded the activity of individual amygdala neurons in monkeys while abstract images acquired either positive or negative value through conditioning. After monkeys had learned the initial associations, we reversed image value assignments. We examined neural responses in relation to these reversals in order to estimate the relative contribution to neural activity of the sensory properties of images and their conditioned values. Here we show that changes in the values of images modulate neural activity, and that this modulation occurs rapidly enough to account for, and correlates with, monkeys' learning. Furthermore, distinct populations of neurons encode the positive and negative values of visual stimuli. Behavioural and physiological responses to visual stimuli may therefore be based in part on the plastic representation of value provided by the amygdala.     

Adaptive filtering enhances information transmission in visual cortex

Sensory neuroscience seeks to understand how the brain encodes natural environments. However, neural coding has largely been studied using simplified stimuli. In order to assess whether the brain's coding strategy depends on the stimulus ensemble, we apply a new information-theoretic method that allows unbiased calculation of neural filters (receptive fields) from responses to natural scenes or other complex signals with strong multipoint correlations. In the cat primary visual cortex we compare responses to natural inputs with those to noise inputs matched for luminance and contrast. We find that neural filters adaptively change with the input ensemble so as to increase the information carried by the neural response about the filtered stimulus. Adaptation affects the spatial frequency composition of the filter, enhancing sensitivity to under-represented frequencies in agreement with optimal encoding arguments. Adaptation occurs over 40 s to many minutes, longer than most previously reported forms of adaptation.     

Small modulation of ongoing cortical dynamics by sensory input during natural vision

During vision, it is believed that neural activity in the primary visual cortex is predominantly driven by sensory input from the environment. However, visual cortical neurons respond to repeated presentations of the same stimulus with a high degree of variability. Although this variability has been considered to be noise owing to random spontaneous activity within the cortex, recent studies show that spontaneous activity has a highly coherent spatio-temporal structure. This raises the possibility that the pattern of this spontaneous activity may shape neural responses during natural viewing conditions to a larger extent than previously thought. Here, we examine the relationship between spontaneous activity and the response of primary visual cortical neurons to dynamic natural-scene and random-noise film images in awake, freely viewing ferrets from the time of eye opening to maturity. The correspondence between evoked neural activity and the structure of the input signal was weak in young animals, but systematically improved with age. This improvement was linked to a shift in the dynamics of spontaneous activity. At all ages including the mature animal, correlations in spontaneous neural firing were only slightly modified by visual stimulation, irrespective of the sensory input. These results suggest that in both the developing and mature visual cortex, sensory evoked neural activity represents the modulation and triggering of ongoing circuit dynamics by input signals, rather than directly reflecting the structure of the input signal itself.     

Behavioural report of single neuron stimulation in somatosensory cortex

Understanding how neural activity in sensory cortices relates to perception is a central theme of neuroscience. Action potentials of sensory cortical neurons can be strongly correlated to properties of sensory stimuli and reflect the subjective judgements of an individual about stimuli. Microstimulation experiments have established a direct link from sensory activity to behaviour, suggesting that small neuronal populations can influence sensory decisions. However, microstimulation does not allow identification and quantification of the stimulated cellular elements. The sensory impact of individual cortical neurons therefore remains unknown. Here we show that stimulation of single neurons in somatosensory cortex affects behavioural responses in a detection task. We trained rats to respond to microstimulation of barrel cortex at low current intensities. We then initiated short trains of action potentials in single neurons by juxtacellular stimulation. Animals responded significantly more often in single-cell stimulation trials than in catch trials without stimulation. Stimulation effects varied greatly between cells, and on average in 5% of trials a response was induced. Whereas stimulation of putative excitatory neurons led to weak biases towards responding, stimulation of putative inhibitory neurons led to more variable and stronger sensory effects. Reaction times for single-cell stimulation were long and variable. Our results demonstrate that single neuron activity can cause a change in the animal's detection behaviour, suggesting a much sparser cortical code for sensations than previously anticipated.     

Gamma-band synchronization in visual cortex predicts speed of change detection

Our capacity to process and respond behaviourally to multiple incoming stimuli is very limited. To optimize the use of this limited capacity, attentional mechanisms give priority to behaviourally relevant stimuli at the expense of irrelevant distractors. In visual areas, attended stimuli induce enhanced responses and an improved synchronization of rhythmic neuronal activity in the gamma frequency band (40-70 Hz). Both effects probably improve the neuronal signalling of attended stimuli within and among brain areas. Attention also results in improved behavioural performance and shortened reaction times. However, it is not known how reaction times are related to either response strength or gamma-band synchronization in visual areas. Here we show that behavioural response times to a stimulus change can be predicted specifically by the degree of gamma-band synchronization among those neurons in monkey visual area V4 that are activated by the behaviourally relevant stimulus. When there are two visual stimuli and monkeys have to detect a change in one stimulus while ignoring the other, their reactions are fastest when the relevant stimulus induces strong gamma-band synchronization before and after the change in stimulus. This enhanced gamma-band synchronization is also followed by shorter neuronal response latencies on the fast trials. Conversely, the monkeys' reactions are slowest when gamma-band synchronization is high in response to the irrelevant distractor. Thus, enhanced neuronal gamma-band synchronization and shortened neuronal response latencies to an attended stimulus seem to have direct effects on visually triggered behaviour, reflecting an early neuronal correlate of efficient visuo-motor integration.     

Correlation between neural spike trains increases with firing rate

Populations of neurons in the retina, olfactory system, visual and somatosensory thalamus, and several cortical regions show temporal correlation between the discharge times of their action potentials (spike trains). Correlated firing has been linked to stimulus encoding, attention, stimulus discrimination, and motor behaviour. Nevertheless, the mechanisms underlying correlated spiking are poorly understood, and its coding implications are still debated. It is not clear, for instance, whether correlations between the discharges of two neurons are determined solely by the correlation between their afferent currents, or whether they also depend on the mean and variance of the input. We addressed this question by computing the spike train correlation coefficient of unconnected pairs of in vitro cortical neurons receiving correlated inputs. Notably, even when the input correlation remained fixed, the spike train output correlation increased with the firing rate, but was largely independent of spike train variability. With a combination of analytical techniques and numerical simulations using 'integrate-and-fire' neuron models we show that this relationship between output correlation and firing rate is robust to input heterogeneities. Finally, this overlooked relationship is replicated by a standard threshold-linear model, demonstrating the universality of the result. This connection between the rate and correlation of spiking activity links two fundamental features of the neural code.     

Functional specificity of local synaptic connections in neocortical networks

Neuronal connectivity is fundamental to information processing in the brain. Therefore, understanding the mechanisms of sensory processing requires uncovering how connection patterns between neurons relate to their function. On a coarse scale, long-range projections can preferentially link cortical regions with similar responses to sensory stimuli. But on the local scale, where dendrites and axons overlap substantially, the functional specificity of connections remains unknown. Here we determine synaptic connectivity between nearby layer 2/3 pyramidal neurons in vitro, the response properties of which were first characterized in mouse visual cortex in vivo. We found that connection probability was related to the similarity of visually driven neuronal activity. Neurons with the same preference for oriented stimuli connected at twice the rate of neurons with orthogonal orientation preferences. Neurons responding similarly to naturalistic stimuli formed connections at much higher rates than those with uncorrelated responses. Bidirectional synaptic connections were found more frequently between neuronal pairs with strongly correlated visual responses. Our results reveal the degree of functional specificity of local synaptic connections in the visual cortex, and point to the existence of fine-scale subnetworks dedicated to processing related sensory information.     

Top-down gain control of the auditory space map by gaze control circuitry in the barn owl

High-level circuits in the brain that control the direction of gaze are intimately linked with the control of visual spatial attention. Immediately before an animal directs its gaze towards a stimulus, both psychophysical sensitivity to that visual stimulus and the responsiveness of high-order neurons in the cerebral cortex that represent the stimulus increase dramatically. Equivalent effects on behavioural sensitivity and neuronal responsiveness to visual stimuli result from focal electrical microstimulation of gaze control centres in monkeys. Whether the gaze control system modulates neuronal responsiveness in sensory modalities other than vision is unknown. Here we show that electrical microstimulation applied to gaze control circuitry in the forebrain of barn owls regulates the gain of midbrain auditory responses in an attention-like manner. When the forebrain circuit was activated, midbrain responses to auditory stimuli at the location encoded by the forebrain site were enhanced and spatial selectivity was sharpened. The same stimulation suppressed responses to auditory stimuli represented at other locations in the midbrain map. Such space-specific, top-down regulation of auditory responses by gaze control circuitry in the barn owl suggests that the central nervous system uses a common strategy for dynamically regulating sensory gain that applies across modalities, brain areas and classes of vertebrate species. This approach provides a path for discovering mechanisms that underlie top-down gain control in the central nervous system.     

Motor learning in a recurrent network model based on the vestibulo-ocular reflex.

Most models of neural networks have assumed that neurons process information on a timescale of milliseconds and that the long-term modification of synaptic strengths underlies learning and memory. But neurons also have cellular mechanisms that operate on a timescale of tens or hundreds of milliseconds, such as a gradual rise in firing rate in response to injection of constant current or a rapid rise followed by a slower adaptation. These dynamic properties of neuronal responses are mediated by ion channels that are subject to modulation. We demonstrate here how a neural network with recurrent feedback connections can convert long-term modulation of neural responses that occur over these intermediate timescales into changes in the amplitude of the steady output from the system. This general principle may be relevant to many feedback systems in the brain. Here it is applied to the vestibulo-ocular reflex, whose amplitude is subject to long-term adaptive modification by visual inputs. The model reconciles apparently contradictory data on the neural locus of the cellular mechanisms that mediate this simple form of learning and memory.     

Sustained firing in auditory cortex evoked by preferred stimuli

It has been well documented that neurons in the auditory cortex of anaesthetized animals generally display transient responses to acoustic stimulation, and typically respond to a brief stimulus with one or fewer action potentials. The number of action potentials evoked by each stimulus usually does not increase with increasing stimulus duration. Such observations have long puzzled researchers across disciplines and raised serious questions regarding the role of the auditory cortex in encoding ongoing acoustic signals. Contrary to these long-held views, here we show that single neurons in both primary (area A1) and lateral belt areas of the auditory cortex of awake marmoset monkeys (Callithrix jacchus) are capable of firing in a sustained manner over a prolonged period of time, especially when they are driven by their preferred stimuli. In contrast, responses become more transient or phasic when auditory cortex neurons respond to non-preferred stimuli. These findings suggest that when the auditory cortex is stimulated by a sound, a particular population of neurons fire maximally throughout the duration of the sound. Responses of other, less optimally driven neurons fade away quickly after stimulus onset. This results in a selective representation of the sound across both neuronal population and time.     

基于多元线性逆滤波器的视顶盖神经元集群亮度信息解码研究

通过解码鸽子视顶盖(the optic tectum,OT)神经元集群亮度信息的方法,研究了OT区神经元集群编码亮度信息的神经机制。首先设计了具有瞬态闪变特性的亮度视觉刺激模式,采用微电极阵列记录了多通道的锋电位(spike)发放序列;然后提取了神经元集群的spike发放率特征,构造多元线性逆滤波器解码视觉刺激亮度;最后采用互相关和信息论的方法对解码结果进行了分析。结果表明:采用的多元线性逆滤波器有效解码了OT区神经元集群编码的亮度信息。通过对解码参数变化与解码精度的分析可知神经元集群数目13个、bin的宽度5 ms、刺激后15 ms、刺激后持续时间35 ms具有最高的解码精度。通过神经元集群中逆滤波器形态的分析发现,单神经元在亮度信息的编码过程中受周围神经元的动态调制。通过对解码精度与刺激闪变频率关系的分析,发现在刺激闪变频率19 Hz到53 Hz的范围内,重建质量较好,在刺激闪变频率为33.5 Hz时,重建质量达到最优。     

Inhibitory feedback required for network oscillatory responses to communication but not prey stimuli

Stimulus-induced oscillations occur in visual, olfactory and somatosensory systems. Several experimental and theoretical studies have shown how such oscillations can be generated by inhibitory connections between neurons. But the effects of realistic spatiotemporal sensory input on oscillatory network dynamics and the overall functional roles of such oscillations in sensory processing are poorly understood. Weakly electric fish must detect electric field modulations produced by both prey (spatially localized) and communication (spatially diffuse) signals. Here we show, through in vivo recordings, that sensory pyramidal neurons in these animals produce an oscillatory response to communication-like stimuli, but not to prey-like stimuli. On the basis of well-characterized circuitry, we construct a network model of pyramidal neurons that predicts that diffuse delayed inhibitory feedback is required to achieve oscillatory behaviour only in response to communication-like stimuli. This prediction is experimentally verified by reversible blockade of feedback inhibition that removes oscillatory behaviour in the presence of communication-like stimuli. Our results show that a sensory system can use inhibitory feedback as a mechanism to 'toggle' between oscillatory and non-oscillatory firing states, each associated with a naturalistic stimulus.     

Activation of specific interneurons improves V1 feature selectivity and visual perception

Inhibitory interneurons are essential components of the neural circuits underlying various brain functions. In the neocortex, a large diversity of GABA (γ-aminobutyric acid) interneurons has been identified on the basis of their morphology, molecular markers, biophysical properties and innervation pattern. However, how the activity of each subtype of interneurons contributes to sensory processing remains unclear. Here we show that optogenetic activation of parvalbumin-positive (PV+) interneurons in the mouse primary visual cortex (V1) sharpens neuronal feature selectivity and improves perceptual discrimination. Using multichannel recording with silicon probes and channelrhodopsin-2 (ChR2)-mediated optical activation, we found that increased spiking of PV+ interneurons markedly sharpened orientation tuning and enhanced direction selectivity of nearby neurons. These effects were caused by the activation of inhibitory neurons rather than a decreased spiking of excitatory neurons, as archaerhodopsin-3 (Arch)-mediated optical silencing of calcium/calmodulin-dependent protein kinase IIα (CAMKIIα)-positive excitatory neurons caused no significant change in V1 stimulus selectivity. Moreover, the improved selectivity specifically required PV+ neuron activation, as activating somatostatin or vasointestinal peptide interneurons had no significant effect. Notably, PV+ neuron activation in awake mice caused a significant improvement in their orientation discrimination, mirroring the sharpened V1 orientation tuning. Together, these results provide the first demonstration that visual coding and perception can be improved by increased spiking of a specific subtype of cortical inhibitory interneurons.     

Short-term memory in olfactory network dynamics

Neural assemblies in a number of animal species display self-organized, synchronized oscillations in response to sensory stimuli in a variety of brain areas. In the olfactory system of insects, odour-evoked oscillatory synchronization of antennal lobe projection neurons (PNs) is superimposed on slower and stimulus-specific temporal activity patterns. Hence, each odour activates a specific and dynamic projection neuron assembly whose evolution during a stimulus is locked to the oscillation clock. Here we examine, using locusts, the changes in population dynamics of projection-neuron assemblies over repeated odour stimulations, as would occur when an animal first encounters and then repeatedly samples an odour for identification or localization. We find that the responses of these assemblies rapidly decrease in intensity, while they show a marked increase in spike time precision and inter-neuronal oscillatory coherence. Once established, this enhanced precision in the representation endures for several minutes. This change is stimulus-specific, and depends on events within the antennal lobe circuits, independent of olfactory receptor adaptation: it may thus constitute a form of sensory memory. Our results suggest that this progressive change in olfactory network dynamics serves to converge, over repeated odour samplings, on a more precise and readily classifiable odour representation, using relational information contained across neural assemblies.     

A synaptic memory trace for cortical receptive field plasticity

Receptive fields of sensory cortical neurons are plastic, changing in response to alterations of neural activity or sensory experience. In this way, cortical representations of the sensory environment can incorporate new information about the world, depending on the relevance or value of particular stimuli. Neuromodulation is required for cortical plasticity, but it is uncertain how subcortical neuromodulatory systems, such as the cholinergic nucleus basalis, interact with and refine cortical circuits. Here we determine the dynamics of synaptic receptive field plasticity in the adult primary auditory cortex (also known as AI) using in vivo whole-cell recording. Pairing sensory stimulation with nucleus basalis activation shifted the preferred stimuli of cortical neurons by inducing a rapid reduction of synaptic inhibition within seconds, which was followed by a large increase in excitation, both specific to the paired stimulus. Although nucleus basalis was stimulated only for a few minutes, reorganization of synaptic tuning curves progressed for hours thereafter: inhibition slowly increased in an activity-dependent manner to rebalance the persistent enhancement of excitation, leading to a retuned receptive field with new preference for the paired stimulus. This restricted period of disinhibition may be a fundamental mechanism for receptive field plasticity, and could serve as a memory trace for stimuli or episodes that have acquired new behavioural significance.     

Cellular networks underlying human spatial navigation

Place cells of the rodent hippocampus constitute one of the most striking examples of a correlation between neuronal activity and complex behaviour in mammals. These cells increase their firing rates when the animal traverses specific regions of its surroundings, providing a context-dependent map of the environment. Neuroimaging studies implicate the hippocampus and the parahippocampal region in human navigation. However, these regions also respond selectively to visual stimuli. It thus remains unclear whether rodent place coding has a homologue in humans or whether human navigation is driven by a different, visually based neural mechanism. We directly recorded from 317 neurons in the human medial temporal and frontal lobes while subjects explored and navigated a virtual town. Here we present evidence for a neural code of human spatial navigation based on cells that respond at specific spatial locations and cells that respond to views of landmarks. The former are present primarily in the hippocampus, and the latter in the parahippocampal region. Cells throughout the frontal and temporal lobes responded to the subjects' navigational goals and to conjunctions of place, goal and view.