Adaptive coding of visual information in neural populations

Our perception of the environment relies on the capacity of neural networks to adapt rapidly to changes in incoming stimuli. It is increasingly being realized that the neural code is adaptive, that is, sensory neurons change their responses and selectivity in a dynamic manner to match the changes in input stimuli. Understanding how rapid exposure, or adaptation, to a stimulus of fixed structure changes information processing by cortical networks is essential for understanding the relationship between sensory coding and behaviour. Physiological investigations of adaptation have contributed greatly to our understanding of how individual sensory neurons change their responses to influence stimulus coding, yet whether and how adaptation affects information coding in neural populations is unknown. Here we examine how brief adaptation (on the timescale of visual fixation) influences the structure of interneuronal correlations and the accuracy of population coding in the macaque (Macaca mulatta) primary visual cortex (V1). We find that brief adaptation to a stimulus of fixed structure reorganizes the distribution of correlations across the entire network by selectively reducing their mean and variability. The post-adaptation changes in neuronal correlations are associated with specific, stimulus-dependent changes in the efficiency of the population code, and are consistent with changes in perceptual performance after adaptation. Our results have implications beyond the predictions of current theories of sensory coding, suggesting that brief adaptation improves the accuracy of population coding to optimize neuronal performance during natural viewing.     

Involuntary orienting to sound improves visual perception

To perceive real-world objects and events, we need to integrate several stimulus features belonging to different sensory modalities. Although the neural mechanisms and behavioural consequences of intersensory integration have been extensively studied, the processes that enable us to pay attention to multimodal objects are still poorly understood. An important question is whether a stimulus in one sensory modality automatically attracts attention to spatially coincident stimuli that appear subsequently in other modalities, thereby enhancing their perceptual salience. The occurrence of an irrelevant sound does facilitate motor responses to a subsequent light appearing nearby. However, because participants in previous studies made speeded responses rather than psychophysical judgements, it remains unclear whether involuntary auditory attention actually affects the perceptibility of visual stimuli as opposed to postperceptual decision and response processes. Here we provide psychophysical evidence that a sudden sound improves the detectability of a subsequent flash appearing at the same location. These data show that the involuntary orienting of attention to sound enhances early perceptual processing of visual stimuli.     

视知觉训练与初级视皮层神经元信息及其表征容量

通过分析猕猴初级视皮层（V1）神经元的群体活动在轮廓线检测训练过程中的变化发现：知觉训练可以降低V1神经元响应在不同试次之间的变异性，促使V1神经元对相同刺激的响应更加稳定；训练还可降低V1神经元群体中神经元活动之间的相关性，使V1神经元之间的活动更加独立；增加了神经活动的维度，提高了神经元表征信息的容量，减少了冗余的神经活动，进而提升了感知能力.     

Neural mechanisms of perceptual grouping in human visual cortex

The current work examined neural substrates of perceptual grouping in human visual cortex using event-related potential (ERP) recording. Stimulus arrays consisted of local elements that were either evenly spaced (uniform stimuli) or grouped into columns or rows by proximity or color similarity (grouping stimuli). High-density ERPs were recorded while subjects identified orientations of perceptual groups in stimulus arrays that were presented randomly in one of the four quadrants of the visual field.Both uniform and grouping stimulus arrays elicited an early ERP component (C1), which peaked at about 70ms after stimulus onset and changed its polarity as a function of stimulated elevations. Dipole modeling based on realistichead boundary-element models revealed generators of the C1 component in the calcarine cortex. The C1 was modulated by perceptual grouping of local elements based on proximity, and this grouping effect was stronger in the upper than in the lower visual field. The findings provide ERP evidence for the engagement of human primary visual cortex in the early stage of perceptual grouping.     

Neural Correlates of Human Associative Learning

Lesion studies in animals have associated the amygdala mainly with aversive conditioning,both cued and contextual.However,neurophysiological studies indicate that the amygdala has a role in the processing of positive emotions in some kinds of stimulusreward learning.The aim of the current study was to extend these findings to humans.Functional magnetic resonance imaging was applied to investigate the neural basis of aversive and appetitive conditioning.In the first study,aversive electrical shocks were deli...     

Dopamine-mediated modulation of odour-evoked amygdala potentials during pavlovian conditioning

Pavlovian conditioning results when an innocuous stimulus, such as an odour, is paired with a behaviourally relevant stimulus, such as a foot-shock, so that eventually the former stimulus alone will elicit the behavioural response of the latter. The lateral nucleus of the amygdala (LAT) is necessary for the emotional memory formation in this paradigm. Enhanced neuronal firing in LAT to conditioned stimuli emerge in parallel with the behavioural changes and are dependent on local dopamine. To study the changes in neuronal excitability and synaptic drive that contribute to the pavlovian conditioning process, here we used in vivo intracellular recordings to examine LAT neurons during pavlovian conditioning in rats. We found that repeated pairings of an odour with a foot-shock resulted in enhanced post-synaptic potential (PSP) responses to the odour and increased neuronal excitability. However, a non-paired odour displayed PSP decrement. The dopamine antagonist haloperidol blocked the PSP enhancement and associated increased neuronal excitability, without reversing previous conditioning. These results demonstrate that conditioning and habituation processes produce opposite effects on LAT neurons and that dopamine is important in these events, consistent with its role in emotional memory formation.     

A neurological dissociation between perceiving objects and grasping them

Studies of the visual capacity of neurological patients have provided evidence for a dissociation between the perceptual report of a visual stimulus and the ability to direct spatially accurate movements toward that stimulus. Some patients with damage to the parietal lobe, for example, are unable to reach accurately towards visual targets that they unequivocally report seeing. Conversely, some patients with extensive damage to primary visual cortex can make accurate pointing movements or saccades toward a stimulus presented in their 'blind' scotoma. But in investigations of visuomotor control in patients with visual disorders, little consideration has been given to complex acts such as manual prehension. Grasping a three-dimensional object requires knowledge not only of the object's spatial location, but also of its form, orientation and size. We have examined a patient with a profound disorder in the perception of such object qualities. Our quantitative analyses demonstrate strikingly accurate guidance of hand and finger movements directed at the very objects whose qualities she fails to perceive. These data suggest that the neural substrates for the visual perception of object qualities such as shape, orientation and size are distinct from those underlying the use of those qualities in the control of manual skills.     

The amygdala modulates prefrontal cortex activity relative to conditioned fear

Animals learn that a tone can predict the occurrence of an electric shock through classical conditioning. Mice or rats trained in this manner display fear responses, such as freezing behaviour, when they hear the conditioned tone. Studies using amygdalectomized rats have shown that the amygdala is required for both the acquisition and expression of learned fear responses. Freezing to a conditioned tone is enhanced following damage to the dorsal part of the medial prefrontal cortex, indicating that this area may be involved in fear reduction. Here we show that prefrontal neurons reduce their spontaneous activity in the presence of a conditioned aversive tone as a function of the degree of fear. The depression in prefrontal spontaneous activity is related to amygdala activity but not to the freezing response itself. These data indicate that, in the presence of threatening stimuli, the amygdala controls both fear expression and prefrontal neuronal activity. They suggest that abnormal amygdala-induced modulation of prefrontal neuronal activity may be involved in the pathophysiology of certain forms of anxiety disorder.     

Neural substrates of global perception are modulated by local element grouping

THE GLOBAL PERCEPTION OF HIERARCHICALLY ORGANIZED STIMULI CAN BE DIFFERENT FROM THE LOCAL PERCEPTION IN THAT GLOBAL RESPONSES ARE FASTER THAN LOCAL RESPONSES AND THE GLOBAL-TO-LOCAL INTERFERENCE IS STRONGER THAN THE RE-VERSE[1]. THIS GLOBAL PRECEDENCE EFF…     

Opposite motivational effects of endogenous opioids in brain and periphery

Many psychoactive drugs, including the opiates, have been shown to have paradoxical reinforcing effects. Opiates produce positive reinforcing effects when they are paired with visual and textural environmental stimuli in rats, yet, at similar doses and over the same routes of administration, produce aversive effects, as shown when they are paired with taste stimuli. Similarly, in human, the positive reinforcing effects of opiates are well known to addicts and recreational drug users, yet patients receiving opiates as analgesics often report nauseous reactions. At present there is no evidence to differentiate between the neural substrates that mediate these opposite motivational effects. We now report an initial step in the resolution of this paradox by demonstrating that endogenous and exogenous opioids produce positive reinforcing effects through an action on brain opiate receptors, and aversive effects through an action on peripheral opiate receptors (especially in the gut).     

The primate amygdala represents the positive and negative value of visual stimuli during learning

Visual stimuli can acquire positive or negative value through their association with rewards and punishments, a process called reinforcement learning. Although we now know a great deal about how the brain analyses visual information, we know little about how visual representations become linked with values. To study this process, we turned to the amygdala, a brain structure implicated in reinforcement learning. We recorded the activity of individual amygdala neurons in monkeys while abstract images acquired either positive or negative value through conditioning. After monkeys had learned the initial associations, we reversed image value assignments. We examined neural responses in relation to these reversals in order to estimate the relative contribution to neural activity of the sensory properties of images and their conditioned values. Here we show that changes in the values of images modulate neural activity, and that this modulation occurs rapidly enough to account for, and correlates with, monkeys' learning. Furthermore, distinct populations of neurons encode the positive and negative values of visual stimuli. Behavioural and physiological responses to visual stimuli may therefore be based in part on the plastic representation of value provided by the amygdala.     

Hearing visual motion in depth

Auditory spatial perception is strongly affected by visual cues. For example, if auditory and visual stimuli are presented synchronously but from different positions, the auditory event is mislocated towards the locus of the visual stimulus-the ventriloquism effect. This 'visual capture' also occurs in motion perception in which a static auditory stimulus appears to move with the visual moving object. We investigated how the human perceptual system coordinates complementary inputs from auditory and visual senses. Here we show that an auditory aftereffect occurs from adaptation to visual motion in depth. After a few minutes of viewing a square moving in depth, a steady sound was perceived as changing loudness in the opposite direction. Adaptation to a combination of auditory and visual stimuli changing in a compatible direction increased the aftereffect and the effect of visual adaptation almost disappeared when the directions were opposite. On the other hand, listening to a sound changing in intensity did not affect the visual changing-size aftereffect. The results provide psychophysical evidence that, for processing of motion in depth, the auditory system responds to both auditory changing intensity and visual motion in depth.     

A new perceptual illusion reveals mechanisms of sensory decoding

Perceptual illusions are usually thought to arise from the way sensory signals are encoded by the brain, and indeed are often used to infer the mechanisms of sensory encoding. But perceptual illusions might also result from the way the brain decodes sensory information, reflecting the strategies that optimize performance in particular tasks. In a fine discrimination task, the most accurate information comes from neurons tuned away from the discrimination boundary, and observers seem to use signals from these 'displaced' neurons to optimize their performance. We wondered whether using signals from these neurons might also bias perception. In a fine direction discrimination task using moving random-dot stimuli, we found that observers' perception of the direction of motion is indeed biased away from the boundary. This misperception can be accurately described by a decoding model that preferentially weights signals from neurons whose responses best discriminate those directions. In a coarse discrimination task, to which a different decoding rule applies, the same stimulus is not misperceived, suggesting that the illusion is a direct consequence of the decoding strategy that observers use to make fine perceptual judgments. The subjective experience of motion is therefore not mediated directly by the responses of sensory neurons, but is only developed after the responses of these neurons are decoded.     

Temporal patterns of human cortical activity reflect tone sequence structure

Despite growing interest in temporal aspects of auditory neural processing, little is known about large-scale timing patterns of brain activity during the perception of auditory sequences. This is partly because it has not been possible to distinguish stimulus-related activity from other, endogenous brain signals recorded by electrical or magnetic sensors. Here we use amplitude modulation of unfamiliar, approximately 1-minute-long tone sequences to label stimulus-related magnetoencephalographic neural activity in human subjects. We show that temporal patterns of activity recorded over particular brain regions track the pitch contour of tone sequences, with the accuracy of tracking increasing as tone sequences become more predictable in structure. In contrast, temporal synchronization between recording locations, particularly between sites over the left posterior hemisphere and the rest of the brain, is greatest when sequences have melody-like statistical properties, which may reflect the perceptual integration of local and global pitch patterns in melody-like sequences. This method is particularly well suited to studying temporal neural correlates of complex auditory sequences (such as speech or music) which engage multiple brain areas as perception unfolds in time.     

Functional dissociation of the left ventral occipito-temporal cortex in the direct and indirect retrieval of color features

Previous studies suggest that the storage/retrieval of object features is related to brain regions that are involved in the processing of these features. However, it remains unclear whether, and under what conditions, retrieving information about a feature reactivates the same region that specifically supports that feature’s perception. In this functional magnetic resonance imaging (fMRI) study, we compared brain activation in the left ventral occipito-temporal cortex during subjects performing a color perception task, and direct and indirect color retrieval tasks. After performing the color perception task to localize the regions responsible for color perception, subjects were intensively trained (outside of the scanner) to remember associations between colors and motion directions, and associations between colors and letters. Then, they were asked to perform two color retrieval tasks in the scanner, with stationary and gray scaled images as control stimuli. The results showed that the bilateral posterior occipito-temporal cortex was activated during the color perception task. When color information was retrieved by direct cues (motion direction), the same bilateral occipito-temporal region was activated. When color information was retrieved indirectly (judging whether a motion direction matched a letter by their associated colors), a region anterior to the color perception region in the left ventral occipito-temporal cortex was additionally activated. Our results provided evidence for the functional dissociation in the two subregions of the ventral occipito-temporal cortex during retrieval of color features: the posterior area might relate to perceptual features of color, while the anterior region might relate to the knowledge of associations with color.     

Influence of a preceding auditory stimulus on evoked potential of the succeeding stimulus

In the present study, we investigated the influ.ence of the preceding auditory stimulus on the audi-tory-evoked potential (AEP) of the succeeding stimuli, whenthe human subjects were presented with a pair of auditorystimuli. We found that the evoked potential of the succeedingstimulus was inhibited completely by the preceding stimulus,as the inter-stimulus interval (ISI) was shorter than 150 ms.This influence was dependent on the IS1 of two stimuli, theshorter the ISI the stronger the influence would be. The in-hibitory influence of the preceding stimulus might be causedby the neural refractory effect.     

The endogenous cannabinoid system controls extinction of aversive memories

Acquisition and storage of aversive memories is one of the basic principles of central nervous systems throughout the animal kingdom. In the absence of reinforcement, the resulting behavioural response will gradually diminish to be finally extinct. Despite the importance of extinction, its cellular mechanisms are largely unknown. The cannabinoid receptor 1 (CB1) and endocannabinoids are present in memory-related brain areas and modulate memory. Here we show that the endogenous cannabinoid system has a central function in extinction of aversive memories. CB1-deficient mice showed strongly impaired short-term and long-term extinction in auditory fear-conditioning tests, with unaffected memory acquisition and consolidation. Treatment of wild-type mice with the CB1 antagonist SR141716A mimicked the phenotype of CB1-deficient mice, revealing that CB1 is required at the moment of memory extinction. Consistently, tone presentation during extinction trials resulted in elevated levels of endocannabinoids in the basolateral amygdala complex, a region known to control extinction of aversive memories. In the basolateral amygdala, endocannabinoids and CB1 were crucially involved in long-term depression of GABA (gamma-aminobutyric acid)-mediated inhibitory currents. We propose that endocannabinoids facilitate extinction of aversive memories through their selective inhibitory effects on local inhibitory networks in the amygdala.     

Distinct representations of olfactory information in different cortical centres

Sensory information is transmitted to the brain where it must be processed to translate stimulus features into appropriate behavioural output. In the olfactory system, distributed neural activity in the nose is converted into a segregated map in the olfactory bulb. Here we investigate how this ordered representation is transformed in higher olfactory centres in mice. We have developed a tracing strategy to define the neural circuits that convey information from individual glomeruli in the olfactory bulb to the piriform cortex and the cortical amygdala. The spatial order in the bulb is discarded in the piriform cortex; axons from individual glomeruli project diffusely to the piriform without apparent spatial preference. In the cortical amygdala, we observe broad patches of projections that are spatially stereotyped for individual glomeruli. These projections to the amygdala are overlapping and afford the opportunity for spatially localized integration of information from multiple glomeruli. The identification of a distributive pattern of projections to the piriform and stereotyped projections to the amygdala provides an anatomical context for the generation of learned and innate behaviours.     

Temporal difference models describe higher-order learning in humans

The ability to use environmental stimuli to predict impending harm is critical for survival. Such predictions should be available as early as they are reliable. In pavlovian conditioning, chains of successively earlier predictors are studied in terms of higher-order relationships, and have inspired computational theories such as temporal difference learning. However, there is at present no adequate neurobiological account of how this learning occurs. Here, in a functional magnetic resonance imaging (fMRI) study of higher-order aversive conditioning, we describe a key computational strategy that humans use to learn predictions about pain. We show that neural activity in the ventral striatum and the anterior insula displays a marked correspondence to the signals for sequential learning predicted by temporal difference models. This result reveals a flexible aversive learning process ideally suited to the changing and uncertain nature of real-world environments. Taken with existing data on reward learning, our results suggest a critical role for the ventral striatum in integrating complex appetitive and aversive predictions to coordinate behaviour.