Neuropsychology: pitch discrimination in the early blind

Do blind people develop superior abilities in auditory perception to compensate for their lack of vision? They are known to be better than sighted people at orientating themselves by sound, but it is not clear whether this enhanced awareness extends to other auditory domains, such as listening to music or to voices. Here we show that blind people are better than sighted controls at judging the direction of pitch change between sounds, even when the speed of change is ten times faster than that perceived by the controls--but only if they became blind at an early age. The younger the onset of blindness, the better is the performance, which is in line with cerebral plasticity being optimal during the early years.     

Ultra-fine frequency tuning revealed in single neurons of human auditory cortex

Just-noticeable differences of physical parameters are often limited by the resolution of the peripheral sensory apparatus. Thus, two-point discrimination in vision is limited by the size of individual photoreceptors. Frequency selectivity is a basic property of neurons in the mammalian auditory pathway. However, just-noticeable differences of frequency are substantially smaller than the bandwidth of the peripheral sensors. Here we report that frequency tuning in single neurons recorded from human auditory cortex in response to random-chord stimuli is far narrower than that typically described in any other mammalian species (besides bats), and substantially exceeds that attributed to the human auditory periphery. Interestingly, simple spectral filter models failed to predict the neuronal responses to natural stimuli, including speech and music. Thus, natural sounds engage additional processing mechanisms beyond the exquisite frequency tuning probed by the random-chord stimuli.     

Developmental plasticity in the visual and auditory representations in the mammalian superior colliculus

Environmental factors play an important role in certain aspects of the development of sensory systems. But the way in which the maturation of different sensory modalities is coordinated is poorly understood. We have investigated this question neurophysiologically in the mammalian superior colliculus (SC), which contains topographically aligned maps of visual and auditory space. We report here that an essentially normal auditory map, in approximate register with the visual map, is found in the SC of adult ferrets reared with abnormal binaural localization cues. Also, if, early in life, one eye is deviated laterally, there is a compensatory shift in the auditory map, but early eye rotation totally disorders the auditory representation. These results imply that development of the auditory map is affected by visual activity or by information about eye position and that there is definite, but limited, capacity for the auditory map to reorganize so that it remains aligned with the visual map.     

Auditory cortical responses in the cat to sounds that produce spatial illusions.

Humans and cats can localize a sound source accurately if its spectrum is fairly broad and flat, as is typical of most natural sounds. However, if sounds are filtered to reduce the width of the spectrum, they result in illusions of sources that are very different from the actual locations, particularly in the up/down and front/back dimensions. Such illusions reveal that the auditory system relies on specific characteristics of sound spectra to obtain cues for localization. In the auditory cortex of cats, temporal firing patterns of neurons can signal the locations of broad-band sounds. Here we show that such spike patterns systematically mislocalize sounds that have been passed through a narrow-band filter. Both correct and incorrect locations signalled by neurons can be predicted quantitatively by a model of spectral processing that also predicts correct and incorrect localization judgements by human listeners. Similar cortical mechanisms, if present in humans, could underlie human auditory spatial perception.     

Potentiation of cortical inhibition by visual deprivation

The fine-tuning of circuits in sensory cortex requires sensory experience during an early critical period. Visual deprivation during the critical period has catastrophic effects on visual function, including loss of visual responsiveness to the deprived eye, reduced visual acuity, and loss of tuning to many stimulus characteristics. These changes occur faster than the remodelling of thalamocortical axons, but the intracortical plasticity mechanisms that underlie them are incompletely understood. Long-term depression of excitatory intracortical synapses has been proposed as a general candidate mechanism for the loss of cortical responsiveness after visual deprivation. Alternatively (or in addition), the decreased ability of the deprived eye to activate cortical neurons could be due to enhanced intracortical inhibition. Here we show that visual deprivation leaves excitatory connections in layer 4 (the primary input layer to cortex) unaffected, but markedly potentiates inhibitory feedback between fast-spiking basket cells (FS cells) and star pyramidal neurons (star pyramids). Further, a previously undescribed form of long-term potentiation of inhibition (LTPi) could be induced at synapses from FS cells to star pyramids, and was occluded by previous visual deprivation. These data suggest that potentiation of inhibition is a major cellular mechanism underlying the deprivation-induced degradation of visual function, and that this form of LTPi is important in fine-tuning cortical circuitry in response to visual experience.     

Sensory experience modifies the short-term dynamics of neocortical synapses.

Many representations of sensory stimuli in the neocortex are arranged as topographic maps. These cortical maps are not fixed, but show experience-dependent plasticity. For instance, sensory deprivation causes the cortical area representing the deprived sensory input to shrink, and neighbouring spared representations to enlarge, in somatosensory, auditory or visual cortex. In adolescent and adult animals, changes in cortical maps are most noticeable in the supragranular layers at the junction of deprived and spared cortex. However, the cellular mechanisms of this experience-dependent plasticity are unclear. Long-term potentiation and depression have been implicated, but have not been proven to be necessary or sufficient for cortical map reorganization. Short-term synaptic dynamics have not been considered. We developed a brain slice preparation involving rat whisker barrel cortex in vitro. Here we report that sensory deprivation alters short-term synaptic dynamics in both vertical and horizontal excitatory pathways within the supragranular cortex. Moreover, modifications of horizontal pathways amplify changes in the vertical inputs. Our findings help to explain the functional cortical reorganization that follows persistent changes of sensory experience.     

The contribution of sensory experience to the maturation of orientation selectivity in ferret visual cortex.

Sensory experience begins when neural circuits in the cerebral cortex are still immature; however, the contribution of experience to cortical maturation remains unclear. In the visual cortex, the selectivity of neurons for oriented stimuli at the time of eye opening is poor and increases dramatically after the onset of visual experience. Here we investigate whether visual experience has a significant role in the maturation of orientation selectivity and underlying cortical circuits using two forms of deprivation: dark rearing, which completely eliminates experience, and binocular lid suture, which alters the pattern of sensory driven activity. Orientation maps were present in dark-reared ferrets, but fully mature levels of tuning were never attained. In contrast, only rudimentary levels of orientation selectivity were observed in lid-sutured ferrets. Despite these differences, horizontal connections in both groups were less extensive and less clustered than normal, suggesting that long-range cortical processing is not essential for the expression of orientation selectivity, but may be needed for the full maturation of tuning. Thus, experience is beneficial or highly detrimental to cortical maturation, depending on the pattern of sensory driven activity.     

Neural substrates of vocalization feedback monitoring in primate auditory cortex

Vocal communication involves both speaking and hearing, often taking place concurrently. Vocal production, including human speech and animal vocalization, poses a number of unique challenges for the auditory system. It is important for the auditory system to monitor external sounds continuously from the acoustic environment during speaking despite the potential for sensory masking by self-generated sounds. It is also essential for the auditory system to monitor feedback of one's own voice. This self-monitoring may play a part in distinguishing between self-generated or externally generatedauditory inputs and in detecting errors in our vocal production. Previous work in humans and other animals has demonstrated that the auditory cortex is largely suppressed during speaking or vocalizing. Despite the importance of self-monitoring, the underlying neural mechanisms in the mammalian brain, in particular the role of vocalization-induced suppression, remain virtually unknown. Here we show that neurons in the auditory cortex of marmoset monkeys (Callithrix jacchus) are sensitive to auditory feedback during vocal production, and that changes in the feedback alter the coding properties of these neurons. Furthermore, we found that the previously described cortical suppression during vocalization actually increased the sensitivity of these neurons to vocal feedback. This heightened sensitivity to vocal feedback suggests that these neurons may have an important role in auditory self-monitoring.     

Top-down gain control of the auditory space map by gaze control circuitry in the barn owl

High-level circuits in the brain that control the direction of gaze are intimately linked with the control of visual spatial attention. Immediately before an animal directs its gaze towards a stimulus, both psychophysical sensitivity to that visual stimulus and the responsiveness of high-order neurons in the cerebral cortex that represent the stimulus increase dramatically. Equivalent effects on behavioural sensitivity and neuronal responsiveness to visual stimuli result from focal electrical microstimulation of gaze control centres in monkeys. Whether the gaze control system modulates neuronal responsiveness in sensory modalities other than vision is unknown. Here we show that electrical microstimulation applied to gaze control circuitry in the forebrain of barn owls regulates the gain of midbrain auditory responses in an attention-like manner. When the forebrain circuit was activated, midbrain responses to auditory stimuli at the location encoded by the forebrain site were enhanced and spatial selectivity was sharpened. The same stimulation suppressed responses to auditory stimuli represented at other locations in the midbrain map. Such space-specific, top-down regulation of auditory responses by gaze control circuitry in the barn owl suggests that the central nervous system uses a common strategy for dynamically regulating sensory gain that applies across modalities, brain areas and classes of vertebrate species. This approach provides a path for discovering mechanisms that underlie top-down gain control in the central nervous system.     

Influence of the thalamus on spatial visual processing in frontal cortex

Each of our movements activates our own sensory receptors, and therefore keeping track of self-movement is a necessary part of analysing sensory input. One way in which the brain keeps track of self-movement is by monitoring an internal copy, or corollary discharge, of motor commands. This concept could explain why we perceive a stable visual world despite our frequent quick, or saccadic, eye movements: corollary discharge about each saccade would permit the visual system to ignore saccade-induced visual changes. The critical missing link has been the connection between corollary discharge and visual processing. Here we show that such a link is formed by a corollary discharge from the thalamus that targets the frontal cortex. In the thalamus, neurons in the mediodorsal nucleus relay a corollary discharge of saccades from the midbrain superior colliculus to the cortical frontal eye field. In the frontal eye field, neurons use corollary discharge to shift their visual receptive fields spatially before saccades. We tested the hypothesis that these two components-a pathway for corollary discharge and neurons with shifting receptive fields-form a circuit in which the corollary discharge drives the shift. First we showed that the known spatial and temporal properties of the corollary discharge predict the dynamic changes in spatial visual processing of cortical neurons when saccades are made. Then we moved from this correlation to causation by isolating single cortical neurons and showing that their spatial visual processing is impaired when corollary discharge from the thalamus is interrupted. Thus the visual processing of frontal neurons is spatiotemporally matched with, and functionally dependent on, corollary discharge input from the thalamus. These experiments establish the first link between corollary discharge and visual processing, delineate a brain circuit that is well suited for mediating visual stability, and provide a framework for studying corollary discharge in other sensory systems.     

Gain control by layer six in cortical circuits of vision

After entering the cerebral cortex, sensory information spreads through six different horizontal neuronal layers that are interconnected by vertical axonal projections. It is believed that through these projections layers can influence each other's response to sensory stimuli, but the specific role that each layer has in cortical processing is still poorly understood. Here we show that layer six in the primary visual cortex of the mouse has a crucial role in controlling the gain of visually evoked activity in neurons of the upper layers without changing their tuning to orientation. This gain modulation results from the coordinated action of layer six intracortical projections to superficial layers and deep projections to the thalamus, with a substantial role of the intracortical circuit. This study establishes layer six as a major mediator of cortical gain modulation and suggests that it could be a node through which convergent inputs from several brain areas can regulate the earliest steps of cortical visual processing.     

人眼明度视觉空间频率传递特性的研究

为描述人眼视觉系统对空间复杂颜色刺激的信息处理机制,研究人眼视觉系统空间频率信息传递的多通道特性.设计心理物理实验,测量人眼视觉系统在感知均匀色空间CIELAB明度通道上的对比度敏感度数据.实验选取明度轴上5个明度值作为颜色样本,制作明度对比度随正弦波频率调制的图像刺激序列,挑选正常视觉观察者,采集5个明度样本的12个空间频率的对比度敏感度数据.对实验数据进行相关性分析发现:单个明度样本的不同空间频率对应的观察值之间是非线性相关的;随着明度样本数量增多,观察值之间的线性相关性增强.因此,人眼视觉系统对明度颜色通道的信息处理机制可用线性模型描述;明度颜色通道的空间频率传递特性可用3条空间频率调谐曲线表征;3条空间频率调谐曲线作用的频段不同,峰值不同,表现了人眼视觉系统具有不同的空间频率感受野.      

Induction of visual orientation modules in auditory cortex

Modules of neurons sharing a common property are a basic organizational feature of mammalian sensory cortex. Primary visual cortex (V1) is characterized by orientation modules--groups of cells that share a preferred stimulus orientation--which are organized into a highly ordered orientation map. Here we show that in ferrets in which retinal projections are routed into the auditory pathway, visually responsive neurons in 'rewired' primary auditory cortex are also organized into orientation modules. The orientation tuning of neurons within these modules is comparable to the tuning of cells in V1 but the orientation map is less orderly. Horizontal connections in rewired cortex are more patchy and periodic than connections in normal auditory cortex, but less so than connections in V1. These data show that afferent activity has a profound influence on diverse components of cortical circuitry, including thalamocortical and local intracortical connections, which are involved in the generation of orientation tuning, and long-range horizontal connections, which are important in creating an orientation map.     

Identifying natural images from human brain activity

A challenging goal in neuroscience is to be able to read out, or decode, mental content from brain activity. Recent functional magnetic resonance imaging (fMRI) studies have decoded orientation, position and object category from activity in visual cortex. However, these studies typically used relatively simple stimuli (for example, gratings) or images drawn from fixed categories (for example, faces, houses), and decoding was based on previous measurements of brain activity evoked by those same stimuli or categories. To overcome these limitations, here we develop a decoding method based on quantitative receptive-field models that characterize the relationship between visual stimuli and fMRI activity in early visual areas. These models describe the tuning of individual voxels for space, orientation and spatial frequency, and are estimated directly from responses evoked by natural images. We show that these receptive-field models make it possible to identify, from a large set of completely novel natural images, which specific image was seen by an observer. Identification is not a mere consequence of the retinotopic organization of visual areas; simpler receptive-field models that describe only spatial tuning yield much poorer identification performance. Our results suggest that it may soon be possible to reconstruct a picture of a person's visual experience from measurements of brain activity alone.     

Efficient auditory coding

The auditory neural code must serve a wide range of auditory tasks that require great sensitivity in time and frequency and be effective over the diverse array of sounds present in natural acoustic environments. It has been suggested that sensory systems might have evolved highly efficient coding strategies to maximize the information conveyed to the brain while minimizing the required energy and neural resources. Here we show that, for natural sounds, the complete acoustic waveform can be represented efficiently with a nonlinear model based on a population spike code. In this model, idealized spikes encode the precise temporal positions and magnitudes of underlying acoustic features. We find that when the features are optimized for coding either natural sounds or speech, they show striking similarities to time-domain cochlear filter estimates, have a frequency-bandwidth dependence similar to that of auditory nerve fibres, and yield significantly greater coding efficiency than conventional signal representations. These results indicate that the auditory code might approach an information theoretic optimum and that the acoustic structure of speech might be adapted to the coding capacity of the mammalian auditory system.     

Visual processing in the leech central nervous system

In animals with complex visual systems spatial contrast is enhanced by mutual inhibition between retinal neurones monitoring different fields. By analogy, if animals like leeches and some caterpillars, that have several simple (non-image-forming) eyes aimed in different directions, are capable of rudimentary form detection, one might predict mutual antagonism between eyes monitoring different fields. In support of this prediction, I report here a paired interneurone in the central nervous system (CNS) of the leech which is stimulated by eyes on one side of the animal and inhibited by eyes on the other. There are striking parallels between these neurones and other integrating neurones, in particular those processing bilateral auditory input in crickets, suggesting that the visual system of the leech may be representative of a general class of sensory processing systems.     

Left hemisphere advantage in the mouse brain for recognizing ultrasonic communication calls

In humans, sound perceived as speech is processed preferentially by the right ear and the left hemisphere of the brain. Among animals, such an advantage of one hemisphere (lateralization) in processing communication sound from other members of the species has so far been demonstrated only in macaque monkeys. I report here that in the house mouse, which has a very much less elaborate forebrain than man or macaque monkey, the ultrasonic calls that are emitted by young mice to evoke maternal caring behavior are preferentially recognized by the left hemisphere. In females with no experience of pups, which have been trained to respond to the same ultrasonic calls by conditioning, no advantage for one hemisphere is detected. The results suggest that lateralization of this function evolved early in mammals and emphasize that an innate predisposition for perceiving communication sounds is connected with a left-hemisphere advantage in processing them. This experimental system is a readily-available animal model for studying lateralized auditory brain functions.     

Dynamic properties of neurons in cortical area MT in alert and anaesthetized macaque monkeys.

In order to see the world with high spatial acuity, an animal must sample the visual image with many detectors that restrict their analyses to extremely small regions of space. The visual cortex must then integrate the information from these localized receptive fields to obtain a more global picture of the surrounding environment. We studied this process in single neurons within the middle temporal visual area (MT) of macaques using stimuli that produced conflicting local and global information about stimulus motion. Neuronal responses in alert animals initially reflected predominantly the ambiguous local motion features, but gradually converged to an unambiguous global representation. When the same animals were anaesthetized, the integration of local motion signals was markedly impaired even though neuronal responses remained vigorous and directional tuning characteristics were intact. Our results suggest that anaesthesia preferentially affects the visual processing responsible for integrating local signals into a global visual representation.     

Hearing visual motion in depth

Auditory spatial perception is strongly affected by visual cues. For example, if auditory and visual stimuli are presented synchronously but from different positions, the auditory event is mislocated towards the locus of the visual stimulus-the ventriloquism effect. This 'visual capture' also occurs in motion perception in which a static auditory stimulus appears to move with the visual moving object. We investigated how the human perceptual system coordinates complementary inputs from auditory and visual senses. Here we show that an auditory aftereffect occurs from adaptation to visual motion in depth. After a few minutes of viewing a square moving in depth, a steady sound was perceived as changing loudness in the opposite direction. Adaptation to a combination of auditory and visual stimuli changing in a compatible direction increased the aftereffect and the effect of visual adaptation almost disappeared when the directions were opposite. On the other hand, listening to a sound changing in intensity did not affect the visual changing-size aftereffect. The results provide psychophysical evidence that, for processing of motion in depth, the auditory system responds to both auditory changing intensity and visual motion in depth.     

The optic tectum controls visually guided adaptive plasticity in the owl's auditory space map.

The midbrain contains an auditory map of space that is shaped by visual experience. When barn owls are raised wearing spectacles that horizontally displace the visual field, the auditory space map in the external nucleus of the inferior colliculus (ICX) shifts according to the optical displacement of the prisms. Topographic visual activity in the optic tectum could serve as the template that instructs the auditory space map. We studied the effects of a restricted, unilateral lesion in the portion of the optic tectum that represents frontal space. Here we show that such a lesion eliminates adaptive adjustments specifically in the portion of the auditory map that represents frontal space on the same side of the brain, while the rest of the map continues to adjust adaptively. Thus, activity in the tectum calibrates the auditory space map in a location-specific manner. Because the site of adaptive changes is the ICX, the results also indicate that the tectum provides a topographic instructive signal that controls adaptive auditory plasticity in the ICX.