Functional imaging with cellular resolution reveals precise micro-architecture in visual cortex

Neurons in the cerebral cortex are organized into anatomical columns, with ensembles of cells arranged from the surface to the white matter. Within a column, neurons often share functional properties, such as selectivity for stimulus orientation; columns with distinct properties, such as different preferred orientations, tile the cortical surface in orderly patterns. This functional architecture was discovered with the relatively sparse sampling of microelectrode recordings. Optical imaging of membrane voltage or metabolic activity elucidated the overall geometry of functional maps, but is averaged over many cells (resolution >100 microm). Consequently, the purity of functional domains and the precision of the borders between them could not be resolved. Here, we labelled thousands of neurons of the visual cortex with a calcium-sensitive indicator in vivo. We then imaged the activity of neuronal populations at single-cell resolution with two-photon microscopy up to a depth of 400 microm. In rat primary visual cortex, neurons had robust orientation selectivity but there was no discernible local structure; neighbouring neurons often responded to different orientations. In area 18 of cat visual cortex, functional maps were organized at a fine scale. Neurons with opposite preferences for stimulus direction were segregated with extraordinary spatial precision in three dimensions, with columnar borders one to two cells wide. These results indicate that cortical maps can be built with single-cell precision.     

Formation of target-specific neuronal projections in organotypic slice cultures from rat visual cortex.

A characteristic feature of the mammalian cortex is that projection neurons located in distinct cortical layers send their axons to different targets. In visual cortex, cells in layers 2 and 3 project to other cortical areas, whereas cells in layers 5 and 6 project to subcortical targets such as the lateral geniculate nucleus. The proper development of these projections is crucial for correct functioning of the visual system. Here we show that specific connections are established in an organotypic culture system in which rat visual cortex slices are co-cultured with another slice of the visual cortex or with a thalamic slice. The laminar origin and cellular morphology in vitro of cortical projections to other cortical regions or to subcortical targets are remarkably similar to those seen in vivo. In addition, axons of projecting cells are not restricted to particular pathways, but appear instead to grow directly towards their appropriate target. These observations raise the possibility that chemotropic attraction from the target areas may play an important part in the development of the cortical projection pattern.     

Iso-orientation domains in cat visual cortex are arranged in pinwheel-like patterns

The mammalian cortex is organized in a columnar fashion: neurons lying below each other from the pia to the white matter usually share many functional properties. Across the cortical surface, cells with similar response properties are also clustered together, forming elongated bands or patches. Some response properties, such as orientation preference in the visual cortex, change gradually across the cortical surface forming 'orientation maps'. To determine the precise layout of iso-orientation domains, knowledge of responses not only to one but to many stimulus orientations is essential. Therefore, the exact depiction of orientation maps has been hampered by technical difficulties and remained controversial for almost thirty years. Here we use in vivo optical imaging based on intrinsic signals to gather information on the responses of a piece of cortex to gratings in many different orientations. This complete set of responses then provides detailed information on the structure of the orientation map in a large patch of cortex from area 18 of the cat. We find that cortical regions that respond best to one orientation form highly ordered patches rather than elongated bands. These iso-orientation patches are organized around 'orientation centres', producing pinwheel-like patterns in which the orientation preference of cells is changing continuously across the cortex. We have also analysed our data for fast changes in orientation preference and find that these 'fractures' are limited to the orientation centres. The pinwheels and orientation centres are such a prominent organizational feature that it should be important to understand their development as well as their function in the processing of visual information.     

Visual motion and cortical velocity

Recent studies have revealed some remarkably simple relationships between visual performance and the neuroanatomy of the visual pathways. The visual field is mapped topographically on the surface of the striate cortex in man; the projection is large for the central visual field and is progressively compressed towards the periphery. Visual acuity decreases with distance from the fovea in proportion to the estimated cortical magnification factor, M (the extent of striate cortex in millimetres corresponding to a degree of arc in visual space). If a stimulus is magnified at peripheral locations in proportion to 1/M, it becomes equally resolvable across the visual field. This scaling procedure (M-scaling) maintains equivalence of the cortical projection of stimuli with different visual field loci. We have used M-scaling to investigate motion perception as a visual field variable. We report here that both the lower threshold of motion and adaptation to motion are uniform for M-scaled stimuli, and are related to the velocity of the 'cortical image'.     

Visual discrimination of target displacement remains after damage to the striate cortex in humans

Damage to the striate cortex usually causes blindness in those regions of the visual field which map to the area of neural damage. Nonetheless, there are reports that some patients with such damage can localize and perform certain visual discriminations between light stimuli presented within the 'blind' area of the visual field. Experiments on animals with different brain areas ablated suggest that visual function is served by two principal projection pathways from the retina. That to the striate cortex is primarily responsible for fine discrimination between stimulus parameters such as colour and spatial pattern, whereas that to the superior colliculus in the midbrain is responsible for visual localization of stimuli. The residual visual functions in patients with cortical damage are usually attributed to the non-striate retinal projection to the superior colliculus. We now present measurements of spatial discrimination in two observers with large visual field defects (scotomata) caused by damage to the striate cortical region. Both exhibit a near normal ability to discriminate displacements of targets when two lights are flashed sequentially in their defective visual field, but they are unable to discriminate spatial pattern or size. We argue that these results are consistent with the 'two visual systems' interpretation of ablation studies on non-human species.     

Orientation-specific cortical responses develop in early infancy

Neurones in the visual cortex of higher mammals differ from those elsewhere in the visual pathway in that the majority respond selectively to particular edge or bar orientations in the stimulus. We have developed a visually evoked potential (VEP) technique which isolates the response of orientation-selective mechanisms from that of cortical or sub-cortical neurones which lack orientation selectivity. We are unable to find such orientation-selective responses in newborn human infants within the sensitivity of our method, but repeated longitudinal testing of individual infants shows that measurable responses emerge around 6 weeks of age. This result is consistent with the idea that human cortical visual function is very immature at birth, but develops rapidly in the first two postnatal months.     

Potentiation of cortical inhibition by visual deprivation

The fine-tuning of circuits in sensory cortex requires sensory experience during an early critical period. Visual deprivation during the critical period has catastrophic effects on visual function, including loss of visual responsiveness to the deprived eye, reduced visual acuity, and loss of tuning to many stimulus characteristics. These changes occur faster than the remodelling of thalamocortical axons, but the intracortical plasticity mechanisms that underlie them are incompletely understood. Long-term depression of excitatory intracortical synapses has been proposed as a general candidate mechanism for the loss of cortical responsiveness after visual deprivation. Alternatively (or in addition), the decreased ability of the deprived eye to activate cortical neurons could be due to enhanced intracortical inhibition. Here we show that visual deprivation leaves excitatory connections in layer 4 (the primary input layer to cortex) unaffected, but markedly potentiates inhibitory feedback between fast-spiking basket cells (FS cells) and star pyramidal neurons (star pyramids). Further, a previously undescribed form of long-term potentiation of inhibition (LTPi) could be induced at synapses from FS cells to star pyramids, and was occluded by previous visual deprivation. These data suggest that potentiation of inhibition is a major cellular mechanism underlying the deprivation-induced degradation of visual function, and that this form of LTPi is important in fine-tuning cortical circuitry in response to visual experience.     

Experience with moving visual stimuli drives the early development of cortical direction selectivity

The onset of vision occurs when neural circuits in the visual cortex are immature, lacking both the full complement of connections and the response selectivity that defines functional maturity. Direction-selective responses are particularly vulnerable to the effects of early visual deprivation, but it remains unclear how stimulus-driven neural activity guides the emergence of cortical direction selectivity. Here we report observations from a motion training protocol that allowed us to monitor the impact of experience on the development of direction-selective responses in visually naive ferrets. Using intrinsic signal imaging techniques, we found that training with a single axis of motion induced the rapid emergence of direction columns that were confined to cortical regions preferentially activated by the training stimulus. Using two-photon calcium imaging techniques, we found that single neurons in visually naive animals exhibited weak directional biases and lacked the strong local coherence in the spatial organization of direction preference that was evident in mature animals. Training with a moving stimulus, but not with a flashed stimulus, strengthened the direction-selective responses of individual neurons and preferentially reversed the direction biases of neurons that deviated from their neighbours. Both effects contributed to an increase in local coherence. We conclude that early experience with moving visual stimuli drives the rapid emergence of direction-selective responses in the visual cortex.     

Involvement of visual cortex in tactile discrimination of orientation.

The primary sense modalities (vision, touch and so on) are generally thought of as distinct. However, visual imagery is implicated in the normal tactile perception of some object properties, such as orientation, shape and size. Furthermore, certain tactile tasks, such as discrimination of grating orientation and object recognition, are associated with activity in areas of visual cortex. Here we show that disrupting function of the occipital cortex using focal transcranial magnetic stimulation (TMS) interferes with the tactile discrimination of grating orientation. The specificity of this effect is illustrated by its time course and spatial restriction over the scalp, and by the failure of occipital TMS to affect either detection of an electrical stimulus applied to the fingerpad or tactile discrimination of grating texture. In contrast, TMS over the somatosensory cortex blocked discrimination of grating texture as well as orientation. We also report that, during tactile discrimination of grating orientation, an evoked potential is recorded over posterior scalp regions with a latency corresponding to the peak of the TMS interference effect (about 180 ms). The findings indicate that visual cortex is closely involved in tactile discrimination of orientation. To our knowledge, this is the first demonstration that visual cortical processing is necessary for normal tactile perception.     

A cellular analogue of visual cortical plasticity

Neuronal activity plays an important role in the development of the visual pathway. The modulation of synaptic transmission by temporal correlation between pre- and postsynaptic activity is one mechanism which could underly visual cortical plasticity. We report here that functional changes in single neurons of area 17, analogous to those known to take place during epigenesis of visual cortex, can be induced experimentally during the time of recording. This was done by a differential pairing procedure, during which iontophoresis was used to artificially increase the visual response for a given stimulus, and to decrease (or block) the response for a second stimulus which differed in ocularity or orientation. Long-term modifications in ocular dominance and orientation selectivity were produced in 33% and 43% of recorded cells respectively. Neuronal selectivity was nearly always displaced towards the stimulus paired with the reinforced visual response. The largest changes were obtained at the peak of the critical period in normally reared and visually deprived kittens, but changes were also observed in adults. Our findings support the role of temporal correlation between pre- and postsynaptic activity in the induction of long-lasting modifications of synaptic transmission during development, and in associative learning.     

Gaze direction controls response gain in primary visual-cortex neurons

To localize objects in space, the brain needs to combine information about the position of the stimulus on the retinae with information about the location of the eyes in their orbits. Interaction between these two types of information occurs in several cortical areas, but the role of the primary visual cortex (area V1) in this process has remained unclear. Here we show that, for half the cells recorded in area V1 of behaving monkeys, the classically described visual responses are strongly modulated by gaze direction. Specifically, we find that selectivity for horizontal retinal disparity-the difference in the position of a stimulus on each retina which relates to relative object distance-and for stimulus orientation may be present at a given gaze direction, but be absent or poorly expressed at another direction. Shifts in preferred disparity also occurred in several neurons. These neural changes were most often present at the beginning of the visual response, suggesting a feedforward gain control by eye position signals. Cortical neural processes for encoding information about the three-dimensional position of a stimulus in space therefore start as early as area V1.     

Corticofugal feedback influences the generation of length tuning in the visual pathway

In the feline visual system, neurons exhibiting sensitivity to the length of a moving contour were first observed in the cortex and described as 'hypercomplex cells'. In these cells an increase in stimulus length beyond an optimal value leads to a rapid decline in response. This decline has been attributed to an intracortical inhibitory input which may be driven by layer VI cells with very long receptive fields. It is now clear, however, that cells in the dorsal lateral geniculate nucleus (dLGN), exhibit a degree of length tuning similar to that of cortical 'hypercomplex cells', suggesting that this response property could be generated subcortically. Alternatively, as the dLGN receives a massive corticofugal projection from layer VI cells in the visual cortex, it is possible that this input has a function in generating length tuning in the dLGN. We have investigated this issue by comparing the length tuning of dLGN cells with and without corticofugal feedback. The data show that corticofugal feedback makes a highly significant contribution to the length tuning of dLGN cells. This raises the possibility that length tuning is an emergent property of the geniculo-cortical loop.     

Highly ordered arrangement of single neurons in orientation pinwheels

In the visual cortex of higher mammals, neurons are arranged across the cortical surface in an orderly map of preferred stimulus orientations. This map contains 'orientation pinwheels', structures that are arranged like the spokes of a wheel such that orientation changes continuously around a centre. Conventional optical imaging first demonstrated these pinwheels, but the technique lacked the spatial resolution to determine the response properties and arrangement of cells near pinwheel centres. Electrophysiological recordings later demonstrated sharply selective neurons near pinwheel centres, but it remained unclear whether they were arranged randomly or in an orderly fashion. Here we use two-photon calcium imaging in vivo to determine the microstructure of pinwheel centres in cat visual cortex with single-cell resolution. We find that pinwheel centres are highly ordered: neurons selective to different orientations are clearly segregated even in the very centre. Thus, pinwheel centres truly represent singularities in the cortical map. This highly ordered arrangement at the level of single cells suggests great precision in the development of cortical circuits underlying orientation selectivity.     

Dynamic coding of behaviourally relevant stimuli in parietal cortex.

A general function of cerebral cortex is to allow the flexible association of sensory stimuli with specific behaviours. Many neurons in parietal, prefrontal and motor cortical areas are activated both by particular movements and by sensory cues that trigger these movements, suggesting a role in linking sensation to action. For example, neurons in the lateral intraparietal area (LIP) encode both the location of visual stimuli and the direction of saccadic eye movements. LIP is not believed to encode non-spatial stimulus attributes such as colour. Here we investigated whether LIP would encode colour if colour was behaviourally linked to the eye movement. We trained monkeys to make an eye movement in one of two directions based alternately on the colour or location of a visual cue. When cue colour was relevant for directing eye movement, we found a substantial fraction of LIP neurons selective for cue colour. However, when cue location was relevant, colour selectivity was virtually absent in LIP. These results demonstrate that selectivity of cortical neurons can change as a function of the required behaviour.     

Small modulation of ongoing cortical dynamics by sensory input during natural vision

During vision, it is believed that neural activity in the primary visual cortex is predominantly driven by sensory input from the environment. However, visual cortical neurons respond to repeated presentations of the same stimulus with a high degree of variability. Although this variability has been considered to be noise owing to random spontaneous activity within the cortex, recent studies show that spontaneous activity has a highly coherent spatio-temporal structure. This raises the possibility that the pattern of this spontaneous activity may shape neural responses during natural viewing conditions to a larger extent than previously thought. Here, we examine the relationship between spontaneous activity and the response of primary visual cortical neurons to dynamic natural-scene and random-noise film images in awake, freely viewing ferrets from the time of eye opening to maturity. The correspondence between evoked neural activity and the structure of the input signal was weak in young animals, but systematically improved with age. This improvement was linked to a shift in the dynamics of spontaneous activity. At all ages including the mature animal, correlations in spontaneous neural firing were only slightly modified by visual stimulation, irrespective of the sensory input. These results suggest that in both the developing and mature visual cortex, sensory evoked neural activity represents the modulation and triggering of ongoing circuit dynamics by input signals, rather than directly reflecting the structure of the input signal itself.     

Receptive field dynamics in adult primary visual cortex.

The adult brain has a remarkable ability to adjust to changes in sensory input. Removal of afferent input to the somatosensory, auditory, motor or visual cortex results in a marked change of cortical topography. Changes in sensory activity can, over a period of months, alter receptive field size and cortical topography. Here we remove visual input by focal binocular retinal lesions and record from the same cortical sites before and within minutes after making the lesion and find immediate striking increases in receptive field size for cortical cells with receptive fields near the edge of the retinal scotoma. After a few months even the cortical areas that were initially silenced by the lesion recover visual activity, representing retinotopic loci surrounding the lesion. At the level of the lateral geniculate nucleus, which provides the visual input to the striate cortex, a large silent region remains. Furthermore, anatomical studies show that the spread of geniculocortical afferents is insufficient to account for the cortical recovery. The results indicate that the topographic reorganization within the cortex was largely due to synaptic changes intrinsic to the cortex, perhaps through the plexus of long-range horizontal connections.     

Neural correlates of perceptual motion coherence.

The motions of overlapping contours in a visual scene may arise from the physical motion(s) of either a single or multiple surface(s). A central problem facing the visual motion system is that of assigning the most likely interpretation. The rules underlying this perceptual decision can be explored using a visual stimulus formed by superimposing two moving gratings. The resultant percept is either that of a single coherently moving 'plaid pattern' (coherent motion) or of the two component gratings sliding noncoherently across one another (noncoherent motion). When plaid patterns are configured to mimic one transparent grating overlying another, the percept of noncoherent motion dominates. We now report that neurons in the visual cortex of rhesus monkeys exhibit changes in direction tuning that parallel this perceptual phenomenon: sensitivity to the motions of the component gratings is enhanced under conditions that favour the perception of noncoherent motion. These results challenge models of cortical visual processing that fail to take into account the contribution of figural image segmentation cues to the analysis of visual motion.     

Cortical remodelling induced by activity of ventral tegmental dopamine neurons.

Representations of sensory stimuli in the cerebral cortex can undergo progressive remodelling according to the behavioural importance of the stimuli. The cortex receives widespread projections from dopamine neurons in the ventral tegmental area (VTA), which are activated by new stimuli or unpredicted rewards, and are believed to provide a reinforcement signal for such learning-related cortical reorganization. In the primary auditory cortex (AI) dopamine release has been observed during auditory learning that remodels the sound-frequency representations. Furthermore, dopamine modulates long-term potentiation, a putative cellular mechanism underlying plasticity. Here we show that stimulating the VTA together with an auditory stimulus of a particular tone increases the cortical area and selectivity of the neural responses to that sound stimulus in AI. Conversely, the AI representations of nearby sound frequencies are selectively decreased. Strong, sharply tuned responses to the paired tones also emerge in a second cortical area, whereas the same stimuli evoke only poor or non-selective responses in this second cortical field in naive animals. In addition, we found that strong long-range coherence of neuronal discharge emerges between AI and this secondary auditory cortical area.     

Visual behaviour mediated by retinal projections directed to the auditory pathway

An unresolved issue in cortical development concerns the relative contributions of intrinsic and extrinsic factors to the functional specification of different cortical areas. Ferrets in which retinal projections are redirected neonatally to the auditory thalamus have visually responsive cells in auditory thalamus and cortex, form a retinotopic map in auditory cortex and have visual receptive field properties in auditory cortex that are typical of cells in visual cortex. Here we report that this cross-modal projection and its representation in auditory cortex can mediate visual behaviour. When light stimuli are presented in the portion of the visual field that is 'seen' only by this projection, 'rewired' ferrets respond as though they perceive the stimuli to be visual rather than auditory. Thus the perceptual modality of a neocortical region is instructed to a significant extent by its extrinsic inputs. In addition, gratings of different spatial frequencies can be discriminated by the rewired pathway, although the grating acuity is lower than that of the normal visual pathway.     

Neural mechanisms of perceptual grouping in human visual cortex

The current work examined neural substrates of perceptual grouping in human visual cortex using event-related potential (ERP) recording. Stimulus arrays consisted of local elements that were either evenly spaced (uniform stimuli) or grouped into columns or rows by proximity or color similarity (grouping stimuli). High-density ERPs were recorded while subjects identified orientations of perceptual groups in stimulus arrays that were presented randomly in one of the four quadrants of the visual field.Both uniform and grouping stimulus arrays elicited an early ERP component (C1), which peaked at about 70ms after stimulus onset and changed its polarity as a function of stimulated elevations. Dipole modeling based on realistichead boundary-element models revealed generators of the C1 component in the calcarine cortex. The C1 was modulated by perceptual grouping of local elements based on proximity, and this grouping effect was stronger in the upper than in the lower visual field. The findings provide ERP evidence for the engagement of human primary visual cortex in the early stage of perceptual grouping.