Guarding the gateway to cortex with attention in visual thalamus

The massive visual input from the eye to the brain requires selective processing of some visual information at the expense of other information, a process referred to as visual attention. Increases in the responses of visual neurons with attention have been extensively studied along the visual processing streams in monkey cerebral cortex, from primary visual areas to parietal and frontal cortex. Here we show, by recording neurons in attending macaque monkeys (Macaca mulatta), that attention modulates visual signals before they even reach cortex by increasing responses of both magnocellular and parvocellular neurons in the first relay between retina and cortex, the lateral geniculate nucleus (LGN). At the same time, attention decreases neuronal responses in the adjacent thalamic reticular nucleus (TRN). Crick argued for such modulation of the LGN by observing that it is inhibited by the TRN, and suggested that "if the thalamus is the gateway to the cortex, the reticular complex might be described as the guardian of the gateway", a reciprocal relationship we now show to be more than just hypothesis. The reciprocal modulation in LGN and TRN appears only during the initial visual response, but the modulation of LGN reappears later in the response, suggesting separate early and late sources of attentional modulation in LGN.     

Parallel colour-opponent pathways to primary visual cortex

The trichromatic primate retina parses the colour content of a visual scene into 'red/green' and 'blue/yellow' representations. Cortical circuits must combine the information encoded in these colour-opponent signals to reconstruct the full range of perceived colours. Red/green and blue/yellow inputs are relayed by the lateral geniculate nucleus (LGN) of thalamus to primary visual cortex (V1), so understanding how cortical circuits transform these signals requires understanding how LGN inputs to V1 are organized. Here we report direct recordings from LGN afferent axons in muscimol-inactivated V1. We found that blue/yellow afferents terminated exclusively in superficial cortical layers 3B and 4A, whereas red/green afferents were encountered only in deeper cortex, in lower layer 4C. We also describe a distinct cortical target for 'blue-OFF' cells, whose afferents terminated in layer 4A and seemed patchy in organization. The more common 'blue-ON' afferents were found in 4A as well as lower layer 2/3. Chromatic information is thus conveyed to V1 by parallel, anatomically segregated colour-opponent systems, to be combined at a later stage of the colour circuit.     

An evolutionary scaling law for the primate visual system and its basis in cortical function

A hallmark of mammalian brain evolution is the disproportionate increase in neocortical size as compared with subcortical structures. Because primary visual cortex (V1) is the most thoroughly understood cortical region, the visual system provides an excellent model in which to investigate the evolutionary expansion of neocortex. I have compared the numbers of neurons in the visual thalamus (lateral geniculate nucleus; LGN) and area V1 across primate species. Here I find that the number of V1 neurons increases as the 3/2 power of the number of LGN neurons. As a consequence of this scaling law, the human, for example, uses four times as many V1 neurons per LGN neuron (356) to process visual information as does a tarsier (87). I argue that the 3/2 power relationship is a natural consequence of the organization of V1, together with the requirement that spatial resolution in V1 should parallel the maximum resolution provided by the LGN. The additional observation that thalamus/neocortex follows the same evolutionary scaling law as LGN/V1 may suggest that neocortex generally conforms to the same organizational principle as V1.     

Segregation of pathways leading from area V2 to areas V4 and V5 of macaque monkey visual cortex

V5 and V4 are areas of macaque monkey prestriate visual cortex that are specialized for involvement in different aspects of visual perception, namely motion for V5 (refs 1-4) and colour vision, with other possible functions, for V4 (refs 2, 5-9). Thus, it is unlikely that they should be fed the same information for further processing, yet both receive a strong input from patches of the upper layers of V2 (refs 10, 11), the area immediately adjoining the primary visual cortex, V1. V2, however, seems to comprise functionally distinct subregions, which can be revealed by staining the tissue for the mitochondrial enzyme cytochrome oxidase. Here we report that V4 and V5 are connected with separate cytochrome oxidase-defined subregions of V2, suggesting that cortical pathways dealing with motion and colour perception are segregated in their passage through V2, and reinforcing evidence for functional specialization in the visual cortex.     

Small modulation of ongoing cortical dynamics by sensory input during natural vision

During vision, it is believed that neural activity in the primary visual cortex is predominantly driven by sensory input from the environment. However, visual cortical neurons respond to repeated presentations of the same stimulus with a high degree of variability. Although this variability has been considered to be noise owing to random spontaneous activity within the cortex, recent studies show that spontaneous activity has a highly coherent spatio-temporal structure. This raises the possibility that the pattern of this spontaneous activity may shape neural responses during natural viewing conditions to a larger extent than previously thought. Here, we examine the relationship between spontaneous activity and the response of primary visual cortical neurons to dynamic natural-scene and random-noise film images in awake, freely viewing ferrets from the time of eye opening to maturity. The correspondence between evoked neural activity and the structure of the input signal was weak in young animals, but systematically improved with age. This improvement was linked to a shift in the dynamics of spontaneous activity. At all ages including the mature animal, correlations in spontaneous neural firing were only slightly modified by visual stimulation, irrespective of the sensory input. These results suggest that in both the developing and mature visual cortex, sensory evoked neural activity represents the modulation and triggering of ongoing circuit dynamics by input signals, rather than directly reflecting the structure of the input signal itself.     

Spatial structure of cone inputs to receptive fields in primate lateral geniculate nucleus.

Human colour vision depends on three classes of cone photoreceptors, those sensitive to short (S), medium (M) or long (L) wavelengths, and on how signals from these cones are combined by neurons in the retina and brain. Macaque monkey colour vision is similar to human, and the receptive fields of macaque visual neurons have been used as an animal model of human colour processing. P retinal ganglion cells and parvocellular neurons are colour-selective neurons in macaque retina and lateral geniculate nucleus. Interactions between cone signals feeding into these neurons are still unclear. On the basis of experimental results with chromatic adaptation, excitatory and inhibitory inputs from L and M cones onto P cells (and parvocellular neurons) were thought to be quite specific (Fig. 1a). But these experiments with spatially diffuse adaptation did not rule out the 'mixed-surround' hypothesis: that there might be one cone-specific mechanism, the receptive field centre, and a surround mechanism connected to all cone types indiscriminately (Fig. 1e). Recent work has tended to support the mixed-surround hypothesis. We report here the development of new stimuli to measure spatial maps of the linear L-, M- and S-cone inputs to test the hypothesis definitively. Our measurements contradict the mixed-surround hypothesis and imply cone specificity in both centre and surround.     

Wavelength sensitivity in blindsight

Blindsight--the residual visual functions observed in visualfield defects resulting from destruction of part of the primary visual cortex (striate cortex) even though visual stimuli presented in the field defect are not consciously perceived--has generated new insights into the nature of consciousness and the role of the extrastriate pathways in visual processing. Some patients can detect and localize unseen stimuli when they are required to guess. Discrimination of movement, flicker and orientation may also be present, but residual colour discrimination is controversial. Negative results imply that only the pathways from eye to striate cortex can transmit information about colour in primates. By measuring sensitivity to light of different wavelengths in patients with blindsight we show that spectral sensitivity in the blind fields is surprisingly high, with a reduction of only 1 log unit or less across the visible spectrum. It is also essentially normal in form, whether the patients are adapted to light or dark. The shift in peak sensitivity from medium to shorter wavelengths in adaptation to the dark (the Purkinje shift) and the presence of discontinuities in the light-adapted curve together show that blindsight involves both rod and cone contributions, and that some colour opponency remains. As colour opponency requires input from primate beta retinal ganglion cells, two-thirds of which degenerate transneurally after a striate cortical lesion in juvenile monkeys, our results show that the surviving subpopulation of primate beta cells is functional.     

Formation of target-specific neuronal projections in organotypic slice cultures from rat visual cortex.

A characteristic feature of the mammalian cortex is that projection neurons located in distinct cortical layers send their axons to different targets. In visual cortex, cells in layers 2 and 3 project to other cortical areas, whereas cells in layers 5 and 6 project to subcortical targets such as the lateral geniculate nucleus. The proper development of these projections is crucial for correct functioning of the visual system. Here we show that specific connections are established in an organotypic culture system in which rat visual cortex slices are co-cultured with another slice of the visual cortex or with a thalamic slice. The laminar origin and cellular morphology in vitro of cortical projections to other cortical regions or to subcortical targets are remarkably similar to those seen in vivo. In addition, axons of projecting cells are not restricted to particular pathways, but appear instead to grow directly towards their appropriate target. These observations raise the possibility that chemotropic attraction from the target areas may play an important part in the development of the cortical projection pattern.     

Visual motion and cortical velocity

Recent studies have revealed some remarkably simple relationships between visual performance and the neuroanatomy of the visual pathways. The visual field is mapped topographically on the surface of the striate cortex in man; the projection is large for the central visual field and is progressively compressed towards the periphery. Visual acuity decreases with distance from the fovea in proportion to the estimated cortical magnification factor, M (the extent of striate cortex in millimetres corresponding to a degree of arc in visual space). If a stimulus is magnified at peripheral locations in proportion to 1/M, it becomes equally resolvable across the visual field. This scaling procedure (M-scaling) maintains equivalence of the cortical projection of stimuli with different visual field loci. We have used M-scaling to investigate motion perception as a visual field variable. We report here that both the lower threshold of motion and adaptation to motion are uniform for M-scaled stimuli, and are related to the velocity of the 'cortical image'.     

Visual behaviour mediated by retinal projections directed to the auditory pathway

An unresolved issue in cortical development concerns the relative contributions of intrinsic and extrinsic factors to the functional specification of different cortical areas. Ferrets in which retinal projections are redirected neonatally to the auditory thalamus have visually responsive cells in auditory thalamus and cortex, form a retinotopic map in auditory cortex and have visual receptive field properties in auditory cortex that are typical of cells in visual cortex. Here we report that this cross-modal projection and its representation in auditory cortex can mediate visual behaviour. When light stimuli are presented in the portion of the visual field that is 'seen' only by this projection, 'rewired' ferrets respond as though they perceive the stimuli to be visual rather than auditory. Thus the perceptual modality of a neocortical region is instructed to a significant extent by its extrinsic inputs. In addition, gratings of different spatial frequencies can be discriminated by the rewired pathway, although the grating acuity is lower than that of the normal visual pathway.     

Chromatic sensitivity of ganglion cells in the peripheral primate retina

Visual abilities change over the visual field. For example, our ability to detect movement is better in peripheral vision than in foveal vision, but colour discrimination is markedly worse. The deterioration of colour vision has been attributed to reduced colour specificity in cells of the midget, parvocellular (PC) visual pathway in the peripheral retina. We have measured the colour specificity (red-green chromatic modulation sensitivity) of PC cells at eccentricities between 20 and 50 degrees in the macaque retina. Here we show that most peripheral PC cells have red-green modulation sensitivity close to that of foveal PC cells. This result is incompatible with the view that PC pathway cells in peripheral retina make indiscriminate connections ('random wiring') with retinal circuits devoted to different spectral types of cone photoreceptors. We show that selective cone connections can be maintained by dendritic field anisotropy, consistent with the morphology of PC cell dendritic fields in peripheral retina. Our results also imply that postretinal mechanisms contribute to the psychophysically demonstrated deterioration of colour discrimination in the peripheral visual field.     

Experience with moving visual stimuli drives the early development of cortical direction selectivity

The onset of vision occurs when neural circuits in the visual cortex are immature, lacking both the full complement of connections and the response selectivity that defines functional maturity. Direction-selective responses are particularly vulnerable to the effects of early visual deprivation, but it remains unclear how stimulus-driven neural activity guides the emergence of cortical direction selectivity. Here we report observations from a motion training protocol that allowed us to monitor the impact of experience on the development of direction-selective responses in visually naive ferrets. Using intrinsic signal imaging techniques, we found that training with a single axis of motion induced the rapid emergence of direction columns that were confined to cortical regions preferentially activated by the training stimulus. Using two-photon calcium imaging techniques, we found that single neurons in visually naive animals exhibited weak directional biases and lacked the strong local coherence in the spatial organization of direction preference that was evident in mature animals. Training with a moving stimulus, but not with a flashed stimulus, strengthened the direction-selective responses of individual neurons and preferentially reversed the direction biases of neurons that deviated from their neighbours. Both effects contributed to an increase in local coherence. We conclude that early experience with moving visual stimuli drives the rapid emergence of direction-selective responses in the visual cortex.     

Top-down signal from prefrontal cortex in executive control of memory retrieval.

Knowledge or experience is voluntarily recalled from memory by reactivation of the neural representations in the cerebral association cortex. In inferior temporal cortex, which serves as the storehouse of visual long-term memory, activation of mnemonic engrams through electric stimulation results in imagery recall in humans, and neurons can be dynamically activated by the necessity for memory recall in monkeys. Neuropsychological studies and previous split-brain experiments predicted that prefrontal cortex exerts executive control upon inferior temporal cortex in memory retrieval; however, no neuronal correlate of this process has ever been detected. Here we show evidence of the top-down signal from prefrontal cortex. In the absence of bottom-up visual inputs, single inferior temporal neurons were activated by the top-down signal, which conveyed information on semantic categorization imposed by visual stimulus-stimulus association. Behavioural performance was severely impaired with loss of the top-down signal. Control experiments confirmed that the signal was transmitted not through a subcortical but through a fronto-temporal cortical pathway. Thus, feedback projections from prefrontal cortex to the posterior association cortex appear to serve the executive control of voluntary recall.     

Modulation of the motion aftereffect by selective attention

The motion aftereffect is a much studied and well documented phenomenon. After viewing a moving visual pattern for a period of time, the same pattern appears to drift in the opposite direction when it is stopped. Psychophysical experiments involving interocular transfer, dichoptic stimulation, and motion aftereffects contingent upon other visual parameters such as colour, orientation and texture, imply that the motion aftereffect is generated at the level of the visual cortex. It has been hypothesized that cortical neurons specialized for the detection of motion along a particular direction become 'fatigued' during the adaptation period so that the resting equilibrium subsequently shifts in the opposite direction to that of the adapting stimulus, giving rise to the sensation of the aftereffect. I have found that if observers are engaged in a separate discrimination task superimposed on a moving textured background, the subsequent motion aftereffect to the background is considerably reduced. It seems that motion aftereffects are susceptible to attentional mechanisms.     

Receptive field dynamics in adult primary visual cortex.

The adult brain has a remarkable ability to adjust to changes in sensory input. Removal of afferent input to the somatosensory, auditory, motor or visual cortex results in a marked change of cortical topography. Changes in sensory activity can, over a period of months, alter receptive field size and cortical topography. Here we remove visual input by focal binocular retinal lesions and record from the same cortical sites before and within minutes after making the lesion and find immediate striking increases in receptive field size for cortical cells with receptive fields near the edge of the retinal scotoma. After a few months even the cortical areas that were initially silenced by the lesion recover visual activity, representing retinotopic loci surrounding the lesion. At the level of the lateral geniculate nucleus, which provides the visual input to the striate cortex, a large silent region remains. Furthermore, anatomical studies show that the spread of geniculocortical afferents is insufficient to account for the cortical recovery. The results indicate that the topographic reorganization within the cortex was largely due to synaptic changes intrinsic to the cortex, perhaps through the plexus of long-range horizontal connections.     

Feature-based attention influences motion processing gain in macaque visual cortex.

Changes in neural responses based on spatial attention have been demonstrated in many areas of visual cortex, indicating that the neural correlate of attention is an enhanced response to stimuli at an attended location and reduced responses to stimuli elsewhere. Here we demonstrate non-spatial, feature-based attentional modulation of visual motion processing, and show that attention increases the gain of direction-selective neurons in visual cortical area MT without narrowing the direction-tuning curves. These findings place important constraints on the neural mechanisms of attention and we propose to unify the effects of spatial location, direction of motion and other features of the attended stimuli in a 'feature similarity gain model' of attention.     

Changes in geniculate cell size following brief monocular blockade of retinal activity in kittens

When a kitten is subjected to monocular lid suture early in life, cells in laminae of the lateral geniculate nucleus (LGN) connected to the sutured eye grow less than normal and cells in those laminae connected to the non-sutured eye grow more than normal. These changes are seen primarily in the binocular segment of the LGN, which corresponds to the central visual field, and are due to competition either between intracortical afferents originating from the different LGN laminae, or directly among cells within the LGN. The afferent deprivation induced by lid suture, however, is not complete, as retinal ganglion cells fire tonically both in darkness and in light. It is generally thought that this tonic retinal activity is necessary to maintain neuronal excitability at normal threshold in the central visual pathway. In the visual cortex of developing kittens, we previously showed a long-lasting change in ocular dominance of binocular cells by a brief blockade of retinal activity in one optic nerve. We report here that a complete blockade of retinal activity in one eye causes major changes in LGN cell size within 1 week. These changes occur throughout the LGN, including the monocular segment where binocular competition does not occur. The results indicate that tonic retinal activity may have an important role in the control of geniculate cell size.     

Disruption of retinogeniculate afferent segregation by antagonists to NMDA receptors.

Afferent activity has an important role in the formation of connections in the developing mammalian visual system. But the extent to which the activity of target neurons shapes patterns of afferent termination and synaptic contact is not known. In the ferret's visual pathway, retinal ganglion cell axons from each eye segregate early in development into eye-specific laminae in the lateral geniculate nucleus (LGN). The dorsal laminae (termed laminae A and A1) then segregate further into inner and outer sublaminae that retain input from on-centre and off-centre retinal axons, respectively. Thus, individual retinogeniculate axons form terminal arbors within laminae A and A1 that are restricted to one inner or outer sublamina. We report here that blockade of N-methyl-D-aspartate (NMDA) receptors on LGN cells with specific antagonists during the period of sublamina formation prevents retinal afferents from segregating into 'On' and 'Off' sublaminae. Retinogeniculate axons have arbors that are not restricted appropriately, or are restricted in size but inappropriately positioned within the eye-specific laminae. NMDA receptor antagonists may specifically disrupt a mechanism by which LGN neurons detect correlated afferent and target activity, and have been shown to reduce retinogeniculate transmission more generally, causing LGN cells to have markedly reduced levels of activity. These results therefore indicate that the activity of postsynaptic cells can significantly influence the patterning of inputs and the structure of presynaptic afferents during development.     

Possible blindsight in infants lacking one cerebral hemisphere.

Patients with damage to the striate cortex have a subjectively blind region of the visual field, but may still be able to detect and localize targets within this region. But the relative roles in this 'blindsight' of subcortical neural systems, and of pathways to extra-striate visual areas, have been uncertain. Here we report results on two infants in whom one cerebral hemisphere, including both striate and extra-striate visual cortex, needed surgical removal in their first year. Single conspicuous targets in the half-field contralateral to the lesion could elicit fixations, implying detection and orienting by a subcortical system. In contrast, binocular optokinetic nystagmus (OKN), for which a subcortical pathway has often been thought adequate, showed a marked asymmetry. In normal neonates, fixation shifts and OKN have both been taken to reflect subcortical control; our results are consistent with subcortical control for fixation but not for OKN.     

Orientation-specific cortical responses develop in early infancy

Neurones in the visual cortex of higher mammals differ from those elsewhere in the visual pathway in that the majority respond selectively to particular edge or bar orientations in the stimulus. We have developed a visually evoked potential (VEP) technique which isolates the response of orientation-selective mechanisms from that of cortical or sub-cortical neurones which lack orientation selectivity. We are unable to find such orientation-selective responses in newborn human infants within the sensitivity of our method, but repeated longitudinal testing of individual infants shows that measurable responses emerge around 6 weeks of age. This result is consistent with the idea that human cortical visual function is very immature at birth, but develops rapidly in the first two postnatal months.