Coding of smooth eye movements in three-dimensional space by frontal cortex

Through the development of a high-acuity fovea, primates with frontal eyes have acquired the ability to use binocular eye movements to track small objects moving in space. The smooth-pursuit system moves both eyes in the same direction to track movement in the frontal plane (frontal pursuit), whereas the vergence system moves left and right eyes in opposite directions to track targets moving towards or away from the observer (vergence tracking). In the cerebral cortex and brainstem, signals related to vergence eye movements--and the retinal disparity and blur signals that elicit them--are coded independently of signals related to frontal pursuit. Here we show that these types of signal are represented in a completely different way in the smooth-pursuit region of the frontal eye fields. Neurons of the frontal eye field modulate strongly during both frontal pursuit and vergence tracking, which results in three-dimensional cartesian representations of eye movements. We propose that the brain creates this distinctly different intermediate representation to allow these neurons to function as part of a system that enables primates to track and manipulate objects moving in three-dimensional space.     

Performance monitoring by the supplementary eye field

Intelligent behaviour requires self-control based on the consequences of actions. The countermanding task is designed to study self-control; it requires subjects to withhold planned movements in response to an imperative stop signal, which they can do with varying success. In humans, the medial frontal cortex has been implicated in the supervisory control of action. In monkeys, the supplementary eye field in the dorsomedial frontal cortex is involved in producing eye movements, but its precise function has not been clarified. To investigate the role of the supplementary eye field in the control of eye movements, we recorded neural activity in macaque monkeys trained to perform an eye movement countermanding task. Distinct groups of neurons were active after errors, after successful withholding of a partially prepared movement, or in association with reinforcement. These three forms of activation could not be explained by sensory or motor factors. Our results lead us to put forward the hypothesis that the supplementary eye field contributes to monitoring the context and consequences of eye movements.     

Free choice activates a decision circuit between frontal and parietal cortex

We often face alternatives that we are free to choose between. Planning movements to select an alternative involves several areas in frontal and parietal cortex that are anatomically connected into long-range circuits. These areas must coordinate their activity to select a common movement goal, but how neural circuits make decisions remains poorly understood. Here we simultaneously record from the dorsal premotor area (PMd) in frontal cortex and the parietal reach region (PRR) in parietal cortex to investigate neural circuit mechanisms for decision making. We find that correlations in spike and local field potential (LFP) activity between these areas are greater when monkeys are freely making choices than when they are following instructions. We propose that a decision circuit featuring a sub-population of cells in frontal and parietal cortex may exchange information to coordinate activity between these areas. Cells participating in this decision circuit may influence movement choices by providing a common bias to the selection of movement goals.     

Influence of the thalamus on spatial visual processing in frontal cortex

Each of our movements activates our own sensory receptors, and therefore keeping track of self-movement is a necessary part of analysing sensory input. One way in which the brain keeps track of self-movement is by monitoring an internal copy, or corollary discharge, of motor commands. This concept could explain why we perceive a stable visual world despite our frequent quick, or saccadic, eye movements: corollary discharge about each saccade would permit the visual system to ignore saccade-induced visual changes. The critical missing link has been the connection between corollary discharge and visual processing. Here we show that such a link is formed by a corollary discharge from the thalamus that targets the frontal cortex. In the thalamus, neurons in the mediodorsal nucleus relay a corollary discharge of saccades from the midbrain superior colliculus to the cortical frontal eye field. In the frontal eye field, neurons use corollary discharge to shift their visual receptive fields spatially before saccades. We tested the hypothesis that these two components-a pathway for corollary discharge and neurons with shifting receptive fields-form a circuit in which the corollary discharge drives the shift. First we showed that the known spatial and temporal properties of the corollary discharge predict the dynamic changes in spatial visual processing of cortical neurons when saccades are made. Then we moved from this correlation to causation by isolating single cortical neurons and showing that their spatial visual processing is impaired when corollary discharge from the thalamus is interrupted. Thus the visual processing of frontal neurons is spatiotemporally matched with, and functionally dependent on, corollary discharge input from the thalamus. These experiments establish the first link between corollary discharge and visual processing, delineate a brain circuit that is well suited for mediating visual stability, and provide a framework for studying corollary discharge in other sensory systems.     

Control of visual cortical signals by prefrontal dopamine

The prefrontal cortex is thought to modulate sensory signals in posterior cortices during top-down attention, but little is known about the underlying neural circuitry. Experimental and clinical evidence indicate that prefrontal dopamine has an important role in cognitive functions, acting predominantly through D1 receptors. Here we show that dopamine D1 receptors mediate prefrontal control of signals in the visual cortex of macaques (Macaca mulatta). We pharmacologically altered D1-receptor-mediated activity in the frontal eye field of the prefrontal cortex and measured the effect on the responses of neurons in area V4 of the visual cortex. This manipulation was sufficient to enhance the magnitude, the orientation selectivity and the reliability of V4 visual responses to an extent comparable with the known effects of top-down attention. The enhancement of V4 signals was restricted to neurons with response fields overlapping the part of visual space affected by the D1 receptor manipulation. Altering either D1- or D2-receptor-mediated frontal eye field activity increased saccadic target selection but the D2 receptor manipulation did not enhance V4 signals. Our results identify a role for D1 receptors in mediating the control of visual cortical signals by the prefrontal cortex and suggest how processing in sensory areas could be altered in mental disorders involving prefrontal dopamine.     

Representation of a perceptual decision in developing oculomotor commands

Behaviour often depends on the ability to make categorical judgements about sensory information acquired over time. Such judgements require a comparison of the evidence favouring the alternatives, but how the brain forms these comparisons is unknown. Here we show that in a visual discrimination task, the accumulating balance of sensory evidence favouring one interpretation over another is evident in the neural circuits that generate the behavioural response. We trained monkeys to make a direction judgement about dynamic random-dot motions and to indicate their judgement with an eye movement to a visual target. We interrupted motion viewing with electrical microstimulation of the frontal eye field and analysed the resulting, evoked eye movements for evidence of ongoing activity associated with the oculomotor response. Evoked eye movements deviated in the direction of the monkey's judgement. The magnitude of the deviation depended on motion strength and viewing time. The oculomotor signals responsible for these deviations reflected the accumulated motion information that informed the monkey's choices on the discrimination task. Thus, for this task, decision formation and motor preparation appear to share a common level of neural organization.     

Regulation of the gain of visually guided smooth-pursuit eye movements by frontal cortex

In studies of the neural mechanisms giving rise to behaviour, changes in the neural and behavioural responses produced by a given stimulus have been widely reported. This 'gain control' can boost the responses to sensory inputs that are particularly relevant, select among reflexes for execution by motoneurons or emphasize specific movement targets. Gain control is also an integral part of the smooth-pursuit eye movement system. One signature of gain control is that a brief perturbation of a stationary target during fixation causes tiny eye movements, whereas the same perturbation of a moving target during the active state of accurate pursuit causes large responses. Here we show that electrical stimulation of the smooth-pursuit eye movement region in the arcuate sulcus of the frontal lobe ('the frontal pursuit area', FPA) mimics the active state of pursuit. Such stimulation enhances the response to a brief perturbation of target motion, regardless of the direction of motion. We postulate that the FPA sets the gain of pursuit, thereby participating in target selection for pursuit.     

Dynamic coding of behaviourally relevant stimuli in parietal cortex.

A general function of cerebral cortex is to allow the flexible association of sensory stimuli with specific behaviours. Many neurons in parietal, prefrontal and motor cortical areas are activated both by particular movements and by sensory cues that trigger these movements, suggesting a role in linking sensation to action. For example, neurons in the lateral intraparietal area (LIP) encode both the location of visual stimuli and the direction of saccadic eye movements. LIP is not believed to encode non-spatial stimulus attributes such as colour. Here we investigated whether LIP would encode colour if colour was behaviourally linked to the eye movement. We trained monkeys to make an eye movement in one of two directions based alternately on the colour or location of a visual cue. When cue colour was relevant for directing eye movement, we found a substantial fraction of LIP neurons selective for cue colour. However, when cue location was relevant, colour selectivity was virtually absent in LIP. These results demonstrate that selectivity of cortical neurons can change as a function of the required behaviour.     

Disruption of cortical activity prevents ocular dominance changes in monocularly deprived kittens

Abundant evidence now indicates that atypical visual exposure early in the life of cats and primates can cause profound alterations in cortical organization. In particular, it has been shown that preventing the use of one eye for vision early in life results in a marked shift of ocular preference among neurones of kitten visual cortex in favour of the exposed eye. The cellular mechanisms underlying these alterations remain uncertain, but much recent attention has focused on the possible role of pharmacological agents in modifying cortical plasticity, with particular reference to catecholamines. These experiments, which have shown that agents which modify cortical noradrenaline levels can alter the degree of cortical plasticity, do not specify the mechanism of action, and leave open the possibility that other neurotransmitter systems may also be involved in cortical modifiability. We now report that chronic intracortical administration of L-glutamate during a period of monocular vision imposed on young kittens largely prevents the ocular dominance shift which normally occurs under these circumstances.     

Changes in geniculate cell size following brief monocular blockade of retinal activity in kittens

When a kitten is subjected to monocular lid suture early in life, cells in laminae of the lateral geniculate nucleus (LGN) connected to the sutured eye grow less than normal and cells in those laminae connected to the non-sutured eye grow more than normal. These changes are seen primarily in the binocular segment of the LGN, which corresponds to the central visual field, and are due to competition either between intracortical afferents originating from the different LGN laminae, or directly among cells within the LGN. The afferent deprivation induced by lid suture, however, is not complete, as retinal ganglion cells fire tonically both in darkness and in light. It is generally thought that this tonic retinal activity is necessary to maintain neuronal excitability at normal threshold in the central visual pathway. In the visual cortex of developing kittens, we previously showed a long-lasting change in ocular dominance of binocular cells by a brief blockade of retinal activity in one optic nerve. We report here that a complete blockade of retinal activity in one eye causes major changes in LGN cell size within 1 week. These changes occur throughout the LGN, including the monocular segment where binocular competition does not occur. The results indicate that tonic retinal activity may have an important role in the control of geniculate cell size.     

Ocular dominance shift in kitten visual cortex caused by imbalance in retinal electrical activity

Monocular lid suture during the sensitive period early in the life of a kitten disrupts normal development of inputs from the two eyes to the visual cortex, causing a decrease in the fraction of cortical cells responding to the deprived eye. Such an ocular dominance shift has been assumed to depend on patterned visual experience, because no change in cortical physiology is produced by inequalities between the two eyes in retinal illumination or temporally modulated diffuse light stimulation. A higher-level process, involving gating signals from areas outside striate cortex, has been proposed to ensure that sustained changes in synaptic efficacy occur only in response to behaviourally significant visual inputs. To test whether such a process is necessary for ocular dominance plasticity, we treated 4-week-old kittens with visual deprivation and monocular tetrodotoxin (TTX) injections to create an imbalance in the electrical activities of the two retinas in the absence of patterned vision. After 1 week of treatment we determined the ocular dominance distribution of single units in primary visual cortex. In all kittens studied, a significant ocular dominance shift was found. In addition to this physiological change, there was an anatomical change in the lateral geniculate nucleus, where cells were larger in laminae receiving input from the more active eye. Our results indicate that patterned vision is not necessary for visual cortical plasticity, and that an imbalance in spontaneous retinal activity alone can produce a significant ocular dominance shift.     

Selective gating of visual signals by microstimulation of frontal cortex

Several decades of psychophysical and neurophysiological studies have established that visual signals are enhanced at the locus of attention. What remains a mystery is the mechanism that initiates biases in the strength of visual representations. Recent evidence argues that, during spatial attention, these biases reflect nascent saccadic eye movement commands. We examined the functional interaction of saccade preparation and visual coding by electrically stimulating sites within the frontal eye fields (FEF) and measuring its effect on the activity of neurons in extrastriate visual cortex. Here we show that visual responses in area V4 could be enhanced after brief stimulation of retinotopically corresponding sites within the FEF using currents below that needed to evoke saccades. The magnitude of the enhancement depended on the effectiveness of receptive field stimuli as well as on the presence of competing stimuli outside the receptive field. Stimulation of non-corresponding FEF representations could suppress V4 responses. The results suggest that the gain of visual signals is modified according to the strength of spatially corresponding eye movement commands.     

Ocular dominance plasticity in adult cat visual cortex after transplantation of cultured astrocytes

During a critical restricted period of postnatal development, the visual cortical circuitry is susceptible to modifications that are dependent on experience. If vision is restricted to only one eye during this period, the territories innervated by the deprived eye shrink considerably, whereas those innervated by the non-deprived eye expand, and the deprived eye loses the ability to influence almost all of the cells in the cortex. Thus, changes in ocular dominance are paralleled and possibly mediated by synapse elimination and axonal sprouting. Hypotheses about the mechanisms underlying ocular-dominance plasticity assume the activation of NMDA (N-methyl-D-aspartate) receptors and subsequent calcium influx as a trigger of synaptic modifications. In addition, plasticity relies on functional neuromodulatory afferents. On the basis of immunocytochemical studies, it was recently proposed that the presence of immature astrocytes is a prerequisite for visual cortical plasticity, and that the end of the critical period is causally linked to the maturation of astrocytes. Here we report, in support of this hypothesis, that resupplementation of the visual cortex of adult cats with astrocytes cultured from the visual cortex of newborn kittens reinduces ocular-dominance plasticity in adult animals.     

Ketamine-xylazine anaesthesia blocks consolidation of ocular dominance changes in kitten visual cortex

In the visual cortex of mammals, response properties of single neurons can be changed by restricted visual experience during early postnatal development. Covering one eye for four to eight hours when kittens are at the peak of the sensitive period is sufficient to weaken the influence of the occluded eye on cortical neurons resulting in a noticeable shift of ocular dominance towards the open eye. The underlying changes in synaptic connections do not occur so readily when a kitten is anaesthetized and paralysed. We report here that an ocular dominance shift is prevented in alert kittens that receive repeated brief monocular exposures when these are followed by ketamine-xylazine anaesthesia. This retrograde effect on cortical plasticity suggests that the process by which synaptic activity is converted into structural changes has been disturbed.     

Bilateral amblyopia after a short period of reverse occlusion in kittens

The majority of neurones in the visual cortex of both adult cats and kittens can be excited by visual stimulation of either eye. Nevertheless, if one eye is deprived of patterned vision early in life, most cortical cells can only be activated by visual stimuli presented to the nondeprived eye and behaviourally the deprived eye is apparently useless. Although the consequences of monocular deprivation can be severe, they can in many circumstances be rapidly reversed with the early implementation of reverse occlusion which forces the use of the initially deprived eye. However, by itself reverse occlusion does not restore a normal distribution of cortical ocular dominance and only promotes visual recovery in one eye. In an effort to find a procedure that might restore good binocular vision, we have examined the effects on acuity and cortical ocular dominance of a short, but physiologically optimal period of reverse occlusion, followed by a period of binocular vision beginning at 7.5 weeks of age. Surprisingly, despite the early introduction of binocular vision, both eyes attained acuities that were only approximately 1/3 of normal acuity levels. Despite the severe bilateral amblyopia, cortical ocular dominance appeared similar to that of normal cats. This is the first demonstration of severe bilateral amblyopia following consecutive periods of monocular occlusion.     

Different time courses of learning-related activity in the prefrontal cortex and striatum

To navigate our complex world, our brains have evolved a sophisticated ability to quickly learn arbitrary rules such as 'stop at red'. Studies in monkeys using a laboratory test of this capacity--conditional association learning--have revealed that frontal lobe structures (including the prefrontal cortex) as well as subcortical nuclei of the basal ganglia are involved in such learning. Neural correlates of associative learning have been observed in both brain regions, but whether or not these regions have unique functions is unclear, as they have typically been studied separately using different tasks. Here we show that during associative learning in monkeys, neural activity in these areas changes at different rates: the striatum (an input structure of the basal ganglia) showed rapid, almost bistable, changes compared with a slower trend in the prefrontal cortex that was more in accordance with slow improvements in behavioural performance. Also, pre-saccadic activity began progressively earlier in the striatum but not in the prefrontal cortex as learning took place. These results support the hypothesis that rewarded associations are first identified by the basal ganglia, the output of which 'trains' slower learning mechanisms in the frontal cortex.     

A neural correlate of response bias in monkey caudate nucleus

Primates are equipped with neural circuits in the prefrontal cortex, the parietal cortex and the basal ganglia that predict the availability of reward during the performance of behavioural tasks. It is not known, however, how reward value is incorporated in the control of action. Here we identify neurons in the monkey caudate nucleus that create a spatially selective response bias depending on the expected gain. In behavioural tasks, the monkey had to make a visually guided eye movement in every trial, but was rewarded for a correct response in only half of the trials. Reward availability was predictable on the basis of the spatial position of the visual target. We found that caudate neurons change their discharge rate systematically, even before the appearance of the visual target, and usually fire more when the contralateral position is associated with reward. Strong anticipatory activity of neurons with a contralateral preference is associated with decreased latency for eye movements in the contralateral direction. We conclude that this neuronal mechanism creates an advance bias that favours a spatial response when it is associated with a high reward value.     

Correlated binocular activity guides recovery from monocular deprivation

Monocular deprivation (MD) has much more rapid and severe effects on the ocular dominance of neurons in the primary visual cortex (V1) than does binocular deprivation. This finding underlies the widely held hypothesis that the developmental plasticity of ocular dominance reflects competitive interactions for synaptic space between inputs from the two eyes. According to this view, the relative levels of evoked activity in afferents representing the two eyes determine functional changes in response to altered visual experience. However, if the deprived eye of a monocularly deprived kitten is simply reopened, there is substantial physiological and behavioural recovery, leading to the suggestion that absolute activity levels, or some other non-competitive mechanisms, determine the degree of recovery from MD. Here we provide evidence that correlated binocular input is essential for such recovery. Recovery is far less complete if the two eyes are misaligned after a period of MD. This is a powerful demonstration of the importance of cooperative, associative mechanisms in the developing visual cortex.     

Optimal eye movement strategies in visual search

To perform visual search, humans, like many mammals, encode a large field of view with retinas having variable spatial resolution, and then use high-speed eye movements to direct the highest-resolution region, the fovea, towards potential target locations. Good search performance is essential for survival, and hence mammals may have evolved efficient strategies for selecting fixation locations. Here we address two questions: what are the optimal eye movement strategies for a foveated visual system faced with the problem of finding a target in a cluttered environment, and do humans employ optimal eye movement strategies during a search? We derive the ideal bayesian observer for search tasks in which a target is embedded at an unknown location within a random background that has the spectral characteristics of natural scenes. Our ideal searcher uses precise knowledge about the statistics of the scenes in which the target is embedded, and about its own visual system, to make eye movements that gain the most information about target location. We find that humans achieve nearly optimal search performance, even though humans integrate information poorly across fixations. Analysis of the ideal searcher reveals that there is little benefit from perfect integration across fixations--much more important is efficient processing of information on each fixation. Apparently, evolution has exploited this fact to achieve efficient eye movement strategies with minimal neural resources devoted to memory.     

Corticostriatal plasticity is necessary for learning intentional neuroprosthetic skills

The ability to learn new skills and perfect them with practice applies not only to physical skills but also to abstract skills, like motor planning or neuroprosthetic actions. Although plasticity in corticostriatal circuits has been implicated in learning physical skills, it remains unclear if similar circuits or processes are required for abstract skill learning. Here we use a novel behavioural task in rodents to investigate the role of corticostriatal plasticity in abstract skill learning. Rodents learned to control the pitch of an auditory cursor to reach one of two targets by modulating activity in primary motor cortex irrespective of physical movement. Degradation of the relation between action and outcome, as well as sensory-specific devaluation and omission tests, demonstrate that these learned neuroprosthetic actions are intentional and goal-directed, rather than habitual. Striatal neurons change their activity with learning, with more neurons modulating their activity in relation to target-reaching as learning progresses. Concomitantly, strong relations between the activity of neurons in motor cortex and the striatum emerge. Specific deletion of striatal NMDA receptors impairs the development of this corticostriatal plasticity, and disrupts the ability to learn neuroprosthetic skills. These results suggest that corticostriatal plasticity is necessary for abstract skill learning, and that neuroprosthetic movements capitalize on the neural circuitry involved in natural motor learning.