Direct visuomotor transformations for reaching

The posterior parietal cortex (PPC) is thought to have a function in the sensorimotor transformations that underlie visually guided reaching, as damage to the PPC can result in difficulty reaching to visual targets in the absence of specific visual or motor deficits. This function is supported by findings that PPC neurons in monkeys are modulated by the direction of hand movement, as well as by visual, eye position and limb position signals. The PPC could transform visual target locations from retinal coordinates to hand-centred coordinates by combining sensory signals in a serial manner to yield a body-centred representation of target location, and then subtracting the body-centred location of the hand. We report here that in dorsal area 5 of the PPC, remembered target locations are coded with respect to both the eye and hand. This suggests that the PPC transforms target locations directly between these two reference frames. Data obtained in the adjacent parietal reach region (PRR) indicate that this transformation may be achieved by vectorially subtracting hand location from target location, with both locations represented in eye-centred coordinates.     

Large adjustments in visually guided reaching do not depend on vision of the hand or perception of target displacement

When we reach towards an object that suddenly appears in our peripheral visual field, not only does our arm extend towards the object, but our eyes, head and body also move in such a way that the image of the object falls on the fovea. Popular models of how reaching movements are programmed have argued that while the first part of the limb movement is ballistic, subsequent corrections to the trajectory are made on the basis of dynamic feedback about the relative positions of the hand and the target provided by central vision. These models have assumed that the adjustments are dependent on seeing the hand moving with respect to the target. Here we present evidence that a change in the position of a visual target during a reaching movement can modify the trajectory even when vision of the hand is prevented. Moreover, these dynamic corrections to the trajectory of the moving limb occur without the subject perceiving the change in target location. These findings demonstrate that visual feedback about the relative position of the hand and target is not necessary for visually driven corrections in reaching to occur, and the mechanisms that maintain the apparent stability of a target in space are dissociable from those that mediate the visuomotor output directed at that target.     

Capacity limit of visual short-term memory in human posterior parietal cortex

At any instant, our visual system allows us to perceive a rich and detailed visual world. Yet our internal, explicit representation of this visual world is extremely sparse: we can only hold in mind a minute fraction of the visual scene. These mental representations are stored in visual short-term memory (VSTM). Even though VSTM is essential for the execution of a wide array of perceptual and cognitive functions, and is supported by an extensive network of brain regions, its storage capacity is severely limited. With the use of functional magnetic resonance imaging, we show here that this capacity limit is neurally reflected in one node of this network: activity in the posterior parietal cortex is tightly correlated with the limited amount of scene information that can be stored in VSTM. These results suggest that the posterior parietal cortex is a key neural locus of our impoverished mental representation of the visual world.     

Relation of neurons in the nonprimary motor cortex to bilateral hand movement

In the primate cerebral cortex there are at least two somatotopically organized, nonprimary motor fields rostral to the primary motor area. To understand the functions of these multiple motor representations we have compared the neuronal activity in each of these fields while monkeys performed a trained motor task, using right, left or both hands. In the nonprimary motor cortex, activity in a number of neurons was related to the movement the animal chose and performed, whereas in the primary motor cortex, changes in the firing of most neurons were simply related to activity in the contralateral muscles. This result indicates that the nonprimary motor cortex is involved in higher-order coding of the laterality of the motor response, implying that it exerts its motor control function at a higher hierarchical level than its counterpart in the primary motor cortex.     

Visual behaviour mediated by retinal projections directed to the auditory pathway

An unresolved issue in cortical development concerns the relative contributions of intrinsic and extrinsic factors to the functional specification of different cortical areas. Ferrets in which retinal projections are redirected neonatally to the auditory thalamus have visually responsive cells in auditory thalamus and cortex, form a retinotopic map in auditory cortex and have visual receptive field properties in auditory cortex that are typical of cells in visual cortex. Here we report that this cross-modal projection and its representation in auditory cortex can mediate visual behaviour. When light stimuli are presented in the portion of the visual field that is 'seen' only by this projection, 'rewired' ferrets respond as though they perceive the stimuli to be visual rather than auditory. Thus the perceptual modality of a neocortical region is instructed to a significant extent by its extrinsic inputs. In addition, gratings of different spatial frequencies can be discriminated by the rewired pathway, although the grating acuity is lower than that of the normal visual pathway.     

Coding of smooth eye movements in three-dimensional space by frontal cortex

Through the development of a high-acuity fovea, primates with frontal eyes have acquired the ability to use binocular eye movements to track small objects moving in space. The smooth-pursuit system moves both eyes in the same direction to track movement in the frontal plane (frontal pursuit), whereas the vergence system moves left and right eyes in opposite directions to track targets moving towards or away from the observer (vergence tracking). In the cerebral cortex and brainstem, signals related to vergence eye movements--and the retinal disparity and blur signals that elicit them--are coded independently of signals related to frontal pursuit. Here we show that these types of signal are represented in a completely different way in the smooth-pursuit region of the frontal eye fields. Neurons of the frontal eye field modulate strongly during both frontal pursuit and vergence tracking, which results in three-dimensional cartesian representations of eye movements. We propose that the brain creates this distinctly different intermediate representation to allow these neurons to function as part of a system that enables primates to track and manipulate objects moving in three-dimensional space.     

Dissociation between mental imagery and object recognition in a brain-damaged patient.

Visual imagery is the creation of mental representations that share many features with veridical visual percepts. Studies of normal and brain-damaged people reinforce the view that visual imagery and visual perception are mediated by a common neural substrate and activate the same representations. Thus, brain-damaged patients with intact vision who have an impairment in perception should have impaired visual imagery. Here we present evidence to the contrary from a patient with severely impaired object recognition (visual object agnosia) but with normal mental imagery. He draws objects in considerable detail from memory and uses information derived from mental images in a variety of tasks. In contrast, he cannot identify visually presented objects, even those he has drawn himself. He has normal visual acuity and intact perception of equally complex material in other domains. We conclude that rich internal representations can be activated to support visual imagery even when they cannot support visually mediated perception of objects.     

视觉神经表征中底-顶和顶-底的双向激活——来自人与猴的实验证据

长期以来,建立在坚实生理学证据之上的底-顶加工说和特征检测理论在视觉研究中占主导地位。对于顶-底加工人们只能靠一般常识,即知识或经验通过激活记忆中的神经表征影响视觉过程。但是近年来,来自人和猴的研究为顶-底的加工提供了实验证据。 首先位于猴腹侧加工系统内的物体和面孔视觉记忆表征,提供了神经编码是怎样创立、组织和再激活的最佳实验证据。联想性编码是通过学习由一些具有特殊功能的神经元建立的,这些神经元具有将时间性关联刺激的表征联系起来的能力。其次,不仅来自视网膜的底-顶信号,而且来自前额叶的顶-底信号都能触发联想性编码的提取,既可以作为有意识回忆的神经基础,又是顶-底加工影响视觉过程的基础。脑损伤病人研究、具有高时间分辨率的人类功能性核磁共振成像(functional magnetic resonance imaging, fMRI)和猴fMRI研究以及猴细胞电生理分析相结合,将进一步加强人们对视觉脑机制的全面理解。     

Visual categorization shapes feature selectivity in the primate temporal cortex.

The way that we perceive and interact with objects depends on our previous experience with them. For example, a bird expert is more likely to recognize a bird as a sparrow, a sandpiper or a cockatiel than a non-expert. Neurons in the inferior temporal cortex have been shown to be important in the representation of visual objects; however, it is unknown which object features are represented and how these representations are affected by categorization training. Here we show that feature selectivity in the macaque inferior temporal cortex is shaped by categorization of objects on the basis of their visual features. Specifically, we recorded from single neurons while monkeys performed a categorization task with two sets of parametric stimuli. Each stimulus set consisted of four varying features, but only two of the four were important for the categorization task (diagnostic features). We found enhanced neuronal representation of the diagnostic features relative to the non-diagnostic ones. These findings demonstrate that stimulus features important for categorization are instantiated in the activity of single units (neurons) in the primate inferior temporal cortex.     

Effects of sleep and arousal on the processing of visual information in the cat

Single units in the cat lateral geniculate nucleus and primary visual cortex show changes in both spontaneous and visually evoked firing as a function of the state of wakefulness. On arousal spontaneous firing is smoother and often reduced, whereas evoked responses are usually enhanced; the result is an increase in the signal-to-noise ratio. Single- and double-label 2-deoxyglucose autoradiographs show further that slow-wave sleep differentially depresses visually evoked activity in the deeper layers of the visual cortex.     

Wavelength sensitivity in blindsight

Blindsight--the residual visual functions observed in visualfield defects resulting from destruction of part of the primary visual cortex (striate cortex) even though visual stimuli presented in the field defect are not consciously perceived--has generated new insights into the nature of consciousness and the role of the extrastriate pathways in visual processing. Some patients can detect and localize unseen stimuli when they are required to guess. Discrimination of movement, flicker and orientation may also be present, but residual colour discrimination is controversial. Negative results imply that only the pathways from eye to striate cortex can transmit information about colour in primates. By measuring sensitivity to light of different wavelengths in patients with blindsight we show that spectral sensitivity in the blind fields is surprisingly high, with a reduction of only 1 log unit or less across the visible spectrum. It is also essentially normal in form, whether the patients are adapted to light or dark. The shift in peak sensitivity from medium to shorter wavelengths in adaptation to the dark (the Purkinje shift) and the presence of discontinuities in the light-adapted curve together show that blindsight involves both rod and cone contributions, and that some colour opponency remains. As colour opponency requires input from primate beta retinal ganglion cells, two-thirds of which degenerate transneurally after a striate cortical lesion in juvenile monkeys, our results show that the surviving subpopulation of primate beta cells is functional.     

Neural subsystems for object knowledge.

Critical issues in the cognitive neuroscience of language are whether there are multiple systems for the representation of meaning, perhaps organized by processing system (such as vision or language), and whether further subsystems are distinguishable within these larger ones. We describe here a patient (K.R.) with cerebral damage whose pattern of acquired deficits offers direct evidence for a major division between visually based and language-based higher-level representations, and for processing subsystems within language. K.R. could not name animals regardless of the type of presentation (auditory or visual), but had no difficulty naming other living things and objects. When asked to describe verbally the physical attributes of animals (for example, 'what colour is an elephant?'), she was strikingly impaired. Nevertheless, she could distinguish the correct physical attributes of animals when they were presented visually (she could distinguish animals that were correctly coloured from those that were not). Her knowledge of input stimulus. To explain this selective deficit, these data mandate the existence of two distinct representations of such properties in normal individuals, one visually based and one language-based. Furthermore, these data establish that knowledge of physical attributes is strictly segregated from knowledge of other properties in the language system.     

Visual motion and cortical velocity

Recent studies have revealed some remarkably simple relationships between visual performance and the neuroanatomy of the visual pathways. The visual field is mapped topographically on the surface of the striate cortex in man; the projection is large for the central visual field and is progressively compressed towards the periphery. Visual acuity decreases with distance from the fovea in proportion to the estimated cortical magnification factor, M (the extent of striate cortex in millimetres corresponding to a degree of arc in visual space). If a stimulus is magnified at peripheral locations in proportion to 1/M, it becomes equally resolvable across the visual field. This scaling procedure (M-scaling) maintains equivalence of the cortical projection of stimuli with different visual field loci. We have used M-scaling to investigate motion perception as a visual field variable. We report here that both the lower threshold of motion and adaptation to motion are uniform for M-scaled stimuli, and are related to the velocity of the 'cortical image'.     

SO(2,1)不可分解表示的Boson实现

本文采用Boson实现的方法,在Heisenberg-Weyl代数的通用包络代数商空间上,研究了三维Lorentz代数SO(2,1)的一个无穷维表示。把这个表示限制到特定的子空间上,我们得到一类不可分解表示。具有物理意义的相干态表示则作为左理想相关的不可分解表示给出。     

Dynamic properties of neurons in cortical area MT in alert and anaesthetized macaque monkeys.

In order to see the world with high spatial acuity, an animal must sample the visual image with many detectors that restrict their analyses to extremely small regions of space. The visual cortex must then integrate the information from these localized receptive fields to obtain a more global picture of the surrounding environment. We studied this process in single neurons within the middle temporal visual area (MT) of macaques using stimuli that produced conflicting local and global information about stimulus motion. Neuronal responses in alert animals initially reflected predominantly the ambiguous local motion features, but gradually converged to an unambiguous global representation. When the same animals were anaesthetized, the integration of local motion signals was markedly impaired even though neuronal responses remained vigorous and directional tuning characteristics were intact. Our results suggest that anaesthesia preferentially affects the visual processing responsible for integrating local signals into a global visual representation.     

Depth is encoded in the visual cortex by a specialized receptive field structure

Binocular neurons in the visual cortex are thought to perform the first stage of processing for the fine stereoscopic depth discrimination exhibited by animals with frontally located eyes. Because lateral separation of the eyes gives a slightly different view to each eye, there are small variations in position (disparities), mainly along the horizontal dimension, between corresponding features in the two retinal images. The visual system uses these disparities to gauge depth. We studied neurons in the cat's visual cortex to determine whether the visual system uses the anisotropy in the range of horizontal and vertical disparities. We report here that there is a corresponding anisotropy in the cortical representation of binocular information: receptive-field profiles for left and right eyes are matched for cells that are tuned to horizontal orientations of image contours. For neurons tuned to vertical orientations, left and right receptive fields are predominantly dissimilar. Therefore, a major modification is required of the conventional notion of disparity processing. The modified scheme allows a unified encoding of monocular form and binocular disparity information.     

Experience with moving visual stimuli drives the early development of cortical direction selectivity

The onset of vision occurs when neural circuits in the visual cortex are immature, lacking both the full complement of connections and the response selectivity that defines functional maturity. Direction-selective responses are particularly vulnerable to the effects of early visual deprivation, but it remains unclear how stimulus-driven neural activity guides the emergence of cortical direction selectivity. Here we report observations from a motion training protocol that allowed us to monitor the impact of experience on the development of direction-selective responses in visually naive ferrets. Using intrinsic signal imaging techniques, we found that training with a single axis of motion induced the rapid emergence of direction columns that were confined to cortical regions preferentially activated by the training stimulus. Using two-photon calcium imaging techniques, we found that single neurons in visually naive animals exhibited weak directional biases and lacked the strong local coherence in the spatial organization of direction preference that was evident in mature animals. Training with a moving stimulus, but not with a flashed stimulus, strengthened the direction-selective responses of individual neurons and preferentially reversed the direction biases of neurons that deviated from their neighbours. Both effects contributed to an increase in local coherence. We conclude that early experience with moving visual stimuli drives the rapid emergence of direction-selective responses in the visual cortex.     

Interocular rivalry revealed in the human cortical blind-spot representation

To understand conscious vision, scientists must elucidate how the brain selects specific visual signals for awareness. When different monocular patterns are presented to the two eyes, they rival for conscious expression such that only one monocular image is perceived at a time. Controversy surrounds whether this binocular rivalry reflects neural competition among pattern representations or monocular channels. Here we show that rivalry arises from interocular competition, using functional magnetic resonance imaging of activity in a monocular region of primary visual cortex corresponding to the blind spot. This cortical region greatly prefers stimulation of the ipsilateral eye to that of the blind-spot eye. Subjects reported their dominant percept while viewing rivalrous orthogonal gratings in the visual location corresponding to the blind spot and its surround. As predicted by interocular rivalry, the monocular blind-spot representation was activated when the ipsilateral grating became perceptually dominant and suppressed when the blind-spot grating became dominant. These responses were as large as those observed during actual alternations between the gratings, indicating that rivalry may be fully resolved in monocular visual cortex. Our findings provide the first physiological evidence, to our knowledge, that interocular competition mediates binocular rivalry, and indicate that V1 may be important in the selection and expression of conscious visual information.     

Perceptual consequences of centre-surround antagonism in visual motion processing

Centre-surround receptive field organization is a ubiquitous property in mammalian visual systems, presumably tailored for extracting image features that are differentially distributed over space. In visual motion, this is evident as antagonistic interactions between centre and surround regions of the receptive fields of many direction-selective neurons in visual cortex. In a series of psychophysical experiments we make the counterintuitive observation that increasing the size of a high-contrast moving pattern renders its direction of motion more difficult to perceive and reduces its effectiveness as an adaptation stimulus. We propose that this is a perceptual correlate of centre-surround antagonism, possibly within a population of neurons in the middle temporal visual area. The spatial antagonism of motion signals observed at high contrast gives way to spatial summation as contrast decreases. Evidently, integration of motion signals over space depends crucially on the visibility of those signals, thereby allowing the visual system to register motion information efficiently and adaptively.     

Temporal properties of pattern adaptation of relay cells in the lateral geniculate nucleus of cats

The temporal properties of pattern adaptation of relay cells induced by repeated sinusoidal drifting grating were investigated in the dorsal lateral geniculate nucleus (dLGN) of cats. The results showed that the response amplitude declined and the response latency prolonged when relay cells were pattern-adapted in dLGN, like the similar findings in visual cortex. However, in contrast to the result in cortex, the response phase of relay cells advanced. This implies that an inhibition with relatively long latency may participate in the pattern adaptation of dLGN cells and the adaptation in dLGN may be via a mechanism different from that of visual cortex.