Modulation of the motion aftereffect by selective attention

The motion aftereffect is a much studied and well documented phenomenon. After viewing a moving visual pattern for a period of time, the same pattern appears to drift in the opposite direction when it is stopped. Psychophysical experiments involving interocular transfer, dichoptic stimulation, and motion aftereffects contingent upon other visual parameters such as colour, orientation and texture, imply that the motion aftereffect is generated at the level of the visual cortex. It has been hypothesized that cortical neurons specialized for the detection of motion along a particular direction become 'fatigued' during the adaptation period so that the resting equilibrium subsequently shifts in the opposite direction to that of the adapting stimulus, giving rise to the sensation of the aftereffect. I have found that if observers are engaged in a separate discrimination task superimposed on a moving textured background, the subsequent motion aftereffect to the background is considerably reduced. It seems that motion aftereffects are susceptible to attentional mechanisms.     

Rapid motion aftereffect seen within uniform flickering test fields

Prolonged viewing of a moving pattern selectively elevates the threshold for a pattern moving in the same direction and induces the classical motion aftereffect (MAE). The aftereffect is seen as a slow drift in the opposite direction, which is visible even with the eyes shut or while viewing a uniform field. However, as we report here, a strikingly different aftereffect is seen when the test field is uniform and sinusoidally flickered: the field is filled with rapid motion in the direction opposite the adapting motion. This flicker MAE has distinct properties: the adapting grating must be of low spatial frequency; the effect is promoted by high contrast and high temporal frequencies of both adapting and test stimuli; and the aftereffect does not transfer interocularly. In all these respects the flicker MAE differs from the traditional MAE. Motion detectors have been identified in human vision by the threshold detectability and discriminability of moving patterns and by selective adaptation. The flicker MAE selectively taps a class of transient motion mechanisms that are selective for rapid motion and low spatial frequency. Uniform flicker is an effective stimulus for these mechanisms. It thus appears that the human visual system contains at least two distinct classes of mechanisms for sensing motion.     

Influence of motion signals on the perceived position of spatial pattern

After adaptation of the visual system to motion of a pattern in a particular direction, a static pattern appears to move in the opposite direction-the motion aftereffect (MAE). It is thought that the MAE is not accompanied by a shift in perceived spatial position of the pattern being viewed, providing psychophysical evidence for a dissociation of the neural processing of motion and position that complements anatomical and physiological evidence of functional specialization in primate and human visual cortex. However, here we measure the perceived orientation of a static windmill pattern after adaptation to rotary motion and find a gradual shift in orientation in the direction of the illusory rotation, though at a rate much lower than the apparent rotation speed. The orientation shift, which started to decline within a few seconds, could persist longer than the MAE, and disappeared when the MAE was nulled by physical motion of the windmill pattern. Our results indicate that the representation of the position of spatial pattern is dynamically updated by neurons involved in the analysis of motion.     

Neural synchrony correlates with surface segregation rules

To analyse an image, the visual system must decompose the scene into its relevant parts. Identifying distinct surfaces is a basic operation in such analysis, and is believed to precede object recognition. Two superimposed gratings moving in different directions (plaid stimuli) may be perceived either as two surfaces, one being transparent and sliding on top of the other (component motion) or as a single pattern whose direction of motion is intermediate to the component vectors (pattern motion). The degree of transparency, and hence the perception, can be manipulated by changing only the luminance of the grating intersections. Here we show that neurons in two visual cortical areas--A18 and PMLS--synchronize their discharges when responding to contours of the same surface but not when responding to contours belonging to different surfaces. The amplitudes of responses correspond to previously described rate predictions for component and pattern motion, but, in contrast to synchrony, failed to reflect the transition from component to pattern motion induced by manipulating the degree of transparency. Thus, dynamic changes in synchronization could encode, in a context-dependent way, relations among simultaneous responses to spatially superimposed contours and thereby bias their association with distinct surfaces.     

Influence of prolonged optic flow stimuli on spontaneous activities of cat PMLS neurons

Changes in neuronal spontaneous activities after prolonged optic flow stimulation (using the three basic flow modes: translation, radiation and rotation) were investigated by extracellular single-unit recording in cortical area PMLS of the cat. The results showed that the evoked responses decreased with the prolongation of visual stimuli,and the spontaneous activities usually dropped to a lower level after the stimuli were withdrawn. Generally, the reduction in spontaneous activities was larger after adaptation in the preferred direction than in the non-preferred direction.This difference was much pronounced to translation stimuli,but relatively insignificant to radiation and rotation. These points suggest that non-specific fatigue may act as the key factor in adaptation to simple translation, while some kinds of more complicated, direction-specific mechanism may be involved in adaptation to the complex optic flow patterns. In addition, PMLS may play an important role in perception and adaptation to complex motion and the relevant motion after-effects.     

图像序列中运动目标深度估计

通过对生物视觉深度运动知觉机理的研究，推导出基于深度运动知觉提取三维运动目标深度信息的数学模型和计算公式．研究结果表明，根据三维运动目标在二维成像平面上的运动可以判断是否存在深度方向变化以及大致区分目标运动的方向．同时如果假定已知运动目标的大小，根据它们在像平面上ｘ或ｙ方向的相对运动变化可以对于目标的深度运动进行估计．经过采用实际图像序列所进行的实验，获得了令人满意的结果．     

Experience with moving visual stimuli drives the early development of cortical direction selectivity

The onset of vision occurs when neural circuits in the visual cortex are immature, lacking both the full complement of connections and the response selectivity that defines functional maturity. Direction-selective responses are particularly vulnerable to the effects of early visual deprivation, but it remains unclear how stimulus-driven neural activity guides the emergence of cortical direction selectivity. Here we report observations from a motion training protocol that allowed us to monitor the impact of experience on the development of direction-selective responses in visually naive ferrets. Using intrinsic signal imaging techniques, we found that training with a single axis of motion induced the rapid emergence of direction columns that were confined to cortical regions preferentially activated by the training stimulus. Using two-photon calcium imaging techniques, we found that single neurons in visually naive animals exhibited weak directional biases and lacked the strong local coherence in the spatial organization of direction preference that was evident in mature animals. Training with a moving stimulus, but not with a flashed stimulus, strengthened the direction-selective responses of individual neurons and preferentially reversed the direction biases of neurons that deviated from their neighbours. Both effects contributed to an increase in local coherence. We conclude that early experience with moving visual stimuli drives the rapid emergence of direction-selective responses in the visual cortex.     

Parallel processing of motion and colour information

When the two eyes are confronted with sufficiently different versions of the visual environment, one or the other eye dominates perception in alternation. A similar situation may be created in the laboratory by presenting images to the left and right eyes which differ in orientation or colour. Although perception is dominated by one eye during rivalry, there are a number of instances in which visual processes nevertheless continue to integrate information from the suppressed eye. For example the interocular transfer of the motion after-effect is undiminished when induced during binocular rivalry. Thus motion information processing may occur in parallel with the rivalry process. Here we describe a novel example in which the visual system simultaneously exhibits binocular rivalry and vision that integrates signals from both eyes. This apparent contradiction is resolved by postulating parallel visual processes devoted to the analyses of colour and motion information. Counterphased gratings are viewed dichoptically such that for one eye the grating is composed of alternating yellow and black stripes (luminance) while for the other it is composed of alternating red and green stripes (chrominance). When the gratings are fused, a moving grating is perceived. A consistent direction of motion can only be achieved if left and right monocular signals are integrated by the nervous system. Yet the apparent colour of the binocular percept alternates between red-green and yellow-black. These observations demonstrate the segregation of processing by the early motion system from that affording the perception of colour. Although, in this stimulus, colour information in itself can play no part in the cyclopean perception of motion direction, colour is carried along perceptually (filled in) by the moving pattern which is integrated from both eyes.     

Self-motion and the perception of stationary objects

One of the ways that we perceive shape is through seeing motion. Visual motion may be actively generated (for example, in locomotion), or passively observed. In the study of the perception of three-dimensional structure from motion, the non-moving, passive observer in an environment of moving rigid objects has been used as a substitute for an active observer moving in an environment of stationary objects; this 'rigidity hypothesis' has played a central role in computational and experimental studies of structure from motion. Here we show that this is not an adequate substitution because active and passive observers can perceive three-dimensional structure differently, despite experiencing the same visual stimulus: active observers' perception of three-dimensional structure depends on extraretinal information about their own movements. The visual system thus treats objects that are stationary (in an allocentric, earth-fixed reference frame) differently from objects that are merely rigid. These results show that action makes an important contribution to depth perception, and argue for a revision of the rigidity hypothesis to incorporate the special case of stationary objects.     

Imaging cortical correlates of illusion in early visual cortex

Exploring visual illusions reveals fundamental principles of cortical processing. Illusory motion perception of non-moving stimuli was described almost a century ago by Gestalt psychologists. However, the underlying neuronal mechanisms remain unknown. To explore cortical mechanisms underlying the 'line-motion' illusion, we used real-time optical imaging, which is highly sensitive to subthreshold activity. We examined, in the visual cortex of the anaesthetized cat, responses to five stimuli: a stationary small square and a long bar; a moving square; a drawn-out bar; and the well-known line-motion illusion, a stationary square briefly preceding a long stationary bar presentation. Whereas flashing the bar alone evoked the expected localized, short latency and high amplitude activity patterns, presenting a square 60-100 ms before a bar induced the dynamic activity patterns resembling that of fast movement. The preceding square, even though physically non-moving, created gradually propagating subthreshold cortical activity that must contribute to illusory motion, because it was indistinguishable from cortical representations of real motion in this area. These findings demonstrate the effect of spatio-temporal patterns of subthreshold synaptic potentials on cortical processing and the shaping of perception.     

Visual motion and cortical velocity

Recent studies have revealed some remarkably simple relationships between visual performance and the neuroanatomy of the visual pathways. The visual field is mapped topographically on the surface of the striate cortex in man; the projection is large for the central visual field and is progressively compressed towards the periphery. Visual acuity decreases with distance from the fovea in proportion to the estimated cortical magnification factor, M (the extent of striate cortex in millimetres corresponding to a degree of arc in visual space). If a stimulus is magnified at peripheral locations in proportion to 1/M, it becomes equally resolvable across the visual field. This scaling procedure (M-scaling) maintains equivalence of the cortical projection of stimuli with different visual field loci. We have used M-scaling to investigate motion perception as a visual field variable. We report here that both the lower threshold of motion and adaptation to motion are uniform for M-scaled stimuli, and are related to the velocity of the 'cortical image'.     

A neural representation of depth from motion parallax in macaque visual cortex

Perception of depth is a fundamental challenge for the visual system, particularly for observers moving through their environment. The brain makes use of multiple visual cues to reconstruct the three-dimensional structure of a scene. One potent cue, motion parallax, frequently arises during translation of the observer because the images of objects at different distances move across the retina with different velocities. Human psychophysical studies have demonstrated that motion parallax can be a powerful depth cue, and motion parallax seems to be heavily exploited by animal species that lack highly developed binocular vision. However, little is known about the neural mechanisms that underlie this capacity. Here we show, by using a virtual-reality system to translate macaque monkeys (Macaca mulatta) while they viewed motion parallax displays that simulated objects at different depths, that many neurons in the middle temporal area (area MT) signal the sign of depth (near versus far) from motion parallax in the absence of other depth cues. To achieve this, neurons must combine visual motion with extra-retinal (non-visual) signals related to the animal's movement. Our findings suggest a new neural substrate for depth perception and demonstrate a robust interaction of visual and non-visual cues in area MT. Combined with previous studies that implicate area MT in depth perception based on binocular disparities, our results suggest that area MT contains a more general representation of three-dimensional space that makes use of multiple cues.     

Cortical microstimulation influences perceptual judgements of motion direction

Neurons in the visual cortex respond selectively to perceptually salient features of the visual scene, such as the direction and speed of moving objects, the orientation of local contours, or the colour or relative depth of a visual pattern. It is commonly assumed that the brain constructs its percept of the visual scene from information encoded in the selective responses of such neurons. We have now tested this hypothesis directly by measuring the effect on psychophysical performance of modifying the firing rates of physiologically characterized neurons. We required rhesus monkeys to report the direction of motion in a visual display while we electrically stimulated clusters of directionally selective neurons in the middle temporal visual area (MT, or V5), an extrastriate area that plays a prominent role in the analysis of visual motion information. Microstimulation biased the animals' judgements towards the direction of motion encoded by the stimulated neurons. This result indicates that physiological properties measured at the neuronal level can be causally related to a specific aspect of perceptual performance.     

Perceptual consequences of centre-surround antagonism in visual motion processing

Centre-surround receptive field organization is a ubiquitous property in mammalian visual systems, presumably tailored for extracting image features that are differentially distributed over space. In visual motion, this is evident as antagonistic interactions between centre and surround regions of the receptive fields of many direction-selective neurons in visual cortex. In a series of psychophysical experiments we make the counterintuitive observation that increasing the size of a high-contrast moving pattern renders its direction of motion more difficult to perceive and reduces its effectiveness as an adaptation stimulus. We propose that this is a perceptual correlate of centre-surround antagonism, possibly within a population of neurons in the middle temporal visual area. The spatial antagonism of motion signals observed at high contrast gives way to spatial summation as contrast decreases. Evidently, integration of motion signals over space depends crucially on the visibility of those signals, thereby allowing the visual system to register motion information efficiently and adaptively.     

Neural correlates of perceptual motion coherence.

The motions of overlapping contours in a visual scene may arise from the physical motion(s) of either a single or multiple surface(s). A central problem facing the visual motion system is that of assigning the most likely interpretation. The rules underlying this perceptual decision can be explored using a visual stimulus formed by superimposing two moving gratings. The resultant percept is either that of a single coherently moving 'plaid pattern' (coherent motion) or of the two component gratings sliding noncoherently across one another (noncoherent motion). When plaid patterns are configured to mimic one transparent grating overlying another, the percept of noncoherent motion dominates. We now report that neurons in the visual cortex of rhesus monkeys exhibit changes in direction tuning that parallel this perceptual phenomenon: sensitivity to the motions of the component gratings is enhanced under conditions that favour the perception of noncoherent motion. These results challenge models of cortical visual processing that fail to take into account the contribution of figural image segmentation cues to the analysis of visual motion.     

Neural mechanisms of unconscious visual motion priming

The neural correlates of the motion priming were examined in normal young subjects using event-related brain potentials (ERPs) and functional magnetic resonance imaging (fMRI). Visual motion perception can be uncon-sciously biased in favor of a particular direction by a pre-ceding motion in that direction. Motion priming first in-volved an enhancement of ERP amplitude about 100 ms fol-lowing the onset of motion. The amplitudes of ERP compo-nents after 350 ms were also increased. The fMRI results suggest that the early-latency effect reflects modulation of neural responses in extrastriate cortex. Higher-level visual processing areas, including cortical regions MT/MST and the intraparietal cortices were also activated. The findings provide direct evidence that unconscious priming of motion perception is the result of interaction of direction-selective neural responses to motion stimuli. The results cannot be accounted for by refractoriness of neural responses, but in-stead support a theory of motion priming based on motion opponency, as proposed in computational models.     

Molecular identification of a retinal cell type that responds to upward motion

The retina contains complex circuits of neurons that extract salient information from visual inputs. Signals from photoreceptors are processed by retinal interneurons, integrated by retinal ganglion cells (RGCs) and sent to the brain by RGC axons. Distinct types of RGC respond to different visual features, such as increases or decreases in light intensity (ON and OFF cells, respectively), colour or moving objects. Thus, RGCs comprise a set of parallel pathways from the eye to the brain. The identification of molecular markers for RGC subsets will facilitate attempts to correlate their structure with their function, assess their synaptic inputs and targets, and study their diversification. Here we show, by means of a transgenic marking method, that junctional adhesion molecule B (JAM-B) marks a previously unrecognized class of OFF RGCs in mice. These cells have asymmetric dendritic arbors aligned in a dorsal-to-ventral direction across the retina. Their receptive fields are also asymmetric and respond selectively to stimuli moving in a soma-to-dendrite direction; because the lens reverses the image of the world on the retina, these cells detect upward motion in the visual field. Thus, JAM-B identifies a unique population of RGCs in which structure corresponds remarkably to function.     

Motion streaks provide a spatial code for motion direction.

Although many neurons in the primary visual cortex (V1) of primates are direction selective, they provide ambiguous information about the direction of motion of a stimulus. There is evidence that one of the ways in which the visual system resolves this ambiguity is by computing, from the responses of V1 neurons, velocity components in two or more spatial orientations and then combining these velocity components. Here I consider another potential neural mechanism for determining motion direction. When a localized image feature moves fast enough, it should become smeared in space owing to temporal integration in the visual system, creating a spatial signal-a 'motion streak'-oriented in the direction of the motion. The orientation masking and adaptation experiments reported here show that these spatial signals for motion direction exist in the human visual system for feature speeds above about 1 feature width per 100 ms. Computer simulations show that this psychophysical finding is consistent with the known response properties of V1 neurons, and that these spatial signals, when appropriately processed, are sufficient to determine motion direction in natural images.     

Selective deficit of visual search in moving displays after extrastriate damage

A visual cue that is often associated with significant stimuli, such as those provided by prey and predators, is movement relative to the observer. An efficient visual system should be able to direct attention to those parts of the visual field that contain such stimuli. What is needed is a system that can filter by movement difference. This could direct attention to a moving item among stationary items, or an item moving in one direction against a background moving in a different direction. Visual search experiments have shown that people are indeed able to filter by movement; that is, they can attend to just the moving items in arrays of moving and stationary stimuli. Single-cell recordings from monkey visual cortex show that the medial temporal cortical area (MT) has some of the properties required to filter by movement. We have now linked these two observations by showing that a patient with bilateral lesions to the presumed human homologue of MT cannot restrict visual attention to the moving items in arrays of both moving and stationary items. This suggests that MT is the site of a movement filter used in normal visual processing.     

The role of disparity-sensitive cortical neurons in signalling the direction of self-motion

Movement of an observer through the environment generates motion on the retina. This optic flow provides information about the direction of self-motion, but only if it contains differential motion of elements at different depths. If the observer tracks a stationary object while moving in a direction different from his line of sight, the images of objects in the foreground and in the background move in opposite directions. We have found neurons in the cerebral cortex of monkeys that prefer one direction of motion when the disparity of a stimulus corresponds to foreground motion and prefer the opposite direction when the disparity corresponds to background motion. We propose that these neurons contribute a signal about the direction of self-motion.