Transparency and coherence in human motion perception

When confronted with moving images, the visual system often must decide whether the motion signals arise from a single object or from multiple objects. A special case of this problem arises when two independently moving gratings are superimposed. The gratings tend to cohere and move unambiguously in a single direction (pattern motion) instead of moving independently (component motion). Here we report that the tendency to see pattern motion depends very strongly on the luminance of the intersections (that is, to regions where the gratings overlap) relative to that of the gratings in a way that closely parallels the physics of transparency. When the luminance of these regions is chosen appropriately, pattern motion is destroyed and replaced by the appearance of two transparent gratings moving independently. The observations imply that motion detecting mechanisms in the visual system must have access to tacit 'knowledge' of the physics of transparency and that this knowledge can be used to segment the scene into different objects. The same knowledge could, in principle, be used to avoid confusing shadows with real object boundaries.     

Neuronal synchrony does not correlate with motion coherence in cortical area MT

Natural visual scenes are cluttered with multiple objects whose individual features must somehow be selectively linked (or 'bound') if perception is to coincide with reality. Recent neurophysiological evidence supports a 'binding-by-synchrony' hypothesis: neurons excited by features of the same object fire synchronously, while neurons excited by features of different objects do not. Moving plaid patterns offer a straightforward means to test this idea. By appropriate manipulations of apparent transparency, the component gratings of a plaid pattern can be seen as parts of a single coherently moving surface or as two non-coherently moving surfaces. We examined directional tuning and synchrony of area-MT neurons in awake, fixating primates in response to perceptually coherent and non-coherent plaid patterns. Here we show that directional tuning correlated highly with perceptual coherence, which is consistent with an earlier study. Although we found stimulus-dependent synchrony, coherent plaids elicited significantly less synchrony than did non-coherent plaids. Our data therefore do not support the binding-by-synchrony hypothesis as applied to this class of motion stimuli in area MT.     

Neural correlates of perceptual motion coherence.

The motions of overlapping contours in a visual scene may arise from the physical motion(s) of either a single or multiple surface(s). A central problem facing the visual motion system is that of assigning the most likely interpretation. The rules underlying this perceptual decision can be explored using a visual stimulus formed by superimposing two moving gratings. The resultant percept is either that of a single coherently moving 'plaid pattern' (coherent motion) or of the two component gratings sliding noncoherently across one another (noncoherent motion). When plaid patterns are configured to mimic one transparent grating overlying another, the percept of noncoherent motion dominates. We now report that neurons in the visual cortex of rhesus monkeys exhibit changes in direction tuning that parallel this perceptual phenomenon: sensitivity to the motions of the component gratings is enhanced under conditions that favour the perception of noncoherent motion. These results challenge models of cortical visual processing that fail to take into account the contribution of figural image segmentation cues to the analysis of visual motion.     

Three-dimensional illusory contours and surfaces.

Under general viewing conditions, objects are often partially camouflaged, obscured or occluded, thereby limiting information about their three-dimensional position, orientation and shape to incomplete and variable image cues. When presented with such partial cues, observers report perceiving 'illusory' contours and surfaces (forms) in regions having no physical image contrast. Here we report that three-dimensional illusory forms share three fundamental properties with 'real' forms: (1) the same forms are perceived using either stereo or motion parallax cues (cue invariance); (2) they retain their shape over changes in position and orientation relative to an observer (view stability); and (3) they can take the shape of general contours and surfaces in three dimensions (morphic generality). We hypothesize that illusory contours and surfaces are manifestations of a previously unnoticed visual process which constructs a representation of three-dimensional position, orientation and shape of objects from available image cues.     

fMRI evidence for objects as the units of attentional selection.

Contrasting theories of visual attention emphasize selection by spatial location, visual features (such as motion or colour) or whole objects. Here we used functional magnetic resonance imaging (fMRI) to test key predictions of the object-based theory, which proposes that pre-attentive mechanisms segment the visual array into discrete objects, groups, or surfaces, which serve as targets for visual attention. Subjects viewed stimuli consisting of a face transparently superimposed on a house, with one moving and the other stationary. In different conditions, subjects attended to the face, the house or the motion. The magnetic resonance signal from each subject's fusiform face area, parahippocampal place area and area MT/MST provided a measure of the processing of faces, houses and visual motion, respectively. Although all three attributes occupied the same location, attending to one attribute of an object (such as the motion of a moving face) enhanced the neural representation not only of that attribute but also of the other attribute of the same object (for example, the face), compared with attributes of the other object (for example, the house). These results cannot be explained by models in which attention selects locations or features, and provide physiological evidence that whole objects are selected even when only one visual attribute is relevant.     

Cortical microstimulation influences perceptual judgements of motion direction

Neurons in the visual cortex respond selectively to perceptually salient features of the visual scene, such as the direction and speed of moving objects, the orientation of local contours, or the colour or relative depth of a visual pattern. It is commonly assumed that the brain constructs its percept of the visual scene from information encoded in the selective responses of such neurons. We have now tested this hypothesis directly by measuring the effect on psychophysical performance of modifying the firing rates of physiologically characterized neurons. We required rhesus monkeys to report the direction of motion in a visual display while we electrically stimulated clusters of directionally selective neurons in the middle temporal visual area (MT, or V5), an extrastriate area that plays a prominent role in the analysis of visual motion information. Microstimulation biased the animals' judgements towards the direction of motion encoded by the stimulated neurons. This result indicates that physiological properties measured at the neuronal level can be causally related to a specific aspect of perceptual performance.     

鸟类离顶盖通路的结构和电生理特性

离顶盖通路是鸟类主要的视觉通路之一, 由视网膜、视顶盖、圆核和外纹体组成. 各结构之间具有区域性的对应投射;通路中的神经细胞具有不同的感受野特性, 对不同形式的刺激呈现出不同的反应模式. 参与物体运动方向和物体的朝向分析、运动物体的速度检测、颜色和物体轮廓处理、图象-背景识别、视觉指导定位、捕食和逃避反应等.离顶盖通路侧重于加工关于目标运动的特殊视觉信号,而对自身引起的视觉运动不敏感.     

Modulation of the motion aftereffect by selective attention

The motion aftereffect is a much studied and well documented phenomenon. After viewing a moving visual pattern for a period of time, the same pattern appears to drift in the opposite direction when it is stopped. Psychophysical experiments involving interocular transfer, dichoptic stimulation, and motion aftereffects contingent upon other visual parameters such as colour, orientation and texture, imply that the motion aftereffect is generated at the level of the visual cortex. It has been hypothesized that cortical neurons specialized for the detection of motion along a particular direction become 'fatigued' during the adaptation period so that the resting equilibrium subsequently shifts in the opposite direction to that of the adapting stimulus, giving rise to the sensation of the aftereffect. I have found that if observers are engaged in a separate discrimination task superimposed on a moving textured background, the subsequent motion aftereffect to the background is considerably reduced. It seems that motion aftereffects are susceptible to attentional mechanisms.     

Segregation of global and local motion processing in primate middle temporal visual area.

The early stages of primate visual processing appear to be divided up into several component parts so that, for example, colour, form and motion are analysed by anatomically distinct streams. We have found that further subspecialization occurs within the motion processing stream. Neurons representing two different kinds of information about visual motion are segregated in columnar fashion within the middle temporal area of the owl monkey. These columns can be distinguished by labelling with 2-deoxyglucose in response to large-field random-dot patterns. Neurons in lightly labelled interbands have receptive fields with antagonistic surrounds: the response to a centrally placed moving stimulus is suppressed by motion in the surround. Neurons in more densely labelled bands have surrounds that reinforce the centre response so that they integrate motion cues over large areas of the visual field. Interband cells carry information about local motion contrast that may be used to detect motion boundaries or to indicate retinal slip during visual tracking. Band cells encode information about global motion that might be useful for orienting the animal in its environment.     

Temporal dynamics of a neural solution to the aperture problem in visual area MT of macaque brain

A critical step in the interpretation of the visual world is the integration of the various local motion signals generated by moving objects. This process is complicated by the fact that local velocity measurements can differ depending on contour orientation and spatial position. Specifically, any local motion detector can measure only the component of motion perpendicular to a contour that extends beyond its field of view. This "aperture problem" is particularly relevant to direction-selective neurons early in the visual pathways, where small receptive fields permit only a limited view of a moving object. Here we show that neurons in the middle temporal visual area (known as MT or V5) of the macaque brain reveal a dynamic solution to the aperture problem. MT neurons initially respond primarily to the component of motion perpendicular to a contour's orientation, but over a period of approximately 60 ms the responses gradually shift to encode the true stimulus direction, regardless of orientation. We also report a behavioural correlate of these neural responses: the initial velocity of pursuit eye movements deviates in a direction perpendicular to local contour orientation, suggesting that the earliest neural responses influence the oculomotor response.     

Neural correlates of implied motion

Current views of the visual system assume that the primate brain analyses form and motion along largely independent pathways; they provide no insight into why form is sometimes interpreted as motion. In a series of psychophysical and electrophysiological experiments in humans and macaques, here we show that some form information is processed in the prototypical motion areas of the superior temporal sulcus (STS). First, we show that STS cells respond to dynamic Glass patterns, which contain no coherent motion but suggest a path of motion. Second, we show that when motion signals conflict with form signals suggesting a different path of motion, both humans and monkeys perceive motion in a compromised direction. This compromise also has a correlate in the responses of STS cells, which alter their direction preferences in the presence of conflicting implied motion information. We conclude that cells in the prototypical motion areas in the dorsal visual cortex process form that implies motion. Estimating motion by combining motion cues with form cues may be a strategy to deal with the complexities of motion perception in our natural environment.     

叠合面对叠合剪力墙极限承载力影响的数值分析

归纳总结目前国外相关规范对界面抗剪强度的规定,通过有限元建立预制层和现浇层的接触面,定义叠合面的黏结-脱离损伤模型,分析叠合面的影响.研究结果表明,建立叠合面的黏结-脱离损伤模型能够反映叠合面在受力过程中的脱离破坏程度;在不同轴压比下,叠合面对叠合剪力墙极限承载力影响均较小,边缘构件现浇的叠合剪力墙叠合面脱离破坏程度较边缘构件预制的叠合剪力墙小.     

采用图像轮廓的弹性连接体三维建模与运动估计

为了用较少的参数反映人肢体皮肤的变形,该文提出以旋转圆锥曲面进行弹性连接体(人体)三维建模.模型包括人体三维骨架和代表人肢体皮肤的变形曲面方程,每个肢体只需调整2个变形参数就能反映出人肢体皮肤的变形.根据双目图像序列的轮廓估计人体变形和运动参数,包括骨架的运动参数估计和变形曲面的变形参数确定.实验结果表明:该模型能正确地反映人肢体皮肤的变形,运动估计算法能精确地估计人体运动参数.     

Experience with moving visual stimuli drives the early development of cortical direction selectivity

The onset of vision occurs when neural circuits in the visual cortex are immature, lacking both the full complement of connections and the response selectivity that defines functional maturity. Direction-selective responses are particularly vulnerable to the effects of early visual deprivation, but it remains unclear how stimulus-driven neural activity guides the emergence of cortical direction selectivity. Here we report observations from a motion training protocol that allowed us to monitor the impact of experience on the development of direction-selective responses in visually naive ferrets. Using intrinsic signal imaging techniques, we found that training with a single axis of motion induced the rapid emergence of direction columns that were confined to cortical regions preferentially activated by the training stimulus. Using two-photon calcium imaging techniques, we found that single neurons in visually naive animals exhibited weak directional biases and lacked the strong local coherence in the spatial organization of direction preference that was evident in mature animals. Training with a moving stimulus, but not with a flashed stimulus, strengthened the direction-selective responses of individual neurons and preferentially reversed the direction biases of neurons that deviated from their neighbours. Both effects contributed to an increase in local coherence. We conclude that early experience with moving visual stimuli drives the rapid emergence of direction-selective responses in the visual cortex.     

Dynamic properties of neurons in cortical area MT in alert and anaesthetized macaque monkeys.

In order to see the world with high spatial acuity, an animal must sample the visual image with many detectors that restrict their analyses to extremely small regions of space. The visual cortex must then integrate the information from these localized receptive fields to obtain a more global picture of the surrounding environment. We studied this process in single neurons within the middle temporal visual area (MT) of macaques using stimuli that produced conflicting local and global information about stimulus motion. Neuronal responses in alert animals initially reflected predominantly the ambiguous local motion features, but gradually converged to an unambiguous global representation. When the same animals were anaesthetized, the integration of local motion signals was markedly impaired even though neuronal responses remained vigorous and directional tuning characteristics were intact. Our results suggest that anaesthesia preferentially affects the visual processing responsible for integrating local signals into a global visual representation.     

Perceptual filling in of artificially induced scotomas in human vision

Patients with scotomas or blind-spots in their visual field resulting from damage to the visual pathways often report that the pattern from the rest of the visual field 'fills in' to occupy the scotoma. Here we describe a novel technique for generating an artificial perceptual scotoma which enabled us to study the spatial and temporal characteristics of this filling-in process. A homogeneous grey square subtending 1.5 degrees was displayed against a background of twinkling two-dimensional noise of equal mean luminance. On steady eccentric fixation for 10 s the square vanished and was filled in by the twinkling noise from the surround. Using this display we found that 'filling in' is an active visual process that probably involves creating an actual neural representation of the surround rather than merely ignoring the absence of information from the scotoma; filling in can occur separately for colour and texture, suggesting separate mechanisms; the filling-in process does not completely suppress information from the scotoma, even after an image has faded completely from consciousness it can nevertheless contribute to motion perception; and the process can be strongly influenced by illusory contours.     

The perception of moving plaids reveals two motion-processing stages

When viewed through a small aperture, the perceived motion exhibited by a long moving line or grating is ambiguous. This situation prevails because even a perfect machine could only detect motion perpendicular to a moving contour, so motion parallel to a contour is undetectable. The human visual system views the world through an aperture array--the neural receptive fields. Therefore a moving object is viewed through many small apertures and the motion within many of those apertures is ambiguous. This ambiguity may be resolved by monitoring the motion of a distinctive feature, such as a line-end or corner, and attributing to the larger object the motion of the feature. Alternatively, Adelson and Movshon have suggested that moving images are processed in two stages, that is, they are first decomposed into one-dimensional components which are later recombined to generate perceived object motion. For a moving plaid, defined as the sum of two drifting gratings, these alternative models generate different predictions concerning the resolution of the plaid's motion ambiguity. A feature monitor would respond to the motion of the intersections between gratings, whereas the two-stage motion processor would first decompose the plaid into its constituent gratings and subsequently recombine them to generate the perception of a moving plaid. Using speed discrimination to distinguish between the two models, I find that discrimination thresholds reflect the speed of a plaid's component gratings, rather than the speed of the plaid itself. This result supports the two-stage model. Although speed discrimination is limited by component processing, observers cannot directly access component speed. The only perceptually accessible velocity signal is generated by the second-stage pattern processing.     

Interaction between colour and motion in human vision

There is a wealth of anatomical and psychological evidence which suggests that when people look at an object in the visual world, its various attributes such as colour, 'form', motion and depth are analysed by separate channels in the visual system. If so, how are these attributes put back together again to create a unified picture of the object? And if the object moves rapidly, how is perfect perceptual synchrony maintained between different features on its surface, if it is indeed true that they are being processed separately? Our evidence suggests that the visual system extracts certain conspicuous image features based on luminance contrast, and that the signals derived from these are then attributed to other features on the object, a process that we call 'capture'. Specifically, we find that when either illusory contours or random-dot patterns are moved in the vicinity of a colour-border, the colour border will also seem to move in the same direction even though it is physically stationary.     

Experience-dependent representation of visual categories in parietal cortex

Categorization is a process by which the brain assigns meaning to sensory stimuli. Through experience, we learn to group stimuli into categories, such as 'chair', 'table' and 'vehicle', which are critical for rapidly and appropriately selecting behavioural responses. Although much is known about the neural representation of simple visual stimulus features (for example, orientation, direction and colour), relatively little is known about how the brain learns and encodes the meaning of stimuli. We trained monkeys to classify 360 degrees of visual motion directions into two discrete categories, and compared neuronal activity in the lateral intraparietal (LIP) and middle temporal (MT) areas, two interconnected brain regions known to be involved in visual motion processing. Here we show that neurons in LIP--an area known to be centrally involved in visuo-spatial attention, motor planning and decision-making-robustly reflect the category of motion direction as a result of learning. The activity of LIP neurons encoded directions of motion according to their category membership, and that encoding shifted after the monkeys were retrained to group the same stimuli into two new categories. In contrast, neurons in area MT were strongly direction selective but carried little, if any, explicit category information. This indicates that LIP might be an important nexus for the transformation of visual direction selectivity to more abstract representations that encode the behavioural relevance, or meaning, of stimuli.     

Rapid motion aftereffect seen within uniform flickering test fields

Prolonged viewing of a moving pattern selectively elevates the threshold for a pattern moving in the same direction and induces the classical motion aftereffect (MAE). The aftereffect is seen as a slow drift in the opposite direction, which is visible even with the eyes shut or while viewing a uniform field. However, as we report here, a strikingly different aftereffect is seen when the test field is uniform and sinusoidally flickered: the field is filled with rapid motion in the direction opposite the adapting motion. This flicker MAE has distinct properties: the adapting grating must be of low spatial frequency; the effect is promoted by high contrast and high temporal frequencies of both adapting and test stimuli; and the aftereffect does not transfer interocularly. In all these respects the flicker MAE differs from the traditional MAE. Motion detectors have been identified in human vision by the threshold detectability and discriminability of moving patterns and by selective adaptation. The flicker MAE selectively taps a class of transient motion mechanisms that are selective for rapid motion and low spatial frequency. Uniform flicker is an effective stimulus for these mechanisms. It thus appears that the human visual system contains at least two distinct classes of mechanisms for sensing motion.