视知觉训练与初级视皮层神经元信息及其表征容量

通过分析猕猴初级视皮层（V1）神经元的群体活动在轮廓线检测训练过程中的变化发现：知觉训练可以降低V1神经元响应在不同试次之间的变异性，促使V1神经元对相同刺激的响应更加稳定；训练还可降低V1神经元群体中神经元活动之间的相关性，使V1神经元之间的活动更加独立；增加了神经活动的维度，提高了神经元表征信息的容量，减少了冗余的神经活动，进而提升了感知能力.     

Guarding the gateway to cortex with attention in visual thalamus

The massive visual input from the eye to the brain requires selective processing of some visual information at the expense of other information, a process referred to as visual attention. Increases in the responses of visual neurons with attention have been extensively studied along the visual processing streams in monkey cerebral cortex, from primary visual areas to parietal and frontal cortex. Here we show, by recording neurons in attending macaque monkeys (Macaca mulatta), that attention modulates visual signals before they even reach cortex by increasing responses of both magnocellular and parvocellular neurons in the first relay between retina and cortex, the lateral geniculate nucleus (LGN). At the same time, attention decreases neuronal responses in the adjacent thalamic reticular nucleus (TRN). Crick argued for such modulation of the LGN by observing that it is inhibited by the TRN, and suggested that "if the thalamus is the gateway to the cortex, the reticular complex might be described as the guardian of the gateway", a reciprocal relationship we now show to be more than just hypothesis. The reciprocal modulation in LGN and TRN appears only during the initial visual response, but the modulation of LGN reappears later in the response, suggesting separate early and late sources of attentional modulation in LGN.     

Localization of a human system for sustained attention by positron emission tomography

Positron emission tomographic (PET) studies of human attention have begun to dissect isolable components of this complex higher brain function, including a midline attentional system in a region of the anterior cingulate cortex. The right hemisphere may play a special part in human attention; neglect, an important phenomenon associated with damage to attentional systems, is more severe, extensive and long-lasting after lesions to the right hemisphere. Here we use PET measurements of brain blood flow in healthy subjects to identify changes in regional brain activity during simple visual and somatosensory tasks of sustained attention or vigilance. We find localized increases in blood flow in the prefrontal and superior parietal cortex primarily in the right hemisphere, regardless of the modality or laterality of sensory input. The anterior cingulate was not activated during either task. These data localize the vigilance aspects of normal human attention to sensory stimuli, thereby clarifying the biology underlying asymmetries of attention to such stimuli that have been reported in clinical lesions.     

视觉神经表征中底-顶和顶-底的双向激活——来自人与猴的实验证据

长期以来,建立在坚实生理学证据之上的底-顶加工说和特征检测理论在视觉研究中占主导地位。对于顶-底加工人们只能靠一般常识,即知识或经验通过激活记忆中的神经表征影响视觉过程。但是近年来,来自人和猴的研究为顶-底的加工提供了实验证据。 首先位于猴腹侧加工系统内的物体和面孔视觉记忆表征,提供了神经编码是怎样创立、组织和再激活的最佳实验证据。联想性编码是通过学习由一些具有特殊功能的神经元建立的,这些神经元具有将时间性关联刺激的表征联系起来的能力。其次,不仅来自视网膜的底-顶信号,而且来自前额叶的顶-底信号都能触发联想性编码的提取,既可以作为有意识回忆的神经基础,又是顶-底加工影响视觉过程的基础。脑损伤病人研究、具有高时间分辨率的人类功能性核磁共振成像(functional magnetic resonance imaging, fMRI)和猴fMRI研究以及猴细胞电生理分析相结合,将进一步加强人们对视觉脑机制的全面理解。     

Body image as a visuomotor transformation device revealed in adaptation to reversed vision

People adapt with remarkable flexibility to reversal of the visual field caused by prism spectacles. With sufficient time, this adaptation restores visually guided behaviour and perceptual harmony between the visible and tactile worlds. Although it has been suggested that seeing one's own body is crucial for adaptation, the underlying mechanisms are unclear. Here we show that a new representation of visuomotor mapping with respect to the hands emerges in a month during adaptation to reversed vision. The subjects become bi-perceptual, or able to use both new and old representations. In a visual task designed to assess the new hand representation, subjects identified visually presented hands as left or right by matching the picture to the representation of their own hands. Functional magnetic resonance imaging showed brain activity in the left posterior frontal cortex (Broca's area) that was unique to the new hand representations of both hands, together with activation in the intraparietal sulcus and prefrontal cortex. The emergence of the new hand representation coincided with the adaptation of perceived location of visible objects in space. These results suggest that the hand representation operates as a visuomotor transformation device that provides an arm-centred frame of reference for space perception.     

Feature-based attention influences motion processing gain in macaque visual cortex.

Changes in neural responses based on spatial attention have been demonstrated in many areas of visual cortex, indicating that the neural correlate of attention is an enhanced response to stimuli at an attended location and reduced responses to stimuli elsewhere. Here we demonstrate non-spatial, feature-based attentional modulation of visual motion processing, and show that attention increases the gain of direction-selective neurons in visual cortical area MT without narrowing the direction-tuning curves. These findings place important constraints on the neural mechanisms of attention and we propose to unify the effects of spatial location, direction of motion and other features of the attended stimuli in a 'feature similarity gain model' of attention.     

Response synchronization: New progress in brain-visual information processing

Studies on brain-vision have entered a new stage, after the stimulus-induced y synchronized oscillation of neuron group activities have been discovered in cat primary visual cortex. Naturally, how to understand the visual system became a very important methodological problem. From aspects such as information processing, nonlinear dynamics and neuronal network, some primary problems in vision studies have been deeply discussed, which are related with the response synchronization of neuron groups to external objects. The nerve representation (NR) is a distinct feature of the visual system that acts as the intelligent information processing system. NR is also the kernel concept of the computational theory of vision, and the wavelet transform is the basis of multiscale representation. Some important problems should be paid attention to in the study of neuronal spatio-temporal coding and brain-visual information processing. The response synchronization might be a significant approach for integration of brain-visual information processing.     

Development of an invasive brain machine interface with a monkey model

Brain-machine interfaces (BMIs) translate neural activities of the brain into specific instructions that can be carried out by external devices. BMIs have the potential to restore or augment motor functions of paralyzed patients suffering from spinal cord damage. The neural activities have been used to predict the 2D or 3D movement trajectory of monkey’s arm or hand in many studies. However, there are few studies on decoding the wrist movement from neural activities in center-out paradigm. The present study developed an invasive BMI system with a monkey model using a 10×10-microelectrode array in the primary motor cortex. The monkey was trained to perform a two-dimensional forelimb wrist movement paradigm where neural activities and movement signals were simultaneous recorded. Results showed that neuronal firing rates highly correlated with forelimb wrist movement; > 70% (105/149) neurons exhibited specific firing changes during movement and > 36% (54/149) neurons were used to discriminate directional pairs. The neuronal firing rates were also used to predict the wrist moving directions and continuous trajectories of the forelimb wrist. The four directions could be classified with 96% accuracy using a support vector machine, and the correlation coefficients of trajectory prediction using a general regression neural network were above 0.8 for both horizontal and vertical directions. Results showed that this BMI system could predict monkey wrist movements in high accuracy through the use of neuronal firing information.     

Capacity limit of visual short-term memory in human posterior parietal cortex

At any instant, our visual system allows us to perceive a rich and detailed visual world. Yet our internal, explicit representation of this visual world is extremely sparse: we can only hold in mind a minute fraction of the visual scene. These mental representations are stored in visual short-term memory (VSTM). Even though VSTM is essential for the execution of a wide array of perceptual and cognitive functions, and is supported by an extensive network of brain regions, its storage capacity is severely limited. With the use of functional magnetic resonance imaging, we show here that this capacity limit is neurally reflected in one node of this network: activity in the posterior parietal cortex is tightly correlated with the limited amount of scene information that can be stored in VSTM. These results suggest that the posterior parietal cortex is a key neural locus of our impoverished mental representation of the visual world.     

Decoding grasp movement from monkey premotor cortex for real-time prosthetic hand control

Brain machine interfaces (BMIs) have demonstrated lots of successful arm-related reach decoding in past decades, which provide a new hope for restoring the lost motor functions for the disabled. On the other hand, the more sophisticated hand grasp movement, which is more fundamental and crucial for daily life, was less referred. Current state of arts has specified some grasp related brain areas and offline decoding results; however, online decoding grasp movement and real-time neuroprosthetic control have not been systematically investigated. In this study, we obtained neural data from the dorsal premotor cortex (PMd) when monkey reaching and grasping one of four differently shaped objects following visual cues. The four grasp gesture types with an additional resting state were classified asynchronously using a fuzzy k-nearest neighbor model, and an artificial hand was controlled online using a shared control strategy. The results showed that most of the neurons in PMd are tuned by reach and grasp movement, us- ing which we get a high average offline decoding accuracy of 97.1%. In the online demonstration, the instantaneous status of monkey grasping could be extracted successfully to control the artificial hand, with an event-wise accuracy of 85.1%. Overall, our results inspect the neural firing along the time course of grasp and for the first time enables asynchronous neural control of a prosthetic hand, which underline a feasible hand neural prosthesis in BMIs.     

Spatial awareness is a function of the temporal not the posterior parietal lobe.

Our current understanding of spatial behaviour and parietal lobe function is largely based on the belief that spatial neglect in humans (a lack of awareness of space on the side of the body contralateral to a brain injury) is typically associated with lesions of the posterior parietal lobe. However, in monkeys, this disorder is observed after lesions of the superior temporal cortex, a puzzling discrepancy between the species. Here we show that, contrary to the widely accepted view, the superior temporal cortex is the neural substrate of spatial neglect in humans, as it is in monkeys. Unlike the monkey brain, spatial awareness in humans is a function largely confined to the right superior temporal cortex, a location topographically reminiscent of that for language on the left. Hence, the decisive phylogenetic transition from monkey to human brain seems to be a restriction of a formerly bilateral function to the right side, rather than a shift from the temporal to the parietal lobe. One may speculate that this lateralization of spatial awareness parallels the emergence of an elaborate representation for language on the left side.     

Practising orientation identification improves orientation coding in V1 neurons

The adult brain shows remarkable plasticity, as demonstrated by the improvement in fine sensorial discriminations after intensive practice. The behavioural aspects of such perceptual learning are well documented, especially in the visual system. Specificity for stimulus attributes clearly implicates an early cortical site, where receptive fields retain fine selectivity for these attributes; however, the neuronal correlates of a simple visual discrimination task remained unidentified. Here we report electrophysiological correlates in the primary visual cortex (V1) of monkeys for learning orientation identification. We link the behavioural improvement in this type of learning to an improved neuronal performance of trained compared to naive neurons. Improved long-term neuronal performance resulted from changes in the characteristics of orientation tuning of individual neurons. More particularly, the slope of the orientation tuning curve that was measured at the trained orientation increased only for the subgroup of trained neurons most likely to code the orientation identified by the monkey. No modifications of the tuning curve were observed for orientations for which the monkey had not been trained. Thus training induces a specific and efficient increase in neuronal sensitivity in V1.     

Visual categorization shapes feature selectivity in the primate temporal cortex.

The way that we perceive and interact with objects depends on our previous experience with them. For example, a bird expert is more likely to recognize a bird as a sparrow, a sandpiper or a cockatiel than a non-expert. Neurons in the inferior temporal cortex have been shown to be important in the representation of visual objects; however, it is unknown which object features are represented and how these representations are affected by categorization training. Here we show that feature selectivity in the macaque inferior temporal cortex is shaped by categorization of objects on the basis of their visual features. Specifically, we recorded from single neurons while monkeys performed a categorization task with two sets of parametric stimuli. Each stimulus set consisted of four varying features, but only two of the four were important for the categorization task (diagnostic features). We found enhanced neuronal representation of the diagnostic features relative to the non-diagnostic ones. These findings demonstrate that stimulus features important for categorization are instantiated in the activity of single units (neurons) in the primate inferior temporal cortex.     

Attentional modulation in visual cortex depends on task timing

Paying attention to a stimulus selectively increases the ability to process it. For example, when subjects attend to a specific region of a visual scene, their sensitivity to changes at that location increases. A large number of studies describe the behavioural consequences and neurophysiological correlates of attending to spatial locations. There has, in contrast, been little study of the allocation of attention over time. Because subjects can anticipate predictable events with great temporal precision, it seems probable that they might dynamically shift their attention when performing a familiar perceptual task whose constraints changed over time. We trained monkeys to respond to a stimulus change where the probability of occurrence changed over time. Recording from area V4 of the visual cortex in these animals, we found that the modulation of neuronal responses changed according to the probability of the change occurring at that instant. Thus, we show that the attentional modulation of sensory neurons reflects a subject's anticipation of the timing of behaviourally relevant events.     

面向细粒度分类的预测属性引导的注意力研究

细粒度图像分类任务比一般图像分类任务更具有挑战性,其通常需要对类间差异小、类内差异大的样本进行分类.现有细粒度分类方法主要依赖视觉特征进行分类,而人类可以根据文本描述等属性描述来辅助识别图像类别.该文提出了一种通过预测属性引导的通道注意力模块,该模块可以插入到任意的卷积神经网络中,从而让模型学习到更高级的特征表示.最后,该算法在CUB-200-2011数据集上测试,在使用Resnet-50、VGG-19、Bilinear-CNN作为主干网络训练时的精度分别达到87.1%、82.1%、85.5%,精度得到显著提升.     

Involvement of visual cortex in tactile discrimination of orientation.

The primary sense modalities (vision, touch and so on) are generally thought of as distinct. However, visual imagery is implicated in the normal tactile perception of some object properties, such as orientation, shape and size. Furthermore, certain tactile tasks, such as discrimination of grating orientation and object recognition, are associated with activity in areas of visual cortex. Here we show that disrupting function of the occipital cortex using focal transcranial magnetic stimulation (TMS) interferes with the tactile discrimination of grating orientation. The specificity of this effect is illustrated by its time course and spatial restriction over the scalp, and by the failure of occipital TMS to affect either detection of an electrical stimulus applied to the fingerpad or tactile discrimination of grating texture. In contrast, TMS over the somatosensory cortex blocked discrimination of grating texture as well as orientation. We also report that, during tactile discrimination of grating orientation, an evoked potential is recorded over posterior scalp regions with a latency corresponding to the peak of the TMS interference effect (about 180 ms). The findings indicate that visual cortex is closely involved in tactile discrimination of orientation. To our knowledge, this is the first demonstration that visual cortical processing is necessary for normal tactile perception.     

Temporal dissociation of parallel processing in the human subcortical outputs.

Many tasks require rapid and fine-tuned adjustment of motor performance based on incoming sensory information. This process of sensorimotor adaptation engages two parallel subcorticocortical neural circuits, involving the cerebellum and basal ganglia, respectively. How these distributed circuits are functionally coordinated has not been shown in humans. The cerebellum and basal ganglia show very similar convergence of input-output organization, which presents an ideal neuroimaging model for the study of parallel processing at a systems level. Here we used functional magnetic resonance imaging to measure the temporal coherence of brain activity during a tactile discrimination task. We found that, whereas the prefrontal cortex maintained a high level of activation, output activities in the cerebellum and basal ganglia showed different phasic patterns. Moreover, cerebellar activity significantly correlated with the activity of the supplementary motor area but not with that of the primary motor cortex; in contrast, basal ganglia activity was more strongly associated with the activity of the primary motor cortex than with that of the supplementary motor area. These results demonstrate temporally partitioned activity in the cerebellum and basal ganglia, implicating functional independence in the parallel subcortical outputs. This further supports the idea of task-related dynamic reconfiguration of large-scale neural networks.     

Conflict monitoring versus selection-for-action in anterior cingulate cortex

The anterior cingulate cortex (ACC), on the medial surface of the frontal lobes of the brain, is widely believed to be involved in the regulation of attention. Beyond this, however, its specific contribution to cognition remains uncertain. One influential theory has interpreted activation within the ACC as reflecting 'selection-for-action', a set of processes that guide the selection of environmental objects as triggers of or targets for action. We have proposed an alternative hypothesis, in which the ACC serves not to exert top-down attentional control but instead to detect and signal the occurrence of conflicts in information processing. Here, to test this theory against the selection-for-action theory, we used functional magnetic resonance imaging to measure brain activation during performance of a task where, for a particular subset of trials, the strength of selection-for-action is inversely related to the degree of response conflict. Activity within the ACC was greater during trials featuring high levels of conflict (and weak selection-for-action) than during trials with low levels of conflict (and strong selection-for-action), providing evidence in favour of the conflict-monitoring account of ACC function.     

Control of visual cortical signals by prefrontal dopamine

The prefrontal cortex is thought to modulate sensory signals in posterior cortices during top-down attention, but little is known about the underlying neural circuitry. Experimental and clinical evidence indicate that prefrontal dopamine has an important role in cognitive functions, acting predominantly through D1 receptors. Here we show that dopamine D1 receptors mediate prefrontal control of signals in the visual cortex of macaques (Macaca mulatta). We pharmacologically altered D1-receptor-mediated activity in the frontal eye field of the prefrontal cortex and measured the effect on the responses of neurons in area V4 of the visual cortex. This manipulation was sufficient to enhance the magnitude, the orientation selectivity and the reliability of V4 visual responses to an extent comparable with the known effects of top-down attention. The enhancement of V4 signals was restricted to neurons with response fields overlapping the part of visual space affected by the D1 receptor manipulation. Altering either D1- or D2-receptor-mediated frontal eye field activity increased saccadic target selection but the D2 receptor manipulation did not enhance V4 signals. Our results identify a role for D1 receptors in mediating the control of visual cortical signals by the prefrontal cortex and suggest how processing in sensory areas could be altered in mental disorders involving prefrontal dopamine.