Vertical disparities and perception of three-dimensional shape

The information about depth and three-dimensional shape available from the horizontal component of the stereo disparity field requires interpretation in conjunction with information about egocentric viewing distance (D). A novel computational approach for estimating D was proposed by Mayhew and Longuet-Higgins, who demonstrated that the horizontal gradient of vertical disparities uniquely specifies the viewing distance. We have now used random dot stereograms in a shape judgement task to show that changes in vertical disparities have no effect on perceived three-dimensional shape. Changes in ocular convergence do alter perceived shape, suggesting substantial changes in the subjects' scaling of horizontal disparities. We conclude that vertical disparities are not used to scale disparities for viewing distance, and that extraretinal signals must be considered when analysing human three-dimensional shape perception.     

Probing the human stereoscopic system with reverse correlation.

Our two eyes obtain slightly different views of the world. The resulting differences in the two retinal images, called binocular disparities, provide us with a stereoscopic sense of depth. The primary visual cortex (V1) contains neurons that are selective for the disparity of individual elements in an image, but this information must be further analysed to complete the stereoscopic process. Here we apply the psychophysical technique of reverse correlation to investigate disparity processing in human vision. Observers viewed binocular random-dot patterns, with 'signal' dots in a specific depth plane plus 'noise' dots with randomly assigned disparities. By examining the correlation between the observers' ability to detect the plane and the particular sample of 'noise' disparities presented on each trial, we revealed detection 'filters', whose disparity selectivity was remarkably similar to that of individual neurons in monkey V1. Moreover, if the noise dots were of opposite contrast in the two eyes, the tuning inverted, just like the response patterns of V1 neurons. Reverse correlation appears to probe disparity processing at the earliest stages of binocular combination, prior to the generation of a full stereoscopic depth percept.     

Depth is encoded in the visual cortex by a specialized receptive field structure

Binocular neurons in the visual cortex are thought to perform the first stage of processing for the fine stereoscopic depth discrimination exhibited by animals with frontally located eyes. Because lateral separation of the eyes gives a slightly different view to each eye, there are small variations in position (disparities), mainly along the horizontal dimension, between corresponding features in the two retinal images. The visual system uses these disparities to gauge depth. We studied neurons in the cat's visual cortex to determine whether the visual system uses the anisotropy in the range of horizontal and vertical disparities. We report here that there is a corresponding anisotropy in the cortical representation of binocular information: receptive-field profiles for left and right eyes are matched for cells that are tuned to horizontal orientations of image contours. For neurons tuned to vertical orientations, left and right receptive fields are predominantly dissimilar. Therefore, a major modification is required of the conventional notion of disparity processing. The modified scheme allows a unified encoding of monocular form and binocular disparity information.     

Sensitivity for vertical retinal image differences

The detection of horizontal disparities between the right and left retinal images is accepted as an important component in the visual perception of depth. It has occasionally been pointed out that a disparity will also occur in the vertical when a target is nearer to one eye than the other and could be used as a second component. Here it is shown that while it is possible to detect size differences between the retinal images in the vertical direction, the sensitivity is at least one order of magnitude less than the horizontal differences. It had been generally accepted that vertical disparities cannot be detected (literature summarized by Tschermak), but there are clear reports of the ability of subjects to respond to relative differences in the vertical magnification of the images of the two eyes, the so-called induced size effect. It manifests itself in the appearance of a visual scene as if there had been an opposite horizontal magnification and is, therefore, in the correct direction if it is to be utilized in asymmetrical convergence.     

Motion direction, speed and orientation in binocular matching

The spatial differences between the images seen by the two eyes, called binocular disparities, can be used to recover the volumetric (three-dimensional) aspects of a scene. The computation of disparity depends upon the correct identification of corresponding features in the two images. Understanding what image features are used by the brain to solve this matching problem is one of the main issues in stereoscopic vision. Many cortical neurons in visual areas V1 (ref. 2), MT (refs 3, 4) and MST (refs 5, 6) that are tuned to binocular disparity are also tuned to orientation, motion direction and speed. Although psychophysical work has shown that motion direction can facilitate binocular matching, the psychophysical literature on the role of orientation is mixed, and it has been argued that speed differences are ineffective in aiding correspondence. Here we use a different psychophysical paradigm to show that the visual system uses similarities in orientation, motion direction and speed to achieve binocular correspondence. These results indicate that cells that multiplex orientation, motion direction, speed and binocular disparity may help to solve the binocular matching problem.     

A matching algorithm based on hybrid matrices consisting of reference differences and disparities

Unique correct correspondence cannot be obtained only by use of gray correlation technique, which describes gray similar degree of feature points between the left and right images too unilaterally. The gray correlation technique is adopted to extract gray correlation peaks as a coarse matching set called multi-peak set. The disparity gradient limited constraint is utilized to optimize the multi-peak set. Unique match will be obtained by calculating the correlation of hybrid matrices consisting of reference differences and disparities from the multi-peak set. Two of the known corresponding points in the left and right images, respectively, are set as a pair of reference points to determine search direction and search scope at first. After the unique correspondence is obtained by calculating the correlation of the hybrid matrices from the multi-peak set, the obtained match is regarded as a new reference point till all feature points in the left (or right) image have been processed. Experimental results proved that the proposed algorithm was feasible and accurate.     

Monocular aniseikonia: a motion parallax analogue of the disparity-induced effect

Mayhew and Longuet-Higgins have recently outlined a computational model of binocular depth perception in which the small vertical disparities between the two eyes' views of a three-dimensional scene are used to determine the 'viewing parameters' of fixation distance (d) and the angle of asymmetric convergence of the eyes (g). The d/g hypothesis, as it has been called, correctly predicts that a fronto-parallel surface, viewed with a vertically magnifying lens over one eye, should appear to be rotated in depth about a vertical axis. We report here a comparable illusion for surfaces specified by monocular motion parallax information, which can be explained more simply by considering the differential invariants of the optic flow field. In addition, our observations suggest that the disparity-induced effect is not a 'whole field' phenomenon nor one limited to small magnification differences between the eyes.     

An unexpected specialization for horizontal disparity in primate primary visual cortex

The horizontal separation of the eyes means that objects nearer or farther than the fixation point project to different locations on the two retinae, differing principally in their horizontal coordinates (horizontal binocular disparity). Disparity-selective neurons have generally been studied with disparities applied in only one direction (often horizontal), which cannot determine whether the encoding is specialized for processing disparities along the horizontal axis. It is therefore unclear if disparity selectivity represents a specialization for naturally occurring disparities. I used random dot stereograms to study disparity-selective neurons from the primary visual cortex (V1) of awake fixating monkeys. Many combinations of vertical and horizontal disparity were used, characterizing the surface of responses as a function of two-dimensional disparity. Here I report that the response surface usually showed elongation along the horizontal disparity axis, despite the isotropic stimulus. Thus these neurons modulated their firing rate over a wider range of horizontal disparity than vertical disparity. This demonstrates that disparity-selective cells are specialized for processing horizontal disparity, and that existing models of disparity selectivity require substantial revision.     

光轴外扩式布置的双目相机图像立体校正

摘要： 针对宽视野光轴外扩式布置双目图像采集和显示系统的图像立体校正问题,利用三维重建误差,提出了一种基于双目图像视差特性的立体校正方法.在分析光轴外扩式布置双目相机图像视差特性的基础上,针对相机光心与显示投影中心间的位置误差和相机光轴与显示视轴间的角度误差,建立图像仿射变换、水平视差畸变和垂直视差的校正函数,利用一组空间采样点的三维重投影误差作为目标函数通过优化方法求解校正参数.仿真实验表明：在视轴外扩夹角为30°时,本方法可以有效地消除光心位置误差和光轴角度误差对图像视差造成的影响.真实图像校正实验表明：校正后的图像水平畸变小,在显示宽视野双目图像时,能保持正确的三维立体感.
关键词：中图分类号：文献标志码： A     

基于地区差距指标体系的东、中、西部区域经济差距的实证分析

从绝对差异指标和相对差异指标两个方面定量分析我国东、中、西部区域经济发展的差距,可以得出结论：在绝对指标上,东、中、西部区域差距均保持扩大趋势;在相对指标上,东、中、西部区域经济在总量差距上保持扩大,而在相对差距上有减小趋势;东、中、西部区域间的基尼系数有减小的趋势。     

对立体视觉中对称性假设的检验

指出了基于立体视觉研究中的隐性对称性假设,即认为匹配的选取与哪只眼观察哪一图像无关,而仅取决于两眼映像特征的相似性,因此交换左眼和右眼图像这样一种实验操作,被认为提供了一种非常简便有效的技术,用于鉴定双眼性视差和其他不同于双眼性视差的因素对立体深度的贡献.采用2:2直线型常规立体视构型,对比了左右眼图像交换前后的匹配结果,发现匹配融合产生中间第3根直线的两根直线在图像交换前后会发生改变,并导致中间直线的深度在图像交换前后不发生颠倒.实验结果证明:立体视觉研究中的隐性对称性假设不成立;交换左眼和右眼图像后深度是否颠倒,并不是判断深度是来源于匹配视差还是其他因素的依据.     

多元函数极值判别法的推广

本文建立了一个二元函数在不可导点处的极值判别定理,并利用了高阶编导数和对称矩阵的性质,推广了二元函数极值的二阶编导数判别定理。     

基于双目立体视觉系统的测量研究

为了实现摄像机与目标物体之间距离的信息,由双目测量原理,采取结合OpenCV与Matlab的方式,设计出一套关于双目测距的立体视觉系统;系统首先对双目摄像机的内外参数进行标定,从黑白格组成的标定板中获得角点信息,使用亚像素角点检测法对角点坐标信息进行更精确检测,在黑白格组成的标定板分别距离双目摄像机300、400、500、600、700mm处获取不同位置的标定图像,经过张正友标定法最终可以得到双目摄像机所需内外参数;其次通过BM(Block Matching)立体匹配算法在VS2017坏境与opencv3.4.7库配合下完成了摄像机的立体校正、立体匹配进而得到视差图;最后在实验中使用了双目摄像头,并编写了代码通过鼠标点击所得到的视差图获取对应的世界坐标来实现物距的测量;实验结果表明:被测物距离摄像头光心500~700mm这一范围时,实测距离和实际距离相对误差百分比在0.171% ~0.192%之间,且实测距离在2 950mm内实验误差小于5%满足实验精度要求。     

基于边缘和像素类型标记的立体匹配算法

提出一种基于边缘图像特征和像素类型标记的立体匹配算法,利用边缘信息及视差在边缘和非边缘区域的分布特征,指导有效初始视差在扫描线方向的传递。并且根据标记值对部分不可靠的像素点进行反向赋值和边缘内中值滤波处理,达到视差精化目的。实验证明这种方法对于整体视差范围不太大的远距离图像,能够获得较为精确的稠密视差图。     

基于广义局部曲率模态信息熵和BP神经网络的结构损伤识别方法

针对曲率模态对振型节点较不敏感且无法定量估计损伤的问题,在广义局部信息熵的基础上引入曲率模态,推导出广义局部曲率模态信息熵的公式,并建立相应的损伤指标.利用有限元软件Midas civil建立一简支梁桥损伤模型,提取并处理该简支梁的动力参数,将一阶曲率模态和广义局部曲率模态信息熵分别作为神经网络的输入参数,对损伤进行识别并对比两种参数的识别结果,以此来研究测点数量对指标精确度的影响.研究结果表明:广义局部曲率模态信息熵作为神经网络的输入参数能较好地定位并定量损伤,在靠近振型节点处指标的识别精度高于曲率模态,当测点数量为33时,识别精度最高.     

基于尺度制约规则耦合距离约束的图像匹配算法

为了提高图像的匹配精度及其鲁棒性,本文提出了基于尺度制约规则耦合距离约束的图像匹配算法.首先,采用箱式滤波器对高斯函数二阶偏导进行逼近,对特征点进行检测;同时,利用特征点对应的空间尺度来建立尺度制约规则,剔除伪特征点.然后,以特征点为中心,形成圆形区域,计算其Haar小波响应,获取特征点的主方向以及特征向量,形成特征描述子.随后,利用特征点的尺度相似性以及角度相似性来建立空间相似法则,完成特征点的匹配.最后,利用特征点欧氏度量的结果,建立距离约束模型,对匹配特征点之间的距离进行约束,剔除错误的匹配特征点.实验结果显示,与当前图像匹配算法相比,本文算法匹配的图像具有更好的匹配准确度及匹配精度.     

A mechanism for impaired fear recognition after amygdala damage

Ten years ago, we reported that SM, a patient with rare bilateral amygdala damage, showed an intriguing impairment in her ability to recognize fear from facial expressions. Since then, the importance of the amygdala in processing information about facial emotions has been borne out by a number of lesion and functional imaging studies. Yet the mechanism by which amygdala damage compromises fear recognition has not been identified. Returning to patient SM, we now show that her impairment stems from an inability to make normal use of information from the eye region of faces when judging emotions, a defect we trace to a lack of spontaneous fixations on the eyes during free viewing of faces. Although SM fails to look normally at the eye region in all facial expressions, her selective impairment in recognizing fear is explained by the fact that the eyes are the most important feature for identifying this emotion. Notably, SM's recognition of fearful faces became entirely normal when she was instructed explicitly to look at the eyes. This finding provides a mechanism to explain the amygdala's role in fear recognition, and points to new approaches for the possible rehabilitation of patients with defective emotion perception.     

基于梯度信息的灰度人脸检测

针对灰度图像提出了一种有效的人脸检测算法。首先对原始灰度图像利用Sobel边缘检测算子得到水平方向的梯度信息;在此基础上,结合人的眼睛灰度信息得到眼睛的初步候选区域,并根据眼睛的几何特征删除非眼睛区域;然后利用眼睛的几何特征以及人脸的“三停五眼”特性确定真正的眼睛和嘴的区域,在精确定位眼睛和嘴的几何位置后确定人脸区域;最后利用人脸的左右对称性来验证人脸。实验表明,该算法对于灰度图像的正面人脸定位以及人脸检测具有良好的效果。     

双棱镜干涉测量激光波长的方法改进

在双棱镜干涉法测量激光波长的实验中，干涉条纹间距、两虚光源经透镜所成的双缝实验间距以及两虚光源到观察屏的距离测量误差是影响实验结果的主要因素.针对以上原因，用一次成像法测两虚光源间距，适当增大狭缝光源与双棱镜之间的距离，并极大地增大狭缝光源到观察屏的距离，使实验结果更趋理论值.     

立体视觉中求对应点的解

从讨论物体表面的特性出发,研究了立体视觉中可匹配点存在的集合以及唯一匹配问题,指出了可匹配点集与成象系统焦点位置及其物体表面法线之间的关系,证明了空间曲线在两幅图象上投影的孤长之比和变形的物理特性。